This application claims priority to Taiwan Patent Application No. 103110547 filed on Mar. 20, 2014.
Not applicable.
1. Field of the Invention
The present invention relates to a head-mounted augmented reality display system, particularly comprising a complementary metal-oxide-semiconductor (CMOS) image sensor and a sound receiver.
2. Descriptions of the Related Art
With the development of technology, the mobility and interactivity of a display system improves significantly. Products integrating display systems and other devices (e.g. glasses) come up in the market and thus, consumers can use such products to view graphs or images anywhere and anytime.
One prior art is a wearable device with input and output structures (United States Patent Publication No. 2013/0044042) as shown in
To overcome these problems, the present invention provides a head-mounted augmented reality display system, having a direct view type (such as LCD, LED or OLED) or a projecting type (such as Liquid Crystal on Silicon (LCOS)) near-to-eye viewing optics. The LCOS display system of the present invention has the advantages of smaller size, higher resolution, higher contrast, shorter response time, lower costs and easier to manufacture over the prior arts. The present invention can present stereo augmented reality effects with high definition (HD) video and audio from the externally captured images and sounds by immersive or see-through type near-to-eye viewing optics.
To achieve the above objectives, the present invention provides a head-mounted augmented reality display system, comprising a driver system board for generating and processing images and sounds; a CMOS image sensor for capturing external real images to the driver system board; an immersive or see-through type near-to-eye viewing optics (hereinafter referred to as “optics”) for casting images from the driver system board on user's vision; an earphone; a sound receiver for recording external sound to the driver system board before transmitting to the earphone; and a frame configured to be mountable on the head of a user for carrying the near-to-eye viewing optics, the CMOS image sensor, the earphone and the sound receiver.
To enhance the quality of stereo augmented reality, this invention provides another embodiment of head-mounted augmented reality display system, comprising a driver system board for generating and processing images and sounds; two CMOS image sensors for capturing external images to the driver system board; two immersive or see-through type near-to-eye viewing optics for casting images from the driver system board on user's vision; two earphones; two sound receivers for recording external sounds to the driver system board before transmitting to the earphones; and a frame configured to be mountable on the head of a user for carrying the near-to-eye viewing optics, the CMOS image sensors, the earphones and the sound receivers.
The detailed technology and preferred embodiments implemented for the subject invention are described in the following paragraphs accompanying the appended drawings for people skilled in this field to well appreciate the features of the claimed invention.
The above summary and following detailed descriptions are exemplary and illustrative for further explaining the claims of the subject invention. Other objectives and advantages will be further illustrated in the following descriptions and graphs.
The contents of the subject invention will be explained through the following embodiments. However, the embodiments of the subject invention are illustrative and shall not be used as limitation to practice the subject invention. Furthermore, some elements that are relative to contents of the subject invention that persons skilled in this field can understand have been omitted and no illustrated. Persons skilled in the art can realize that the head-mounted augmented reality display system disclosed in the subject invention can be utilized in various different occasions.
In addition, in the first embodiment of subject invention comprises a CMOS image sensor 120 for capturing external real images to the driver system board 160 which outputs single image to near-to-eye viewing optics 110, including internal images which are stored or downloaded by the driver system board 160, integrated images, which are integrated with external images and internal images, or multiple images, such as Picture by Picture (PBP), Picture in Picture (PIP), Picture out Picture (POP). For example, users can see how the weather is (sunny or cloudy) through or on the near-to-eye viewing optics 110. The driver system board 160 will indicate weather condition by showing current temperature, humidity, probability of precipitation or even 7-days forecast on the near-to-eye viewing optics 110 in single or multiple graphs. Other applications such as users can simultaneously watch several TV channels, surveillance monitors or combination of different images. Stereoscopic vision will be created by parallax with the multi-angle images captured from different positions by the CMOS image sensor 120, processed by the driver system board 160 and displayed by near-to-eye viewing optics 110. In other words, the driver system board 160 can convert original images or graphs into stereoscopic ones, and additional functions such as multimedia player or connect to Wi-Fi can be incorporated.
Furthermore, in the first embodiment of the subject invention comprises an earphone 130 and a sound receiver 140 for recording external sound to the driver system board 160 before transmitting sound to the earphone 130. The earphone 130 can play external sounds or internal sounds (multimedia information stored or downloaded by the driver system board 160) separately or in mixture. The potential drawback is that users may not perceive the change of the external environment when they view the images on the near-to-eye viewing optics 110 and listen to the sound from the earphone 130 at the same time. Users may miss the bus stop or offensively ignore friends if they immersed themselves in the joy from this invention. Therefore, in a preferred embodiment of the first embodiment, a high-sensitivity sound receiver is used as sound receiver 140 so as to automatically switch sound outputting to the earphone 130 in accordance with the volume, direction or the frequency of the external sound received by the sound receiver 140. For example, when the earphone 130 only outputs internal sound, the driver system board 160 will automatically switch the mode of output in accordance default setting in the factory or user adjustment when detecting a specific frequency external sound, such as human sound, animal sound, or firecracker sound or footstep sound, or detecting a certain volume of external sound. The above automatic switch can be from only outputting internal sound to only outputting external sound, or both outputting internal sound and external sound together with the adjustment of the volume of these two type of sounds Accordingly, the automatic switch of sounds can improve the above drawback.
Furthermore, in the first embodiment of the subject invention comprises a frame 150 mountable on the head of a user for carrying the near-to-eye viewing optics 110, the CMOS image sensor 120, the earphone 130 and the sound receiver 140. As shown in
To overcome the weakness of the color-filter type near-to-eye viewing optics 110A, this invention provides color sequential type near-to-eye viewing optics 110B as shown in
In addition to all function of the first embodiment, the second embodiment further comprise a stereo video and audio function by using two near-to-eye viewing optics 110, two CMOS image sensors 120, two sound receivers 140 and two earphones 130. Stereoscopic vision will be created by parallax with the multi-angle images captured from different positions by the CMOS image sensors 120, processed by the driver system board 160 and displayed on near-to-eye viewing optics 110. In other words, the driver system board 160 can convert original images or graphs into stereoscopic displays, and additional functions such as multimedia player or connect to Wi-Fi can be incorporated. Likewise, multichannel stereo audio will be outputted with multi-angle sound captured from different positions by the sound receivers 140, processed by the driver system board 160 and played by the earphones 130. The second embodiment can overcome the drawback in the prior art that change of outside environment cannot be easily perceived by using the above mentioned automatic switch sound sources mechanism.
The above disclosures are related to the detailed technical contents and inventive features thereof. Persons skilled in this field may proceed with a variety of modifications and replacements based on the disclosures and suggestions of the invention as described without departing from the characteristics thereof. Nevertheless, although such modifications and replacements are not fully disclosed in the above descriptions, they have substantially been covered in the following claims as appended.
Number | Date | Country | Kind |
---|---|---|---|
103110547 | Mar 2014 | TW | national |