This application is a continuation-in-part application of and claims the priority benefit of U.S. application Ser. No. 17/563,105, filed on Dec. 28, 2021, which claims the priority benefit of Taiwan application serial no. 110146849, filed on Dec. 15, 2021. This application also claims the priority benefit of Taiwan application serial no. 111145301, filed on Nov. 25, 2022. The entirety of each of the above-mentioned patent applications is hereby incorporated by reference herein and made a part of this specification.
The disclosure relates to an imaging system, and more particularly to a head-mounted augmented reality stereo vision optical film on glasses.
In order to provide higher quality audio and video effects, technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR) have become one of the research and development priorities of the new generation display technology, and the head-mounted augmented reality stereo vision optical film is one of the means to implement the technologies.
The disclosure provides a head-mounted augmented reality stereo vision optical film, which can present corresponding stereo vision imaging.
The head-mounted augmented reality stereo vision optical film of the disclosure includes a light transmitting display layer, an optical projection layer, and an eye tracking layer. The light transmitting display layer has multiple pixel units and a light shielding layer corresponding to the pixel unit. The optical projection layer has multiple light guide units. The light guide unit corresponds to the pixel units. The eye tracking layer has multiple light emitting elements and micro sensing elements. In a viewing direction of a wearer, the optical projection layer is located between the light transmitting display layer and the eye tracking layer.
In order for the features and advantages of the disclosure to be more comprehensible, the following specific embodiments are described in detail in conjunction with the drawings.
In the drawings, the sizes of some elements, films, or layers may be enlarged or reduced for clarity. In addition, some elements, films, or layers may be omitted from being depicted or labeled in the drawings for clarity. Also, a value expressed in the specification may include the value and deviation values within the range of deviation acceptable to persons skilled in the art.
In the embodiments to be described later or the corresponding drawings, the same or similar components are denoted by the same or similar reference numerals and have the same or similar functions, and the description is omitted. In addition, not all elements, films, or layers are labeled or depicted in the drawings for clarity.
Referring to
Please continue to refer to
In an embodiment, the light guide unit 121 may include a reflecting member, a refractive member, and/or other suitable light guide members. For example, the light guide unit 121 may include a lens. For example, the light guide unit 121 may be a metalens or a metasurface having a nanostructure. In an embodiment, the material of the light guide unit 121 may include gallium nitride (GaN), silicon nitride (SiN), or titanium dioxide (TiO2), but the disclosure is not limited thereto.
In an exemplary application, the head-mounted augmented reality stereo vision optical film 100 may be applied to smart glasses, virtual reality equipment, augmented reality equipment, mixed reality equipment, etc., but the disclosure is not limited thereto.
In the embodiment, in the viewing direction D9 of the wearer 90, the optical projection layer 120 is located between the light transmitting display layer 110 and the eye tracking layer 130, but the disclosure is not limited thereto.
In the embodiment, there is a first distance D1 between the light transmitting display layer 110 and the optical projection layer 120, there is a second distance D2 between the optical projection layer 120 and the eye tracking layer 130, there is a viewing distance D3 between the head-mounted augmented reality stereo vision optical film 100 and an eyeball 91, and the viewing distance D3 may be greater than the first distance D1 or the second distance D2.
In an embodiment, the first distance D1 or the second distance D2 may be less than 5 centimeters (cm) or in a fully fitted state. The viewing distance D3 may be adjusted according to the habit of the wearer 90, which is not limited in the disclosure and is difficult to limit. The recommended viewing distance D3 is at least 1 cm to 3 cm.
In an embodiment, two opposite sides of the optical projection layer 120 may be respectively in contact with the light transmitting display layer 110 and the eye tracking layer 130. In other words, the first distance D1 and the second distance D2 are basically 0 cm.
In an embodiment, the optical projection layer 120 and the light transmitting display layer 110 may be fitted to be in contact with each other by an adhesive layer on the optical projection layer 120 and/or an adhesive layer on the light transmitting display layer 110. Similarly, the optical projection layer 120 and the eye tracking layer 130 may be fitted to be in contact with each other by the adhesive layer on the optical projection layer 120 and/or the adhesive layer on the eye tracking layer 130. However, the disclosure is not limited thereto.
In an embodiment, the light transmitting display layer 110, the optical projection layer 120, and the eye tracking layer 130 may be in close contact with each other by sealants located on sides thereof.
For example, the light transmitting display layer 110, the optical projection layer 120, and the eye tracking layer 130 may be fitted to each other and fixed on a frame 190. The fitting process requires precise alignment and gluing, but the disclosure is not limited thereto. In other words, as for the glasses having the head-mounted augmented reality stereo vision optical film 100 integrated thereon, the rough visual appearance thereof may be the same as or similar to general glasses to be more adapted to be worn and/or used by the wearer 90.
In an embodiment, the form or the material of the frame 190 may be adjusted according to design requirements, which is not limited in the disclosure. The frame 190 may be integrally formed or a combination of multiple components, which is not limited in the disclosure.
In the embodiment, the light transmitting display layer 110 may further include a substrate 119. The substrate 119 may include a light transmitting substrate. The substrate 119 may include a hard substrate (for example, glass or hard plastic, but not limited thereto) or a soft substrate (for example, a polyimide (PI) film, a polyethylene terephthalate (PET) film, or other similar polymer films, but not limited thereto), wherein the substrate includes a circuit driving structure of a display layer, which may be a low temperature poly-silicon thin film transistor (LTPS-TFT), a mini driver integrated circuit (IC), etc. The pixel unit PU may be configured on the substrate 119, and the pixel unit PU on the substrate 119 may face the wearer 90.
In an embodiment, each pixel unit PU may include a corresponding first subpixel unit R, second subpixel unit G, and third subpixel unit B.
As shown in
In an embodiment, an optical encapsulation layer 111 may be provided between the light emitting diodes, but the disclosure is not limited thereto.
In an embodiment, the forming manner of the first subpixel unit R, the second subpixel unit G, or the third subpixel unit B may include color conversion, nanorod, etc. as known to persons skilled in the art.
In an embodiment, the light emitting diode (for example, the light emitting diode B1, R1, or G1) may include a micro light emitting diode (μLED) with a size of basically (5 micrometers (μm) to 100 μm)×(5 μm to 100 μm), but the disclosure is not limited thereto. The light emitting diode (not limited in size or color) may be one type of the light emitting element 112.
In an embodiment, the light transmitting display layer 110 may further include an element layer (not shown). The element layer may be located on the substrate 119. The element layer may include a driving circuit and/or a corresponding wiring. The driving circuit may include a corresponding active element (for example, a thin film transistor) and/or a corresponding passive element (for example, a capacitor). The light emitting diode may be electrically connected to the corresponding wiring by an appropriate manner (for example, flip-chip bonding, but not limited thereto) and may be further electrically connected to the driving circuit by the corresponding wiring.
In an embodiment, the substrate 119 may include a circuit board. For example, the substrate 119 may include a thin film transistor (TFT) array substrate.
In an embodiment, the driving circuit may be electrically connected to a control unit 140 (labelled in
In an embodiment, a region S between the light transmitting display layer 110 and the optical projection layer 120 may have an adhesive layer, an air gap, and/or a pixel light shielding layer, but the disclosure is not limited thereto.
As shown in
Referring to
In an embodiment, the light shielding layer 118 may be in direct contact with the pixel unit PU (that is, the distance is 0). In an embodiment, there may be a corresponding spacing between the light shielding layer 118 and the pixel unit PU (that is, the distance is greater than 0). For example, the light shielding layer 118 and the pixel unit PU may be respectively disposed on two sides of the substrate 119, and the pixel unit PU is disposed between the wearer 90 and the light shielding layer 118.
Referring to
In an embodiment, on a cross-section (for example, the cross-section shown in
In an embodiment, the light transmitting display layer 110 may further include a light shielding layer (also referred to as a second light shielding layer) 113 having a pinhole. Viewing from the viewing direction D9 of the wearer 90, the light shielding layer 113 is located between the light emitting element 112 and the wearer 90. The pinhole of the light shielding layer 113 may correspond to the light emitting element 112. In other words, light emitted by the light emitting element 112 may be transmitted to the wearer 90 through the pinhole of the light shielding layer 113.
Referring to
In an embodiment, in the same direction, the ratio of the aperture of the pinhole 113Da to the size of the corresponding light emitting element 112 may be between 3% and 50%. In an embodiment, the aperture of the pinhole 113Da may be between 0.5 μm and 10 μm.
In an embodiment, the material of the light shielding layer 113D may include a light shielding insulating layer (for example, a dark-colored epoxy resin or other similar dark-colored polymers), a light shielding conductive layer (for example, a molybdenum layer or a graphite layer, but not limited thereto), a combination of the above, or a stack of the above.
In an embodiment, the light shielding layer having the pinhole may reduce the light mixing phenomenon between different subpixel units and/or improve light collimation, so as to improve the display quality.
In an embodiment, a light transmitting layer 114 may be provided between the light shielding layer 113D and the light emitting element 112. The material of the light transmitting layer 114 may include an optical clear adhesive (OCA). In an embodiment, the light transmitting layers 114 covering the light emitting elements 112 may be separated from each other, and the light shielding layer 113D may conformally cover the corresponding light transmitting layer 114.
It should be noted that the disclosure does not limit the light transmitting layer 114 to be a single film layer. In other words, the light transmitting layer 114 may be a single film layer or the light transmitting layer 114 may be a stack of multiple light transmitting film layers.
Referring to
In an embodiment, the material of the light shielding layer 113E may be the same as or similar to the light shielding layer 113D.
In an embodiment, the light shielding layer 113E and the substrate 119 may be located on two opposite sides of the light transmitting layer 114. In an embodiment, the light shielding layer 113E may be a planar film layer.
Referring to
In an embodiment, a corresponding light blocking structure 115 may be provided between the first subpixel unit R, the second subpixel unit G, and the third subpixel unit B two by two. The material of the light blocking structure 115 may include a light shielding insulating layer, a light shielding conductive layer, a combination of the above, or a stack of the above. In an embodiment, the light blocking structure 115 may reduce the light mixing phenomenon between different subpixel units, so as to improve the display quality.
Please continue to refer to
In
Referring to
In an embodiment, the light guide unit (for example, the light guide unit 121A) that may be configured corresponding to multiple pixel units PU may be referred to as a Fresnel lens or a thread lens.
In an embodiment, the light guide unit 121A may be a combination of a microlens and a Fresnel lens. For example, the microlens may be configured on the corresponding pixel unit PU, and the Fresnel lens may be further configured on the corresponding microlens. In this way, light emitted by the pixel units PU may generate a corresponding image via the corresponding microlens. Then, light rays are deflected via the corresponding Fresnel lens and enter the eye. In other words, in a light path direction of the pixel unit PU, the microlens is located between the pixel unit PU and the Fresnel lens.
Referring to
In an embodiment, the light guide unit 121B may be located on a light transmitting substrate 121S. For example, the light guide unit 121B may be a microstructure (for example, a nanostructure) formed on the light transmitting substrate 121S. For example, the corresponding microstructure may be formed on the light transmitting substrate 121S by a deposition process or an etching process. In an embodiment, the light transmitting substrate 121S may also be regarded as a part of the light guide unit.
In an embodiment, the material of the light guide unit 121B may include gallium nitride (GaN), silicon nitride (SiN), titanium dioxide (TiO2), derivatives of the above, or a combination of the above. In an embodiment, the height of the light guide unit 121B (for example, the size in a direction perpendicular to the surface of the light emitting element 112 on which the light guide unit 121B is configured) may be between 300 nanometers (nm) and 1000 nm. In an embodiment, the width of the light guide unit 121B (for example, the maximum size in a direction parallel to the surface of the light emitting element 112 on which the light guide unit 121B is configured) may be less than half of the light emitting wavelength of the corresponding light emitting element 112.
In an embodiment, the appearance of the light guide unit 121B may be the same as or similar to a cylindrical shape.
In an embodiment, multiple light guide units 121B are arranged on the light transmitting substrate 121S. In an embodiment, the light guide units 121B may be arranged in an array on the light transmitting substrate 121S.
In an embodiment, the light guide unit 121B and the corresponding light transmitting substrate 121S may be referred to as a metalens.
Referring to
In an embodiment, the light guide unit 121C may be located on the light transmitting substrate 121S. For example, the light guide unit 121C may be a microstructure (for example, a nanostructure) formed on the light transmitting substrate 121S. In an embodiment, the light transmitting substrate 121S may also be regarded as a part of the light guide unit.
In an embodiment, the material, the height, and/or the width of the light guide unit 121C may be respectively the same as or similar to the material, the height, and/or the width of the light guide unit 121B.
In an embodiment, the appearance of the light guide unit 121C may be the same as or similar to a polygonal columnar shape. For example, the appearance of the light guide unit 121C may be the same as or similar to a square columnar shape.
In an embodiment, multiple light guide units 121C are arranged on the light transmitting substrate 121S. In an embodiment, the light guide units 121C may be arranged in an array on the light transmitting substrate 121S.
In an embodiment, the light guide unit 121C and the corresponding light transmitting substrate 121S may be referred to as a metalens.
Referring to
In the embodiment, the first subpixel unit R, the second subpixel unit G, and the third subpixel unit B may be sequentially arranged along a certain direction in an unlimited order.
Referring to
In the embodiment, the first subpixel unit R, the second subpixel unit G, and the third subpixel unit B may be arranged in a delta-type in an unlimited order.
Referring to
In the embodiment, the first subpixel unit R, the second subpixel unit G, and the third subpixel unit B may be sequentially arranged along a certain direction in an unlimited order.
Referring to
In the embodiment, the first subpixel unit R, the second subpixel unit G, and the third subpixel unit B may be arranged in a delta-type in an unlimited order.
Referring to
In the embodiment, the width of the light guide unit 121H (for example, the maximum size in a direction parallel to the surface of the light emitting element T on which the light guide unit 121H is configured) may be less than half of the minimum adjustable light emitting wavelength of the light emitting element T corresponding to the light guide unit 121H.
In an embodiment, the light guide unit 121D, the light guide unit 121E, the light guide unit 121F, the light guide unit 121G, and/or a light guide unit 121H may be referred to as metalens.
It should be noted that the disclosure does not limit the light guide unit 121 to be in direct contact with one or more corresponding light emitting elements 112. For example, the light guide unit 121 may be matched with and in direct contact with the one or more corresponding light emitting elements 112. For example, the light guide unit 121 may be matched with the one or more corresponding light emitting elements 112, and other film layers or elements (for example, OCA, but not limited thereto) may be provided between the light guide unit 121 and the one or more corresponding light emitting elements 112, and the light guide unit 121 is in indirect contact with the one or more corresponding light emitting elements 112.
It should be noted that the disclosure is not limited to the light guide unit 121 being only a single element when viewing in the viewing direction D9. In other words, the light guide unit 121 may be any of the above light guide elements or a combination or a stack of one or more of the above light guide elements when viewing in the viewing direction D9.
Please continue to refer to
Please continue to refer to
In an embodiment, the substrate 139 may include a hard substrate (for example, glass or hard plastic, but not limited thereto) or a soft substrate (for example, a PI film, a PET film, or other similar polymer films, but not limited thereto), but the disclosure is not limited thereto.
In an embodiment, the micro sensing element 131 may include a reverse-biased light emitting diode, a photodiode (PD), or a light sensing element under a flat optical layer with a diffraction pattern (for example, a mura mask, but not limited thereto). After a tracking beam is irradiated onto the eyeball 91 of the wearer 90, corresponding reflections may be generated in corresponding regions or directions according to corresponding eyeball tissues (for example, iris, pupil, lens, cornea, etc.). For example, under the irradiation of the tracking beam with basically the same light wavelength, the tissues of the eyeball may have light reflections in different directions and/or intensities at different positions. In this way, the movement of the eyeball 91 may be tracked by the micro sensing element 131 receiving the tracking beam (which may be referred to as a reflected beam) reflected via the eyeball 91 of the wearer 90.
In an embodiment, the size of the reverse-biased light emitting diode or the photodiode may be less than 250 μm×250 μm, but the disclosure is not limited thereto.
In an embodiment, a spacing P3 between two adjacent micro sensing elements 131 (that is, the distance between the midpoints of the two micro sensing elements 131) may be between 0.1 millimeters (mm) and 20 mm, but the disclosure is not limited thereto.
In an embodiment, as shown in
As shown in
As shown in
It should be noted that the disclosure does not limit an element to substantially correspond to only one die. For example, an element may correspond to only one die or an element may include multiple dies connected in parallel and/or in series.
As shown in
It is worth noting that in some of the schematic side views (also referred to as cross-sectional views, such as
In an embodiment, the emitter circuit 142 and/or the sensor circuit 141 may be electrically connected to a corresponding chip 146 and/or terminal 147 by the corresponding wiring 145. The chip 146 may include a current IC, a voltage IC, an amplifier IC (AMP IC), an analog/digital conversion IC, or other suitable integrated circuits. Multiple of the above integrated circuits may be integrated into the same chip or may respectively belong to different chips. The terminal 147 may include a power terminal, a common terminal, or a ground terminal.
In an embodiment, the chip 146 and/or the terminal 147 may be electrically connected to the control unit 140 by the corresponding wiring 145. The control unit 140 may include an embedded system, a microcontroller (MCU), and/or an application specific integrated circuit (ASIC), but the disclosure is not limited thereto.
In an embodiment, the line width of the wiring 145 may be less than 10 μm and/or the material of the wiring 145 may include zinc oxide (ZnO), tin oxide (SnO), indium-zinc oxide (IZO), gallium-zinc oxide (GZO), zinc-tin oxide (ZTO), indium-tin oxide (ITO), other suitable light transmitting conductive materials, or other materials with good electrical conductivity such as gold, but the disclosure is not limited thereto.
In an embodiment, the eye tracking layer 130 may further include an anti-reflection coating layer 138, but the disclosure is not limited thereto. The anti-reflection coating layer 138 may be located on the substrate 139. The anti-reflection coating layer 138 may be a single film or layer or a stack of multiple films or layers, which is not limited in the disclosure.
In an embodiment, as shown in
Taking
Taking
In the embodiment, the micro sensing elements 131 are adapted to sense the eyeball 91 of the wearer 90. In addition, sensing signals of the micro sensing elements 131 may be operated by the control unit 140, so that the pixel units PU emit corresponding image beams. The image beam may be viewed by the wearer 90 after being guided by the light guide units 121. In addition, the image beam may basically correspond to a natural focus image of stereo vision of the human eye by the operation of the control unit 140. In other words, compared with conventional stereo vision images generated by using multiple polarizers to enable the left and right eyes of the viewer to respectively see light with different polarizations, in the head-mounted augmented reality stereo vision optical film 100 of the embodiment, the stereo vision images seen by the wearer 90 are more natural and/or the viewing process can be more comfortable.
In an embodiment, light emitted by the light emitting element 132 may generate corresponding reflected light after being irradiated onto the eyeball 91 of the wearer 90, and the reflected light may be sensed by the sensing element 132 to generate a corresponding electrical signal. By the electrical signal, the control unit 140 may detect and/or calculate the position or the movement of the eyeball 91 of the wearer 90 via an appropriate algorithm, so as to drive the light transmitting display layer 110 to generate a corresponding image (which, for example, includes but is not limited to, a dynamic visual adjustment and/or an eye box compensation effect). In this way, when the wearer 90 views by the head-mounted augmented reality stereo vision optical film 100, an augmented reality stereo vision effect can be generated.
In the embodiment, within a unit area range, the number of the micro sensing elements 131 is less than the number of the pixel units PU or the number of the light guide units 121. In an embodiment, within the unit area range, the number of the light guide units 121 is less than or equal to the number of the pixel units PU.
In an embodiment, within the unit area range, the number of the pixel units PU or the number of the light guide units 121 is far greater than the number of the micro sensing elements 131. For example, the number of the pixel units PU or the number of the light guide units 121 is at least 100 times more than the number of the micro sensing elements 131.
As shown in
As shown in
In an embodiment, the head-mounted augmented reality stereo vision optical film 100 may further include a folded light path system 410. The folded light path system 410 may include multiple reflecting films or reflecting sheets (for example, transflective films or reflecting polarizers) and/or multiple polarizing films or polarizing sheets, so that light rays are reflected at least multiple times therein, so as to generate multiple folded or overlapping light paths. As such, the visual depth of field can be increased and/or the thickness of the head-mounted augmented reality stereo vision optical film 100 can be reduced. In an embodiment, the folded light path system 410 may be referred to as a pancake optical system. In an embodiment, the folded light path system 410 may further include a corresponding refraction film, a refraction sheet, a filter film, or a filter sheet according to usage requirements, but the disclosure is not limited thereto.
For example, the folded light path system 410 may include a polarizer 411, a quarter-wave plate (QWP) 412, a beam splitter (BS) 413, a quarter-wave plate 414, and a polarization beam splitter (PBS) 416. The quarter-wave plate 414 and the polarization beam splitter 416 may be placed on a light transmitting substrate 415. Light passing through the light transmitting display layer 110 or light emitted from the light transmitting display layer 110 may generate multiple light paths L1, L2, and L3 in the folded light path system 410. The directions of the light path L1 and the light path L3 are basically the same, and the direction of the light path L2 is basically opposite to the light path L1 or the light path L3. It should be noted that the positions of the light paths L1, L2, and L3 in
In the embodiment, a head-mounted augmented reality stereo vision optical film 200 includes a light transmitting display layer 210, an optical projection layer 220, and an eye tracking layer 230. The light transmitting display layer 210 may be the same as or similar to the light transmitting display layer 110 of the above embodiment. The optical projection layer 220 may be similar to the optical projection layer 120 of the above embodiment. The eye tracking layer 230 may be the same as or similar to the eye tracking layer 130 of the above embodiment.
In the embodiment, in the viewing direction D9 of the wearer 90, the light transmitting display layer 210 is located between the optical projection layer 220 and the eye tracking layer 230.
In the embodiment, in the light transmitting display layer 210, the pixel unit PU on the substrate 119 may face the optical projection layer 220. A substrate 229 of the optical projection layer 220 may at least reflect light emitted by the pixel unit PU, so that the light reflected by the substrate 229 may be directed to the wearer 90.
In the embodiment, the substrate 229 may be a transflective substrate. For example, the substrate 229 may partially reflect the light emitted by the pixel unit PU, and the substrate 229 may partially allow an ambient light L9 to pass through.
In the embodiment, a surface of the substrate 229 facing the wearer 90 may include a curved surface.
In an embodiment, the optical projection layer 220 may not have a metalens having a nanostructure by the same or similar architecture as
In the embodiment, the optical projection layer 320 may further include an optical microstructure 321. The optical microstructure 321 may be configured on an edge of the substrate 229. The optical microstructure 321 can reduce visual parallax.
In an embodiment, the optical microstructure 321 may be a metalens or a metasurface having a nanostructure, but the disclosure is not limited thereto.
In the embodiment, the optical projection layer 420 may have multiple curved surfaces. For example, the number of the substrate 229 may be multiple, and the corresponding optical microstructure 321 may be configured on each substrate 229.
Based on the above, in the head-mounted augmented reality stereo vision optical film of the disclosure, the light transmitting display layer can have higher resolution, higher brightness, higher transparency, and/or higher endurance; the optical projection layer can have a wider field of view and/or higher efficiency; and/or the eye tracking layer can have a preferred human machine interface (HMI), lower power consumption, a smaller volume, and/or preferred integration. In addition, by stacking and integrating the film layers of the light transmitting display layer, the optical projection layer, and the eye tracking layer, the head-mounted augmented reality stereo vision optical film can be lighter and thinner, have higher efficiency, a wider perspective, and/or a preferred interactive scenario.
Although the disclosure has been disclosed in the above embodiments, the embodiments are not intended to limit the disclosure. Persons skilled in the art may make some changes and modifications without departing from the spirit and scope of the disclosure. Therefore, the protection scope of the disclosure shall be defined by the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
110146849 | Dec 2021 | TW | national |
111145301 | Nov 2022 | TW | national |
Number | Date | Country | |
---|---|---|---|
Parent | 17563105 | Dec 2021 | US |
Child | 18089532 | US |