Example embodiments of the present disclosure relate to a display apparatus, and more particularly, to a display apparatus including a volume grating based combiner.
Three-dimensional image display technology has been applied to various fields, and also has been recently applied to image devices for virtual reality (VR) displays and augmented reality (AG) displays.
Head mounted displays for VR are commercialized at present and tend to be widely applied in the entertainment industry. In addition, head mounted displays have been developed for medical, educational, and industrial fields.
As a development step for VR displays, AR displays have been developed to induce interactions between reality and an imagine as image devices for combining the real world and VR. Interactions between reality and VR are based on a function of providing information on a real situation in real-time and may further increase a reality effect by overlaying a virtual object or information on an environment of the real world. Such an AR display includes a combiner for combining a virtual image with an external real foreground and providing the combined image to an observer.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of example embodiments.
According to an aspect of an example embodiment, there is provided a display apparatus including an image providing device configured to provide an image, and a combiner configured to combine light containing the image, which is emitted from the image providing device, and light containing an external landscape, wherein the combiner includes a plurality of volume gratings configured to diffract the light containing the image emitted from the image providing device, wherein each volume grating of the plurality of volume gratings has a first surface and a second surface facing each other, and wherein each volume grating of the plurality of volume gratings is configured to diffract light incident on the first surface and transmit therethrough light incident on the second surface without diffraction.
Each volume grating of the plurality of volume gratings may be configured to diffract light incident on the first surface at a pre-defined incident angle toward a pre-defined direction.
The light containing the image, which is provided from the image providing device to each volume grating of the plurality of volume gratings, may be collimated parallel light.
Each volume grating of the plurality of volume gratings may be configured to have an optical characteristic having no refractive power with respect to the light incident on the first surface.
The light containing the image, which is provided from the image providing device to each volume grating of the plurality of volume gratings, may be diverging light.
Each volume grating of the plurality of volume gratings may be configured to collimate by diffraction the diverging light incident on the first surface into parallel light.
The combiner may further include a transparent substrate, and wherein the plurality of volume gratings may be provided on the transparent substrate in a two-dimensionally.
The image providing device may be further configured to provide the light containing the image toward the first surface of each volume grating of the plurality of volume gratings, and the plurality of volume gratings may be configured to diffract the light containing the image at different angles such that lights respectively diffracted by the plurality of volume gratings travel toward a single region.
The first surface of each volume grating of the plurality of volume gratings may have a circular shape, an oval shape, a quadrangular shape, or a hexagonal shape.
A distance between two adjacent volume gratings of the plurality of volume gratings may be greater than or equal to a width of each volume grating of the plurality of volume gratings.
The width of each volume grating of the plurality of volume gratings may range from 0.5 mm to 1.5 mm.
The distance between two adjacent volume gratings of the plurality of volume gratings may gradually increase or decrease away from a center of the combiner.
The width of each volume grating of the plurality of volume gratings may gradually increase or decrease away from a center of the combiner.
Some of the plurality of volume gratings may be provided in a line along a first row, and remaining ones of the plurality of volume gratings may be provided in a line along a second row adjacent to the first row, and volume gratings provided along the first row and volume gratings provided along the second row are provided to be mismatched with each other in a column direction.
Some of the plurality of volume gratings may be provided in a line along a first row, and remaining ones of the plurality of volume gratings may be provided in a line along a second row adjacent to the first row, and volume gratings provided along the first row and volume gratings provided along the second row are provided to face each other in a column direction.
The combiner may further include a transparent light guide plate through which light travels by total reflection, and an input coupler configured to guide the light containing the image, which is emitted from the image providing device, to an inside of the transparent light guide plate, wherein the transparent light guide plate has a first surface and a second surface facing each other, and wherein the plurality of volume gratings are provided on the second surface of the transparent light guide plate and configured to diffract the light containing the image toward the first surface of the transparent light guide plate.
The plurality of volume gratings may be provided such that the first surface of each volume grating is included inside the transparent light guide plate.
The plurality of volume gratings may be provided such that the first surface of each volume grating is in contact with the second surface of the transparent light guide plate.
The plurality of volume gratings may include a plurality of first volume gratings configured to diffract, at a first angle, light of a first wavelength band incident on the first surface at a pre-defined incident angle, a plurality of second volume gratings configured to diffract, at a second angle that is different from the first angle, light of a second wavelength band that is different from the first wavelength band, incident on the first surface at the pre-defined incident angle, and a plurality of third volume gratings configured to diffract, at a third angle that is different from the first angle and the second angle, light of a third wavelength band that is different from the first wavelength band and the second wavelength band, incident on the first surface at the pre-defined incident angle.
The plurality of first volume gratings, the plurality of second volume gratings, and the plurality of third volume gratings may be alternately provided one by one.
The display apparatus may further include an eye tracker configured to track a location of a pupil of an observer and measure a size of the pupil of the observer.
The image providing device may be further configured to adjust a beam diameter of light incident on the first surface of each volume grating of the plurality of volume gratings, based on information with respect to the location of the pupil of the observer or information with respect to the size of the pupil of the observer.
The display apparatus may further include a beam diameter adjustment device configured to adjust a beam diameter of light incident on the first surface of each volume grating of the plurality of volume gratings from the image providing device, based on information with respect to the location of the pupil of the observer or information with respect to the size of the pupil of the observer.
The beam diameter adjustment device may include one of an aperture having a variable opening, a lens having a variable focal length, a diffusion plate having a variable diffusion angle, a micro-electromechanical systems (MEMS) mirror array configured to electrically adjust a reflective region, and an actuator configured to move the image providing device to adjust a distance between the combiner and the image providing device.
The beam diameter adjustment device may be configured to decrease a beam diameter of light incident on the first surface of each volume grating of the plurality of volume gratings based on a distance between the combiner and the observer decreasing or the size of the pupil of the observer increasing, and to increase the beam diameter of the light incident on the first surface of each volume grating of the plurality of volume gratings based on the distance between the combiner and the observer increasing or the size of the pupil of the observer decreasing.
The display apparatus may be a virtual reality (VR) display apparatus, an augmented reality (AR) display apparatus, or a mixed reality (MR) display apparatus of a head mounting type, an eyeglasses type, or a goggle type.
The above and/or other aspects, features, and advantages of example embodiments will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
Reference will now be made in detail to example embodiments which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. In this regard, the example embodiments may have different forms and should not be construed as being limited to the descriptions set forth herein. Accordingly, the example embodiments are merely described below, by referring to the figures, to explain aspects. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Expressions such as “at least one of,” when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list. For example, the expression, “at least one of a, b, and c,” should be understood as including only a, only b, only c, both a and b, both a and c, both b and c, or all of a, b, and c.
Hereinafter, a display apparatus including a volume grating-based combiner will be described in detail with reference to the accompanying drawings. In the drawings, the sizes of constituent elements may be exaggerated for clarity. In addition, the embodiments described below are only illustrative, and various changes in form and details may be made therein.
Hereinafter, the term “above” or “on” may include not only directly on in a contact manner but also above in a contactless manner. An expression in the singular includes an expression in the plural unless they are clearly different from each other in context. In addition, when a certain part “includes” a certain component, this indicates that the part may further include another component instead of excluding another component unless there is different disclosure.
The use of the term “the” or a similar directional term may correspond to both the singular and the plural. For steps forming the methods, if an order is not clearly disclosed or, if there is no disclosure opposed to the clear order, the steps may be performed in any order deemed proper, and the methods are not necessarily limited to the disclosed order of the steps.
In addition, terms such as “ . . . unit”, “ . . . module”, and the like refer to units that perform at least one function or operation, and the units may be implemented as hardware or software or as a combination of hardware and software.
Connections or connection members of lines between components shown in the drawings illustrate functional connections and/or physical or circuit connections, and the connections or connection members may be represented by replaceable or additional various functional connections, physical connections, or circuit connections in an actual apparatus.
The use of all illustrations or illustrative terms is simply to describe the technical idea in detail, and the scope is not limited due to the illustrations or illustrative terms unless they are limited by claims.
The image providing device 20 may include a spatial light modulator or a display panel for forming an image containing virtual reality or virtual information. The display panel may include, for example, a liquid crystal display panel or an organic light-emitting display panel. In addition, the image providing device 20 may include a projector for projecting the light L0 containing the image to the combiner 10. Therefore, the image providing device 20 may project the light L0 containing the image, which is formed by the spatial light modulator or the display panel, to the combiner 10. For example, the image providing device 20 may collimate the light L0 containing the image to make parallel light, and project the parallel light to the combiner 10.
The combiner 10 is configured to combine the light L0 containing the image, which is projected from the image providing device 20, and the light L1 containing the external landscape and provide the combined image to an observer. For example, the combiner 10 may be configured to change a traveling direction of the light L0 containing the image, which is projected from the image providing device 20, to a particular direction by diffracting the light L0 containing the image and transmit the light L1 containing the external landscape therethrough without diffraction. The external light L1 contains a real landscape existing in front of the observer and not an artificial image modulated and generated by a separate spatial light modulator or displayed by a separate display panel. Therefore, the observer may observe both an artificially generated virtual image and a real landscape. Accordingly, the display apparatus 100 according to the example embodiment may be applied to implement augmented reality (AR) or mixed reality (MR). For example, the display apparatus 100 according to the example embodiment may be a near-eye AR display apparatus. For example, when the display apparatus 100 is used, the combiner 10 may be arranged in front of an eye of the observer.
To diffract the light L0 containing the image, which is projected from the image providing device 20, such that the light L0 containing the image travels toward the eye of the observer, the combiner 10 may include a plurality of volume gratings VG1, VG2, and VG3. A volume grating may include an interference pattern formed by interference between reference light and signal light. The interference pattern may vary according to a wavelength of the reference light, an incident angle of the reference light, a traveling direction of the signal light, and a form of the signal light. When light having the same wavelength as the reference light is incident on this volume grating at the same incident angle as that of the reference light, the reference light is diffracted by the interference pattern of the volume grating such that the same light as the signal light is reproduced. Therefore, according to interference patterns of volume gratings, various forms of signal light may be generated.
According to the example embodiment, each of the plurality of volume gratings VG1, VG2, and VG3 is configured to diffract light incident at a pre-defined particular incident angle toward a pre-defined particular direction. For example, the light L0 containing the image, which is projected from the image providing device 20, acts as the reference light, and the plurality of volume gratings VG1, VG2, and VG3 may be configured to diffract the light L0 containing the image, which is incident at the pre-defined particular incident angle, and reproduce signal light containing an image, which travels toward the eye of the observer.
The plurality of volume gratings VG1, VG2, and VG3 are locally formed on the surface of the combiner 10 and separated from each other. The plurality of volume gratings VG1, VG2, and VG3 arranged at different locations may diffract the light L0 containing the image at different angles such that lights respectively diffracted from the plurality of volume gratings VG1, VG2, and VG3 travel toward a single same region and are incident on the eye of the observer, particularly, the pupil of the eye of the observer. For example, the volume grating VG1 located to be higher than the eye of the observer may be configured to diffract downward the light L0 projected from the image providing device 20, the volume grating VG2 located at the same height as the eye of the observer may be configured to diffract, in a normal direction with respect to the grating VG2, the light L0 projected from the image providing device 20, and the volume grating VG3 located to be lower than the eye of the observer may be configured to diffract upward the light L0 projected from the image providing device 20.
The image providing device 20 may be configured to individually project the light L0 containing the image to the plurality of volume gratings VG1, VG2, and VG3. For example, the image providing device 20 may generate a plurality of parallel light beams respectively corresponding to the plurality of volume gratings VG1, VG2, and VG3 and individually project the plurality of parallel light beams to the plurality of volume gratings VG1, VG2, and VG3, respectively. The image providing device 20 may be configured to project the light L0 containing the image toward the entire region of the combiner 10. In this case, the light L0 is diffracted only in regions in which the plurality of volume gratings VG1, VG2, and VG3 are formed among the entire region of the combiner 10. In any case, the light L0 containing the image, which is projected from the image providing device 20, may be incident on the plurality of volume gratings VG1, VG2, and VG3 at the same incident angle.
In addition, each volume grating VG1, VG2, or VG3 may be configured such that light diffracted by each volume grating VG1, VG2, or VG3 and traveling toward the eye of the observer is parallel light. Therefore, the light L0 which contains the image and is incident on each volume grating VG1, VG2, or VG3 may be parallel light, and light traveling from each volume grating VG1, VG2, or VG3 toward the eye of the observer may also be parallel light. In this case, each volume grating VG1, VG2, or VG3 may have an optical characteristic having no refractive power like a plane mirror.
In addition, each volume grating VG1, VG2, or VG3 may have a first surface S1 and a second surface S2 facing each other. For example, when the display apparatus 100 is used, the first surface S1 of each volume grating VG1, VG2, or VG3 may be arranged toward the eye of the observer, and the second surface S2 of each volume grating VG1, VG2, or VG3 may be arranged toward an external landscape. In this case, each volume grating VG1, VG2, or VG3 may be configured to diffract light incident on the first surface S1 and transmit therethrough light incident on the second surface S2 without refraction. The image providing device 20 may be arranged to project the light L0 containing the image to the first surface S1 of each volume grating VG1, VG2, or VG3. Then, the plurality of volume gratings VG1, VG2, and VG3 may diffract the light L0 containing the image toward the eye of the observer and transmit the external light L1 therethrough without refraction.
First, referring to
Each volume grating may have, for example, a quadrangular shape. A distance d between two adjacent volume gratings may be greater than or equal to a width w of each volume grating. For example, the width w of each volume grating may be about 0.5 mm to about 1.5 mm. Because a size of each volume grating is very small, each volume grating may act as a pinhole. Therefore, because image information is delivered to the observer through a small opening such as a pinhole, a depth of focus may be long. In addition, an angle of view may increase by using a plurality of volume gratings.
The widths w of the plurality of volume gratings may not all be the same. In addition, the distances d between the plurality of volume gratings may not be all the same. For example, sizes of the widths w of the plurality of volume gratings and the distances d between the plurality of volume gratings may vary according to relative locations from the eye of the observer. For example, the width w of each volume grating may gradually increase or decrease away from the center of the combiner 10, and the distance d between two adjacent volume gratings may gradually increase or decrease away from the center of the combiner 10.
In addition, referring to
Although
As described above, a volume grating includes an interference pattern formed by interference between reference light an signal light. A method of forming an interference pattern of a volume grating having the optical characteristics described above includes a hologram recording method and a method using a holographic printer.
For example,
Therefore, an optical characteristic of the volume grating VG1 formed on the combiner 10 may be more easily determined according to the CGH signal applied to the spatial light modulator SLM of the holographic printer. In addition, a location and a shape of the volume grating VG1 formed on the combiner 10 may be more easily determined according to a forming location and an arrangement shape of the plurality of hogels. For example, an interference pattern and a location of the plurality of hogels may be determined by considering a pre-defined optical characteristic of the volume grating VG1. In addition, the one volume grating VG1 may be formed by calculating a CGH signal for forming a determined interference pattern of a hogel and then by sequentially forming a plurality of hogels in the photosensitive layer 12 while applying the calculated CGH signal to the spatial light modulator SLM.
After completing the one volume grating VG1 in this way, as shown in
After completing all of a plurality of volume gratings, a residual part of the photosensitive layer 12 in which no volume gratings are formed may remain as it is or be removed. For example, referring to
In addition,
As shown in
Volume gratings formed by the holographic printing method or the hologram recording method described above may react only to light incident in a particular direction. For example, the volume gratings diffract only the light L0 containing the image, which is obliquely incident on the first surface S1 of
In addition, the combiner 10 used in the display apparatus 100 according to the example embodiment may be more easily produced using a holographic printer. When a holographic printer is used, an optical characteristic of volume gratings formed in the combiner 10 may be more easily determined according to a CGH signal applied to the spatial light modulator SLM of the holographic printer, and a location and a shape of the volume gratings formed in the combiner 10 may be more easily determined according to a location and an arrangement of hogels. Therefore, optical efficiency of the combiner 10 with respect to the light L0 containing the image may be optimized, and the combiner 10 having high transmittance and low noise with respect to the light L1 containing the external landscape may be implemented.
For example, the volume grating VG1 located to be higher than the eye of the observer may be configured to diffract downward the light L0 projected from the image providing device 20 and collimate the diffracted light into parallel light. The volume grating VG2 located at the same height as the eye of the observer may be configured to diffract, in a normal direction, the light L0 projected from the image providing device 20 and collimate the diffracted light into parallel light. The volume grating VG3 located to be lower than the eye of the observer may be configured to diffract upward the light L0 projected from the image providing device 20 and collimate the diffracted light into parallel light. Accordingly, the plurality of volume gratings VG1, VG2, and VG3 shown in
The plurality of volume gratings VG1, VG2, and VG3 shown in
The transparent light guide plate 31 may have a first surface 31a and a second surface 31b facing each other. When the display apparatus 120 is used, the combiner 30 may be arranged such that the first surface 31a of the transparent light guide plate 31 faces the eye of the observer. The plurality of volume gratings VG1, VG2, and VG3 may be configured to diffract the light containing the image toward the first surface 31a of the transparent light guide plate 31 by being arranged on the second surface 31b of the transparent light guide plate 31. The light containing the image, which is diffracted by the plurality of volume gratings VG1, VG2, and VG3, may exit from the first surface 31a of the transparent light guide plate 31 and be incident on the eye of the observer.
In the example embodiment illustrated in
The plurality of volume gratings VG1, VG2, and VG3 described above may be configured to react to light of all wavelengths. For example, each of the plurality of volume gratings VG1, VG2, and VG3 described above may be configured to diffract all of incident light of a red band, incident light of a green band, and incident light of a blue band in the same direction. However, in this case, diffraction efficiency of the plurality of volume gratings VG1, VG2, and VG3 may be relatively low. Therefore, when volume gratings are configured to react only to light of a particular wavelength band, diffraction efficiency of the volume gratings may be improved.
For example,
In the display apparatuses according to the example embodiments described above, because a size of volume gratings is small, a long depth of focus may be achieved according to the principle of pinhole. However, because a size of volume gratings cannot be zero, an image may not be focused according to a location change of the pupil of the observer or a size change of the pupil. In this case, to focus an image, an effective reaction area of an opening may be actively adjusted in response to a location change of the pupil of the observer or a size change of the pupil. However, because it is difficult to actively change a size of volume gratings, a beam diameter of light containing an image, which is projected from the image providing device 20 and incident to the volume gratings, may be actively adjusted.
For example,
Referring to
In addition, referring to
In addition, referring to
Referring to
Referring to
Referring to
According to the example embodiments described above, a change in a location or a size of the pupil of the observer may be actively responded. Particularly, because the plurality of volume gratings VG1, VG2, and VG3 of the combiner 10 react to only light of a particular wavelength, which is incident at a particular angle, even when a size of the plurality of volume gratings VG1, VG2, and VG3 increases, a transmittance of external light does not significantly decrease. Therefore, even without sacrificing the transmittance of external light, a change in a location or a size of the pupil of the observer may be responded.
In addition, the display apparatus may be provided in a smartphone, and the smartphone itself may be used as a VR display apparatus, an AR display apparatus, or an MR display apparatus. In other words, the display apparatus may be applied to a small electronic device (mobile electronic device) that is not the wearable device as shown in
It should be understood that example embodiments described herein should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of features or aspects within each example embodiment should typically be considered as available for other similar features or aspects in other embodiments. While one or more example embodiments have been described with reference to the figures, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope as defined by the following claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2020-0006743 | Jan 2020 | KR | national |
This application is based on and claims priority under 35 U.S.C. § 119 to U.S. Provisional Application No. 62/952,699, filed on Dec. 23, 2019 in the U.S. Patent Office and Trademark Office, and Korean Patent Application No. 10-2020-0006743, filed on Jan. 17, 2020 in the Korean Intellectual Property Office, the disclosures of which are incorporated by reference herein in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
9176265 | Mukawa et al. | Nov 2015 | B2 |
10151874 | Joo et al. | Dec 2018 | B2 |
10412378 | Lowney et al. | Sep 2019 | B2 |
20070070504 | Akutsu | Mar 2007 | A1 |
20190086668 | Ha | Mar 2019 | A1 |
20190324274 | Kalinowski | Oct 2019 | A1 |
20190339436 | Lee et al. | Nov 2019 | A1 |
20200064633 | Maimone | Feb 2020 | A1 |
20200183152 | Pennell | Jun 2020 | A1 |
Entry |
---|
Andrew Maimone et al., “Pinlight Displays: Wide Field of View Augmented Reality Eyeglasses using Defocused Point Light Sources”, ACM Transactions on Graphics, vol. 33, No. 4, Article 89, Jul. 2014, 11 pages total. |
Number | Date | Country | |
---|---|---|---|
20210191129 A1 | Jun 2021 | US |
Number | Date | Country | |
---|---|---|---|
62952699 | Dec 2019 | US |