Patent Grant
11808954
Example embodiments of the present disclosure relate to a multi-image display apparatus such as an augmented reality system, and more particularly, to a multi-image display apparatus providing a wide angle of view using a polarization selective lens and screen while the size of the multi-image display apparatus is reduced or miniaturized.
Recently, along with the development of electronic apparatuses and display apparatuses capable of implementing virtual reality (VR), interest in such apparatuses has increased. As a next step of VR, technology for implementing augmented reality (AR) and mixed reality (MR) is being researched.
Unlike VR that is based on a complete virtual world, AR is a display technique that shows the real world and overlapped or combined virtual objects or information thereon, thereby further increasing the effect of reality. While VR is limitedly applied only to fields such as games or virtual experience, AR is advantageous in that it may be applied to various real environments. In particular, AR attracts attention as next-generation display technology suitable for a ubiquitous environment or an Internet of things (IoT) environment. AR may be an example of MR in that it shows a mixture of the real world and additional information such as virtual world.
One or more example embodiments provide a multi-image display apparatus such as an augmented reality system.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of example embodiments.
According to an aspect of an example embodiment, there is provided a multi-image display apparatus including an image forming device configured to form a first image, a first polarization plate configured to transmit a first polarization component of the first image provided from the image forming device, a second polarization plate configured to transmit a second polarization component of a second image that is provided from a path different from the first image, the second polarization component being different from the first polarization component, a screen configured to reflect and diffuse the first image, and transmit the second image, and a polarization selective lens configured to focus the first image having the first polarization component, and transmit the second image having the second polarization component without refraction.
The screen may include a first surface and a second surface that is opposite to the first surface, and the screen may further include an anisotropic holographic screen configured to reflect and diffuse light that is incident on the first surface at an angle, and transmit light incident on the second surface.
The image forming device may be disposed to provide the first image to the first surface of the screen at an angle.
The second polarization plate may be disposed on the second surface of the screen.
The screen may be configured such that a diffusion central angle is 0 degrees from a normal line perpendicular to the first surface in a central area of the first surface, and the diffusion central angle increases from the normal line perpendicular to the first surface from the central area of the first surface to edge areas of the first surface.
The screen may be configured such that the diffusion central angle is symmetrically inclined based on the central area of the first surface, and light reflected and diffused at the diffusion central angle from the first surface are gathered on a point of an optical axis.
The diffusion central angle may range from 10 degrees to 20 degrees at an edge of the first surface.
The multi-image display apparatus, wherein a diffusion angle at which light is reflected and diffused from the first surface is within 10 degrees.
The first image may include a first color image, a second color image, and a third color image, and the screen may include a first anisotropic holographic screen configured to reflect and diffuse the first color image that is incident on a first surface of the first anisotropic holographic screen at an angle, and transmit light incident on a second surface of the first anisotropic holographic screen that is opposite to the first surface, a second anisotropic holographic screen configured to reflect and diffuse the second color image that is incident on a third surface of the second anisotropic holographic screen at an angle, and transmit light incident on a fourth surface of the second anisotropic holographic screen that is opposite to the third surface, and a third anisotropic holographic screen configured to reflect and diffuse the third color image that is incident on a fifth surface of the third anisotropic holographic screen at an angle, and transmit light incident on a sixth surface of the third anisotropic holographic screen that is opposite to the fifth surface.
The image forming device may be configured to provide the first color image to the first surface of the first anisotropic holographic screen at an angle, provide the second color image to the third surface of the second anisotropic holographic screen at an angle, and provide the third color image to the fifth surface of the third anisotropic holographic screen at an angle.
The first anisotropic holographic screen may be configured to transmit the second color image and the third color image incident on the first surface, the second anisotropic holographic screen is configured to transmit the first color image and the third color image incident on the third surface, and the third anisotropic holographic screen is configured to transmit the first color image and the second color image incident on the fifth surface.
The first anisotropic holographic screen may be configured such that a diffusion central angle of the first color image is 0 degrees from a normal line perpendicular to the first surface, in a central area of the first surface, and the diffusion central angle of the first color image from the normal line perpendicular to the first surface increases from the central area of the first surface to edge areas of the first surface, the second anisotropic holographic screen is configured such that a diffusion central angle of the second color image is 0 degrees from a normal line perpendicular to the third surface in a central area of the third surface, and the diffusion central angle of the second color image from the normal line perpendicular to the third surface increases from the central area of the third surface to edge areas of the third surface, and the third anisotropic holographic screen is configured such that a diffusion central angle of the third color image is 0 degrees from a normal line perpendicular to the fifth surface in a central area of the fifth surface, and the diffusion central angle of the third color image from the normal line perpendicular to the fifth surface increases from the central area of the fifth surface to edge areas of the fifth surface.
The first anisotropic holographic screen, the second anisotropic holographic screen, and the third anisotropic holographic screen may be sequentially disposed away from the polarization selective lens, such that the first color image has a first light path length, the second color image has a second light path length greater than the first light path length, and the third color image has a third light path length greater than the second light path length, and the first anisotropic holographic screen, the second anisotropic holographic screen, and the third anisotropic holographic screen are disposed to offset chromatic aberration of the polarization selective lens.
The multi-image display apparatus may further include a light guide plate disposed between the screen and the polarization selective lens.
The light guide plate may include an input coupler configured to reflect incident light at an angle, and to provide the incident light into the light guide plate, and the image forming device may be disposed to provide the first image to the input coupler of the light guide plate.
The light guide plate may be configured to totally reflect the first image provided at an angle to the light guide plate by the input coupler, between a first surface of the light guide plate and a second surface of the light guide plate that is opposite to the first of the light guide plate, and the screen is directly disposed on the first surface of the light guide plate.
The polarization selective lens may be configured to focus light having a first circular polarization component having a first rotation direction and transmit, without change, light having a second circular polarization component having a second rotation direction which is opposite to the first rotation direction.
The polarization selective lens may include two geometric phase lenses and a polarization conversion plate between the two geometric phase lenses, the two geometric phase lenses may be configured to operate as convex lenses with respect to the light having the first circular polarization component, and operate as concave lenses with respect to the light having the second circular polarization component, and the polarization conversion plate may be configured to transmit, without change, the light having the first circular polarization component, and convert the light having the second circular polarization component into the light having the first circular polarization component.
The first polarization plate may include a first circular polarization plate configured to transmit the light having the first circular polarization component, and the second polarization plate includes a second circular polarization plate configured to transmit the light having the second circular polarization component.
The screen may include a polarization selective screen configured to reflect and diffuse light having a first linear polarization component, and transmit light having a second linear polarization component that is perpendicular to the first linear polarization component, the first polarization plate may include a first linear polarization plate configured to transmit the light having the first linear polarization component, and the second polarization plate includes a second linear polarization plate configured to transmit the light having the second linear polarization component perpendicular to the first linear polarization component, and the multi-image display apparatus may further include a ¼ wavelength plate disposed between the screen and the polarization selective lens.
The above and/or other aspects will become apparent and more readily appreciated from the following description of example embodiments, taken in conjunction with the accompanying drawings in which:
Hereinafter, multi-image display apparatuses including a polarization selective lens and a screen will be described with reference to the accompanying drawings. In the drawings, like reference numerals refer to like elements, and the sizes of elements may be exaggerated for clarity of illustration. Example embodiments described herein are for illustrative purposes only, and various modifications may be made therefrom. In the following description, when an element is referred to as being “above” or “on” another element in a layered structure, it may be directly on an upper, lower, left, or right side of the other element while making contact with the other element or may be above an upper, lower, left, or right side of the other element without making contact with the other element.
It will be understood that the terms “comprise” or “include” should not be construed as including all elements or steps described in the specification and may omit some elements or some steps or may further include additional elements or steps. While such terms as “first”, “second”, etc., may be used to describe various components, such components must not be limited to the above terms. The above terms are used only to distinguish one component from another.
As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Expressions such as “at least one of”, when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list. For example, the expression, “at least one of a, b, and c,” should be understood as including only a, only b, only c, both a and b, both a and c, both b and c, or all of a, b, and c.
For example, the first image L10 may be a display image formed and provided by the image forming device 110 in the multi-image display apparatus 100 and may contain virtual reality or virtual information. The second image L20 may be an image of the outside that a user faces. The second image L20 may include an image of a foreground that the user faces, and a background subject. The second image L20 may be an image of the real world. Therefore, the multi-image display apparatus 100 of the example embodiment may be used for implementing augmented reality (AR) or mixed reality (MR). In this case, the multi-image display apparatus 100 may be a near-eye AR display apparatus.
The image forming device 110 forming the first image L10 may be configured in various ways. For example, the image forming device 110 may include a light source and a spatial light modulator. For example, the spatial light modulator may include a semiconductor modulator based on a compound semiconductor such as GaAs, a liquid crystal on silicon (LCoS) panel, a liquid crystal display (LCD) panel, a digital light projection (DLP) panel, or the like. The image forming device 110 may form the first image L10 using the light source and the spatial light modulator. The light source may, for example, include a plurality of light-emitting diodes or a plurality of laser diodes capable of emitting red light, green light, and blue light, respectively. Therefore, the first image L10 formed by the image forming device 110 may include a red image, a green image, and a blue image.
As an example, the image forming device 110 may include a display panel. For example, the display panel may include a micro light-emitting diode (LED) display panel, an organic LED (OLED) display panel, or a liquid crystal display (LCD) display panel. The first image L10 realized by using the display panel may be a two-dimensional (2D) image or a three-dimensional (3D) image. For example, the 3D image may be a hologram image, a stereo image, a light field image, an integral photography (IP) image, etc.
The polarization selective lens 160 is configured to focus incident light or transmit the incident light without refraction based on a polarization state of the incident light. For example, the polarization selective lens 160 may focus light having a first circular polarization component having a first rotation direction and may intactly transmit light having a second circular polarization component having a second rotation direction without change, which is a direction opposite to the first rotation direction. Thus, when the first image L10 formed by the image forming device 110 has the first circular polarization component, the polarization selective lens 160 may provide the first image L10 to a user's eye by focusing the first image L10. Also, when the second image L20, which is an image of the real world, has the second circular polarization component, the polarization selective lens 160 may provide the second image L20 to the user's eye without change and distortion.
To this end, the multi-image display apparatus 100 may further include a first circular polarization plate 120 for transmitting only the light having the first circular polarization component and a second circular polarization plate 150 for transmitting only the light having the second circular polarization component. The first circular polarization plate 120 is arranged on a light path of the first image L10, the light path being between the image forming device 110 and a first surface 141 of the anisotropic holographic screen 140, so that the first image L10 incident on the polarization selective lens 160 has the first circular polarization component. The second circular polarization plate 150 is arranged to face a second surface 142 of the anisotropic holographic screen 140 so that the second image L20 incident on the polarization selective lens 160 has the second circular polarization component.
The polarization selective lens 160 may be configured in various ways. For example,
When the first image L10 having the first circular polarization component is incident on the polarization selective lens 160, the geometric phase lens 160a may act as a convex lens to the first image L10 and change a polarization state of the first image L10 to the second circular polarization component, as illustrated in
Also, when the second image L20 having the second circular polarization component is incident on the polarization selective lens 160, the geometric phase lens 160a may act as a concave lens to the second image L20 and change a polarization state of the second image L20 to the first circular polarization component. The second image L20 that has the first circular polarization component may maintain the first circular polarization component by passing through the polarization conversion plate 160b. Then, the geometric phase lens 160c may act as a convex lens to the second image L20 and change the polarization state of the second image L20 to the second circular polarization component. Consequently, since the second image L20 passes through each of the concave lens and the convex lens once, the concave lens and the convex lens having the same focal distance, no optical effect may be applied to the second image L20 by passing through the polarization selective lens 160. Accordingly, the second image L20 having the second circular polarization component may pass through the polarization selective lens 160 without change and distortion.
The polarization selective lens 160 may have other configurations than the configuration described in
The anisotropic holographic screen 140 includes the first surface 141 and the second surface 142 opposite to each other. The first surface 141 of the anisotropic holographic screen 140 is arranged toward the polarization selective lens 160 and the second surface 142 thereof is arranged toward the second circular polarization plate 150. Also, the image forming device 110 is arranged such that the first image L10 is incident into the first surface 141 of the anisotropic holographic screen 140 and the second image L20 is incident into the second surface 142 of the anisotropic holographic screen 140.
The anisotropic holographic screen 140 is configured to reflect and diffuse light incident into the first surface 141 and to intactly transmit light incident into the second surface 142. Thus, the anisotropic holographic screen 140 may operate as a screen for the first image L10 incident into the first surface 141, while functioning as a transparent flat plate for the second image L20 incident into the second surface 142.
In particular, the anisotropic holographic screen 140 may be configured to have different diffusion central angles based on a location of the first surface 141, on which the light is incident. For example,
Meanwhile, the diffusion central angle β may have a greater inclination with respect to the normal line perpendicular to the first surface 141, as a distance from the center of the first surface 141 of the anisotropic holographic screen 140 increases. Also, as illustrated in
Also, a diffusion angle α at which light is reflected and diffused from any one point on the first surface 141 of the anisotropic holographic screen 140 may be, for example, within about 10 degrees. Here, the diffusion angle α may be defined as an angle between a progression direction of light diffused at a half intensity of an intensity of the light diffused at the diffusion central angle β, and the normal line perpendicular to the first surface 141. According to an example embodiment, the diffusion angle α at which light is reflected and diffused is relatively less, and thus, loss of light may be less. Also, the diffusion central angle β is symmetrically inclined based on the center of the first surface 141 of the anisotropic holographic screen 140, and thus, an angle of view for the first image L10 may be increased.
Also, referring to
However, according to the example embodiment, by using the anisotropic holographic screen 140 having different diffusion central angles β based on locations of the anisotropic holographic screen 140, the angle of view for the first image L10 may be increased. For example, when the diffusion central angle β at both ends of the anisotropic holographic screen 140 is 15 degrees, an angle of view of about 90 degrees may be obtained. Also, since the diffusion angle α of the anisotropic holographic screen 140 is about 10 degrees, which is relatively small, the loss of light may be decreased to increase the brightness of the first and second images L10 and L20. Thus, the multi-image display apparatus 100 described above may reduce a difference between the angle of view of the multi-image display apparatus 100 and an actual external scene, thereby providing a more realistic AR experience. Also, the polarization selective lens 160 and the anisotropic holographic screen 140 may be arranged in front of a user's eye without a relay optical system, and thus, the size of the multi-image display apparatus 100 may be reduced.
Here, the reference waves and the signal waves have the same wavelength. For example, light generated from one light source may be split by a beam splitter to be provided as each of reference waves and signal waves. Then, interference patterns generated when the signal waves and the reference waves interfere with each other may be recorded in the photosensitive member 140′. When the photosensitive member 140′ in which the interference patterns are recorded is developed, the anisotropic holographic screen 140 performing the operation illustrated in
Referring to
Meanwhile, the anisotropic holographic screen 140 may operate as the reflection diffusion plate only for light having the same wavelength as the reference waves and the signal waves used for manufacturing the anisotropic holographic screen 140. Thus, when the first image L10 has a red image, a green image, and a blue image, all operations described with reference to
First, as illustrated in
The first wavelength-selective anisotropic holographic screen 140a, the second wavelength-selective anisotropic holographic screen 140b, and the third wavelength-selective anisotropic holographic screen 140c may operate as screens for light of different wavelengths. For example, the first wavelength-selective anisotropic holographic screen 140a may reflect and diffuse light of a red wavelength and transmit light of other wavelengths. The second wavelength-selective anisotropic holographic screen 140b may reflect and diffuse light of a green wavelength and transmit light of other wavelengths. The third wavelength-selective anisotropic holographic screen 140c may reflect and diffuse light of a blue wavelength and transmit light of other wavelengths.
Thus, a red image of the first image L10 provided by the image forming device 110 is reflected and diffused by the first wavelength-selective anisotropic holographic screen 140a. A green image passes through the first wavelength-selective anisotropic holographic screen 140a, and then is reflected and diffused by the second wavelength-selective anisotropic holographic screen 140b. A blue image passes through the first wavelength-selective anisotropic holographic screen 140a and the second wavelength-selective anisotropic holographic screen 140b, and then is reflected and diffused by the third wavelength-selective anisotropic holographic screen 140c. Thereafter, the red image, the green image, and the blue image of the first image L10 are focused by the polarization selective lens 160. The second image L20 passes through all of the first wavelength-selective anisotropic holographic screen 140a, the second wavelength-selective anisotropic holographic screen 140b, and the third wavelength-selective anisotropic holographic screen 140c, and then passes through the polarization selective lens 160.
Also, referring to
Lastly, referring to
In
The first wavelength-selective anisotropic holographic screen 140a, the second wavelength-selective anisotropic holographic screen 140b, and the third wavelength-selective anisotropic holographic screen 140c may be arranged to offset or reduce chromatic aberration of the polarization selective lens 160. In general, the geometric phase lenses 160a and 160c of the polarization selective lens 160 are realized by forming patterns of a plurality of nonlinear material elements on a transparent substrate, whereby the polarization selective lens 160 may have chromatic aberration due to dispersion based on the wavelengths. Unlike a general refractive lens having a focal distance that is proportional to the wavelength, the polarization selective lens 160 using diffraction has a focal distance that is inversely proportional to the wavelength of light. That is, as the wavelength of incident light is increased, the focal distance of the polarization selective lens 160 is decreased, and the focal distance of the polarization selective lens 160 is sensitively changed as the wavelength is changed. For example, the polarization selective lens 160 may have a first focal distance for a red image, a second focal distance that is greater than the first focal distance for a green image, and a third focal distance that is greater than the second focal distance for a blue image.
According to the example embodiment, the chromatic aberration of the polarization selective lens 160 may be offset by allowing each of the red image, the green image, and the blue image to have a different optical path length by placing the first wavelength-selective anisotropic holographic screen 140a, the second wavelength-selective anisotropic holographic screen 140b, and the third wavelength-selective anisotropic holographic screen 140c on different locations of the optical path. For example, the first wavelength-selective anisotropic holographic screen 140a, the second wavelength-selective anisotropic holographic screen 140b, and the third wavelength-selective anisotropic holographic screen 140c may be sequentially arranged away from the polarization selective lens 160. Then, the red image may have a first optical path length, the green image may have a second optical path length that is greater than the first optical path length, and the blue image may have a third optical path length that is greater than the second optical path length. To this end, the locations of the first wavelength-selective anisotropic holographic screen 140a, the second wavelength-selective anisotropic holographic screen 140b, and the third wavelength-selective anisotropic holographic screen 140c may be selected by taking into account chromatic aberration of the polarization selective lens 160 to offset the chromatic aberration.
According to the example embodiment of the multi-image display apparatus 300 illustrated in
Also,
According to the example embodiment, the polarization selective screen 183 is configured to operate as a diffusion plate or a transparent flat plate based on a linear polarization direction of incident light. For example,
To this end, the multi-image display apparatus 500 may further include a first linear polarization plate 181 configured to transmit only light having the first linear polarization component and a second linear polarization plate 182 configured to transmit only light having the second liner polarization component. The first linear polarization plate 181 is arranged on a light path of the first image L10 that is between the image forming device 110 and the light guide plate 170, so that the first image L10 has the first linear polarization component. The second linear polarization plate 182 is arranged to face a surface of the polarization selective screen 183, on which the second image L20 is incident, so that the second image L20 has the second linear polarization component.
Also, the polarization selective lens 160 focuses the incident light or transmits the incident light without refraction according to a circular polarization state of the incident light, and thus, the multi-image display apparatus 500 may further include a ¼ wavelength plate 184 arranged between the light guide plate 170 and the polarization selective lens 160. Then, a phase of the first image L10 having the first linear polarization component is delayed by a ¼ wavelength by the ¼ wavelength plate 184, and thus, the first image L10 incident into the polarization selective lens 160 may have the first circular polarization component. Also, a phase of the second image L20 having the second linear polarization component is delayed by a ¼ wavelength by the ¼ wavelength plate 184, and thus, the second image L20 incident into the polarization selective lens 160 may have the second circular polarization component.
Also, in the multi-image display apparatus 100 illustrated in
In addition, the multi-image display apparatuses of the example embodiments may be included in smartphones, and the smart phones may be used as multi-image display apparatuses. For example, the multi-image display apparatuses may be applied to compact electronic devices or mobile electronic devices. The application fields of the multi-image display apparatuses of the example embodiments may vary in various ways. For example, the multi-image display apparatuses of the example embodiments may be not only used to implement AR or MR, but also used in other fields. For example, the technical concepts of the example embodiments may be applied not only to AR or MR, but also to displays through which a plurality of images may be simultaneously seen.
It should be understood that the multi-image display apparatuses including the polarization selective lens and the screen described according to example embodiments should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of features or aspects within each example embodiment should typically be considered as available for other similar features or aspects in other example embodiments. While example embodiments have been described with reference to the figures, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope as defined by the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2018-0145645 | Nov 2018 | KR | national |
This application is a Continuation Application of U.S. application Ser. No. 16/591,152, filed Oct. 2, 2019 in the United States Patent and Trademark Office, which claims priority from Korean Patent Application No. 10-2018-0145645, filed on Nov. 22, 2018 in the Korean Intellectual Property Office, the disclosures of which are incorporated herein in their entireties by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 20150362728 | Tei | Dec 2015 | A1 |
| 20170269366 | Lee | Sep 2017 | A1 |
| 20180107000 | Sung et al. | Apr 2018 | A1 |
| 20180210222 | Seo et al. | Jul 2018 | A1 |
| 20200096816 | Lee et al. | Mar 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 107966813 | Apr 2018 | CN |
| 3312659 | Apr 2018 | EP |
| 10-1741912 | Jun 2017 | KR |
| 10-2018-0043072 | Apr 2018 | KR |
| 10-2020-0034401 | Mar 2020 | KR |
| Number | Date | Country | |
|---|---|---|---|
| 20210405388 A1 | Dec 2021 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16591152 | Oct 2019 | US |
| Child | 17474685 | US |
