Patent Application
20240393509
This application is based on and claims priority under 35 U.S.C. § 119 to Korean Patent Application No. 10-2023-0066117, filed on May 23, 2023, in the Korean Intellectual Property Office, the disclosure of which is herein incorporated by reference in its entirety.
The disclosure relates to an optical system for an augmented reality display, and more particularly, to an optical system for real-world occlusion in an augmented reality display.
A related-art augmented reality display shows an image to a user simply by overlaying image information without applying occlusion for the real world. However, if it is possible to provide occlusion for the real world, it is possible to implement mixed reality that shows blend of the real world and a virtual image in a more natural way, and also, there may be advantages that a large amount of light from the real world is blocked and hence required luminance of the virtual image is reduced.
In order to provide occlusion for a real object positioned at a long distance from a user, an optical system capable of imaging the real object on an occlusion mask may be required, and, to achieve this, a complicated optical system as shown in
However, in an observer vision system which focuses on real objects positioned at a long distance, respective pixels of the occlusion mask positioned at a short distance may be projected on observer's retina with a blur due to characteristics of the augmented reality display which is typically implemented in the form of near-eye display (NED). Accordingly, in this configuration, an occlusion pattern of the occlusion mask may be blurred and there may be a disadvantage that the real world is not exactly hidden as desired. This method is referred to as soft-edge occlusion since an edge of the occlusion pattern is blurred.
The disclosure has been developed in order to solve the above-described problems, and an object of the disclosure is to provide an optical system for an augmented reality display, which is capable of implementing real-world occlusion in the unit of pixel while having a thin form factor.
According to an embodiment of the disclosure to achieve the above-described object, an optical system may include: a first dihedral corner reflector array (DCRA) configured to reflect light beams focused on holes; a mask positioned on a light emitting surface of the first DCRA to pass or block the light beams emitted from the first DCRA; and a second DCRA configured to reflect the light beams which are focused on holes after passing through the mask.
According to an embodiment, the optical system may further include first lenses configured to focus incident light beams on the holes of the first DCRA, and the first DCRA may reflect the light beams focused on the holes by the first lenses.
The first lenses may be positioned at positions where the incident light beams enter the holes of the first DCRA in an off-axis orientation, respectively.
The first lenses may have centers positioned at a position apart from an optic axis of the incident light beams.
The mask may block light beams reflected from holes corresponding to positions where occlusion is provided for a real object, while passing light beams reflected from the other holes.
The mask may be an LC mask having pixels corresponding to the holes of the first DCRA.
According to an embodiment, the optical system may further include second lenses which have same center axes as the center axes of the first lenses and are configured to focus light beams emitted from the mask after passing therethrough on the holes of the second DCRA, and the second DCRA may reflect the light beams focused on the holes by the second lenses.
According to an embodiment, the optical system may further include third lenses which have same center axes as the center axes of the first lenses and the second lenses and are positioned on a light emitting surface of the second DCRA to transform the light beams emitted from the second DCRA into light beams parallel to the incident light beams entering the first lenses.
f3=f1f2/(f1−f2), where f1 is a focal distance of the first lenses, f2 is a focal distance of the second lenses, and f3 is a focal distance of the third lenses.
According to another aspect of the disclosure, there is provided a real-world occlusion method of an optical system, the method including: reflecting, by a first DCRA, light beams focused on holes; passing or blocking, by a mask positioned on a light emitting surface of the first DCRA, the light beams emitted from the first DCRA; and reflecting, by a second DCRA, the light beams which are focused on holes after passing through the mask.
According to still another aspect of the disclosure, there is provided an optical system including: a first DCRA configured to reflect light beams focused on holes; a mask positioned on a light emitting surface of the first DCRA to pass or block the light beams emitted from the first DCRA; and a second DCRA configured to reflect the light beams which are focused on holes after passing through the mask, wherein the mask is configured to block light beams reflected from holes corresponding to positions where occlusion is provided for a real object, while passing light beams reflected from the other holes.
According to yet aspect of the disclosure, there is provided a real-world occlusion method of an optical system, the method including: reflecting, by a first DCRA, light beams focused on holes; masking, by a mask positioned on a light emitting surface of the first DCRA, to pass or block the light beams emitted from the first DCRA; and reflecting, by a second DCRA, the light beams which are focused on holes after passing through the mask, wherein masking includes blocking light beams reflected from holes corresponding to positions where occlusion is provided for a real object, while passing light beams reflected from the other holes.
According to embodiments of the disclosure as described above, an optical system for an augmented reality display can apply real-world occlusion in the unit of pixel while having a thin form factor by using off-axis lens arrays, a DCRA, and an LC mask.
Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.
Before undertaking the DETAILED DESCRIPTION OF THE INVENTION below, it may be advantageous to set forth definitions of certain words and phrases used throughout this patent document: the terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation; the term “or,” is inclusive, meaning and/or; the phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like. Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases.
For a more complete understanding of the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which like reference numerals represent like parts:
Hereinafter, the disclosure will be described in more detail with reference to the accompanying drawings.
Embodiments of the disclosure propose a thin optical system for real-world occlusion in an augmented reality display.
Real-world occlusion technology for a related-art augmented reality display provides real-world occlusion in the unit of pixel through an optical system having a large volume. Alternatively, the related-art technology uses an optical system having a thin form factor, but this method does not provide occlusion in the unit of pixel and provides soft-edge occlusion. To solve these problems of the related-art technology, embodiments of the disclosure propose an optical system for an augmented reality display, which is capable of providing occlusion in the unit of pixel while having a thin form factor.
As shown in
In this case, the light beams reflected from the inner surfaces of the DCRA an odd number of times are oriented in an intended direction, whereas the light beams passing through the rectangular holes without being reflected or the light beams reflected an even number of times travel in an unintended direction and act as a noise.
In order to avoid such a noise, incident light should enter in an off-axis orientation at a certain angle as shown in
The unit optical system according to an embodiment refers to an optical system that focuses incident parallel light entering at a certain angle θ on an LC mask 130 disposed in the middle of the optical system, and determines whether to pass or block the incident light by turning on/off a pixel of a focus position of the LC mask 130, and, when it is determined that light is passed, finally outputs parallel light having an angle θ like the incident light.
In order to perform the above-described function, the unit optical system according to an embodiment may include a lens 1 111, a DCRA 1 120, an LC mask 130, a lens 2 141, a DCRA 2 150, and a lens 3 161.
First, incident light enters the lens 1 111 which has a center at a position apart from an optic axis of the incident light. The lens 1 111 has a focal distance f1 and has a lens center at a position apart from the optic axis of the incident light by Δx, and focuses on a plane positioned at the focal distance f1 of the lens 1 111.
If the LC mask 130 which is a kind of dynamic mask is placed on this plane, it may be determined whether to pass or block all of the parallel light beams entering at the certain angle by controlling pixels of the LC mask 130. In addition, the DCRA1 120 may be disposed on the incident surface of the LC mask 130, thereby allowing light beams passing through the LC mask 130 to return in an original optic axis direction.
The incident light should enter the DCRA1 120 in an off-axis orientation in order to remove a noise as described above. To achieve this, the center of the lens 1 111 is positioned apart from the optic axis, and paraxial light beams of the incident light entering the lens 1 111 is made to be focused in the proximity of an intersection point between the DCRA 1 120 and the center axis of the lens 111, which is apart from the optic axis by Δx, and eventually, the light beams enter the DCRA 1 120 in an off-axis orientation. Accordingly, when Δx is greater than or equal to an appropriate value, a noise is removed from the paraxial light beams at the DCRA1 120, and the DCRA1 120 operates as intended.
The light that is focused on the plane of the DCRA 1 120 and the LC mask 130 is emitted again. In this case, if the lens 2 141 having the same center axis as the lens 1 111 and having a focal distance f2 is placed at a distance f1, the incident light is focused after passing through the lens 2 141 (secondary image point). In this case, a focal distance may be obtained by a lens expression of f1f2/(f1−f2), and the light is oriented toward the center axis of the lenses 111, 141 again.
If the DCRA 2 150 is placed on a light emitting surface of the lens 2 141, the image point may be changed to a tertiary image point which is positioned at a mirror-symmetric position of a light emitting surface of the DCRA 2 150. However, since light entering the DCRA 2 150 still enters in the off-axis orientation, a noise is removed at the DCRA 2 150 and the DCRA 2 150 is usable to perform an intended function.
In this case, the lens 3 161 having the same center axis as the lens 1 111 and the lens 2 141 and having a focal distance f3 is placed on the light emitting surface of the DCRA 2 150. In this case, if f3 is equal to f1f2/(f1−f2) which is the focal distance of the secondary image point, light passing through the DCRA 2 15 may be outputted as parallel light having the same angle θ as incident light.
Accordingly, the optical system according to an embodiment may block the entire incident light entering as parallel light having the angle θ if it is determined that light is blocked by controlling a corresponding pixel of the LC mask 140, but, if it is determined that light is passed, the optical system may emit parallel light having the same angle θ as the incident light.
In the optical system according to an embodiment, an expression 2(f1+d) may be established if a thickness of DCRA 1, 2 120, 150 is d.
The optical system for the augmented reality display according to an embodiment may include three off-axis lens arrays 110, 140, 160, two DCRAs 120, 150, and one LC mask 130 as shown in
Respective lenses of the lens 1 array 110 focus incident light beams on holes of the DCRA1 120, respectively, and the DCRA 1 120 reflects the light beams focused on the respective holes, and the LC mask 130 positioned on a light emitting surface of the DCRA1 120 may pass or block the light beams emitted from the DCRA1 120.
Respective lenses of the lens 2 array 140 focus the light beams passing through and emitted from the LC mask 130 on the holes of the DCRA 2 150, and the DCRA 2 150 reflects the light beams focused on the holes, and respective lenses of the lens 3 array 160 positioned on a light emitting surface of the DCRA2 150 transform the light beams emitted from the DCRA2 150 into light beams parallel to the incident light beams entering the respective lenses of the lens 1 array 110.
Accordingly, in this system, light starting from one point of an object positioned at a long distance in the real world passes through the DCRA 1 20 by the respective lenses of the lens 1 array 110, and then, is imaged on the surface of the LC mask 130, and thereafter, passes through the lens 2 array 140, the DCRA 2 150, and the lens 3 array 150 and then is delivered to an observer along an original light path.
On the other hand, if the LC mask 130 blocks the imaged light, a corresponding point light source of the real object may be blocked. In this way, an optical system capable of providing real-world occlusion while having a thin thickness may be configured.
Up to now, the optical system for the augmented reality display has been described in detail with reference to preferred embodiments.
The above-described embodiments propose an optical system for an augmented reality display, which is capable of providing real-world occlusion in the unit of pixel while having a thin form factor by using off-axis lens arrays, a DCRA, and an LC mask.
The technical concept of the present disclosure may be applied to a computer-readable recording medium which records a computer program for performing the functions of the apparatus and the method according to the present embodiments. In addition, the technical idea according to various embodiments of the present disclosure may be implemented in the form of a computer readable code recorded on the computer-readable recording medium. The computer-readable recording medium may be any data storage device that can be read by a computer and can store data. For example, the computer-readable recording medium may be a read only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical disk, a hard disk drive, or the like. A computer readable code or program that is stored in the computer readable recording medium may be transmitted via a network connected between computers.
In addition, while preferred embodiments of the present disclosure have been illustrated and described, the present disclosure is not limited to the above-described specific embodiments. Various changes can be made by a person skilled in the at without departing from the scope of the present disclosure claimed in claims, and also, changed embodiments should not be understood as being separate from the technical idea or prospect of the present disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2023-0066117 | May 2023 | KR | national |
