The present invention relates to a near-eye display device capable of implementing a multifocal view while dynamically providing a three-dimensional parallax image.
Korean Patent Registration No. 10-0617396 (hereinafter, referred to as Patent Document 1) discloses a three-dimensional image display device capable of providing two or more parallax images within a minimum diameter of a pupil of an eye. However, in Patent Document 1, in order to provide two or more parallax images within the pupil, a parallax image providing unit including a laser light source, an optical diffuser, and an optical modulator, and a parallax image converging unit including pinholes and lenses should be provided, and thus, there is a problem in that the size and volume of the three-dimensional image display device increase.
Korean Patent Registration No. 10-1059763 (hereinafter, referred to as Patent Document 2) discloses a three-dimensional image display device capable of providing a full parallax image by arranging two or more projection optical systems. However, in Patent Document 2, due to discretely distributed selective light sources, a flat panel, a two-dimensional arrangement of optionally openable and closable apertures, a transmissive micro-display, and use of at least three lenses, it is difficult to achieve a size of a head mounted display (HMD) on the commercial level.
Even in Korean Patent Registration No. 10-1919486 (hereinafter, referred to as Patent Document 3), a plurality of IP lenses or apertures or combinations thereof are used when a multifocal view is implemented, thereby resulting in a decrease in resolution of each parallax image. In Patent Document 3, since a plurality of IP lens or pinhole arrays are used on the same micro-display panel to spatially divide the resolution of the display, when the micro-display panel is used as a virtual reality (VR)/mixed reality (MR)/augmented reality (AR) device, a resolution of each parallax image is greatly decreased.
That is, in Patent Document 3, since a display area is partially divided and the lens array is used to provide a virtual image, a plurality of parallax images may be provided, but it is difficult to provide a high definition virtual image.
The present invention is directed to controlling a width size and a position of light passing through a lens by using a dynamic aperture disposed adjacent to the lens, thereby controlling a position and a size of a convergence area of a virtual image formed at an eye pupil position of an observer.
The present invention is also directed to providing a virtual image formed through a lens and a dynamic aperture at an eye pupil of an observer using an entire resolution of a display.
According to an embodiment of the present invention, a near-eye display device includes a display, a first lens disposed in front of the display so as to be spaced apart from the display by a predetermined distance, a dynamic aperture adjustment element disposed adjacent to the first lens to dynamically control an aperture size of the first lens and a horizontal position of the aperture on a plane perpendicular to an optical axis, a main optics lens disposed to be spaced apart from the first lens by a predetermined distance, and a control system configured to control the dynamic aperture adjustment element, wherein an eye pupil of an observer is positioned in an exit pupil disposed to be spaced apart from the main optics lens by a predetermined distance, and a size and a horizontal position of the exit pupil are determined according to the size and the horizontal position of the aperture of the dynamic aperture adjustment element that are adjusted according to a control signal from the control system.
The size of the aperture of the dynamic aperture adjustment element may be adjusted such that the size of the exit pupil is within 2 mm that is smaller than a pupil size of the observer.
The dynamic aperture adjustment element may be a liquid crystal device (LCD) or an electronic shutter, in which a size and a horizontal position of an aperture thereof are adjustable according to the control signal from the control system.
The dynamic aperture adjustment element may have two or more horizontal positions of the apertures, and the apertures at the horizontal positions of the dynamic aperture adjustment element may be sequentially operated within one frame virtual image according to the control signal from the control system so that two or more exit pupils are sequentially disposed.
The control system may sequentially provide two or more parallax images to the display in synchronization with a change in aperture position of the dynamic aperture adjustment element to allow different parallax images to be disposed at positions of the exit pupils.
The near-eye display device may further include a pupil tracking device configured to track an eye pupil position of the observer, wherein the control system uses pupil tracking information acquired by the pupil tracking device to control the horizontal position of the aperture of the dynamic aperture adjustment element in real time such that the exit pupil is continuously disposed in the eye pupil of the observer.
The dynamic aperture adjustment element may generate two or more aperture arrangements rearranged according to a moving direction of the eye pupil of the observer tracked by the pupil tracking device, one dynamic aperture at each horizontal position of the dynamic aperture adjustment element is operated within one frame virtual image according to the control signal from the control system, and the exit pupil is always placed within a pupil diameter according to the moving direction of the eye pupil of the observer to enlarge a size of the exit pupil in the moving direction of the eye pupil of the observer.
The dynamic aperture adjustment element may generate two or more aperture arrangements rearranged according to a moving direction of the eye pupil of the observer tracked by the pupil tracking device, the apertures at the horizontal positions of the dynamic aperture adjustment element may be sequentially operated within one frame virtual image according to the control signal from the control system, and two or more exit pupils may be sequentially disposed according to the moving direction of the eye pupil of the observer to enlarge a size of the exit pupil in the moving direction of the eye pupil of the observer.
Two or more aperture positions of the dynamic aperture adjustment element may be arranged in a horizontal direction, a vertical direction, a diagonal direction, or a combination thereof on the plane perpendicular to the optical axis.
The control system may adjust the size of the aperture of the dynamic aperture element according to a set best virtual image position and a depth of focus range to adjust the size of the exit pupil at an eye pupil position such that a nearest image blur size formed on a retina at a nearest focus position of an eye is equal to a farthest image blur size of an image point formed on the retina at a farthest focus position of the eye, the nearest image blur size and the farthest image blur size are within ±20% of the same value as an image blur size due to diffraction, and a best position of an image point of a virtual image is an arithmetic mean position of a nearest focus position and a farthest focus position of the eye in a diopter unit.
The aperture of the dynamic aperture adjustment element may be an annular aperture including a circular light blocking portion in a circular aperture.
When a radius of the circular aperture is denoted by a and a radius of the circular light blocking portion is denoted by a0, and when a ratio of the radius of the circular light blocking portion to the radius of the circular aperture is defined as β (≡a0/a), β may be zero or more and 1/3 or less.
When a radius of the circular aperture is denoted by a and a radius of the circular light blocking portion is denoted by a0, and when a ratio of the radius of the circular light blocking portion to the radius of the circular aperture is defined as β (≡a0/a), β may be zero or more and 0.45 or less.
The control system may adjust the size of the aperture of the dynamic aperture adjustment element to be wide so as to decrease the depth of focus range at a best virtual image position set according to a type of the virtual image and to provide an image with increased resolution.
The near-eye display device may further include a display position adjustment element configured to adjust a distance between the display and the first lens, wherein the control system controls the display position adjustment element according to the set best virtual image position to adjust a best virtual image position.
The first lens may have a focal distance which is adjustable according to the control signal from the control system, and the control system may control the focal distance of the first lens according to the set best virtual image position to adjust a best virtual image position.
The near-eye display device may further include a pupil tracking device configured to track a focus adjustment position of the eye of the observer, wherein the control system uses pupil tracking information acquired by the pupil tracking device to control the display position adjustment element to form a best virtual image position close to a focus adjustment position of the eye of the observer.
The near-eye display device may further include a pupil tracking device configured to track a focus adjustment position of the eye of the observer, wherein the control system uses pupil tracking information acquired by the pupil tracking device to control the focal distance of the first lens to form the best virtual image position close to a focus adjustment position of the eye of the observer.
Two pupil tracking devices may be provided and may track convergence position information of both eyes of the observer, and the control system may control the display position adjustment element to form the best virtual image position close to a gaze convergence depth of the both eyes of the observer.
Two pupil tracking devices may be provided and may track convergence position information of both eyes of the observer, and the control system may control the focal distance of the first lens to form the best virtual image position close to a gaze convergence depth of the both eyes of the observer.
For an abnormal vision observer with nearsightedness or farsightedness, a vision correction value may be input to the control system to correct a position of the display corresponding to the set best virtual image position so that the best virtual image position is provided to the abnormal vision observer without wearing vision correction glasses.
The display position adjustment element may be a piezoelectric element configured to perform precise position control, a voice coil motor (VCM), or an LCD in which a refractive index thereof is changed according to an electrical signal to adjust an effective distance between the display and the first lens.
For an abnormal vision observer with nearsightedness or farsightedness, a vision correction value may be input to the control system to correct the focal distance of the first lens corresponding to the set best virtual image position so that the best virtual image position is provided to the abnormal vision observer without wearing vision correction glasses.
The first lens of which the focal distance is adjustable is a focus-tunable lens of which a precise focal distance is manually or electrically controllable, a polymer lens, a liquid lens, a liquid crystal lens, or a lens of which a refractive index is changed according to an electrical signal.
The display may include a plurality of pixels, adjacent pixels of each pixel may provide a first virtual image having first polarization and a second virtual image having second polarization which is orthogonal to the first polarization, the dynamic aperture adjustment element may include a polarization aperture set including a first aperture having the first polarization and a second aperture having the second polarization, and two virtual images of the display may be transferred to an eye pupil position of the observer through the polarization aperture set of the dynamic aperture adjustment element so that the exit pupil is expanded.
The first virtual image and the second virtual image may be parallax images.
The polarization aperture set of the dynamic aperture adjustment element may have two or more horizontal positions, and apertures at the horizontal positions of the dynamic aperture adjustment element may be sequentially operated in one frame virtual image according to the control signal from the control system to allow two or more exit pupils to be sequentially disposed so that the size of the exit pupil is enlarged.
The control system sequentially may provide two or more parallax images to the display in synchronization with a position change of the polarization aperture set of the dynamic aperture adjustment element so that different parallax images are disposed at positions of the exit pupils.
The near-eye display device may further include two external sight cameras, wherein an external image captured by the two external panorama cameras is combined with a virtual image in the display through the control system and provided to each of both eyes of the observer.
Information acquired by the pupil position tracking device may be transmitted to the control system, and the control system may provide an image of the two external sight cameras to each of the both eyes of observer as a parallax image for each eyeball through a dynamic aperture.
One or more near-eye display devices may be disposed with respect to a left eye and a right eye and may each further include a mirror configured to change an optical path between the dynamic aperture adjustment element and the main optics lens.
The near-eye display devices may be disposed with respect to a left eye and a right eye, respectively, and may each further include a polarization beam splitter between the dynamic aperture adjustment element and the main optics lens and further include a half-wave retarder between the polarization beam splitters, wherein, while light passing through a left side (or right side) dynamic aperture passes through the polarization beam splitter at a left side (or a right side) and the half-wave retarder, polarization thereof is converted, and the light is reflected by the polarization beam splitter at the right side (or the left side) and then travels to the main optics lens at a right side (or a left side).
The near-eye display device may further include a mirror configured to change an optical path between the dynamic aperture adjustment element and the polarization beam splitter.
According to another embodiment of the present invention, a near-eye display device include a display, a first lens disposed in front of the display so as to be spaced apart from the display by a predetermined distance, a dynamic aperture adjustment element disposed adjacent to the first lens to dynamically control an aperture size of the first lens and a horizontal position of an aperture thereof on a plane perpendicular to an optical axis, a reflective mirror disposed to be spaced apart from the first lens by a predetermined distance and configured to reflect a virtual image to a beam splitter, the beam splitter disposed such that a virtual image providing direction and an external viewing window direction do not interfere with each other and configured to allow the virtual image and an external image to be simultaneously provided to an observer, a trans-reflective concave mirror configured to reflect the virtual image to the observer and transmit the external image, and a control system configured to control the dynamic aperture adjustment element, wherein an eye pupil of the observer is positioned in an exit pupil disposed to be spaced apart from the trans-reflective concave mirror by a predetermined distance, and a size and a horizontal position of the exit pupil are determined according to a size and the horizontal position of the aperture of the dynamic aperture adjustment element which are adjusted according to a control signal from the control system.
The near-eye display device may further include a vision correction lens for an abnormal vision observer with nearsightedness or farsightedness provided on an outer surface of an external viewing window of the trans-reflective concave mirror.
The near-eye display device may further include a display position adjustment element configured to adjust a distance between the display position and the first lens, wherein the control system controls the display position adjustment element according to a set best virtual image position to adjust a best virtual image position.
The near-eye display device may further include a pupil tracking device configured to track an eye pupil position of the observer, wherein the control system uses pupil tracking information acquired by the pupil tracking device to control the display position adjustment element to form the best virtual image position close to a focus adjustment position of an eye of the observer.
The near-eye display device may further include a pupil tracking device configured to track an eye pupil position of the observer, wherein the control system uses pupil tracking information acquired by the pupil tracking device to control the focal distance of the first lens to form the best virtual image position close to a focus adjustment position of an eye of the observer.
Two pupil tracking devices may be provided and may track orientation point information of both eyes of the observer, and the control system may control the display position adjustment element to form the best virtual image position close to a convergence position of the both eyes of the observer.
Two pupil tracking devices may be provided and may track convergence position information of both eyes of the observer, and the control system may control the focal distance of the first lens to form the best virtual image position close to a convergence position of the both eyes of the observer.
For an abnormal vision observer with nearsightedness or farsightedness, a vision correction value may be input to the control system to correct a position of the display corresponding to the set best virtual image position so that a best observing position is provided to the abnormal vision observer without wearing vision correction glasses.
For an abnormal vision observer with nearsightedness or farsightedness, a vision correction value may be input to the control system to correct the focal distance of the first lens corresponding to the set best virtual image position so that a best observing position is provided to the abnormal vision observer without wearing vision correction glasses.
The near-eye display device may further include an external sight shielding component and two external sight cameras on an outer surface of an external viewing window of the trans-reflective concave mirror, wherein an external image captured by the two external sight cameras is combined with the virtual image in the display through the control system and provided to each of both eyes of the observer.
The external panorama shielding component may be an optionally detachable clip type or an element of which transmittance is adjustable according to an electrical control signal.
The external image of the two external sight cameras may be corrected in consideration of a corresponding eye pupil position of the observer and provided to each of the both eyes of the observer.
According to the present invention, a near-eye display device with an extended depth of focus can be implemented, and a size of a convergence area of a virtual image at an eye pupil position can be formed to be smaller than a pupil size changed according to a use environment, thereby providing a virtual image without degradation in image quality according to the pupil size.
In addition, even when a dynamic aperture having a partial size of an entire aperture is applied by applying a time division of a synchronized parallax image to the dynamic aperture having the partial size, a parallax image with a wide depth of focus can be additionally provided without reducing a size of an entire exit pupil.
Furthermore, a position of a reduced convergence area with a wide depth of focus at an eye pupil position (or a reduced exit pupil determined according to the convergence area) is changed by making reference to pupil position information of an eyeball, thereby continuously providing one best virtual image at some moment to a pupil of an eyeball within a farthest portion of an entire exit pupil.
In addition, a super multi-view image of a full parallax can be provided in a pupil in a time division method, thereby providing a virtual image similar to a hologram.
Furthermore, by applying an annular aperture that more efficiently controls a diffraction effect, it is possible to reduce the Airy radius due to a diffraction effect determined by diffraction at the same aperture size. Accordingly, a depth of focus range can be widened in the same optical system, and a modulation transfer function (MTF) value at a spatial frequency of a high frequency can be increased.
In addition, an observer having a (near-sighted or far-sighted) abnormal vision eyeball can efficiently view a virtual image without vision correction glasses by using a device of the present invention.
Furthermore, in an example in which an optical structure is applied to virtual reality (VR), augmented reality (AR), mixed reality (MR), or extended reality (XR), when the optical structure is applied to both eyes, a polarization beam splitter and a half-wave retarder are applied to light polarized by passing through a dynamic aperture, thereby reducing light loss and simultaneously reducing a volume of an entire optical system.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawings will be provided by the Office upon request and payment of the necessary fee.
Hereinafter, specific embodiments of the present invention will be described with reference to the accompanying drawings. In describing the present invention, detailed descriptions related to well-known functions or configurations obvious to those skilled in the art related to the present invention will be omitted in order to not unnecessarily obscure the essence of the present invention.
Referring to
The first lens 20 is disposed in front of the display 10 so as to be spaced apart from the display 10 by a first distance Dmd. The dynamic aperture adjustment element 30 is disposed adjacent to the first lens 20 to dynamically control a size Adl of an aperture of the first lens 20 and a horizontal position of an aperture thereof on a plane perpendicular to an optical axis. The dynamic aperture adjustment element 30 may be positioned between the display 10 and the first lens 20 or may be positioned between the first lens 20 and the main optics lens 40. In addition, when the first lens 20 may consist of several lens elements and groups, the dynamic aperture adjustment element 30 may be disposed inside the lens group. The main optics lens 40 is disposed to be spaced apart from the first lens 20 by a second distance Do. An exit pupil 50 is disposed at a position spaced apart from the main optics lens by a third distance De. The control system 60 (not shown) controls the dynamic aperture adjustment element 30.
Virtual image information provided from an entire area of the display 10 generates an intermediate image on an intermediate image plane Pi by using the first lens 20, and the generated intermediate image converges to an eye pupil of an observer at a predetermined distance (eye relief) De through the main optics lens. The near-eye display device has a basic configuration that allows the observer to view a virtual image at a predetermined distance Dbest determined in such a manner.
Here, when the intermediate image is generated on the intermediate image plane Pi in consideration of a distance relationship between the display 10 and the first lens 20, an image that is maintained in a ratio of 1:1, reduced, or enlarged may be generated. When the image is enlarged to be greater than a ratio of 1:1, a field of view (FOV) may be enlarged to be greater than a ratio of 1:1 in a state in which the predetermined distance (eye relief) De is maintained with the same display 10.
The first lens 20 and the main optics lens 40 are expressed as one thin lens (lens expressed as one principal plane) for convenience of description, but actually, the first lens 20 and the main optics lens 40 may be applied in the form of several lens elements and groups having the same effective focal distance to improve optical performance.
As shown in
The dynamic aperture adjustment element 30 may be disposed adjacent to the first lens 20, for example, in front or rear of the first lens 20, and the size Adl of a dynamic aperture and a horizontal position of an aperture on the plane (X-Y plane) perpendicular to the optical axis may be adjusted to control a size and a position of the common light distribution area. The size of the common light distribution area is defined by a spatial area in which light beams emitted from the entire area of the display 10 are commonly present. According to the adjusted common light distribution area, the size PDeye and horizontal position of the exit pupil 50 formed at an eye pupil position of an observer are determined.
The dynamic aperture adjustment element 30 may be a liquid crystal device (LCD) or an electronic shutter of which an aperture size and a horizontal position are changeable according to a control signal from the control system 60 (not shown). Specifically, in order to adjust the size Adl and the horizontal position of the dynamic aperture, an LCD of which transmittance is locally adjustable according to application of an electrical signal, or other elements used as various types of electronic shutters may be used.
A shape of the dynamic aperture adjustment element 30 may be a circular shape and may be an elliptical shape or a polygonal shape as necessary. A shape of the exit pupil 50 is the same as the shape of the dynamic aperture adjustment element and the size of the exit pupil 50 remains the same or is reduced according to a ratio. In the case of the example, a size of the exit pupil 50 is reduced to 1/3.
According to the present invention, in a dynamic aperture disposed adjacent to the first lens 20, a position and a size of the exit pupils 50, 51, 52, and 53 positioned at an eye pupil position of an observer can be adjusted by controlling a width size and a position of light that is generated from the display 10 to pass through the first lens 12. The exit pupils 50, 51, 52, and 53 correspond to a size PDeye of a convergence area of a virtual image. The size of the exit pupils 50, 51, 52, and 53 at an eye pupil position is directly related to a depth of focus (DOF) range of an eyeball. A specific relationship will be described as follows.
[DOF Range according to Size Adjustment of Exit Pupil]
Referring to
DOF Range ∝1/(PDeye) (Formula 1)
In order to express a clear virtual image from a virtual image at infinity (Dfar=zero diopters) to a near distance Dnear of about 333 mm to 1,000 mm, which is a distance at which an interaction with the virtual image is easy, a system having a DOF range of three diopters to one diopter is required.
To this end, it is necessary to implement a size PDeye of a convergence area of a virtual image within 2 mm. That is, in order to widen a DOF range, the control system 60 (not shown) may adjust the aperture size of the dynamic aperture adjustment element such that the size of the exit pupil 50 is within 2 mm, which is smaller than a pupil size of an observer.
[Adjustment of Horizontal Formation Position of Exit Pupil 50]
As an exit pupil 50 formed when a dynamic aperture is fully opened becomes smaller, a DOF range may be widened, but there is a problem of a reduction in horizontal position range in which a virtual image at an observer's eye position is visible.
In order to maintain a size of the exit pupil 50 when the dynamic aperture is fully opened, a position of the reduced dynamic aperture may be changed in real time by being combined with a time division dynamic aperture interlocking operation or a pupil position tracking device, thereby solving the problem of the reduction in size of the exit pupil 50.
According to the present embodiment, a near-eye display device with an extended DOF can be implemented, and a size of a convergence area of a virtual image can be formed to be smaller than a pupil size (of 2 mm to 8 mm) which is changed according to a use environment, thereby providing a virtual image without degradation in image quality according to a pupil size.
According to the present invention, by using a full resolution of the display, a virtual image, which is formed by being transferred through the first lens 20 and the dynamic aperture, can be provided at an eye pupil position of an observer.
[Spatial resolution of Virtual Image according to Display Resolution and FOV]
When a resolution of the display 10 is determined and an FOV of a virtual image of a designed optical system is determined, a spatial resolution of a virtual image viewed by an observer may be expressed by a density of a maximum line-space pair image in an angle unit, which may be generated by the virtual image. This may be expressed in a CPD unit.
A horizontal resolution (H_Resolution), a horizontal FOV (H_FOV), and a CPD value of a virtual image have a relationship as in Formula 2 below.
A specific application example of a design H_FOV value depending on a resolution of the display 10 is as shown in
For example, when a full high definition (FHD)-class (1920×1080) display is used to implement a virtual image with a horizontal FOV (H_FOV) of 32°, an image spatial resolution of 30 CPD may be provided. However, when a video graphics array (VGA)-class (640×480) display is applied, an image spatial resolution of 10.7 CPD, which is decreased to about 1/3 of 30 CPD, is provided.
According to the present embodiment, when virtual images having the same FOV are provided, a high spatial resolution virtual image can be provided to an observer as compared with the related art.
Referring to
In addition, the control system 60 sequentially provides two or more parallax images to a display in synchronization with changes in local aperture positions of the dynamic aperture adjustment element 30, thereby allowing different parallax images to be disposed at positions of two or more partial exit pupils in the exit pupil 50.
When a dynamic aperture is fully opened, the entire exit pupil 50 at an eye pupil position of an observer may be designed to have a size of 4 mm or more and thus may be designed such that a clearance according to a movement range of an eye pupil and an interpupillary distance of a user is sufficient.
The control system 60 determines a necessary size Adl of the dynamic aperture according to a depth range of a virtual image manually input by a user or a depth range automatically determined according to the type or need of a virtual image such as a two-dimensional text image or a three-dimensional virtual image, thereby transferring the determined size Adl to the dynamic aperture adjustment element 30.
In addition, when provided parallax images are provided to a display 10, the control system 60 synchronizes the partial exit pupils 51, 52, and 53 at an eye pupil position formed according to a dynamic aperture position and parallax images corresponding thereto, and provides sequentially them by dividing time within a frame, thereby allowing partial exit pupils 51, 52, and 53 in the entire exit pupil 50, in which different parallax images are provided to an observer, to be sequentially formed on a plane (X-Y plane) perpendicular to an optical axis.
Referring to
Although the above embodiment of the present invention has been described based on the dynamic apertures disposed in a straight line in one direction (Y-axis direction) perpendicular to an optical axis, the dynamic apertures may be two-dimensionally disposed on a plane (X-Y plane) perpendicular to the optical axis. Actually, in order to effectively use parallax images, it is efficient when apertures are disposed in the same direction as an arrangement of both eyes of an observer (Y-axis direction in the present embodiment), but in order to effectively increase the number of parallax images, dynamic apertures may be two-dimensionally disposed on the X-Y plane to increase the number of the partial exit pupils 51, 52, and 53 which provide parallax images.
In addition, in the above embodiment of the present invention, although a case in which the partial exit pupils 51, 52, and 53 formed by adjacent dynamic apertures are disposed adjacent to each other without empty space therebetween has been described as an example, there may be an empty space between adjacent exit pupils 51, 52, and 53, and when the number of parallax images is increased or the size Adl of the dynamic aperture is increased according to an adjustment of a DOF range, the adjacent exit pupils 51, 52, and 53 may be formed such that certain portions thereof overlap each other.
According to the present embodiment, in the present invention, in order to solve a problem in that a size of the entire exit pupil 50 is decreased due to a size of the partial exit pupils 51, 52, and 53 formed at an eye pupil position being formed within 2 mm so as to widen a DOF range by applying a dynamic aperture, a combination of two or more partial exit pupils 51, 52, and 53, which provide parallax images with an extended DOF range, can be made in the entire exit pupil 50. Accordingly, in the above embodiment, even when a dynamic aperture having a partial size of an entire aperture is applied, a parallax image having a wide DOF range can be additionally provided without reducing the size of the entire exit pupil 50.
Referring to
When a pupil center of an eyeball of the observer is near a center of an optical axis, and when a center of a dynamic aperture is set on the optical axis, the partial exit pupil 51 is formed at a position near the pupil center of the eyeball due to a common light distribution formation area C1 formed by the dynamic aperture.
An entire exit pupil 50 at an eye pupil position of an observer, which is formed when the dynamic aperture is fully opened, may be designed to have a size of 4 mm or more, and thus, the entire exit pupil 50 may be designed such that a clearance according to a movement range of a pupil and an interpupillary distance of a user is sufficient.
The control system 60 determines a necessary size Adl of the dynamic aperture according to a depth range of a virtual image manually input by a user or a depth range automatically determined according to the type of a virtual image (such as a two-dimensional text image or a three-dimensional virtual image), thereby transferring the determined size Adl to the dynamic aperture adjustment element 30.
Referring to
When the pupil tracking device 70 for tracking an eye pupil position of an observer in real time transmits pupil position information of an eyeball to the control system 60 in real time, the control system 60 changes a size Adl of a dynamic aperture determined according to a DOF range and a center position of the dynamic aperture corresponding to a center position of an eye pupil of an observer to change positions of the dynamic partial exit pupils 51, 52, and 53 at the eye pupil position in real time. In the present embodiment, a center position of a dynamic aperture is shifted on a plane (X-Y plane) perpendicular to the optical axis, and the center position of the dynamic aperture on the plane is in a direction opposite to an eye pupil movement of an observer.
That is, when the observer moves in a +Y-direction, the dynamic aperture is moved in a −Y-direction, and an amount of movement is determined according to a design of a ratio of a second distance Do to a third distance De of an optical system. For example, when the ratio of the second distance Do to the third distance Do is 2:1, the center position of the dynamic aperture may be shifted by 2 mm in order to move the dynamic partial exit pupils 52 and 53 at an eye pupil position by 1 mm.
Referring to
Referring to
Embodiments of a coupling structure of dynamic aperture control and a pupil tracking device and an operating method of the present invention will be described as follows.
[When Eye pupil Center of Observer Exceeds Range of Available Entire Exit Pupil 50]
Specifically, in the situations of
According to the present embodiment, in the preceding embodiment, the partial exit pupils 51, 52, and 53 having parallax images are formed by applying a time division to the entire exit pupil 50 without eye pupil tracking, thereby providing a parallax image and a virtual image with a wide DOF range while using most of the entire exit pupil 50, but in the present embodiment, positions of the reduced partial exit pupils 51, 52, and 53 with a wide DOF range at an eye pupil position are changed by making reference to pupil position information of an eyeball, thereby continuously providing a best virtual image to an eye pupil within a farthest portion of the entire exit pupil 50.
Hereinafter, a dynamic aperture being controlled by simultaneously using a parallax image provision and eye pupil tracking information according to a fourth embodiment of the present invention will be described.
When an embodiment in which three parallax images are dynamically formed is described as an example with reference to
However, when a center position of an eye pupil is shifted to the outside of the entire exit pupil 50 that is controllable with a dynamic aperture, as described in the third embodiment, the partial exit pupil 52 that provides a central parallax image cannot be aligned with a pupil center, and as in the method described in the third embodiment, a parallax image is provided to the farthest partial exit pupil 52 or 53 (see
Referring to
In the above-described embodiment, a case in which an eye pupil position is shifted only in a one-dimensional direction has been described as an example, but actually, a pupil may be two-dimensionally moved on a plane (X-Y plane) perpendicular to an optical axis of an optical system. In this case, in order to effectively allow a moving speed of a pupil to correspond to a reaction speed of dynamic apertures, positions of the plurality of dynamic apertures may be variously set.
Among these,
According to embodiments of the present invention, when parallax images, in which a two-dimensional dynamic aperture and a time division are used, are two-dimensionally provided, a super multi-view images with full parallax can be provided in a pupil, thereby simulating artificial light focusing and defocusing to provide virtual images similar to a hologram.
Hereinafter, a DOF range adjusting method and an operation structure according to a fifth embodiment of the present invention will be described with reference to
Referring to
As described above with reference to
As described in the first embodiment, by adjusting the size Adl of a dynamic aperture, the exit pupil at the eye pupil position can be adjusted to one of the partial exit pupils 51, 52, and 53 which is a part of the size of an entire exit pupil 50, thereby the size PDeye of the convergence area of the image point of the virtual image may be adjusted.
In the embodiment of
The present embodiment corresponds to a case in which a DOF range is three diopters, and when the size PDeye of the convergence area at the image point of the virtual image is 0.978 mm, the diffraction Airy radius and the geometric blur radius have the same radius value of 12.12 μm. In this case, a wavelength λ and an effective axial eye length deye of an eyeball used for calculating in embodiments of the present invention are 0.587 μm and 16.535 mm.
A configuration for determining a range of the size PDeye of the convergence area according to a DOF range will be described in detail as follows.
When the DOF range is determined as described above, the optimal size PDeye of the convergence area has a value at which a diffraction Airy radius is equal to a geometric blur radius on the eye retina. In this case, an MTF characteristic when an eye is focused on the best virtual image position Dbest is not the same as an MTF characteristic when a focus is adjusted on the nearest distance or farthest distance Dn or Df, and as shown in
As a result, according to a maximum spatial frequency value of the virtual image implemented in consideration of a resolution of a display and FOV of a designed optical system, the optimal size PDeye of a convergence area of an image point of a virtual image, which is defined in a condition in which diffraction Airy radius is equal to geometric blur radius, may vary depending on the designed maximum spatial frequency value.
A cut-off spatial frequency of an MTF determined according to an optical design may be changed, but changes in MTF values according to the spatial frequency in which the cut-off spatial frequency is normalized to one are the same. Accordingly, a maximum usable spatial frequency in consideration of observer's visibility in a designed optical system actually has an MTF value of 0.1 to 0.3.
As shown in the result, the size PDeye of the convergence area of the image point of the virtual image, at which a maximum spatial frequency is provided according to a reference MTF value, is changed from a best condition. Such a range is about ±20% of the optimal size PDeye of a convergence area of an image point of a virtual image. Within the range, it is possible to adjust and use the size PDeye of the convergence area of an image point of a virtual image, which is determined according to a suitable DOF range according to the priority of optical design.
Therefore, a control system 60 (not shown) may adjust an aperture size of a dynamic aperture adjustment element according to a set best virtual image position and the DOF range to adjust a size of an exit pupil at eye pupil position such that a nearest image blur size of an image point formed on a retina at a nearest focus position of an eye is equal to a farthest image blur size of an image point formed on a retina at a farthest focus position of an eye, the nearest image blur size and the farthest image blur size are in a range of ±20% of the same value as an image blur size (Airy disk) due to diffraction, and a best position of an image point of a virtual image is an arithmetic mean position of the nearest focus position and the farthest focus position of the eye in a diopter unit.
The adjustment of a DOF range and a best virtual image formation position according to the present invention will be described as follows with reference to
When a DOF range is determined according to a size PDeye of a convergence area of an image point of a virtual image as described above, a best virtual image formation position Dbest is determined as an arithmetic mean position of a nearest distance Dn and a farthest distance Df of the DOF range (Dbest=(Dn+Df)/2). In this case, each distance unit is a diopter unit. When being expressed in a distance unit in meters, it should be noted that the best virtual image formation position Dbest does not have a relationship with an arithmetic mean of farthest distance and nearest distance of a DOF range.
In embodiments of the present invention,
A principle of improving optical characteristics according to a change in shape of a dynamic aperture (annular aperture) will be described as follows with reference to
As shown in
Although the dynamic aperture according to the preceding embodiments has been basically described based on a circular aperture (β=0), when an annular aperture, in which a diffraction effect is more efficiently controlled, is applied, it is possible to reduce a diffraction Airy radius determined by diffraction at the same aperture size. Accordingly, a DOF range can be widened in the same optical system, and an MTF value in a high spatial frequency area can be increased.
Referring to
However, even in this case, in the case of having the same dynamic aperture size Adl (i.e., when Adl=2a and β=0), a size of a partial exit pupil 51 at an observer pupil position determined geometrically or a size PDeye of a convergence area of an image point of a virtual image determined by the partial exit pupil 51 may remain the same. However, when a dynamic aperture has an annular shape, a diffraction Airy radius can be decreased in a spatial frequency area of a high frequency, thereby improving optical characteristics. It is noted that, in an annular dynamic aperture, a condition at which a diffraction Airy radius is equal to a geometrical blur radius is changed and thus depending on the designed DOF range, the optimum condition or optimum range of the aperture is different from those of the general aperture of the preceding embodiments.
A case in which β is 0 corresponds to a general dynamic aperture condition of the preceding embodiments, and as β is increased, a diffraction Airy radius is decreased. As a result, there is an advantage in that a DOF range is increased at the same size PDeye of a convergence area of a virtual image. However, there is a problem in that image quality is degraded due to a decrease in center peak value (Strehl ratio) of a point spread function (PSF) of an image point formed on a retina of an eyeball, and there is a problem in that an amount of light is decreased due to an increase in β at the same aperture size Adl.
Regarding consideration of conditions for a best use range of β, when a decreased amount of light is within 20%, light loss is not a big problem in practical applications, and when a Strehl ratio of a PSF in consideration of user's visibility is greater than or equal to 0.8 (approximately based on a Rayleigh's quarter wave criterion), there is no problem.
β that satisfies the two conditions is 1/3. In this case, about 89% of light may be used as compared with a case in which β is 0, a user may not feel degradation in image quality with user's visibility, and a DOF range may be widened to be about 12.5% at the same size PDeye of the convergence area at the image point of the virtual image. Therefore, when a β value of an annular aperture according to the present invention is applied to the present invention, a value of about 1/3 can be optimally applied to β, and the (3 value can be applied within 1/3 according to the importance of a DOF range and light amount adjustment.
A use range of β according to MTF characteristics according to a spatial frequency for comprehensively determining optical characteristics of a virtual image will be described as follows with reference to
It is appropriate that an β value in consideration of an MTF according to a spatial frequency is set to a maximum β value at which characteristics, in which an MTF value is monotonically decreased as a spatial frequency is increased, are exhibited. A β value that satisfies this is 0.45. In this case, an amount of light is about 80% as compared with a case in which a β value is zero, and a Strehl ratio of a PSF is decreased to 0.64, and thus, some deterioration in image quality is felt as compared with the circular dynamic aperture (β=0). However, this is a condition applicable when considering a DOF range and a spatial frequency of a high frequency (at which a virtual image with increased resolution is provided).
Therefore, in the annular dynamic aperture according to the present invention, it is appropriate that β is within 1/3, but when visible spatial resolution or a DOF range becomes more important, β can extend to 0.45.
A control system 60 may adjust an aperture size of a dynamic aperture adjustment element 30 to be widened so as to decrease a DOF range at a best virtual image position set according to a type of virtual image and to provide an image with increased resolution.
A size PDeye of a convergence area at an eye pupil position should be decreased so as to widen a DOF range, but as the size PDeye of the convergence area of an image point of a virtual image is decreased, a diffraction effect is increased, thereby reducing spatial resolution that may be provided by an optical system. Visible maximum spatial resolution is determined according to a resolution of a display and an FOV used in an optical system (see
A size PDeye of a convergence area of an image point of a virtual image at an eye pupil position and a diffraction Airy radius satisfy Formula below.
Here, λ refers to a wavelength, and deye refers to a distance between an eye lens and a retina. In this case, a wavelength λ and an effective axial eye length deye of an eyeball used for calculating in embodiments of the present invention are 0.587 μm and 16.535 mm.
According to the present embodiment, when a high definition virtual image with many fine patterns is provided or a virtual image for mainly expressing a two-dimensional image such as a text is provided according to a type of virtual image, in the preceding embodiments, a DOF range is automatically decreased by the control system 60 or decreased by a user (that is, a size PDeye of a convergence area of an image point of a virtual image is adjusted to be increased), thereby allowing the user to conveniently view a virtual image requiring high resolution.
A specific embodiment of a DOF range adjustment and a spatial resolution adjustment will be described with reference to
For example, when a DOF range is one diopter, a first optimal size PDeye1 of a convergence area of an image point of a virtual image is 1.693 mm, and when the DOF range is three diopters, a second optimal size PDeye2 of a convergence area of an image point of a virtual image is 0.9776 mm.
The size PDeye1 of the convergence area of the image point of the first virtual image at an eye pupil position is proportional to a size Adl of a dynamic aperture of a dynamic aperture adjustment element disposed adjacent to a first lens, which is determined according to a ratio of Do:De of an optical system. In the example of
Therefore, in the case of one diopter, the size Adl of the dynamic aperture is 5.08 mm, and in the case of three diopters, the size Adl of the dynamic aperture is 2.933 mm. In this case, when an ideal diffraction limit (Airy radius) is calculated by applying an equation of Formula 3, the ideal diffraction limit is increased from 7 μm at one diopter to 12.12 μm at three diopters.
From the above results, when the DOF range is decreased from three diopters to one diopter, it is possible to implement a system which has increased brightness as well as increased maximum spatial resolution (which corresponds to a Rayleigh criterion and is a maximum spatial resolution at which two adjacent pixels are distinguishable from each other in consideration of diffraction).
In the above case, the DOF range of one diopter is three times brighter than the case of three diopter (as shown in Formula 1, a DOF range is inversely proportional to a square of a convergence area), and as a diffraction effect is decreased, maximum spatial resolution is increased by about 1.72 times.
In addition, even though a spatial frequency actually used in consideration of a resolution of a display and an FOV of a designed optical system uses a smaller area, an increase in maximum spatial resolution gives an effect of increasing an MTF value at a corresponding spatial frequency, thereby providing a higher contrast ratio of a virtual image to implement a clearer image.
A dynamic aperture size adjustment according to the seventh embodiment of the present invention will be described in detail as follows.
When a DOF range is determined, a dynamic aperture size is determined in a condition for imparting a necessary size PDeye of a convergence area of an image point of a virtual image at an eye pupil position. A size Adl of a dynamic aperture and the size PDeye of the convergence area of the image point of the virtual image are in a proportional relationship and are determined according to a ratio of Do:De of an optical system. Specifically, a relationship between the size Adl of the dynamic aperture and the size PDeye of the convergence area satisfies Formula 4 below.
Therefore, when an optical system providing virtual image is determined, the size Adl of the dynamic aperture according to the size PDeye of the convergence area of the image point of the virtual image, which is required for each DOF range to be applied, may be recorded in an internal look-up table, or a simple formula calculation may be applied.
For a change of the size Adl of the dynamic aperture, when a user manually sets a DOF range, the control system 60 may change the size Adl of the dynamic aperture through the dynamic aperture adjustment element 30.
In another embodiment, according to a type of content used by a user (when a wide DOF range is required or when a high resolution image as in a text is required at a specific distance), the control system 60 may automatically adjust the size Adl of the dynamic aperture by selecting a necessary DOF range according to the type of content.
The dynamic aperture adjustment element 30 is a device which is disposed adjacent to a first lens (disposed in front or rear of the first lens) and adjusts an area of light of a virtual image, which passes through the first lens, according to the information of the dynamic aperture size Adl received from the control system.
The dynamic aperture adjustment element 30 should adjust a position and size of an area, through which light passes, according to an electrical signal. Specifically, an LCD may be used, and among elements suitable to be applicable as an optical shutter, a ferroelectric liquid crystal (FLC) element capable of being operated at a high speed may be easy to use. In addition, other elements capable of adjusting a size and position of a transmission area thereof according to an electrical signal may be used as a dynamic aperture of the present invention.
Since
Referring to
Virtual image information generated by the display 10 forms an intermediate image between the first lens 20 and a main optics lens 40, and when an intermediate image formation position from the main optics lens is the same as that of a focal distance of the main optics lens, a focus adjustment distance of an eye spaced apart from the main optics lens by an eye relief becomes an infinite distance (zero diopters).
When Dobj0 denotes a distance from the main optics lens to a reference intermediate image formation position I0 at which an infinite distance virtual image is provided to an observer, the intermediate image formation position for an infinite distance is determined according to a focal distance of the first lens 20 and a distance between the display 10 and the first lens 20 through a lens equation. Accordingly, a distance Dmd0 between a reference display position P0 and the first lens is determined.
When the determined reference display position P0 is changed to a position P1 close to the first lens 20 (i.e., when a condition of Dmd1<Dmd0 is satisfied), the reference intermediate image formation position is changed from I0 to I1, and thus, a distance to the main optics lens 40 is decreased. As shown in the drawing, a condition of Dobj1<Dobj0 is satisfied.
In this case, I1 is at a distance that is shorter than the focal distance of the main optics lens, which becomes a condition in which a virtual image is generated, and as a distance of the position I1 from a reference position is increased, a position of a virtual image approaches to the main optics lens 40. The position of the virtual image according to the intermediate image formation position is the best position Dbest of the virtual image viewed from an eye.
Therefore, the display position P0 is adjusted to the position P1 so as to be close to the first lens 20 spaced apart from the reference position by a predetermined distance, thereby changing the best position Dbest of the virtual image.
In
Referring to
Virtual image information generated by the display 10 forms an intermediate image between the first lens 20 and a main optics lens 40, and when an intermediate image formation position from the main optics lens is the same as that of a focal distance of the main optics lens, a focus adjustment distance of an eye spaced apart from the main optics lens by an eye relief becomes an infinite distance (zero diopters).
When Dobj0 denotes a distance from the main optics lens to a reference intermediate image formation position I0 at which an infinite distance virtual image is provided to an observer, the intermediate image formation position for an infinite distance is determined according to the focal distance of the first lens 20 and a distance between the display 10 and the first lens 20 through a lens equation. Accordingly, when a distance Dmd0 between a display position and the first lens is determined, the intermediate image formation position is determined according to the focal distance of the first lens.
At the determined distance between the display position and the first lens 20, the focal distance of the first lens may be adjusted to fL0 to adjust the intermediate image formation position to be I0. In order to change the intermediate image formation position to I1 close to the main optics lens 40, a focal distance should be changed to be longer as compared with the previous case. Such a relationship may be calculated using a lens equation. In this case, I1 is at a distance that is shorter than the focal distance of the main optics lens, which becomes a condition in which a virtual image is generated, and as a distance of the position I1from a reference position I0 is increased, a position of a virtual image approaches the main optics lens 40. The position of the virtual image according to the intermediate image formation position is the best position Dbest of the virtual image viewed from an eye.
Therefore, the best position of the virtual image may be changed by fixing the distance between the display position and the first lens and adjusting the focal distance of the first lens 20.
Referring to
As an example according to the embodiment of the present invention,
Referring to
As an example according to the embodiment of the present invention,
Referring to
Alternatively, when a user manually inputs best position information of a virtual image, the control system 60 may transmit display adjustment position information corresponding to the best position information to the position adjustment element 80 for controlling a position of the display 10 and adjust the position of the display 10 through the position adjustment element 80, thereby adjusting a best virtual image formation position.
Referring to
Alternatively, when a user manually inputs best position information of a virtual image, the control system 60 may transmit focal distance information corresponding to the best position information to the first lens, thereby adjusting a best virtual image formation position.
Referring to
In addition, referring to
When one pupil position tracking device 70 is used in the preceding embodiments, and when only position information of a pupil center of a single eye is used, it may be difficult to determine a gaze depth of both eyes of an observer. In order to overcome the difficulty, as embodiments of the present invention, the pupil tracking devices 71 and 72, which apply an algorithm for tracking the pupil orientation direction of both eyes of the observer, may be used to calculate an distance at which both eyes converge, and the calculated distance may be determined as a best focal distance of an observer's gaze, thereby providing information about best virtual image formation position to the control system 60.
Meanwhile, the display position adjustment element of
Meanwhile, a type of the first lens capable of controlling a focal distance adjustment according to a control signal from the control system of
In the previous embodiments, it has been described that a distance between a display and a first lens (fixed focal distance lens) can be controlled by a control system in order to change a best formation position of a virtual image, and apart from this, a focal distance of a first lens can be controlled while maintaining a distance between a fixed display and the first lens (variable focal distance lens). Although it will not be described in detail in the present invention, two such technologies of the present invention can be driven in a time division manner to implement two or more best formation positions of a virtual image within one frame. Thus, it is possible to effectively widen a DOF range of a virtual image. On the other hand, in order to widen a DOF range at one best formation position of a virtual image, a size of an exit pupil at an eye pupil position should be decreased, which causes loss of an amount of light entering an eye pupil and a decrease in resolution of a virtual image due to an increase in diffraction limit. As an alternative capable of overcoming such disadvantages, forming two or more best formation positions of a virtual image in a time division manner has an advantage.
Referring to
Referring to
An adjustment of a best position of a virtual image in the preceding embodiments has been described based on an observer having a normal vision eyeball, but actually, many observers do not have normal vision without vision correction glasses (lenses). In addition, when a near-eye display device of the present invention is used by wearing vision correction glasses, there is inconvenience in using the device, and also, when sufficient eye relief is not secured according to a design of an optical system, it is difficult to see the optimal virtual image.
In the present embodiment, in order to solve such problems, the device of the present invention is used without vision correction glasses, thereby allowing an observer having an abnormal vision eyeball such as a near-sighted or far-sighted eyeball to properly view a virtual image.
In the case of nearsightedness, an image is formed in front of a retina (when a focal distance of an eye lens is shorter than an average or an axial eye length is longer than the average), and on the contrary, in the case of farsightedness, an image is formed in rear of a retina (when a focal distance of an eye lens is longer than an average or an axial eye length is shorter than the average), which are called a refractive power error of an eyeball and can be corrected using a vision correction lens.
Referring to
Farsightedness corresponds to a case in which a focal distance of an eye lens at the time of maximum relaxation is too long with respect to an object at an infinite distance (or when optical power is too low). By using a lens (convex lens) with positive optical power as a correction lens, a real image of the object at the infinite distance is allowed to be placed at a predetermined distance Sf2 in rear of the correction lens to allow light of the object at the infinite distance to converge at an eye lens position by as much as vision correction value, thereby being properly focused on a retina of a far-sighted user.
Referring to
Specifically, when a distance between the display 10 and the first lens 20 is adjusted to Dmd0) to adjust an intermediate virtual image formation position to be spaced apart from a main optics lens by a focal distance of the lens in front of the main optics lens (condition of I0=fmo), a normal vision user at a position spaced apart from an optical system by an eye relief De can observe a virtual image at an infinite position. Such positions become a reference display position Dmd0) and an intermediate virtual image formation position I0, at which a virtual image is provided to a normal vision eye.
In order to provide an infinite distance virtual image to a near-sighted user, a virtual image position I1 is formed closer to a main optics lens 40 than a virtual image reference position I0 of normal vision to allow light entering an eye lens to be properly focused on a retina with the same principle of correction glasses for a near-sighted eye described above so that the near-sighted user can view the infinite distance virtual image properly. In order to implement this, the position of the display 10 is adjusted to Dmd1 which is closer to the first lens 20 than a position of the normal vision.
In order to provide an infinite distance virtual image to a far-sighted user, a virtual image position I2 is formed farther away from the main optics lens 40 than the virtual image reference position I0 of the normal vision to allow light entering an eye lens to be properly focused on a retina as the same principle of correction glasses for a far-sighted eye described above so that the far-sighted user can view the infinite distance virtual image properly. In order to implement this, the position of the display 10 may be adjusted to Dmd2, which is farther away from the first lens 20 than a position of the normal vision.
In the above, unlike a normal vision eye, it has been described that a reference position of an infinite distance virtual image is corrected based on a reference position of a display with respect to a near-sighted eye and a fart-sighted eye. When Dbest approaches an infinite distance based on such a position, a display position can be changed by reflecting a virtual image formation position from a reference display position of each user.
The control system 60 (not shown) may transmit display position information according to a best position of a virtual image to a position control element by making reference to a stored data table with respect to a reference display position (reference position with respect to an infinite distance object) for each corrected vision reflecting the above contents.
Referring to
Referring to
This is an embodiment in which vision of the abnormal vision users is corrected with respect to a virtual image, and when the present invention is used as an augmented reality (AR) device in which an external real object needs to be viewed together with a virtual image, a separate vision correction of an abnormal vision user is required with respect to the external real object. When the present invention is used as the AR device, a method of correcting vision of a user with respect to an external real object will be described as a twelfth embodiment to be described below.
Referring to
This is an embodiment in which vision of abnormal vision users is corrected with respect to a virtual image, and when the present invention is used as an AR device in which an external real object needs to be viewed together with a virtual image, a separate vision correction of an abnormal vision user is required with respect to the external real object. When the present invention is used as the AR device, a method of correcting vision of a user with respect to an external real object will be described as the twelfth embodiment to be described below.
Referring to
Specifically, a display 10 includes a plurality of pixels, and adjacent pixels of each pixel provide a first virtual image having first polarization and a second virtual image having second polarization which is orthogonal to the first polarization. A dynamic aperture adjustment element 30 includes a polarization aperture set including a first aperture having the first polarization and a second aperture having the second polarization. Two virtual images of the display 10 may be transferred to an eye pupil position of an observer through the polarization aperture set of the dynamic aperture adjustment element 30 so that an exit pupil may be expanded. The first virtual image and the second virtual image may be parallax images.
In addition, the polarization aperture set of the dynamic aperture adjustment element 30 may have two or more horizontal positions, and apertures having different horizontal positions of the dynamic aperture adjustment element 30 may be sequentially operated in one frame virtual image according to a control signal from a control system 60 (not shown) to sequentially arrange two or more exit pupils, thereby enlarging a size of the exit pupil.
In addition, the control system 60 (not shown) may sequentially provide two or more parallax images to the display 10 in synchronization with a horizontal position change of the polarization aperture set of the dynamic aperture adjustment element 30, thereby arranging different parallax images at positions of the exit pupils.
Hereinafter, a method of using a polarization division will be described in more detail.
When some pixels of an element of the display 10 have the first polarization (circular polarization or linear polarization) and the remaining pixels thereof have the second polarization (circular polarization or linear polarization) orthogonal to the first polarization, and when the dynamic apertures include a first aperture having the same polarization direction as the first polarization and a second aperture having the same polarization direction as the second polarization, even if there is no time division, it is possible to provide two parallax images to an eye pupil of a user and also provide a virtual image in which a DOF range is wide and an exit pupil is expanded.
On the other hand, since an entire resolution of the display is divided in half, a virtual image passing through the first aperture and the second aperture of the dynamic apertures is formed to have decreased resolution. However, since currently available displays have a full HD resolution (1920×1080), even when resolution is divided in half for each parallax image, degradation in image is not a big problem, and when high definition displays with a resolution of 4K or more are developed in the future, an image with FHD resolution or more may be provided for each parallax image.
Moreover, it is also possible to use a polarization division and a time division at the same time. For example, an embodiment in which two polarization aperture sets are applied may be used in combination with the preceding first to third embodiments. When the embodiments are used in combination, the number of parallax images in an exit pupil can be effectively increased while a DOF range is wide. For example, when a polarization division (two orthogonal polarization apertures used as one dynamic aperture set) and three dynamic aperture sets are sequentially driven within one frame in a time division manner, six parallax images can be provided.
In the preceding embodiments, for convenience of description, an operating principle and a virtual image controlling method of the present invention have been described based on the first lens 20 and the main optics lens 40 expressed as thin lenses, but each lens may be used as a group of several lenses in order to actually apply the present invention.
In particular, when technology of the present invention is used as the AR device, since a position of a display 10 for providing a virtual image should not block an external viewing window, it is necessary to additionally use an optical path changing element such as a mirror or a beam splitter.
A dynamic aperture adjustment element 30 may be disposed near a center position of the double Gauss Lens system. In addition, the position of the display 10 may be adjusted by a position adjustment element 80 in order to change a best virtual image formation position.
An AR structure according to the present invention may be mainly divided into two parts and may be divided into a multi-focus (MF) optics module and a basic AR optical system. As a specific operating method of the MF optics module, the operating method of the preceding embodiments may be applied, and light passing through the lens system 20 is reflected by the reflective mirror 90 to travel to the AR optical system. In the AR optical system, light reflected by the beam splitter 420 is reflected again by the trans-reflective concave mirror 410 to travel to an eye of a user. Although not shown in the drawing, as in the previous embodiments, a pupil tracking system may be additionally provided.
In an MF Optics module, even when the visual acuity of a user is not normal vision (nearsightedness/farsightedness), the visual acuity of the user may be corrected by adjusting a display position, thereby providing a specific distance virtual image (see the preceding embodiments for detailed descriptions of vision correction).
However, when the present invention is applied as an AR device, it is necessary to properly view an external real object and a virtual image at the same time. To this end, a lens for correcting vision of a user may be additionally provided in front of an external viewing window of an AR optical system. When a user wears a vision correction lens and uses a device, since an eye relief is not sufficient, it may be difficult to observe a best optimal image. Such inconvenience can be solved through the above configuration.
Referring to
In addition, for the abnormal vision observer with nearsightedness or farsightedness, a vision correction value is input to a control system 60 (not shown) to correct a position of a display 10 or a focal distance of a first lens 20, which corresponds to a set best virtual image position, thereby providing a best observing position to the abnormal vision observer without wearing vision correction glasses.
In addition, the external images of the two external sight cameras 110 may be corrected in consideration of a corresponding eye pupil position of the observer to be provided to both eyes of the observer.
In addition, two observer pupil position tracking devices may also be provided. Information acquired by each pupil position tracking device may be transmitted to the control system 60 (not shown), and the control system 60 (not shown) may compare positions of both eyes of the observer with positions of two external sight cameras 110 to correct corresponding external images. In this case, a virtual image, in which a captured external image and a stored virtual image are combined with each other, may be provided to an observer.
In this case, in order to optionally apply an external sight shielding component positioned on an outer surface of the external viewing window, clip-type sunglasses or the like may be used as a shielding component, and sunglasses of which transmittance is adjustable according to an electrical signal may be used.
In order to implement a structure of an MR or XR-dedicated device using technology of the present invention, a virtual reality (VR) optical system structure, to which the preceding embodiments of
In the embodiments of
When compared with
The protected scope in the present field is not limited to the description and the expression of the embodiments explicitly described above. In addition, it is added again that the protected scope of the present invention is not limited by obvious changes or substitutions in the technical field to which the present invention belongs.
Number | Date | Country | Kind |
---|---|---|---|
10-2020-0083211 | Jul 2020 | KR | national |
10-2021-0006699 | Jan 2021 | KR | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/KR2021/003528 | 3/22/2021 | WO |