This disclosure relates generally to optical systems, and in particular but not exclusively, relates to optical systems for head wearable displays.
A head mounted display (“HMD”) or head wearable display is a display device worn on or about the head. HMDs usually incorporate some sort of near-to-eye optical system to create a magnified virtual image placed between a meter or so (near) and optical infinity (distant) in front of the user. Single eye displays are referred to as monocular HMDs while dual eye displays are referred to as binocular HMDs. Some HMDs only permit the user to see a display image (e.g., computer generated image, still image, video image, etc.) while other types of HMDs are capable of superimposing the display image over a real-world view. The type of HMD that shows a real-world view combined with a display image typically includes some form of see-through eyepiece and can serve as the hardware platform for realizing augmented reality. With augmented reality the viewer's perception of the world has added to it an overlaying display image. This type of system is sometimes also referred to as a head-up display (“HUD”). Fully immersive displays (i.e., not see-through) are often referred to as virtual reality (“VR”) displays. Immersive HMDs can also provide augmented reality by electronically combining images from a camera or other sensors that are viewing the world in front of the user, fused with other electronic imagery or information.
HMDs have numerous practical and leisure applications. Aerospace applications permit pilots to see vital flight control information without taking their eyes from the flight path. Public safety applications include tactical displays of maps and thermal imaging. Other application fields include video games, transportation, and telecommunications. There are certain to be newly found practical and leisure applications as the technology evolves; however, many of these applications are limited due to the cost, size, weight, field of view, and efficiency of conventional optical systems used to implement existing HMDs.
Non-limiting and non-exhaustive embodiments of the invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles being described.
Embodiments of an apparatus, system, and method of operation for a hybrid optical system that uses both an aspherical lens for foveal perception and a Fresnel lens for peripheral vision to provide a wide field of view suitable for head wearable displays are described herein. In the following description numerous specific details are set forth to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects.
Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
This disclosure is separated into two parts. Part 1, including
Part 1: Terminology & Design Concepts
A. Inter-pupillary Distance Considerations
Human inter-pupillary distance (IPD) is defined as the distance between the centers of the pupils of the left and right eyes (see
Human IPD ranges from 52 mm to 75 mm for most of the adult population. Therefore, to fit the narrowest likely adult IPD, we have 26 mm between the pupil and the mid-sagittal frontal plane (see
B. Visual Acuity and Pixel Size
A Snellen visual acuity of 20:20 corresponds to an angular resolution of 1 minute of arc. Visual acuity of 20:40 corresponds to a resolution of 2 minutes of arc. For a person with normal vision (20:20), the retina cannot distinguish a difference between an emitting object subtending 1 min of arc and an emitting object subtending less than 1 min of arc. Therefore, for a person with 20:20 vision, any image of a pixel (which is an emitting object) that subtends less than 1 minute of arc will nevertheless be perceived as subtending 1 minute of arc, owing to the size and spacing of the cones on the retina. Therefore, if designing for 20:20 acuity, there are few reasons to design systems that employ pixels whose images subtend less than 1 min of arc.
A second factor related to visual acuity is the quality of the optical system. In order to create a system that delivers 20:20 vision, the optical system should be capable of providing magnification without blurring pixels that are separated by only 1 min of arc. However, very high performance lenses are often very narrow in diameter and thus not well suited to a wide FOV system. A wide FOV is desirable in a head wearable display.
C. Binocular Overlap
In binocular displays, individual virtual images are created for the left and right eyes by a left display and lens, and a right display and lens. The left and right virtual images may completely or partially overlap, depending on the FOV of the optics. The binocular overlap region is defined as the region of the left and right virtual images that overlap geometrically.
The binocular overlap region is limited on the left by the edge of the virtual image perceived by the right eye looking left across the sagittal plane, and limited on the right by the edge of the virtual image perceived by the left eye looking right across the sagittal plane.
The eye turns comfortably over a range of 0 to 15 degrees in any direction. Accounting for a further 2.5 degrees for half the foveal region, the lower acceptable value of θ is about 18 degrees. However, 18 degrees may be too narrow to establish a satisfactory degree of presence. To allow even further eye motion into an uncomfortable but useful range, a more desirable value for θ is 30 degrees, and an upper useful value is likely about 45 degrees (it may vary from person to person).
Once the value of θ is chosen, the number of pixels in the half angle region needed for 20:20 acuity can be determined by dividing the half angle by the pixel subtense. For example, if the half angle is 30 degrees, the number of pixels in the half angle is 1800. For the full 60 degree FOV in the binocular overlap region, 3600 pixel columns should be in the display. For θ of 45 deg, 2700 pixel columns should be between the eye and the sagittal plane to fill the half angle region, and 5400 are needed for a 90 degree binocular overlap region.
Another design consideration is whether the full binocular overlap region is to have 20:20 visual acuity. This seems desirable but may not be necessary. Thus, a system could be designed with a 90 degree binocular overlap, but with visual acuity of 20:20 only over a 60 degree overlap sub-region. Thus, an optical system that provides high acuity over a central region of the binocular overlap region and a lower acuity at angles beyond this central region can be desirable.
HMDs with head tracking make it unnecessary for the eye to turn beyond a comfortable range to view an object that is not in the central visual field. The head and the eye can thus turn to place the image of the object of interest on the fovea. Since the retina has diminishing cone density as the distance from the fovea increases, an HMD system intended for VR need not provide high resolution at all field angles. By taking account of the human visual system in this way, the HMD system may be simplified (in a manner to be shown), without significant loss of presence.
D. Focal Length
Another design factor is the focal length of the optical system, which determines the magnification. Ignoring for the moment vignetting which can limit FOV, horizontal FOV (H-FOV) of the image approximately satisfies the following equation:
H-FOV=2*arctan(image width/2F),
where F is the focal length, or
F=(image width/2)/tan(H-FOV/2).
For a system with 20:20 acuity and pixel subtense of 1 min,this equation defines the relationship between the pixel size and the focal length. Since tan(0.5 min)=0.000145,
F=pixel width/0.00029.
A 10 micron pixel therefore calls for a focal length of 34 mm in order for the 10 micron pixel to subtend 1 min of arc.
E. Vignetting
Although the FOV of the image is set by the focal length and display size, the display may be vignetted by the optical system.
A critical distance for determining the degree of vignetting by the lens is the distance from the eye to the lens (termed “eye relief”) plus the eye radius (nominally 13 mm). A close practical eye relief is about 15 mm, thus the sum is 28 mm.
Part 2: Embodiments of a Hybrid Lens System with Wide FOV
Typical HMD designs are based on a single conventional lens per eye, in which the diameter is approximately equal to or less than the focal length (this is typical of conventional plano-convex and double convex lenses). The edge of the lens limits the FOV of the image owing to vignetting as previously discussed. By eliminating the vignetting imposed by the lens, the FOV can be increased. Embodiments disclosed herein use a hybrid lens system including a Fresnel lens and a refractive spherical or aspherical lens.
Since an optical system intended for either the left or right eye should not cross the sagittal plane, Fresnel lens 610 is truncated on the nasal side and the physical center of Fresnel lens 610 and its optical center are not co-located (e.g., see
One reason for replacing the central area of Fresnel lens 610 with singlet lens 605 is the following: for displays of very small pixel pitch, the singlet lens may provide better magnification of high spatial frequencies where it matters most—directly in front of the eye over the limited range of comfortable gaze angles. In this way, the ability to resolve objects subtending 1 min of arc is preserved over the gaze range of the eye by using singlet lens 605, and the remainder of the scene is also presented, although at the resolution permitted by the Fresnel lens 610, which may be less than singlet lens 605. Another way to state this is that Fresnel lens 610 may have a less satisfactory modulation transfer function (MTF) than singlet lens 605, but since Fresnel lens 610 acts mainly outside the central gaze range of the fovea, the reduced MTF may not be significantly consequential. Accordingly, singlet lens 605 serves as a central vision lens while Fresnel lens 810 serves as a peripheral vision lens when the user is looking straight forward.
Referring again to
It is noteworthy that Fresnel lens 610 (and its lower resultant acuity) is used outside the principal field of gaze, which is acceptable because when the user is looking through singlet lens 605 (whose image is upon the fovea), the Fresnel image is provided to a region of the retina beyond the fovea, and from which the user typically cannot perceive high resolution. Accordingly, an acceptable wide FOV is presented to the user.
A second infrequent case occurs when the eye turns to enable the user's gaze along direction C through Fresnel lens 610, and in this case a lower acuity image is provided to the fovea. However, this is also acceptable since rarely is the eye turned to high angles, and even more rarely can a high angle (e.g., >30 degrees) of eye rotation be sustained without discomfort. Instead, normally the head is turned to view objects so that the eye remains in the comfortable gaze range. When a head wearable display (e.g., a VR display or augmented reality display) includes head tracking, the head will also be turned to view objects at high initial angles, so that gaze C direction will be converted to gaze A direction via head motion. For these reasons, user dissatisfaction with low acuity at high eye rotation angles is expected to be rare.
The extension of Fresnel lens 610 beyond singlet lens 605 toward the nose provides a capability for more binocular overlap than is obtained by singlet lens 605 alone. For example, singlet lens 605 may provide high visual acuity over a 60 degree FOV, and the presence of Fresnel lens 610 extending in the nasal direction may provide an additional amount of binocular overlap, but with lower acuity. Similarly, the vertical field of binocular overlap may be extended as well.
Although
An optical system intended for use in a very high field of view system can also be formed from a hybrid lens system. One way to improve peripheral vision is to employ a curve near the temple as shown in
Another optional feature is illustrated in
Many variations of the approach shown in
The hybrid lens systems described above may also be used with curved displays. The curvature of the hybrid lens may be designed to match the curvature of the display so that high spatial fidelity in the image may be maintained, even in the periphery. In this way it is possible to make very high binocular FOV systems (>180 degrees in the horizontal field) with acuity matching the retina over the entire horizontal, and vertical visual field, or any subset of the entire field.
The brain perceives depth of objects from a number of cues. One cue is termed the accommodation distance—the distance at which the eye focuses. The brain is able to interpret ciliary muscle cues needed to obtain this focus and develop an estimate of distance from these focusing cues originating at the eye. A second cue is obtained by interpreting the extraocular muscle motion needed to turn the eyes so that gaze of both eyes converges on an object so as to fuse the perceived images of the left and right eye. This second distance cue is based on the angle to which the eyes must turn to place the object of interest on the fovea, and this perceived distance is called the vergence distance.
One of the known problems in conventional stereo/3D VR systems is the difference between vergence and accommodation distances. For example, some conventional 3D systems place the image plane at infinity and provide depth cues by vergence. This can lead to discomfort for the user. One way of reducing or eliminating accommodation vergence conflict is by adjusting the power of the VR system lens, which changes the image distance. Variable diopter lenses are known. If the eye gaze direction is known from eye tracking or can be estimated based on VR scene and objects of interest, then the vergence distance can be determined or estimated. An adjustable power lens can then be set to a focal length such that the accommodation distance equals the vergence distance, in this way eliminating accommodation-vergence disparity.
The equation that specifies the relationship between object distance s1, image distance s2, and focal length f is:
1/f=1/s1+1/s2.
Employing the sign conventions appropriate for a magnifier system of the type discussed here yields:
1/f=1/|s1|−1/|s2|, or
|s2|=1/{−1/f+1/|s1|}.
If the focal length is fixed, the image distance can alternatively be changed by adjusting the optical distance between the lens and the display pixel plane. By optical distance, OD, we mean the physical distance, PD, corrected for index of refraction n of the media between the lens and the pixel plane (for example, a layer of glass).
OD=n·PD.
This distance is also known as the optical path length. We can vary this distance by at least the following three options: (1) moving the display, (2) interposing an optical material with a variable index of refraction (such as a liquid crystal), or (3) interposing an optical material with a variable physical thickness.
Eye tracking can be used to determine the convergence angle and from the angles and IPD, the convergence distance. Once convergence distance is known, accommodation distance can be adjusted to match. For example, if the focal length of the lens system is fixed at 44 mm, and the initial optical distance between the pixel plane and the lens is 43.95 mm, the image distance will be 38.7 m.
Another method of reducing accommodation-vergence conflict is based on adjusting the focal length of the lens. Such adjustable lenses are known and can be combined with the hybrid lens systems described above to form a lens with adjustable power. The vergence distance is determined from eye tracking, and the focal length of the lens is adjusted to obtain the appropriate accommodation distance.
A passive method of reducing accommodation-vergence disparity is obtained by using a modification of a progressive lens that has been in use in ophthalmics for correction of presbyopia. Ophthalmic progressive lenses have focal length that varies as the eye rotates from the center of the lens toward the bottom of the lens, and toward the nose. By adding optical power as the convergence is increased, objects that are closer are brought into focus. This principle can be modified for reducing accommodation-vergence conflict.
|s2|=−1/{1/f−1/|s1|},
where s1 is the distance from the display to the lens, and s2 is the distance from the image to the lens. Assuming s1 is fixed, if the object is viewed through a section of the lens for which f is smaller than the center, then s2 is smaller, meaning that the image is brought closer. Referring again to
For objects that are viewed by turning one eye toward the temple, a disparity will still be present: the eye turning toward the nose will have a closer accommodation distance than the eye turning toward the temple. Yet, if the head is subsequently turned to center the image on the sagittal plane (which is the natural way to view objects), the disparity will be absent. Therefore, since centering the object of interest in the binocular field is the natural way to view images, this technique cures the disparity for the most natural way of viewing close objects.
The above description of illustrated embodiments of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific embodiments of, and examples for, the invention are described herein for illustrative purposes, various modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.
These modifications can be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.
This application claims priority to U.S. Provisional Application No. 62/102,491 filed on Jan. 12, 2015, the contents of which are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
3436151 | Conrose, Sr. | Apr 1969 | A |
5090796 | Feinbloom | Feb 1992 | A |
5129717 | Feinbloom | Jul 1992 | A |
6804066 | Ha et al. | Oct 2004 | B1 |
20040223116 | Baugh | Nov 2004 | A1 |
20070091250 | Hwang | Apr 2007 | A1 |
20090046349 | Haddock | Feb 2009 | A1 |
20140125944 | Huang | May 2014 | A1 |
20140268017 | Sweis | Sep 2014 | A1 |
Number | Date | Country |
---|---|---|
WO 96-13194 | May 1996 | WO |
Entry |
---|
Missig et al., “Diffractive optics applied to eyepiece design”, Applied Optics, vol. 34, Issue 14, pp. 2452-2461, May 10, 1995. |
PCT/US2016/013039—International Search Report and Written Opinion, mailed Apr. 29, 2016, 10 pages. |
Number | Date | Country | |
---|---|---|---|
20160198949 A1 | Jul 2016 | US |
Number | Date | Country | |
---|---|---|---|
62102491 | Jan 2015 | US |