This disclosure relates generally to the field of optics, and in particular but not exclusively, relates to head-worn displays.
In the field of optics, a combiner is an optical apparatus that combines two images together, from either the same side of the combiner (reflective/reflective, or transmissive/transmissive) or from the two different sides of the combiner (reflective/transmissive). Often times, optical combiners are used in heads up displays (“HUDs”), sometimes referred to as head mounted displays (“HMDs”), head wearable displays, or near-to-eye displays, which allow a user to view a display image superimposed over an external view. The HUD enables the user to view the display image without having to look away from her usual viewpoint. The term HUD originated from its use in avionics, which enables a pilot to view information while looking forward with his head up, as opposed to looking down at an instrument panel.
Conventional HUD combiner implementations include tilted dichroic plates, holographic combiners, transparent substrates used at an angle (e.g., beam splitters), and zero power shells. Two versions of combiners exist. The first version combines two fields without adding any optical power to either field (typically a tilted dichroic plate or zero power shell). The second version has optical power, in addition to the combining functionality. The optical power is used to form a virtual magnified image of a microdisplay located at a specific distance from the combiner. Field of view is set by the application requirements. The field of view and the desired microdisplay diagonal determine the focal length (inversely related to the optical power) of the optical combiner.
Holographic combiners that provide a high quality HUD are typically used in military applications, although their cost is relatively expensive. Holographic combiners can be fabricated by exposing a dichromated gelatin, silver halides, or photopolymers to a pair of intersecting laser beams (reference and object beams). The interference pattern between these beams is recorded into the holographic media thereby forming the holographic combiner after curing. Holographic combiners have a number of drawbacks. They are expensive to fabricate, difficult to mass produce, and have limited life spans (e.g., begin to degrade due to temperature, humidity, pressure and other harsh environmental conditions).
Angled transparent substrate combiners (e.g., beam splitters) have been used in automobiles to present the driver with HUD information on the windshield. These optical combiners are made of a clear see-through substrate upon which an external image source displays computer generated images (“CGI”). However, since the clear see-through substrate is typically a flat substrate without optical power so as not to distort the external FOV, the clear substrate must be angled (e.g., near 45 degrees) and bulky external magnification lenses are used to expand the display image over the display region. The bulky external lenses and angled nature of the clear see-through substrate combiners do not lend themselves well to compact arrangements, such as HMDs.
The above mentioned optical combiners each have their own respective drawbacks, which have limited their use to niche markets. In order to broaden the adoption of an HMD outside of a particular niche market, such an HMD should be implemented with a low cost optical combiner that is compact, lightweight, durable, and provide a good quality image without undue optical aberrations.
Non-limiting and non-exhaustive embodiments of the invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles being described.
Embodiments of an apparatus, system, and method of fabrication of a diffractive optical combiner including a plurality of diffractive optical element (“DOE”) segments are described herein. In the following description numerous specific details are set forth to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects.
Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
The contiguous planar DOE of diffractive optical combiner 105 is advantageous from an industrial design perspective because its thickness D1 is relatively thin. However, when a contiguous planar DOE is illuminated by image source 120 from an off-axis position (e.g., from a temple region in a near-to-eye display), undesirable optical aberrations may be induced in the reflected image light 115. Such optical aberrations include astigmatism, as well as others.
However, using a contiguous curved DOE, as illustrated in
During operation, image source 120 emits image light 115 along an emission path that directs image light 115 to be incident upon an eye-ward side of diffractive optical combiner 305 from an oblique or off-axis angle relative to a normal vector of the eye-ward side surface of diffractive optical combiner 305. Diffractive optical combiner 305 includes reflective diffraction gratings or DOE segments 315 that at least partially reflect image light 115 and collimate (or nearly collimate) image light 115 to an eyebox 310 setback from diffractive optical combiner 305 by an eye relief dimension of D3+D4, where the dimension D4 represents an approximate distance between the corneal surface and the pupil of eye 125. In the illustrated embodiment, diffractive optical combiner 305 magnifies image light 115 so that human eye 125 can view the magnified virtual image in a near-to-eye configuration. A frame assembly may be used to support the components of optical system 300 such that diffractive optical combiner 305 is positioned in front of a user's eye 125 by a distance that places the user's pupil within eyebox 310 having a dimension D5. For example, in one embodiment, D3 is approximately 21 mm while D5 is approximately 4 mm. Other dimensions for the eye relief and eyebox 310 may be implemented. Since the illustrated embodiment of optical system 300 is configured into a see-through near-to-eye display, diffractive optical combiner 305 is at least partially transmissive to external scene light 110 incident through an external scene side of diffractive optical combiner 305. Image light 115 is perceived by the user as an image that is superimposed over external scene light 110 (e.g., image light 115 augments external scene light 110).
Diffractive optical combiner 305 operates to overcome some of the shortcomings of the diffractive optical combiners 105 and 205 discussed above by using a plurality of DOE segments 315 instead of a single contiguous DOE that spans the length D6 of eyepiece body 320. By implementing diffractive optical combiner 305 using DOE segments 315, the individual DOE segments 315 can be repositioned within eyepiece body 320 to reduce the overall thickness D7 of eyepiece body 320. Reducing the thickness D7 improves the industrial design of eyepiece body 320 by reducing the bug-eye character associated with the contiguous curved DOE of diffractive optical combiner 200 illustrated in
Additionally, segmenting a single contiguous DOE into a plurality of DOE segments 315 provides an optical designer extra freedom in geometry to improve image quality and address optical aberrations that occur from off-axis illumination by image source 120. Since the individual DOE segments 315 are disjoint surfaces, they can be separately oriented or angled (e.g., see
By fabricating smaller DOE segments 315, versus the larger single contiguous DOEs illustrated in
The individual DOE segments 315 are reflective diffraction gratings formed along individual disjoint surfaces within eyepiece body 320. These surfaces can be curved (e.g.,
The phases of each diffraction grating can be controlled such that adjacent DOE segments 315 have diffraction gratings with phases that are aligned with each other and the DOE segments 315 collectively reflect a continuous image to eye 125 without undue discontinuities. In some embodiments, the edges of each diffraction grating are apodized to disguise discontinuities and improve the reflective image blending at the boundaries between adjacent DOE segments 315. Apodization may be achieved using a number of different techniques including reducing the reflectivity of the partially reflective material near the perimeter of each DOE segment 315 and/or thinning the diffraction element shapes themselves near the perimeter to reduce their efficiency around the edges.
In one embodiment, eyepiece body 320 is fabricated of an optically clear material that surrounds DOE segments 315 in a material having uniform index of refraction. Eyepiece body 320 may be fabricated of optical grade plastics (e.g., Zeonex Z-E48R), poly-methyl-metha-crylate (PMMA), glass, or otherwise. In one embodiment, the uniform refractive index material may be disposed on or bonded to other material layers for mechanical support or various other optical layers disposed on one or both sides (e.g., antireflection layers, tint layers, etc.).
Image source 120 may be fabricated using a variety of compact image source technologies such as the various micro-displays used today in pico-projectors, liquid crystal on silicon (“LCOS”) displays, backlit liquid crystal displays, organic light emitting diode (“OLED”) displays, quantum dot array displays, light emitting diode (“LED”) arrays, or otherwise. Reflection of image light 115 off of diffractive optical combiner 305 causes color aberrations, also referred to as color separation or spectral spatial separation, as a result of the finite linewidth (or bandwidth) of image light 115 emitted by image source 120. Diffraction gratings exchange different diffraction angles for different wavelengths. Thus, color separation can be reduced or prevented by using a narrow linewidth lamp source, such as a laser source, or a narrow bandwidth optical filter. Additionally, tradeoffs can be made within DOE segments 315 themselves to reduce the color separation sensitivity. For example, the optical power provided by the diffraction gratings can be reduced, while the optical power provided by the curvatures of DOE segments 315 is increased. This optical power tradeoff between diffraction and reflective curvature can be designed to make the overall diffractive optical combiner 305 less susceptible to color separation and ease the color constraints on image source 120.
Curved DOE segments 405 may be designed by starting with a single contiguous curved DOE 415 as a reference (see
Referring to
Planar DOE segments 605 may be designed by starting with a single contiguous curved DOE 615 as a reference (see
Thus
The illustrated portion of eyepiece body 701 includes a base sandwich layer 710 and a planarization sandwich layer 715 between which the structures of DOE segment 705 are sandwiched. The top side of planarization sandwich layer 715 is referred to as the eye-ward side 720 while the bottom side of base sandwich layer 710 is referred to as the external scene side 725. The illustrated embodiment of DOE segment 705 is a reflective diffraction grating formed of a two-dimensional (“2D”) array of three-dimensional (“3D”) diffraction element shapes formed into base sandwich layer 710 with partially reflective elements 730 coated onto the 3D diffraction element shapes and conforming thereto.
DOE segment 705 is a reflective diffraction grating sandwiched between two material layers (i.e., base sandwich layer 710 and planarization sandwich layer 715) having substantially equal, if not identical, indexes of refraction. By doing this, diffractive optical combiner 700 simultaneously operates in both reflection and transmission modes with each mode having different characteristics. In reflection, image source 120 is positioned on the same side of diffractive optical combiner 700 as the user's eye 125 (i.e., eye-ward side 720). Since DOE segment 705 is composed of partially reflective elements 730, a portion of image light 115 output from image source 120 is reflected back towards the user's eye 125. In transmission, the diffractive effects of DOE segment 705 are eliminated by using the same or similar index of refraction material above and below partially reflective elements 730. Since partially reflective elements 730 are also partially transmissive and sandwiched in substantially uniform index material(s), the portion of external scene light 110 that passes through DOE segment 705 is not diffracted, but rather passes to eye 125 substantially without experiencing optical distortion or power. By simultaneously operating diffractive optical combiner 700 in both reflective and transmissive modes, it can be used to overlay image light 115 onto external scene light 110 to provide a type of augmented reality to the user.
If the 3D diffraction element shapes of DOE segment 705 are formed along a curved surface of base sandwich layer 710, then DOE segment 705 provides hybrid optical power due to the reflective curvature and due to the diffraction grating structures disposed along the curvature. The curvature can be selected to balance or otherwise compensate for various optical aberrations induced by the diffraction grating structures when illuminated from an off-axis position.
The shape, size, orientation, and placement of the individual 3D diffraction element shapes formed into base sandwich layer 710 may be designed to provide optical power for magnifying image light 115. This magnifying configuration may be particularly useful in near-to-eye configurations, such as head mountable/wearable displays (“HMDs”) and some types of heads up displays (“HUDs”), such as scopes. The generic design of diffraction gratings that provide optical power is well known. For example, design of diffractive optics is discussed in “Applied Digital Optics: From Micro-optics to Nanophotonics” by Bernard Kress and Patrick Meyrueis, published by John Wiley and Sons in 2009. In particular, this book discusses how to design and subsequently carve out diffraction structures (microscopic grooves) and select their depth to maximize the amount of light diffracted in a specific diffraction order, while reducing the light diffracted in the zero and higher diffraction orders.
As mentioned above, DOE segment 705 is an off-axis lens, which is capable of receiving input light at incident angle A1 and reflects the image light along a reflection path having an emission angle A2 that is different from A1. In other words, each DOE segment (only one is illustrated in
In
where x, y and z are the spatial coordinates along the surface of base sandwich layer 710 upon which the DOE segment 705 is formed and (Pm,n)i,j are a set of polynomial coefficients.
DOE segment 705 is formed by overlaying each 3D diffraction element shape with a partially reflective element 730. Partially reflective elements 730 each conformally coat a corresponding 3D diffraction element shape thereby creating a reflective structure that assumes the shape and orientation of the underlying 3D diffraction element shape. Partially reflective elements 730 may be made of a variety of different materials. In one embodiment, partially reflective elements 730 are fabricated of a layer of conventional non-polarizing beam splitter material (e.g., thin silver layer, CrO2, etc.). The degree of reflectivity may be selected based upon the particular application (e.g., primarily indoor use, outdoor use, combination use, etc.). In one embodiment, partially reflective elements 730 comprise a 10% reflective 100 nm layer of CrO2.
In one embodiment, partially reflective elements 730 are fabricated of a multi-layer dichroic thin film structure. Dichroic films can be created to have a selectable reflectivity at a selectable wavelength. Additionally, the dichroic film can be designed to improve the angle selectivity of the DOE segment 705. A dichroic film can be designed with high reflectivity to a specific wavelength or wavelength band that overlaps with image light 115 and to the angles of incidence of image light 115, while being substantially more transparent to other visible spectrum wavelengths and to the normal incidence of external scene light 110. In this manner, the efficiency of diffractive optical combiner 700 can be improved while also increasing the brightness of the transmitted external scene light 110.
In one embodiment, partially reflective elements 730 are fabricated of polarizing beam splitter material that substantially reflects one linear polarization of incident light while substantially passing the orthogonal linear polarization. In this case, image source 120 could be designed to emit polarized image light matching the reflection characteristic of partially reflective elements 730. Since ambient light typically has a random polarization, approximately 50% of external scene light 110 would pass through diffractive optical combiner 700 to eye 125.
Referring back to
Alternatively, each surface associated with a given DOE segment 315 could be fabricated using SPDT or polishing on the base sandwich layer of eyepiece body 320. These structures would then be aligned to and the grating structures of the DOE would be fabricated onto the surface using electron beam lithography, direct laser ablation, or optical lithography. Again, a partially reflective coating would be formed over the grating structures and a planarization sandwich layer having the same index of refraction as the base sandwich layer formed over the partially reflective coating.
In yet another embodiment, flexible DOE gratings could be fabricated and adhered to the disjoint surfaces of DOE segments 315 using embossing techniques. Additionally, the base sandwich layer and planarization sandwich layers of eyepiece body 320 could be fabricated using injection molding of optical grade plastics.
The illustrated embodiment of eyepiece body 910 further includes a curved external scene side surface 930 and a curved eye-ward side surface 935. Curved surfaces 930 and 935 may be curved and parallel (or nearly parallel) such that the surfaces 930 and 935 collectively provide zero refractive diopter (optical power). Curving surfaces 930 and 935 improves the industrial design of diffractive optical combiner 900 and can reduce incidence angles on eye-ward side surface 935 thereby providing higher reflectance of image light 115 into eye 125 by diffractive optical combiner 900.
In other embodiments, curved external scene side surface 930 and curved eye-ward side surface 935 are purposely designed with different curvatures to provide refractive optical power, such as provided by a corrective prescription. DOE segments 905 do not contribute to the refractive prescriptive lensing of external scene light 110 provided by the curvatures of surfaces 930 and 935. In some embodiments, only one of surfaces 930 and 935 is curved while the other is planar (not illustrated).
The see-through displays 1001 are secured into an eye glass arrangement or head wearable display that can be worn on the head of a user. The left and right ear arms 1010 and 1015 rest over the user's ears while nose bridge 1005 rests over the user's nose. The frame assembly is shaped and sized to position each diffractive optical combiner in front of a corresponding eye 125 of the user. Other frame assemblies having other shapes may be used (e.g., a visor with ear arms and a nose bridge support, a single contiguous headset member, a headband, goggles type eyewear, etc.).
The illustrated embodiment of display 1000 is capable of displaying an augmented reality to the user. Each see-through display 1001 permits the user to see a real world image via external scene light 110. Left and right (binocular embodiment) image light 115 may be generated by image sources 120 mounted to left and right ear arms 1010. Image light 115 is seen by the user as a virtual image superimposed over external scene light 110 as an augmented reality. In some embodiments, external scene light 110 may be fully, partially, or selectively blocked to provide sun shading characteristics and increase the contrast of image light 115.
The above description of illustrated embodiments of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific embodiments of, and examples for, the invention are described herein for illustrative purposes, various modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.
These modifications can be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.
Number | Name | Date | Kind |
---|---|---|---|
4218111 | Withrington et al. | Aug 1980 | A |
4220400 | Vizenor | Sep 1980 | A |
4560233 | Banbury | Dec 1985 | A |
4799765 | Ferrer | Jan 1989 | A |
4895790 | Swanson et al. | Jan 1990 | A |
4968117 | Chern et al. | Nov 1990 | A |
5050966 | Berman | Sep 1991 | A |
5237455 | Bordo et al. | Aug 1993 | A |
5257133 | Chen | Oct 1993 | A |
5537253 | Cox et al. | Jul 1996 | A |
5654827 | Reichert | Aug 1997 | A |
5694230 | Welch | Dec 1997 | A |
5821911 | Jachimowicz | Oct 1998 | A |
5880888 | Schoenmakers et al. | Mar 1999 | A |
5886822 | Spitzer | Mar 1999 | A |
5923476 | Heffner | Jul 1999 | A |
5943171 | Budd et al. | Aug 1999 | A |
5949583 | Rallison et al. | Sep 1999 | A |
5995071 | Mertz | Nov 1999 | A |
6005714 | Welch | Dec 1999 | A |
6057966 | Carroll et al. | May 2000 | A |
6111701 | Brown | Aug 2000 | A |
6147807 | Droessler et al. | Nov 2000 | A |
6204975 | Watters et al. | Mar 2001 | B1 |
6236509 | Grandjean et al. | May 2001 | B1 |
6236511 | Brown | May 2001 | B1 |
6330118 | Daschner et al. | Dec 2001 | B1 |
6349004 | Fischer et al. | Feb 2002 | B1 |
6353503 | Spitzer et al. | Mar 2002 | B1 |
6396639 | Togino et al. | May 2002 | B1 |
6462882 | Chen et al. | Oct 2002 | B2 |
6466471 | Bhattacharyya | Oct 2002 | B1 |
6687057 | Yamazaki | Feb 2004 | B1 |
6690516 | Aritake et al. | Feb 2004 | B2 |
6728036 | Kleemann et al. | Apr 2004 | B2 |
6829095 | Amitai | Dec 2004 | B2 |
6847488 | Travis | Jan 2005 | B2 |
6885503 | Yun et al. | Apr 2005 | B2 |
6961162 | Nakamura et al. | Nov 2005 | B2 |
7095562 | Peng et al. | Aug 2006 | B1 |
7119965 | Rolland et al. | Oct 2006 | B1 |
7145726 | Geist | Dec 2006 | B2 |
7205960 | David | Apr 2007 | B2 |
7230766 | Rogers | Jun 2007 | B2 |
7450310 | McGuire | Nov 2008 | B2 |
7542209 | McGuire, Jr. et al. | Jun 2009 | B2 |
7551335 | Schilling | Jun 2009 | B2 |
7566863 | Chang et al. | Jul 2009 | B2 |
7586686 | Hall | Sep 2009 | B1 |
7595480 | Kress | Sep 2009 | B2 |
7595933 | Tang | Sep 2009 | B2 |
7637617 | Liu et al. | Dec 2009 | B2 |
7672055 | Amitai | Mar 2010 | B2 |
7715103 | Sprague et al. | May 2010 | B2 |
7724442 | Amitai | May 2010 | B2 |
7777960 | Freeman | Aug 2010 | B2 |
7821715 | Suzuki et al. | Oct 2010 | B2 |
8336333 | Ushigome | Dec 2012 | B2 |
8384999 | Crosby et al. | Feb 2013 | B1 |
8411365 | Saito | Apr 2013 | B2 |
20020186179 | Knowles | Dec 2002 | A1 |
20060215244 | Yosha et al. | Sep 2006 | A1 |
20070070859 | Hirayama | Mar 2007 | A1 |
20090067057 | Sprague et al. | Mar 2009 | A1 |
20100046075 | Powell et al. | Feb 2010 | A1 |
20100079356 | Hoellwarth | Apr 2010 | A1 |
20100149073 | Chaum et al. | Jun 2010 | A1 |
20110213664 | Osterhout et al. | Sep 2011 | A1 |
20110221656 | Haddick et al. | Sep 2011 | A1 |
20120086623 | Takagi et al. | Apr 2012 | A1 |
20120212398 | Border et al. | Aug 2012 | A1 |
20120212399 | Border et al. | Aug 2012 | A1 |
20120249797 | Haddick et al. | Oct 2012 | A1 |
20120293548 | Perez et al. | Nov 2012 | A1 |
Number | Date | Country |
---|---|---|
0 898 726 | Mar 2000 | EP |
0 995 145 | Sep 2001 | EP |
1 930 762 | Jun 2008 | EP |
1 465 003 | Dec 2008 | EP |
WO 2007065995 | Jun 2007 | WO |
WO 2009153446 | Dec 2009 | WO |
WO 2010097439 | Sep 2010 | WO |
Entry |
---|
Rossi et al., “Refractive and diffractive properties of planar micro-optical elements,” Applied Optics, vol. 34, No. 26, Sep. 10, 1995, pp. 5996-6007. |
Cakmakci, O. et al., “Head-Worn Displays: A Review”, IEEE, Journal of Display Technology, vol. 2, No. 3, Sep. 2006, pp. 199-216. |
Mukawa, H. et al., “8.4: Distinguished Paper: A Full Color Eyewear Display using Holographic Planar Waveguides”, SID Symposium Digest of Technical Papers, May 2008, vol. 39, Issue 1, pp. 89-92. |
Cakmakci, O. et al. “Design of a Freeform Single-Element Head-Worn Display”, Proc. of SPIE vol. 7618, 761803, 2010, 6 pages. |
Kress, B. et al., “Low Cost Replicable Plastic HUD combiner element”, Photonics in the Transportation Industry: Auto to Aerospace II, Proc. SPIE vol. 7314, 73140I, Apr. 13, 2009, 8 pages, Orlando, Florida. |
Kress, B. et al., “Digital combiner achieves low cost and high reliability for head-up display applications”, SPIE Newsroom. DOI: 10.1117/2.1200904.1599, May 18, 2009, 3 pages. |
Kress, B. et al., “Applied Digital Optics: From Micro-optics to Nanophotonics, Chapter 5: Digital Diffractive Optics: Analytic Type”, 40 pages, 2009, John Wiley & Sons, Ltd. |
Kress, B. et al., “Applied Digital Optics: From Micro-optics to Nanophotonics, Chapter 12: Digital Optics Fabrication Techniques”, 74 pages, 2009, John Wiley & Sons, Ltd. |
Kress, B. et al., “Applied Digital Optics: From Micro-optics to Nanophotonics, Chapter 14: Replication Techniques for Digital Optics”, 27 pages, 2009, John Wiley & Sons, Ltd. |
Kress, B. et al., “Applied Digital Optics: From Micro-optics to Nanophotonics, Chapter 16: Digital Optics Application Pools”, 60 pages, 2009, John Wiley & Sons, Ltd. |
Kress, B., “Sandwiched Diffractive Optical Combiner”, U.S. Appl. No. 13/411,346, filed Mar. 2, 2012. |