The present invention relates to optical device, and more particularly, is related to a head mounted display (HMD) or head-up display (HUD).
As shown by
In general, space envelope constraints mean that the combiner 140 generally takes the form of a tilted piece of optical material, with negligible optical power in transmission, but positive optical focusing power in reflection. The application of optical power on the tilted surface of a combiner 140 inherently creates aberrations that must be corrected by the HUD/HMD relay optics 120. In particular, tilted spherical surfaces of the combiner 140 generate a significant amount of aberration, yet see widespread use as they are economical to manufacture.
Embodiments of the present invention provide a gradient-index freeform head mounted display and head-up display. Briefly described, the present invention is directed to an optical projection assembly that directs a first image to an eyebox of a user combined with light from a second source. A relay optic has a refractive gradient-index (GRIN) component arranged to receive the first image. A tilted, partially reflective combiner has a tilted first surface to receive and transmit the light from the second source, and an opposite second surface to receive and project the first image from the relay optic and transmit the light received from the second source to the eyebox. The GRIN component is configured to reduce a perceivable aberration of the first image introduced by the combiner.
Other systems, methods and features of the present invention will be or become apparent to one having ordinary skill in the art upon examining the following drawings and detailed description. It is intended that all such additional systems, methods, and features be included in this description, be within the scope of the present invention and protected by the accompanying claims.
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present invention. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
The following definitions are useful for interpreting terms applied to features of the embodiments disclosed herein, and are meant only to define elements within the disclosure.
As used within this disclosure, “freeform GRIN” refers to a distribution of variable refractive index within an optical component that lacks an axis of rotational symmetry.
As used within this disclosure, “toric GRIN” refers to a distribution of variable refractive index within an optical component that varies independently in two perpendicular meridians, conforming to a GRIN distribution of form:
About a defined axis through the lens that may be tilted, rotated or decentred with respect to the optical axis.
As used within this disclosure, “cylindrical GRIN” refers to a distribution of variable refractive index within an optical component that varies independently in one single meridian, conforming to a GRIN distribution of form:
About a defined axis through the lens that may be tilted, rotated or decentred with respect to the optical axis.
As used within this disclosure, a “relay lens” refers to an optical device that generates a pair of real images, often used to project an intermediate image onto an image plane, or to invert said intermediate image.
As used within this disclosure, a “head-up display” (HUD) refers to a transparent display that presents data without requiring a user to look away from his usual viewpoint.
As used within this disclosure, a “head mounted display” refers to a display device worn on the head or as part of a helmet of a user that has a small display optic in front of one (monocular HMD) or each eye (binocular HMD).
As used within this disclosure gradient-index (GRIN) optics refers to a branch of optics covering optical effects produced by a gradient of the refractive index of a material. Such gradual variation may be used to produce lenses with flat surfaces, or lenses that do not have the aberrations typical of traditional spherical lenses. There are several fabrication methods for GRIN systems, including a Volumetric Index of Refraction Gradient Optics (VIRGO) printing technique developed by Vadient Optics (Portland, Oreg.), where inkjet printing of nanoparticle doped inks is used to deposit gradient-index media. This process theoretically allows any distribution of index within boundaries imposed by the printer resolution and base material refractive indices, and a large number of materials to be deposited in a highly scalable process. Another reference to additive manufacture GRIN, referred to as “the sol-gel based direct ink writing (DIW) approach” developed by Lawrence Livermore National Labs may be found at www.science.org/doi/10.1126/sciadv.abc7429. The manufacture of such GRIN optics is described in several patents, for example, U.S. Pat. No. 9,903,984 B1 (“Achromatic Optical-Dispersion Corrected Refractive-Gradient Index Optical-Element for Imaging Applications”), U.S. Pat. No. 9,555,623 B1 (“Refractive Gradient Inkjet Printing”), U.S. Pat. No. 9,447,299 B2 (“Inks for 3D Printing Gradient Refractive Index (GRIN) Optical Components”), and 3.4 U.S. Pat. No. 9,623,609 B2 (“Method of manufacturing multi-component functional article”), each of which is incorporated herein by reference in its entirety.
As used within this disclosure, a “coordinate break” refers to a defined point in a lens system where one coordinate system is transformed to another.
As used within this disclosure, “decentre” refers to a lateral shift of one coordinate system with respect to another.
As used within this disclosure, “tilt” refers to an angular shift of one coordinate system with respect to another.
As used within this disclosure, “Tilt/Decentre and bend” refers to a surface that is tilted/decentred following a coordinate break, with a second coordinate break thereafter which bends the optical axis to match a reflected ray of light from mirror located at the surface pole.
As used within this disclosure, “Tilt/Decentre and return” refers to a surface that is tilted or decentred with respect to a coordinate system, whereafter a second coordinate break returns the optical axis to that prior to the surface.
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts.
Embodiments of the present invention include a display projection system, for example, a head mounted display or head-up display that does not obscure the outside world from the operator. A first embodiment of a GRIN HUD shown by
Light that is reflected from the combiner 340 becomes substantially aberrated with coma and astigmatism. The light from the display 360 that strikes the combiner 340 is therefore “pre-aberrated” by the refractive relay optic 320 with aberrations of the opposite sign and equal magnitude. The result of that is near net-zero aberration when the light reaches the eyebox 150.
The combiner 340 applies optical focusing power, without which the bundles of rays that converge to the eyebox 150 would become unfeasibly far separated. Instead, the combiner 340 collimates these ray bundles from an intermediate image 380 (indicated by the dash-dot box) that forms between the combiner 340 and the brow mirror 330.
The purpose of the refractive relay optic 320 therefore, is to focus light to the intermediate image 380 between the combiner 340 and the brow mirror 330 that creates an inverse level of aberration required to counteract the aberration of the combiner 340. This is achieved by introducing asymmetric terms to the index distribution of GRIN lenses of 322, 324 of the refractive relay optic 320.
Under the present embodiments, the GRIN head-up display (HUD) 300 or head mounted display (HMD) 900 (
As compared with the existing off-axis HMD/HUD device 200 (
The embodiments employ freeform GRIN to replace the cemented doublet and diffractive components used by existing off-axis HMD/HUD device 200 (
The first exemplary embodiment 300 of an HMD device uses GRIN optics to correct chromatic aberrations in addition to the correction of monochromatic aberrations induced by the tilted combiner 340. For purposes of example only, first embodiment 300 is a fixed-visor head mounted display: alternative embodiments may be directed to different applications with a wide range of constructions and space envelopes that may apply to, for example avionic optical design problems. The first embodiment is, however, directed to addressing a problem common to a large number of avionic systems, namely, the removal of aberrations induced by a tilted, powered combiner.
As shown by
For the GRIN components under the first embodiment, a common optical axis is retained through the refractive relay optic 320. Retaining a common axis significantly simplifies mechanical design, machining, and inspection of the lens housing. The GRIN freeform degrees of freedom compensate for the aberrations generated by lens tilt and decentre.
Under the first embodiment the curvature of the combiner 340 is fixed at 50 mm radius of curvature. The geometry of the brow mirror 330 was considered to be a useful degree of freedom in design. For example, the brow mirror 330 may be a diamond turned reflective surface; aspheric terms and radius of curvature were used to enhance aberration correction.
The GRIN lenses are composed of blends of up to three homogeneous base materials (see below). These homogeneous base materials form a heterogeneous GRIN lens when combined in a spatially varying alloy. The refractive index may be computed from the material space equation for linear index blending:
Where NA, NB, NC are the refractive indices of the base materials A, B, and C respectively, and mA, mB and mc represent the volumetric relative composition of materials A, B, and C when normalised. The relative composition coefficients were a function of X and Y coordinates perpendicular to the optical axis (see Eq. 6, below).
Selection of GRIN materials for a specific application may be aided using optical modeling software, for example, in this case, CodeV, among other possibilities, which enables optimisation of GRIN designs using native CodeV GRIN coefficients. Modelling of the asymmetric GRIN distribution requires a user-modified routine, implemented as either “macro” code within the optical design software or as an external raytracing .dll that returns the GRIN refractive index and its derivatives. Use of a .dll file provides additional computation speed to enable efficient design of HUDs/HMDs, which are larger computational problems than rotationally symmetric lens designs. A non-rotationally symmetric design should involve field sampling over positive and negative field angles in both X and Y fields to account for asymmetry in the aberrations of the image, as well as a plurality of rays over each individual field, due to the potentially rapid variation of aberrations over the lens pupil. Furthermore, to correct the aberrations of a non-rotationally symmetric design involves more optimisation degrees of freedom than a rotationally symmetric solution. Expansion of the number of degrees of freedom means that more derivatives must be computed during lens optimisation which again increases the computational load.
Printing parts with significant thickness may be difficult and costly to fabricate. Therefore, as shown by
As shown in
The distributed dispersion of the hybrid GRIN lenses 422, 424 is determined by the ΔN at three sequential wavelengths: short, mid, and long that cover the optical waveband of the HMD. Distributed dispersion is given by:
where ΔN indicates a change in refractive index at the referenced wavelength dependent index reference point, and the wavelengths λlong>λmid>λshort.
The hybrid GRIN lenses 422, 424 of the refractive relay optic 420 may be described via a model of relative composition, see Boyd [Proc SPIE Vol 10998, 2019]. It should be noted that the refractive relay optic 420 is different from, for example, a corrector plate that operates in collimated light and has negligible focusing power. The refractive index of each GRIN lens 422a, 424a is determined by the relative amounts of three base materials, A, B and C as described by the equation:
where x and y are Cartesian coordinates normal to the local optical axis of the GRIN component 422a, 424a and the relative composition factors mn are greater than zero at all points within the lens clear aperture. The relative composition factors of the nth material are functions of x and y and are defined by the equation:
m
n
=m
n0
+m
n2ρ2+mn4ρ4+mn6ρ6+mnxx+mnyy+mnx2x2+mny2y2+mny3y3+mnx2yx2y (Eq. 6)
where ρ2=x2+y2 and represents the square of the perpendicular distance from the optical axis.
The volumetric relative composition at any point within the material is described for material A, B and C as follows:
The system field of view in the entrance pupil is defined by a circular field of semi-angle 20°, truncated by a y-plane absolute field of view of 15°. The system waveband covers the visible spectrum. In this embodiment, the system is defined for three wavelengths in the red, yellow, and blue regions of the spectrum as defined by the Fraunhofer C, D3 and F lines.
The system is illuminated by the display 360 placed at the focal plane of the system, emitting light that may sit within the aforementioned spectral waveband. The display 360 may be an emissive micro display based on OLED (organic light emitting diode) or similar technologies.
A number of surfaces are of aspheric form, whereby the surface sagitta is defined in the local optical axis by a conical cap of radius of curvature R added to even polynomial terms as follows:
Where c is the surface curvature defined as
k is the conic constant and An is the nth aspheric coefficient.
For purposes of providing a non-limiting example only, an exemplary construction of the second embodiment 400 (
A refractive relay optic 420 with gradient-index (GRIN) components 422, 424 is provided, as shown by block 810. An electronic display 360 provides an image at a focal plane of the refractive relay optic 420, as shown by block 820. A mirror 330 is arranged to receive and reflect the image from the refractive relay optic 420, as shown by block 830. A partially reflective combiner 340 with positive optical power comprising a first surface 13 in a tilted fashion with respect to external light 170 to transmit the external light 170 to the eyebox 350 of a user, and a second surface 12 opposite the first surface arranged to receive and project the image received from the refractive relay optic 420 via the mirror 330 to the eyebox 350, as shown by block 840. The relay lens GRIN components 422, 424 are configured to address aberrations introduced by the combiner 340. It should be noted that in alternative embodiments the mirror of block 830 may be omitted, for example in a HUD embodiment.
The embodiments presented above disclose a plurality of GRIN lenses.
The third embodiment 600 includes a full freeform GRIN 620, both axially and radially, and involves a separate set of compositional materials from the first and second embodiments. The third embodiment is based on a printable ink, doped with nanoparticles, and uses available refractive index data. The third embodiment 600 is based on two ink “endpoints” with the GRIN acting as a relative composition between these two materials. The first material is an optical grade polyester, OKP4HT, that has been doped with hollow silica nanospheres to reduce the refractive index. The second material consists of OKP4 that has been doped with Zirconium oxide nanoparticles. All of these materials are commercially available. Polyester (or a similar material such as polystyrene) can be printed as monomers and UV cured.
Under the third embodiment, the clear aperture of the GRIN lens is defined as a surface that joins two end surfaces 624 and 625, being defined as the boundary surface of all rays to occupy a 40° circular field of view truncated to 30° vertical field of view in the eyebox. Outside the clear aperture boundary, the specified GRIN distribution does not apply, and the lens may consist of any material necessary for mechanical integration and reduction of stray light effects.
The GRIN of the third embodiment may described as a distribution of relative composition between two materials as determined by the equation:
where x, y, and z are the three principal axes in the local coordinate system of the lens defined by the intersection of vertex of surface 4 with the optical axis. The optical axis is defined to be the z axis, with the x axis projecting out of the page. The relative composition of the nth material is defined by:
m
n=(mn00+mn01z+mn02z2)+(mn20+mn21z+mn22z2)ρ2+(mn40+mn41z+mn42z2)ρ4+(mn60+mn61z+mn62z2)ρ6+(mny10+mny11z+mny12z2)y+(mnx20+mnx21z+mnx22z2)x2+(mny20+mny21z+mny22z2)y2+(mny30+mny31z+mny32z2)y3+(mnx2y10+mnx2y11z+mnx2y12z2)x2y+(mnx40+mnx41z+mnx42z2)x4+(mny40+mny41z+mny42z2)y4+(mnx2y20+mnx2y21z+mnx2y22z2)x2y2 (Eq. 10)
The coefficients of each material in this GRIN design are listed in Table 5. The base index data for materials A and B are listed in Table 6. The volumetric relative composition at any point within the material is described for material A and B as follows:
The overall optical construction of the system under the third embodiment is listed as follows:
The HUD relay optics 920 typically sit above the head of the user and project an image to the eyebox 150 via the combiner. 950 An intermediate image sits between the combiner 340 and the relay optics 920. As in the previous case of the HMD 100 (
The specification for the design of the HUD embodiment 900 was configured to be similar to (but not a direct derivation of) an existing QUK HUD. Under this exemplary embodiment the HUD is modelled as a combination of three optical materials. In particular, the materials of this embodiment are modelled as combinations of printable polymers doped with known nanoparticle data. The base resin is modelled as an optical grade polyester, OKP4HT (which can be printed as a monomer and cured). Nanoparticles of titanium oxide, zirconium oxide, and hollow silica nanospheres are used as index modifiers. All are commercially available nanoparticle materials. While this exemplary set of base materials may be optimized for specific applications, the configuration here demonstrates the core functionality of the invention. Refractive index data of the base inks are listed in Table 11.
The aperture of the HUD system 900 under the fourth embodiment is defined by a 90 mm diameter entrance pupil at the “eyebox” plane. This aperture is vignetted by apertures defined on the lens elements.
The GRIN lens is described via a model of relative composition (see Boyd [Proc SPIE Vol 10998, 2019]). The refractive index of each GRIN lens is determined by the relative amounts of three base materials, A, B and C as described by Eq. 5 (above).
The system field of view in the entrance pupil is defined by a circular field of semi angle 18°, truncated by a y-plane absolute field of view of 14°. Tables 12-19 prescribe parameters for the HUD system under the fourth embodiment, with reference to the surfaces 11-21 shown in
The system 900 is illuminated by a display (not shown) placed at the focal plane of the system, emitting light that may sit within the aforementioned spectral waveband. The display may be an emissive micro display based on OLED (organic light emitting diode) or similar technologies.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present invention without departing from the scope or spirit of the invention. The description above presents a number of embodiments with varying numbers of GRIN elements. GRIN lenses of general rotationally symmetric form may perform the role of several conventional lens elements. For example, the single GRIN lens embodiment represents such a system, having of an asymmetric freeform GRIN distribution within the lens bulk to compensate the aberrations introduced by a tilted, optically powered, semi-transparent combiner component.
It is an accepted principle in optical design that lens elements may be “split” into additional components. This may often have the effect of increasing performance due to the additional design degrees of freedom offered by extra surfaces, with the associated trade-off that manufacturing complexity increases due to the additional lens count. To this effect, the embodiment shown in
It also follows that the GRIN relay lens may consist of one or more GRIN lenses in combination with conventional homogeneous lenses, as presented by embodiment shown in
The embodiments described in this application may have utility in a number of information display applications where a tilted semi-transparent combiner is necessary to allow light to clear a space envelope occupied by the user. This will typically be the head of a user but could also represent a broader space envelope such as a vehicle or aircraft cockpit.
The embodiments may be applied at different scales, both larger and smaller depending on the user and application. Most commonly, system size varies between applications that project information into a single eye, or both eyes of a user. To this effect several embodiments have been included that image to a single eye of a human user, with one example embodiment featuring a larger, flatter eyebox that images to both eyes. It follows logically that embodiments may include even larger scales for systems featuring multiple users, or smaller scales where applicable.
In view of the foregoing, it is intended that the present invention cover modifications and variations of this invention provided they fall within the scope of the following claims and their equivalents.
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 63/116,264, filed Nov. 20, 2020, entitled “Gradient-Index Freeform Head Mounted Display and Head-Up Display,” which is incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
63116264 | Nov 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2021/057098 | Oct 2021 | US |
Child | 18319637 | US |