Patent Application
20160091723
Aspects and embodiments of the invention are most generally directed to optical systems/apparatus and methods for designing and/or making said optical systems/apparatus. More particularly, aspects and embodiments of the invention are directed to a see-through optical display apparatus and method for designing and/or making said see-through optical display apparatus.
Wearable displays, such as head-worn displays (HWDs), represent the newest entry into the ever-evolving augmented reality market. Packaging constraints for HWDs align with the constraints of other devices that are worn on one's head. This necessitates such devices to be lightweight and compact, meaning using a minimum number of optical elements and employing unique packaging geometries. The problem remains that when the number of optical elements is reduced and non-rotationally symmetric geometries are used, the resulting optical aberrations are too great to correct with rotationally symmetric optical surfaces. Because the design problem of HWDs is so highly constrained (element count, geometry), the surface shapes play an extremely important role.
When starting an optical design, there are three critical parameters that need to be well-defined: the operational waveband, the aperture stop size, and the field of view. The waveband is important because it dictates the materials one can use, and, for a visual system that requires an external aperture stop, lateral chromatic aberrations are often the limiting aberrations of the system. The remaining two parameters often fight against one another according to the Lagrange invariant, where a given value for the Lagrange invariant reflects the overall complexity of the design. A large aperture stop requires a smaller FOV, and vice-versa.
A disadvantage of rotationally symmetric reflective systems is that they are obscured, which decreases the total intensity of light and introduces diffraction effects at the image plane. Designers can use a variety of strategies to make reflective systems unobscured: 1) the aperture stop can be offset from the mechanical axis, 2) the FOV can be biased, meaning a portion of the off-axis fields are considered the active fields for the system, 3) a combination of 1) and 2), or 4) the surfaces themselves can be tilted. For systems with rotationally symmetric surfaces, the latter most method is typically avoided because tilting powered surfaces results in optical aberrations such as field-constant astigmatism and coma that may not be balanced using rotationally symmetric surfaces.
Another packaging constraint for HWDs is the requirement that they fit around the facial structures near the eye. The distance from the entrance pupil of the optical design, which will be coincident with the entrance pupil of the eye, to the closest design feature (i.e., optical element, detector, microdisplay, etc.) must be great enough to clear the brows, nose, and/or cheek bones.
The inventors have recognized the benefits and advantages to be realized by a see-through optical display apparatus that addresses the aforementioned disadvantages and shortcomings, the especial benefits and advantages of such a see-through optical display apparatus in the form of a head worn display, a detailed and efficient method for designing and making such see-through optical display apparatus and HWDs, and techniques for analyzing the performance of such see-through optical display apparatus and HWDs. These benefits and advantages are realized by the embodied invention as described herein below with reference to the figures and in the appended claims.
Definitions of Certain Terms As Used Herein
The term ‘freeform’ optical surface refers to an optical surface without rotational symmetry, and as that term is well understood in the art, including but not limited to, e.g., XY polynomials, φ-polynomial such as Zernike polynomials and other orthogonal sets (such as disclosed in U.S. Pat. No. 8,616,712, the subject matter of which is incorporated herein by reference in its entirety), radial basis functions, and hybrid descriptions combining, for example, φ-polynomial and radial basis functions.
The term ‘external pupil’ refers to the system aperture stop not being located at, on, within or between any optical surface(s) of the optical system.
The term ‘see-through’ optical display means that the apparatus offers an unobstructed view of the surrounding environment, while overlaying a magnified image generated by an image-generating component of the apparatus.
The term ‘adding a coma (or) an astigmatism (or) a spherical aberration term to a surface’ means that the shape of the surface is changed to be characteristic of either coma, astigmatism, or spherical aberration, respectively.
The term ‘field of view’ (FOV) means to what angular extent the optical system can ‘see’ into and has the format (X FOV)×(Y FOV), where (X FOV) is the half field of view in the X-direction and (Y FOV) is the half field of view in the Y-direction.
The term ‘eyebox’ means the volume where the pupil of the eye (iris) will go, which is roughly three millimeters (mm) behind the cornea. The entrance pupil to the human eye varies in diameter depending on the relative brightness of the environment. In a well-lighted room it is roughly three mm in diameter, thus the optical system advantageously has an eyebox of at least three mm in diameter. When the eyebox is larger than three mm, it has the added benefit of allowing for slight decenters of the eye with respect to the optical system. Also, the eye will naturally scan the environment, so a larger eyebox allows the viewer to accommodate this natural swivel of the eye without losing any light from a head worn display (HWD).
The term ‘effective focal length’ (EFL) means that if collimated light enters the optical system, the EFL will tell you where the light will focus with respect to the rear principal plane. The value is chosen based on the size of the image source and the desired FOV using the relations EFL=(half the diagonal of the image source)/(half of the FOV).
The term ‘about’ means the amount of the specified quantity plus/minus a fractional amount (e.g., ±10%, +9%, +8%, +7%, +6%, +5%, +4%, +3%, +2%, +1%, etc.) thereof that a person skilled in the art would recognize as typical and reasonable for that particular quantity or measurement.
The term ‘substantially’ means as close to or similar to the specified term being modified as a person skilled in the art would recognize as typical and reasonable; for e.g., within typical manufacturing and/or assembly tolerances, as opposed to being intentionally different by design and implementation.
The most general aspects and embodiments of the invention are a see-through optical display apparatus and method for designing and/or making such a see-through optical display apparatus.
More particularly, aspects and embodiments provide an optical display system, design and fabrication methods for the optical display system, and applications of use of the optical display system. An exemplary, non-limiting embodiment of the optical display system is an all reflective, freeform, optical see-through, head-worn display (HWD) apparatus.
An aspect of the invention is a see-through optical display apparatus. The apparatus includes an image generating component, a tilted primary mirror having a non-flat, freeform, front optical surface, and a tilted secondary minor having a non-flat, freeform, front optical surface, wherein the apparatus has an external pupil. According to various exemplary, non-limiting embodiments, the apparatus may include the following additional features, limitations, and/or characteristics:
wherein the external pupil is an aperture stop located at the entrance pupil of an observer viewing the image;
wherein the image generating component is an OLED microdisplay;
wherein the front surfaces of the primary mirror and the secondary mirror have concave curvatures;
wherein at least one of the minors' surfaces has a photochromic or an electrochromic coating;
further comprising a flat surface, semi-transparent/semi-reflective optical component;
characterized by a volumetric footprint having a diameter that is equal to or less than 32.5 millimeters (mm);
characterized by a volumetric footprint having a radius that is equal to or less than 14 millimeters (mm);
characterized by a field of view (FOV) between 20-30 degrees;
further comprising an eyeglass frame to which the image generating component, the primary minor, and the secondary mirror are coupled;
further comprising a head-wearable structure to which the image generating component, the primary mirror, and the secondary mirror are coupled;
wherein the apparatus consists of the image generating component, the primary mirror having a non-flat, freeform, front optical surface, and the secondary mirror having a non-flat, freeform, front optical surface, wherein the primary minor is a semi-transparent/semi-reflective optical component;
wherein the apparatus consists of the image generating component, the primary mirror having a non-flat, freeform, front optical surface, the secondary mirror having a non-flat, freeform, front optical surface, and a flat surface, semi-transparent/semi-reflective optical component;
A method for designing/making a see-through optical display apparatus for displaying an image generated by or on an image generating component of the apparatus. The method includes the steps of: a) determining an apparatus specification; b) selecting a field of view and an aperture stop size for the apparatus; c) positioning the aperture stop at an entrance pupil of an observing optical system; d) designing a rotationally symmetric, spherical optical system; e) determining an aberration content of the apparatus over the full field of view; f) identifying a dominant aberration comprising one of coma and astigmatism, and i) if coma: determining whether the coma is more field constant or more field dependent, and if more field constant: adding a coma term to the optical surface nearest to the aperture stop, or if more field dependent: adding a spherical aberration term to the optical surface furthest from the aperture stop; or ii) if astigmatism: determining whether the astigmatism is more field constant or more field dependent, and if more field constant: adding an astigmatism term to the optical surface nearest to the aperture stop, or if more field dependent: adding a coma term to the optical surface furthest from the aperture stop; g) optimizing the optical system design; h) determining whether the aberration content of the optimized design decreased, and iii) if no: determining whether the apparatus meets the determined specification, and if yes: design is complete, or if no: determining whether the limiting aberration is more field constant or more field dependent, and if more field constant: adding the next higher-order aberration term to the surface nearest to the aperture stop, or if more field dependent: adding the next higher-order aberration term to the surface furthest from the aperture stop; i) repeating steps (g) through (h); or iv) if yes: repeating steps (e) through (h).
It should be appreciated that all combinations of the foregoing concepts and additional concepts discussed in greater detail below (provided such concepts are not mutually inconsistent) are contemplated as being part of the inventive subject matter disclosed herein. In particular, all combinations of claimed subject matter appearing at the end of this disclosure are contemplated as being part of the inventive subject matter disclosed herein. It should also be appreciated that terminology explicitly employed herein that also may appear in any disclosure incorporated by reference should be accorded a meaning most consistent with the particular concepts disclosed herein.
The above mentioned benefits and advantages are obtained and enabled by a see-through optical display apparatus that uses tilted, all reflective and semi-reflective/semi-transmissive components having freeform optical surfaces. The embodied design strategy involved first choosing the pupil size so that it corresponds with that of a human eye and then maximizing the FOV.
Because the design problem is so highly constrained (element count, geometry), the surface shape plays an extremely important role. Some mathematical descriptions of these surfaces include: XY polynomials, φ-polynomial such as Zernike polynomials and other orthogonal sets, radial basis functions, and hybrid descriptions combining for example φ-polynomial and radial basis functions. Zernike polynomials were used in the instant invention because of their close relationship with the wavefront expansion aberrations and the optical design leverage provided by nodal aberration theory.
Two classes of a see-through optical display apparatus will be discussed: a two-mirror design 100-1 and a three-mirror design 100-2.
Table 1 lists the relevant top level parameters of system 100-1.
Table 2 shows the angles at which the mirrors 101, 102 and image source 109 are tilted, as well as the distances from the eyebox to the closest structure and to the primary mirror 101. The mirrors are tilted so the path of the light is bent into a configuration such that the mirrors/image source are not obstructing the light internal to the system.
Table 3 lists the relevant top level parameters of system 100-2.
Table 4 shows the angles at which the mirrors 101, 102, 103, and image source 109 are tilted, as well as the distances from the eyebox to the closest structure and to the primary mirror 101. The minors are tilted so the path of the light is bent into a configuration such that the mirrors/image source are not obstructing the light internal to the system. A benefit of this system is the extended eye relief (“eye relief” meaning the distance from the position of the eye to the nearest structure of the optical system).
In both the two-mirror and the three-mirror designs, the mirrors have been constrained to be concave to minimize the package size. Convex minors diverge light, requiring larger subsequent minor apertures and, thus, a larger package size as a whole. It is also advantageous to minimize the tilts of all of the mirrors to minimize the induced astigmatism and coma. This will reduce the overall amount of correction the minors need to provide, decreasing the amount of freeform departure.
Without regard to a two-mirror or a three-mirror system, the starting designs were all-spherical designs folded into each final, unobscured geometry. To illustrate the deleterious effect that tilting the mirrors has on the astigmatism and coma,
The sag, z(x,y), of the freeform surfaces in each design is defined mathematically by the following equation,
where c is the curvature of the base sphere, k is the conic constant, p is the radial coordinate of the surface, Cj is weight factor on the jth Zernike term, Zj. The first term is a base conic (a sphere being a special case), upon which the second term, a weighted sum of Zernike polynomials, is overlaid. A consequence of having an external stop in an optical system that is significantly displaced from the first surface is that the object fields may be thought to “walk” about the surfaces, meaning that each field point experiences a different portion of the surface. Each field receives a different contribution to its net aberration field from a surface depending on its location with respect to the vertex of the surface and the surface shape. The type of aberration correction is proportional to the pupil derivatives of the surface description. For example, if the surface is purely comatic, the resulting aberration correction would be astigmatic as well as other aberrations with lower-order pupil dependence. As a result of the external stop, the system cannot easily correct for field-constant aberrations. However, we can still correct the residual field-dependent aberrations and quantify that a high performance system can still be designed. The final specifications for each exemplary design are reported in TABLE 5.
Display Space Analysis
We evaluated the performance of the (two-minor and three-minor) systems by calculating the modulation transfer function (MTF) over the full FOV at 100% and 75% of the Nyquist frequency of the OLED microdisplay (Model: MICROOLED Maryland).
Visual Space Analysis
While the display space analysis can give the designer a quick glimpse into the overall performance of the optical system, it cannot accurately predict how the system will perform when it is used as intended. There are, however, methods that can. In ray trace software, the analyses are typically done in the same configuration as the system is designed, but visual systems, including the HWDs disclosed herein, are designed such that the OLED microdisplay is in image space, so one cannot immediately analyze what the eye will “see.” The solution is to flip the system. After flipping the optical system, image space is now the same space in which the eye is located; therefore, any analysis completed will be in visual space. In visual space, we choose to work in units of angle because the image plane is infinitely far away. The human eye can resolve roughly 1 cycle/arcminute on-axis where the photoreceptors are most densely packed (rods only) and degrades significantly off-axis due to a lower density of photoreceptors (rods and cones). This represents a maximum useful resolution for any design and analysis done in visual space. Systems with resolution greater than 1 arcmin may be considered as overdesigned for the visual system. The disclosed systems, however, are limited by the OLED microdisplay and its pixel pitch of 10 microns. Dividing the FFOV by the pixel array size in the horizontal direction gives an idea of how close the system comes to being eye-limited. The three mirror HWD and the two minor HWD have a maximum visual resolution of 1.5 arcmin/pixel. We evaluated the visual space MTF of both systems out to a frequency of 0.65 cycles/arcmin, which is an equivalent measurement of the maximum visual resolution of the system.
While several inventive embodiments have been described and illustrated herein, those of ordinary skill in the art will readily envision a variety of other means and/or structures for performing the function and/or obtaining the results and/or one or more of the advantages described herein, and each of such variations and/or modifications is deemed to be within the scope of the inventive embodiments described herein. More generally, those skilled in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are meant to be exemplary and that the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the inventive teachings is/are used. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific inventive embodiments described herein. It is, therefore, to be understood that the foregoing embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described and claimed. Inventive embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein. In addition, any combination of two or more such features, systems, articles, materials, kits, and/or methods, if such features, systems, articles, materials, kits, and/or methods are not mutually inconsistent, is included within the inventive scope of the present disclosure.
All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.
The indefinite articles “a” and “an,” as used herein in the specification and in the claims, unless clearly indicated to the contrary, should be understood to mean “at least one.” The phrase “and/or,” as used herein in the specification and in the claims, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases. Multiple elements listed with “and/or” should be construed in the same fashion, i.e., “one or more” of the elements so conjoined. Other elements may optionally be present other than the elements specifically identified by the “and/or” clause, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, a reference to “A and/or B”, when used in conjunction with open-ended language such as “comprising” can refer, in one embodiment, to A only (optionally including elements other than B); in another embodiment, to B only (optionally including elements other than A); in yet another embodiment, to both A and B (optionally including other elements); etc.
As used herein in the specification and in the claims, “or” should be understood to have the same meaning as “and/or” as defined above. For example, when separating items in a list, “or” or “and/or” shall be interpreted as being inclusive, i.e., the inclusion of at least one, but also including more than one, of a number or list of elements, and, optionally, additional unlisted items. Only terms clearly indicated to the contrary, such as “only one of” or “exactly one of,” or, when used in the claims, “consisting of,” will refer to the inclusion of exactly one element of a number or list of elements. In general, the term “or” as used herein shall only be interpreted as indicating exclusive alternatives (i.e. “one or the other but not both”) when preceded by terms of exclusivity, such as “either,” “one of,” “only one of,” or “exactly one of.” “Consisting essentially of,” when used in the claims, shall have its ordinary meaning as used in the field of patent law.
As used herein in the specification and in the claims, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, “at least one of A and B” (or, equivalently, “at least one of A or B,” or, equivalently “at least one of A and/or B”) can refer, in one embodiment, to at least one, optionally including more than one, A, with no B present (and optionally including elements other than B); in another embodiment, to at least one, optionally including more than one, B, with no A present (and optionally including elements other than A); in yet another embodiment, to at least one, optionally including more than one, A, and at least one, optionally including more than one, B (and optionally including other elements); etc.
It should also be understood that, unless clearly indicated to the contrary, in any methods claimed herein that include more than one step or act, the order of the steps or acts of the method is not necessarily limited to the order in which the steps or acts of the method are recited.
In the claims, as well as in the specification above, all transitional phrases such as “comprising,” “including,” “carrying,” “having,” “containing,” “involving,” “holding,” “composed of,” and the like are to be understood to be open-ended, i.e., to mean including but not limited to. Only the transitional phrases “consisting of” and “consisting essentially of” shall be closed or semi-closed transitional phrases, respectively, as set forth in the United States Patent Office Manual of Patent Examining Procedures, Section 2111.03.
The instant application claims priority to U.S. provisional application Ser. No. 61/827,033 filed May 24, 2013, the subject matter of which is incorporated herein by reference in its entirety.
This work was supported by the NSF/GOALI under grant number EECS-1002179. The U.S. Government has rights in this invention.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US14/37494 | 5/9/2014 | WO | 00 |
| Number | Date | Country | |
|---|---|---|---|
| 61827033 | May 2013 | US |
