Transparent optical systems, such as head-up displays, provide the ability to present information and graphics to an observer without requiring the observer to look away from a given viewpoint or otherwise refocus his or her eyes. In such systems, the observer views an external scene through a combiner. The combiner allows light from the external scene to pass through while also redirecting an image artificially generated by a projector so that the observer can see both the external light as well as the projected image at the same time.
An optical system is disclosed herein. In an example, the optical system of an augmented reality head-up display includes a picture generation unit configured to output an optical image, a correcting optical element, and a combiner. The shape of the combiner and the shape of the correcting optical element are correlated such that the optical system can produce realistic long-distance augmented reality features within a given scene viewable through the combiner. The long-distance augmented reality features may appear to be, for instance, 1.5 meters or more from the observer. The correcting optical element includes a convex reflective surface configured to reflect the optical image output by the picture generation unit. The combiner has a concave reflective surface and a convex transparent surface. The concave reflective surface of the combiner is configured to reflect the optical image reflected by the correcting optical element toward an eye box, which represents an eye pupil of the observer. The convex transparent surface of the combiner is configured to permit external light to pass through the combiner and combine with the optical image reflected by the correcting optical element. So, for instance, in an example use case, the external light is from a real-world scene viewable through the windshield of a vehicle, and the optical image includes one or more virtual features that appear to be within the real-world scene at a distance that appears to be 1.5 meters or more away from the driver of the vehicle. Numerous other example use cases will be appreciated in light of this disclosure.
General Overview
As noted above, certain types of optical systems include a combiner that combines light from the external environment with artificially generated images to provide a head-up display. However, mismatches between the projected image and the combiner can lead to distortions or other undesirable visual effects. For example, when an optical system is used to generate augmented reality, the observer should perceive the virtual image generated by the system at the same distance from the observer as real-world objects in the external scene. Such distances can be, for example, 1.5 meters or longer. However, augmented reality is ineffective at distances greater than or equal to 1.5 meters if the combiner has insufficient optical power to create the virtual image at such distances or if the combiner otherwise introduces visual distortions into the virtual image or the external scene at such distances. This shortcoming is particularly acute in some applications, such as automotive and aeronautical applications, where the amount of available space for the optical system is very limited and does not provide enough clearance between the projector and the combiner to create realistic or otherwise undistorted virtual images at distances of 1.5 meters or more, which ultimately constrains the ability of the optical system to generate augmented reality.
To this end, in accordance with an example, an optical system is provided that is compact and can produce undistorted augmented reality in a head-up display at relatively long distances of (e.g., 1.5 meters or greater, and up to perceptible infinity). An example optical system includes a picture generation unit configured to output an optical image, a correcting optical element, and a combiner. The shape of the combiner and the shape of the correcting optical element are correlated such that the optical system can produce augmented reality at such relatively long distances. In more detail, the correcting optical element includes a convex reflective surface configured to reflect the optical image output by the picture generation unit. The convex reflective surface of the correcting optical element includes (i) a second- or higher-order reflective aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface. In some examples, the convex reflecting surface of the correcting optical element has a shape such that a deviation of an angle between the chief rays of light exiting the combiner for either or both of the left and right eyes of the observer from a nominal value does not exceed 2 milliradians. In this manner, virtual image distortions caused by optical power of the combiner's reflective concave surface are reduced or eliminated.
Further, the combiner has a concave reflective surface and a convex transparent surface. The concave reflective surface of the combiner is configured to reflect the optical image reflected by the correcting optical element toward an eye box, which represents an eye pupil of the observer. The concave reflective surface includes (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface. The convex transparent surface of the combiner is configured to permit external light to pass through the combiner and combine with the optical image reflected by the correcting optical element. The convex transparent surface includes (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface. In some examples, an angle between imaginary and real directions of a view through the combiner at any eye position inside pupil area does not exceed 1 milliradian, which reduces or eliminates further optical distortions caused by the curvature of the concave reflective surface of the combiner. As will be appreciated in light of this disclosure, a reflective surface as used herein refers to a surface that is at least optically reflective, such that the surface at least reflects visible light; likewise, a transparent surface as used herein refers to a surface that is at least optically transparent, such that the surface at least passes visible light. Various other examples will be apparent in light of the present disclosure.
Example System
The combiner 202 includes a concave reflective surface 210 and a convex transparent, or light transmitting, surface 212. The concave reflective surface 210 includes (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface. The freeform surface of the concave reflective surface 210 can be a non-regular, three-dimensional geometric surface defined by a set of points or a set of parametric equations. The concave reflective surface 210 reflects the optical image 220 output from the PGU 206 toward the eye box 106, creating a least a portion of the virtual image 108. The concave reflective surface 210 has a curvature or other shape that, in conjunction with the correcting optical element 204, provides sufficient optical power for the virtual image 108 to virtually appear at any distance up to infinity away from the eye box 106.
The convex transparent surface 212 includes (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface. The freeform surface of the convex transparent surface 212 can be a non-regular, three-dimensional geometric surface defined by a set of points or a set of parametric equations. The convex transparent surface 212 is configured to permit at least some external light 222 to pass through the combiner 202 and exit via the concave reflective surface 210. In this manner, the combiner 202 combines the external light 222 passing through the combiner 202 with the optical image 220 (as reflected off of the correcting optical element 204) to produce the output image 224, which is directed toward the eye box 106. In some examples, and as further detailed with respect to
In some examples, the optical system 200 includes the correcting optical element 204, which reduces the volume of the optical system 200 by permitting the PGU 206 to be located closer to the combiner 202 than would be possible without the correcting optical element 204 (such as if optical image 220 was projected directly onto the combiner 202). The correcting optical element 204 includes a convex reflective surface 214 configured to reflect the optical image 220 output from the PGU 206 toward the combiner 202. The convex reflective surface 214 includes (i) a second or higher order reflective aspherical surface, (ii) a second or higher order decentered aspherical surface, or (iii) a freeform surface. The freeform surface of the convex reflective surface 214 can be a non-regular, three-dimensional geometric surface defined by a set of points or a set of parametric equations. The convex reflective surface 214 has a shape such that a deviation, from a nominal value, of an angle between chief rays of the optical image 220 for each of left and right eyes at the eye box 106 does not exceed 2 milliradians while observing the virtual image 108 from the eye box 106, such as described in further detail with respect to
A value of an angle between real and imaginary directions of a view through the wedge 602 at each possible eye position inside the pupil area (eye box) can be described by:
As can be seen in
β=Q+α′ (2)
It follows that:
sin(β′)=ncom sin(β)=ncom sin(Q+α′) (3)
The angle of ray deviation through the wedge 602 is:
ω=−α+α′+β′−β=β′−α−Q (4)
Because the refractive angle of the wedge 602 is low, equation (3) can be modified as follows:
β=Q cos(α′)+sin(α′) (5)
sin(β′)=sin(ω+Q+α)=(ω+Q)cos(α)+sin(α) (6)
Using equations (1), (5) and (6), the angle can be represented as:
Example Method
In some examples, the convex transparent surface of the combiner is configured such that a value of an angle between imaginary and real observation directions through the combiner from any eye position inside the eye box does not exceed 1 milliradian. In some examples, the convex reflective surface of the correcting optical element is configured such that a deviation, from a nominal value, of an angle between chief rays of the optical image at the eye box does not exceed 2 milliradians. In some examples, the concave reflective surface of the combiner has a radius of curvature of less than 350 mm. In some examples, the method 800 includes reflecting 808 the optical image output from the picture generation unit off of a secondary reflecting surface toward the correcting optical element.
The following examples describe further example embodiments, from which numerous permutations and configurations will be apparent.
Example 1 is an optical system including a picture generation unit configured to output an optical image; a correcting optical element having a convex reflective surface configured to reflect the optical image output by the picture generation unit, the convex reflective surface including a second- or higher-order reflective aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface; and a combiner having a concave reflective surface and a convex transparent surface, the concave reflective surface configured to reflect the optical image reflected by the correcting optical element toward an eye box, the concave reflective surface including (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface, the convex transparent surface configured to permit external light to pass through the combiner and combine with the optical image reflected by the correcting optical element, the convex transparent surface including (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface.
Example 2 includes the subject matter of Example 1, wherein the convex transparent surface of the combiner is configured such that a value of an angle between imaginary and real observation directions through the combiner from any eye position inside the eye box does not exceed 1 milliradian.
Example 3 includes the subject matter of Examples 1 or 2, wherein the convex reflective surface of the correcting optical element is configured such that a deviation, from a nominal value, of an angle between chief rays of the optical image at the eye box does not exceed 2 milliradians.
Example 4 includes the subject matter of any one of Examples 1-3, wherein the concave reflective surface of the combiner has a radius of curvature of less than 350 mm.
Example 5 includes the subject matter of any one of Examples 1-4, wherein the picture generation unit includes a thin-film-transistor liquid-crystal display (TFT LCD), an organic light emitting diode (OLED), an Active Matrix Organic Light Emitting Diode (AMOLED), a digital micromirror device (DMD) projector, and/or a liquid crystal on silicon (LCOS) with a light emitting diode (LED), a laser projector.
Example 6 includes the subject matter of any one of Examples 1-5, including a secondary reflecting surface configured to reflect the optical image output from the picture generation unit toward the correcting optical element.
Example 7 includes the subject matter of Example 6, including a light transmissive element configured to permit at least a portion of the optical image to pass therethrough.
Example 8 is an optical system including a picture generation unit configured to output an optical image; a correcting optical element having a convex reflective surface configured to reflect the optical image output by the picture generation unit; and a combiner having a concave reflective surface and a convex transparent surface, the concave reflective surface configured to reflect the optical image reflected by the correcting optical element toward an eye box, the convex transparent surface configured to permit external light to pass through the combiner and combine with the optical image reflected by the correcting optical element, wherein the correcting optical element is configured such that a value of an angle between imaginary and real observation directions through the combiner from any eye position inside the eye box does not exceed 1 milliradian, and wherein the convex reflective surface of the correcting optical element is configured such that a deviation, from a nominal value, of an angle between chief rays of the optical image at the eye box does not exceed 2 milliradians.
Example 9 includes the subject matter of Example 8, wherein the convex reflective surface of the correcting optical element includes a second- or higher-order reflective aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface.
Example 10 includes the subject matter of Examples 8 or 9, wherein the convex transparent surface of the combiner includes (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface.
Example 11 includes the subject matter of any one of Examples 8-10, wherein the concave reflective surface of the combiner includes (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface.
Example 12 includes the subject matter of any one of Examples 8-11, wherein the concave reflective surface of the combiner has a radius of curvature of less than 350 mm.
Example 13 includes the subject matter of any one of Examples 8-12, wherein the picture generation unit includes a thin-film-transistor liquid-crystal display (TFT LCD), an organic light emitting diode (OLED), an Active Matrix Organic Light Emitting Diode (AMOLED), a digital micromirror device (DMD) projector, and/or a liquid crystal on silicon (LCOS) with a light emitting diode (LED), a laser projector.
Example 14 includes the subject matter of any one of Examples 8-13, including a secondary reflecting surface configured to reflect the optical image output from the picture generation unit toward the correcting optical element.
Example 15 includes the subject matter of Example 14, including a light transmissive element configured to permit at least a portion of the optical image reflected off of the secondary reflecting surface to pass through toward the correcting optical element.
Example 16 is a method of combining external light with an optical image, the method including outputting, by a picture generation unit, the optical image; reflecting the optical image output off of a correcting optical element having a convex reflective surface, the convex reflective surface including a second- or higher-order reflective aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface; and reflecting the optical image reflected by the correcting optical element off of a combiner toward an eye box, the combiner having a concave reflective surface and a convex transparent surface, the concave reflective surface including (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface, the convex transparent surface configured to permit external light to pass through the combiner and combine with the optical image reflected by the correcting optical element, the convex transparent surface including (i) a second- or higher-order aspherical surface, (ii) a second- or higher-order decentered aspherical surface, or (iii) a freeform surface.
Example 17 includes the subject matter of Example 16, wherein the convex transparent surface of the combiner is configured such that a value of an angle between imaginary and real observation directions through the combiner from any eye position inside the eye box does not exceed 1 milliradian.
Example 18 includes the subject matter of Examples 16 or 17, wherein the convex reflective surface of the correcting optical element is configured such that a deviation, from a nominal value, of an angle between chief rays of the optical image at the eye box does not exceed 2 milliradians.
Example 19 includes the subject matter of any one of Examples 16-18, wherein the concave reflective surface of the combiner has a radius of curvature of less than 350 mm.
Example 20 includes the subject matter of any one of Examples 16-19, further including causing the optical image output from the picture generation unit to reflect off of a secondary reflecting surface toward the correcting optical element.
The foregoing description and drawings of various embodiments are presented by way of example only. These examples are not intended to be exhaustive or to limit the present disclosure to the precise forms disclosed. Alterations, modifications, and variations will be apparent in light of this disclosure and are intended to be within the scope of the present disclosure as set forth in the claims. Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. Any references to examples, components, elements or acts of the systems and methods herein referred to in the singular can also embrace examples including a plurality, and any references in plural to any example, component, element or act herein can also embrace examples including only a singularity. References in the singular or plural form are not intended to limit the presently disclosed systems or methods, their components, acts, or elements. The use herein of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. References to “or” can be construed as inclusive so that any terms described using “or” can indicate any of a single, more than one, and all of the described terms. In addition, in the event of inconsistent usages of terms between this document and documents incorporated herein by reference, the term usage in the incorporated references is supplementary to that of this document; for irreconcilable inconsistencies, the term usage in this document controls.