The present application claims priority from European Patent Application No. EP20305928, filed Aug. 13, 2020, entitled “LOW DISTORTION IMAGING THROUGH A C-SHAPE FLAT OPTICAL ARCHITECTURE.”
The present disclosure relates to the field of optics and photonics, and more specifically to optical device comprising at least one diffraction grating. It may find applications in the field of conformable and wearable optics (e.g. ARNR glasses (Augmented RealityNirtual Reality)), as well as in a variety of other electronic consumer products comprising displays and/or lightweight imaging systems, including head up displays (HUD), as for example in the automotive industry.
This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present disclosure that are described and/or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the systems and methods described herein. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
ARNR glasses are under consideration for a new generation of human-machine interface. Development of ARNR glasses (and more generally eyewear electronic devices) is associated with a number of challenges, including reduction of size and weight of such devices as well as improvement of the image quality (in terms of contrast, field of view, color depth, etc.) that should be realistic enough to enable a truly immersive user experience.
The tradeoff between the image quality and physical size of the optical components motivates research into ultra-compact optical components that can be used as building blocks for more complex optical systems, such as ARNR glasses. It is desirable for such optical components to be easy to fabricate and replicate.
In such ARNR glasses, various types of refractive and diffractive lenses and beam-forming components are used to guide the light from a micro-display or a projector towards the human eye, allowing formation of a virtual image that is superimposed with an image of the physical world seen with a naked eye (in case of AR glasses) or captured by a camera (in case of VR glasses).
Some of kinds of AR/VR glasses utilize an optical waveguide wherein light propagates into the optical waveguide by TIR (for Total Internal Reflection) only over a limited range of internal angles. The FoV (for Field of View) of the waveguide depends on the material of the waveguide, among other factors.
The FoV of a waveguide may be expressed as the maximum span of
which propagates into the waveguide by TIR. In some cases, as illustrated by
having incident angle
and the grazing ray
having incident angle
The critical ray is the light ray that just diffracts into the waveguide at the critical angle
defined by sin
where n2 is the refractive index of the waveguide’s material and λ the wavelength of the incident light. Above the critical angle
total internal reflection (TIR) occurs. The grazing ray is the ray having an input angle that diffracts into the waveguide at grazing incidence, which may be
The theoretical FoV of a waveguide presented above is for a single mode system where one single diffraction mode is used to carry the image: either +1 or -1 diffraction mode.
The field of view of an optical waveguide can be further extended by taking advantage of a second direction of propagation inside of the waveguide, doubling it.
In WO2017180403, a waveguide with extended Field of View (ultra high FoV) is proposed wherein a dual mode image propagation is used. In this method, they use the diffraction mode +1 to carry one side of the image in one direction and the -1 mode to propagate the other side of the image into the opposite direction into the waveguide. Combining both half images is done using pupil expanders and out-couplers at the exit of the waveguide so that the user sees one single image.
Using diffraction orders higher than one has the effect of multiplying the wavelength by the order which is used in the diffraction equation. As the grating pitch is directly a function of the product Mλ, this means that the grating pitch is multiplied by M. This allows for structures used for the in-coupler to be larger and opens up new possibilities in the fabrication technology. For example, nano-imprinting could be used. Also, fewer lines per mm for the grating density are necessary, providing for a simpler fabrication process since the structures will have an over-wavelength size rather than a sub-wavelength size. Such an optical waveguide using both ±2 diffraction orders provides a FoV of about 60° with a refractive index of 1.5. It is thus possible to get a 60° Field of View using a material with refractive index 1.5, instead of 2 in single mode.
However, a 60° FoV is still limited with respect to the total human field of view where stereopsis is effective for human vision and which is about 114°.
Architectures using two waveguides for a full RGB combiner have been investigated in which the green FoV is shared between first and second waveguides, as described in B. C. Kress, “Optical waveguide combiners for AR headsets: features and limitation,” Proc. of SPIE, vol. 11062, p. 110620J, 2019.
Waveguide-based AR/VR glasses can exhibit a wide field of view along one direction (e.g. in a horizontal direction) but may have a narrower field of view along another direction (e.g. in a vertical direction). However, because AR/VR applications generally call for particular aspect ratios, a limitation of the field of view along one direction may, for practical purposes, effectively limit the field of view along the other direction.
References in the specification to “one embodiment,” “an embodiment,” “an example embodiment,” and the like indicate that the embodiment described may include a particular feature, structure, or characteristic, but not every embodiment necessarily includes that particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, such feature, structure, or characteristic may be used in connection with other embodiments whether or not explicitly described.
In some embodiments, a waveguide apparatus includes: an in-coupler grating configured to use diffraction order M1, the in-coupler grating having a first grating pitch Λ1 and a first grating vector
In some embodiments, the out-coupler grating is configured to use a first diffractive order, such that |M4| = 1, and at least one of the in-coupler gratings and the eye pupil expander gratings is configured to use a second diffractive order.
In some embodiments, the out-coupler grating is configured to use a first diffractive order, such that |M4| = 1, and the in-coupler grating and the first and second eye pupil expander gratings are configured to use a second diffractive order, such that |M1| = |M2| = |M3| = 2.
In some embodiments of the waveguide apparatus, wherein the fourth grating pitch Λ4 of the out-coupler substantially satisfies:
In some embodiments, the grating pitches Λ2 and A3 substantially satisfy:
where
In some embodiments, the grating pitch Λ1 substantially satisfies:
In some embodiments, the grating pitches are within 20% of the following values:
In some embodiments, the grating pitches are within 10% of the following values:
In some embodiments, the following relationship is substantially satisfied:
In some embodiments, the following relationships are substantially satisfied, where ϕK = 90° -ΦG:
and
where
In some embodiments, the following relationships are substantially satisfied:
and
where
In some embodiments, the following relationships are substantially satisfied:
and
where
with
and
In some embodiments, the following relationships are substantially satisfied:
and
where
In some embodiments, a waveguide apparatus further includes an image generator configured to generate an image, the in-coupler grating being configured to couple the image along at least one optical path to the out-coupler grating.
A waveguide apparatus according to some embodiments comprises an in-coupler grating, at least one eye pupil expander grating, and an out-coupler grating, wherein each of the in-coupler grating, the eye pupil expander grating, and the out-coupler grating, has a grating pitch greater than 600 nm.
A waveguide apparatus according to some embodiments comprises an in-coupler grating, at least one eye pupil expander grating, and an out-coupler grating, wherein the out-coupler grating is configured to use a first diffractive order, and at least one of the in-coupler grating and the eye pupil expander grating is configured to use a second diffractive order. In some embodiments, the in-coupler grating and the eye pupil expander gratings are configured to use a second diffractive order.
A method according to some embodiments comprises: coupling light into a waveguide using an in-coupler grating configured to use diffraction order M1, the in-coupler grating having a first grating pitch Λ1 and a first grating vector
Described herein are waveguide display systems and methods. An example waveguide display device is illustrated in
Light representing an image 112 generated by the image generator 102 is coupled into a waveguide 104 by a diffractive in-coupler 106. The in-coupler 106 diffracts the light representing the image 112 into one or more diffractive orders. For example, light ray 108, which is one of the light rays representing a portion of the bottom of the image, is diffracted by the in-coupler 106, and one of the diffracted orders 110 (e.g. the second order) is at an angle that is capable of being propagated through the waveguide 104 by total internal reflection.
At least a portion of the light 110 that has been coupled into the waveguide 104 by the diffractive in-coupler 106 is coupled out of the waveguide by a diffractive out-coupler 114. At least some of the light coupled out of the waveguide 104 replicates the incident angle of light coupled into the waveguide. For example, in the illustration, out-coupled light rays 116a, 116b, and 116c replicate the angle of the in-coupled light ray 108. Because light exiting the out-coupler replicates the directions of light that entered the in-coupler, the waveguide substantially replicates the original image 112. A user’s eye 118 can focus on the replicated image.
In the example of
In some embodiments, the waveguide 104 is at least partly transparent with respect to light originating outside the waveguide display. For example, at least some of the light 120 from real-world objects (such as object 122) traverses the waveguide 104, allowing the user to see the real-world objects while using the waveguide display. As light 120 from real-world objects also goes through the diffraction grating 114, there will be multiple diffraction orders and hence multiple images. To minimize the visibility of multiple images, it is desirable for the diffraction order zero (no deviation by 114) to have a great diffraction efficiency for light 120 and order zero, while higher diffraction orders are lower in energy. Thus, in addition to expanding and out-coupling the virtual image, the out-coupler 114 is preferably configured to let through the zero order of the real image. In such embodiments, images displayed by the waveguide display may appear to be superimposed on the real world.
In some embodiments, as described in further detail below, a waveguide display includes more than one waveguide layer. Each waveguide layer may be configured to preferentially convey light with a particular range of wavelengths and/or incident angles from the image generator to the viewer.
As illustrated in
An example layout of another binocular waveguide display is illustrated in
In different embodiments, different features of the waveguide displays may be provided on different surfaces of the waveguides. For example (as in the configuration of
While
For waveguides based on diffraction gratings with an optical system generating a synthetic image to be superimposed in the field of view, it is desirable for lens systems to have real and not virtual exit pupils. In other words, its exit pupil location is external to the lens, and it is also at the same time the aperture stop of the lens.
The lens system of
A lens system may be referred to as afocal if either one of the object or the image is at infinity. The lens system of
A point position on an object may be referred to as a field.
As seen in
The pupil can be tiled spatially. This means that the positive side of the pupil (rays hitting the pupil at y>0) will undergo one diffraction process, while rays hitting the pupil at the negative side (y<0), will undergo another diffraction process. The origin of the y axis is the optical axis. The rays hitting the pupil with some angular sign will undergo a particular process, while those hitting with the opposite sign will undergo another diffraction process. Alternatively, pupil angular tiling may lead to rays with a range [θ1, θ2] being diffracted into one direction in the waveguide while rays with [-θ1, -θ2] are diffracted into the opposite direction.
Another property of an afocal lens is to map all pixels from the display, which are referenced by their respective position in a cartesian coordinates by their (x,y) coordinates on the display, into a spherical coordinate system. With respect to
In the example of
When symmetric diffraction modes are used, the diffraction grating will diffract an incoming ray in the plus or minus order. In some cases, if the ray has one particular sign orientation, it will diffract in one mode, and if the sign changes, it will diffract into the opposite mode. In fact, mathematically, the diffraction occurs always in all modes. Hence what we mean here is that if for a particular direction of incoming ray we diffract into a particular mode, the energy in that mode is stronger than in the mode of opposite sign. Symmetric here means that if a plus direction diffracts efficiently into the mode M, the minus direction will diffract efficiently into the -M direction. (M is a relative natural number.)
A symmetric diffraction grating generally permits the previous property of symmetric diffraction modes. This property may be effected with the use of a basic structure (elementary pitch) that has a left-right geometrical symmetry. Blazed and slanted grating are not symmetric diffraction gratings. Grating based on square shape steps (door shape) can be symmetric diffraction gratings.
Example embodiments use symmetric diffraction gratings that can achieve symmetric diffraction modes of very high efficiency. For opposite signed angle of incidence, some embodiments provide +M or -M diffraction modes of high efficiency.
In a grating as in
In contrast, a diffraction grating with a profile as illustrated in
The incoupler pitch size may be set based on parameters such as the refractive index of the waveguide, the amount of angular overlap near normal incidence, and the grazing angle in the waveguide. The incoupler pitch size may be selected based on a desired horizontal field of view, for example it may be selected to substantially maximize the horizontal field of view.
In examples provided below, the in-coupler’s parameters are indexed by 1. The first eye pupil expanders by 2, the second eye pupil expanders by 3, and the out-coupler by 4. Incoming rays are indexed by 0. Rays diffracted by element 1 are indexed by 1, and so on. Rays emerging from the system are hence indexed by 4. For a waveguide of refractive index n2=1.52 nm and for a red wavelength of λ=625nm, for the grazing angle of
in a case with no angular overlap, using the second diffractive order (M = 2), the pitch Λ1 of the in-coupler may be selected according to
where
Then for eye pupil expanders at 45°, the pitch sizes Λ2 and Λ3 of the eye pupil expanders may be selected according to
Where
Which leads to a pitch of 729.46 nm. The out-coupler may then be selected with the same pitch size as the incoupler. With this choice of parameters, using the second diffractive order for each grating, |M|=2 for each grating, results in the diagram of
In the diagram of
It is desirable to have little to no distortion in a C-shape geometry in order to be compatible with a pupil tiling in-coupler for very high field of view systems.
The grating equation, describing the relationship between an incident light beam and one or more diffracted light beams, can be expressed in a vector format using vectors as shown in
As illustrated in
Using the grating vectors and wavevectors of
where M is an integer representing the diffractive order. The operator “Λ” here signifies the vector cross product (sometimes signified in other sources by “x”). This equation is satisfied both in the case of reflective diffractive orders (in which case the medium of the incident beam is the same as the medium of the diffracted beam, such that n1 = n2), and in the case of transmissive diffractive orders (in which case the medium of the incident beam is not necessarily the same as the medium of the diffracted beam).
Not every mathematical solution to the above equation necessarily represents a physical situation. For example, if
with the sign of the z-component kz being resolved based on physical constraints. For example, the sign of kz is inverted when a beam is reflected but remains the same when a beam is transmitted.
As illustrated in
An out-coupler grating 1508 has grating vector G4 oriented at an angle of 90° with respect to the x-axis.
In operation, a light beam (which may be generated by an image generator) with wavevector
(in the plane of the figure) diffracts to a beam with wavevector
An incoming beam with wavevector
In some embodiments, the pitch Λ1 of the in-coupler grating is selected based on the grazing angle
and on the incident angle
that diffracts to the grazing angle. The angle
may be used to represent an amount of angular overlap between the left and right halves of the field of view. Using the grating equation (a geometric interpretation of which is illustrated graphically in
For example values of
and calculated for wavelength λ = 625 nm, a pitch of Λ1 = 882.5 nm may be selected.
Using the grating equations as described above, the wavevectors may be described by the following relationships:
Canceling
To avoid distortion, it is desirable for the difference between the x- and y- components of the incoming beam
Given the above equation, and setting the condition
It may be noted that this relationship is satisfied in some embodiments that use diffractive orders other than the first diffractive order. For example, in some embodiments, the above relationship is substantially satisfied by a system in which some or all of the diffraction gratings use a second diffractive order. In some embodiments, different diffractive orders are used for different gratings while substantially satisfying the above relationship. For example, in some embodiments, all gratings except the out-coupler are configured to use the second diffractive order, while the out-coupler is configured to use the first diffractive order. Use of the first diffractive order at the out-coupler may help to reduce stray light effects that could otherwise be caused by diffraction of the real-world image.
Because the grating equation is not sensitive to changes in the z-components of wavevectors, this equation may be used regardless of whether the z-component of
Because the sum of the vectors (M4
In some embodiments, the pitch Λ2 and angle ΦG of the first eye pupil expander are selected to substantially maximize the field of view, and the pitch A3 and angle ΦG3 = 90° + ΦG of the second eye pupil expander are selected using the equations above to reduce or minimize distortion.
In some embodiments, to substantially maximize the vertical field of view, the pitch Λ2 and angle ΦG of the first eye pupil expander have one or more of the following relationships. In the following embodiments, it is convenient to use the parameter ϕK, where
It may further be recalled as noted above that
In a first group of embodiments, the angle ϕK falls within the following range:
In the first group of embodiments, the pitch Λ2 of the first eye pupil expander may be selected according to
where
In a second group of embodiments, the angle ϕK falls within the following range:
In the second group of embodiments, the pitch Λ2 of the first eye pupil expander may be selected according to
where
In a third group of embodiments, the angle ϕK falls within the following range:
In the third group of embodiments, the pitch Λ2 of the first eye pupil expander may be selected according to
where
with
and
In a fourth group of embodiments, the angle ϕK satisfies:
In the fourth group of embodiments, the pitch Λ2 of the first eye pupil expander may be selected according to
where
In some embodiments, where ΦG is around 45°, Λ2 and A3 may be selected as follows
where
and where
is a selected grazing angle, which may be 75°. Example solutions for different grating orientations ΦG are illustrated in
Starting again from the condition that the sum of the vectors (M4
Substituting in the above expression for Λ3 gives
which reduces through trigonometric identities to
The above expression may be used to determine the pitch Λ4 of the out-coupler.
Using the expressions above, in some embodiments, ΦG = 45° and the pitches and grating order of the different grating may be selected as follows, for an example embodiment with an overlap angle of zero:
Using only first diffractive orders, the pitches and grating orders in some embodiments may be selected as follows:
In some embodiments, different gratings use different diffractive orders. In an example of one such embodiment, the pitches and grating orders in some embodiments may be selected as follows:
In some embodiments, all grating pitches are above 600 nm.
In some embodiments, one or more of the grating pitches have values within 5% of the above values. In some embodiments, one or more of the grating pitches have values within 10% of the above values. In some embodiments, one or more of the grating pitches have values within 20% of the above values.
In some embodiments, the out-coupler grating is configured to use a first diffractive order, such that |M4| = 1, and at least one of the in-coupler gratings and the eye pupil expander gratings is configured to use a second diffractive order. The use of the first diffractive order for the out-coupler grating generally provides for better transparency of the out-coupler waveguide to light from the ambient scenery (e.g. light 120 of
It may be noted that other relationships can be implemented based on the configurations described above. For example, in some embodiments, the grating pitches may be selected to substantially satisfy
In selecting the pitch and orientation of gratings in a waveguide display, it is desirable to consider limits on the parameters.
and an angle of ΦG=37.48°. The minimum is at
and an angle of ΦG=49.59°.
These values may be different for different values of the refractive index of the waveguide and the grazing angle inside of the waveguide. The pitch sizes vary linearly with the diffraction order. Then, depending on the amount of overlap between portions of the field of view coupled to the left and portions coupled to the right, which may lead to changes in Λ1, the range for Λ4 may be determined using the equations above. In the case of a system without overlap, and using only the second diffractive order, a Λ4 value may be selected between 1211 nm and 1409 nm.
In an overview of an example embodiment, an incoupler grating pitch Λ1 is selected based on the field of view to be coupled into the waveguide. The orientation of a first eye pupil expander may be selected, for example to allow for an out coupler with a relatively smallest pitch size, which may help minimize stray light. In some embodiments, the first eye pupil expander may be oriented with an angle above 45 degrees, which may be desirable in embodiments in which the second eye pupil expander and the out-coupler are fused together to form one grating.
Once the orientation of the first eye pupil expander has been selected, the pitch Λ2 of the first eye pupil expander may be selected to substantially maximize the field of view, or it may be selected based on other considerations. The pitch Λ2 for the first eye pupil expander may, for example, be selected according to the graph of
In example embodiments, the horizontal field of view may be enlarged (e.g. maximized) through selection of the pitch Λ1 and diffractive order M1 of the in-coupler, the vertical field of view may be enlarged (e.g. maximized) through selection of the pitch Λ2 and diffractive order M2 of the first eye pupil expander, and other parameters may be selected to avoid distortion according to one or both of the following relationships:
Parameters selected according to embodiments described herein may depart from exact solutions to the equations provided for practical reasons (such as tolerances in the fabrication process) or other design considerations. In some embodiments, the grating pitches Λ are selected within 5% of a value that satisfies the above equations. In some embodiments, the grating pitches Λ are selected within 10% of a value that satisfies the above equations. In some embodiments, the angle ΦG is within 5° of a value that satisfies the above equations. In some embodiments, the angle ΦG is within 10° of a value that satisfies the above equations. In some embodiments, the grating vectors
In some embodiments, the diffraction grating of a waveguide are all on the same surface of the waveguide (e.g. all on the user-facing surface or all on the opposite surface). In various different embodiments, the diffraction gratings may be provided on different surfaces of the waveguide. For example, one or more of the gratings may be on a user-facing surface of the waveguide, while one or more of the other gratings may be on the opposite surface of the waveguide. In some embodiments, the waveguide gratings may overlap one another. Overlapping gratings may be on opposite sides of the waveguide, or they may at least partially overlap on the same surface of the waveguide. Overlapping gratings on the same surface may take on a cross-hatched form in the region of overlap.
In some embodiments, instead of using two eye pupil expanders for each half of the field of view, four polarization-selective eye pupil expanders may be used for each half of the field of view. For example, the left half of the field of view may use two eye pupil expanders configured for a first polarization state to process the upper-left quarter of the field of view and two eye pupil expanders configured for a second (e.g. orthogonal) polarization state to process the lower-left quarter of the field of view. A similar (e.g. symmetric) arrangement of polarization-sensitive eye pupil expanders may be used to process the upper-right and lower-right quarters of the field of view. In such embodiments, the eye pupil expanders associated with each quarter of the field of view may, as a group together with the in-coupler and out-coupler gratings, substantially satisfy the relationships described herein.
Example embodiments provide a wide field of view while also providing imaging with little to no distortion using a C-shape geometry for the diffraction gratings.
In the present disclosure, modifiers such as “first,” “second,” “third,” and the like are sometimes used to distinguish different features. These modifiers are not meant to imply any particular order of operation or arrangement of components. Moreover, the terms “first,” “second,” “third,” and the like may have different meanings in different embodiments. For example, a component that is the “first” component in one embodiment may be the “second” component in a different embodiment.
Although features and elements are described above in particular combinations, one of ordinary skill in the art will appreciate that each feature or element can be used alone or in any combination with the other features and elements.
Number | Date | Country | Kind |
---|---|---|---|
20305928.2 | Aug 2020 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2021/072246 | 8/10/2021 | WO |