This invention generally relates to optical light guides for conveying image-bearing light to a viewer particularly for use in video eyewear or augmented or virtual reality near-eye displays.
Head-Mounted Displays (HMDs), which include near eye displays in a form resembling conventional eyeglasses or sunglasses, are being developed for a range of diverse uses, including military, commercial, industrial, fire-fighting, and entertainment applications. For many of these applications, there is particular value in forming a virtual image that can be visually superimposed over the real-world image that lies in the field of view of the HMD user. Light guides incorporating various types of waveguides relay image-bearing light to a viewer in a narrow space, acting as exit-pupil expanders for redirecting the virtual image to the viewer's pupil and enabling this superposition function.
In the conventional light guide, collimated angularly related light beams from an image source are coupled into the light guide substrate, generally referred to as a waveguide, by an input optical coupling such as an in-coupling diffraction grating, which can be formed on a surface of the substrate or buried within the substrate. Other types of diffractive optics could be used as input couplings, including diffractive structures formed of alternating materials of variable index such as holographic polymer dispersed liquid crystal (HPDLC) or volume holograms. The diffractive optics could also be formed as surface relief diffraction gratings. The collimated light beams can be directed out of the waveguide by a similar output optical coupling, which can also take the form of a diffractive optic. The collimated angularly related beams ejected from the waveguide overlap at an eye relief distance from the waveguide forming an exit pupil within which a virtual image generated by the image source can be viewed. The area of the exit pupil through which the virtual image can be viewed at the eye relief distance is referred to as an “eyebox.”
The output coupling can also be arranged for enlarging the exit pupil. For example, the collimated beams can be enlarged in one dimension by offsetting partially reflected portions of the collimated beams in a direction at which the collimated beams propagate along the output coupling or by ejecting collimated beams of different angles from different positions along the waveguide to more efficiently overlap the collimated beams at the eye relief distance from the waveguide.
A so-called “turning optic” located along the waveguide between the input coupling and the output coupling, can be used for expanding pupil size in a second dimension. The expansion can be effected by offsetting reflected portions of the collimated beam to enlarge a second dimension of the beams themselves or by directing the collimated beams to different areas of the output coupling so the collimated beams of different angles are ejected from different positions to more efficiently overlap within the eyebox. The turning optic can also take the form of a diffractive optic and, especially when located between the diffraction gratings of the input coupling and output coupling, can also be referred to as an intermediate grating.
Although conventional light guide mechanisms have provided a significant reduction in bulk, weight, and overall cost of display optics, there are still issues to resolve. Suitable separation of color channels is need in order to prevent cross-talk, in which color is processed and displayed from the wrong color channel. Cross-talk can lead to disparity between the color image data and the displayed color, and can also be a cause of objectionable color shifts, perceptible across the image field. Attempts to correct this problem have included stacking approaches in which multiple waveguides are stacked together with optional filters to prevent color from being directed to the wrong channel. Stacking, however, leads to thicker devices, adds weight, reduces brightness, and has not provided highly satisfactory results.
Thus, it can be appreciated that there is a need for improved designs that still provide the pupil expansion capabilities of the optical light guide, but allow these devices to be thinner and more lightweight, without compromising image quality and color balance.
It is an object of the present disclosure to advance the art of image presentation when using compact head-mounted devices and similar imaging apparatus. Advantageously, embodiments of the present disclosure provide an improved double-sided beam expander capable of handling two color channels within a single thickness of substrate.
These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following detailed description of the preferred embodiments and appended claims, and by reference to the accompanying drawings.
According to an aspect of the present disclosure, there is provided an imaging light guide including a waveguide for conveying image-bearing light beams from an image source to an eyebox within which a virtual image can be viewed. A first in-coupling diffractive optic directs a first set of the image-bearing light beams into the waveguide along a first path. A first turning diffractive optic disposed along the first path expands the image-bearing light beams of the first set in a first dimension and directs the expanded image-bearing light beams of the first set to a first out-coupling diffractive optic. The first out-coupling diffractive optic further expands the image-bearing light beams of the first set in a second dimension and directs the further expanded image-bearing light beams of the first set from the waveguide toward the eyebox. A second in-coupling diffractive optic directs a second set of the image-bearing light beams into the waveguide along a second path that is different from the first path. A second turning diffractive optic disposed along the second path expands the image-bearing light beams of the first set in a first dimension and directs the expanded image-bearing light beams of the second set to a second out-coupling diffractive optic. The second out-coupling diffractive optic further expands the image-bearing light beams of the second set in a second dimension and directs the further expanded image-bearing light beams of the second set from the waveguide toward the eyebox.
The first in-coupling diffractive optic can have a first in-coupling grating vector for directing the first set of the image-bearing light beams into the waveguide along the first path, the second in-coupling diffractive optic can have a second in-coupling grating vector for directing the second set of the image-bearing light beams into the waveguide along the second path, and the first in-coupling grating vector can be oriented away from the second in-coupling grating vector. Similarly, the first out-coupling diffractive optic can have a first out-coupling grating vector for directing the first set of the image-bearing light beams out of the waveguide, the second out-coupling diffractive optic can have a second out-coupling grating vector for directing the second set of the image-bearing light beams out of the waveguide, and the first out-coupling grating vector can be oriented away from the second out-coupling grating vector. Either or both the first in-coupling grating vector and second in-coupling grating vector or the first out-coupling grating vector and second out-coupling grating vector are relatively oriented away from each other by 25 to 40 degrees.
The first set of image bearing beams can comprise a first range of wavelengths and the second set of image bearing beams can comprise a second range of wavelengths that differs from the first range of wavelengths. Alternatively, the first set of image bearing beams can comprise a first range of angularly related beams and the second set of image bearing beams can comprise a second range of angularly related beams that differs from the first range of angularly related beams.
While the specification concludes with claims particularly pointing out and distinctly claiming the subject matter of the present invention, it is believed that the invention will be better understood from the following description when taken in conjunction with the accompanying drawings.
The present description is directed in particular to elements forming part of, or cooperating more directly with, apparatus in accordance with the invention. It is to be understood that elements not specifically shown or described may take various forms well known to those skilled in the art.
Where they are used herein, the terms “first”, “second”, and so on, do not necessarily denote any ordinal, sequential, or priority relation, but are simply used to more clearly distinguish one element or set of elements from another, unless specified otherwise. The terms “top” and “bottom” do not necessarily designate spatial position but provide relative information about a structure, such as to distinguish opposing surfaces of a planar (flat) waveguide.
In the context of the present disclosure, the terms “viewer”, “operator”, “observer”, and “user” are considered to be equivalent and refer to the person who wears the HMD viewing device.
As used herein, the term “energizable” relates to a device or set of components that perform an indicated function upon receiving power and, optionally, upon receiving an enabling signal.
The term “actuable” has its conventional meaning, relating to a device or component that is capable of effecting an action in response to a stimulus, such as in response to an electrical signal, for example.
The term “set”, as used herein, refers to a non-empty set, as the concept of a collection of elements or members of a set is widely understood in elementary mathematics. The term “subset”, unless otherwise explicitly stated, is used herein to refer to a non-empty proper subset, that is, to a subset of the larger set, having one or more members. For a set S, a subset may comprise the complete set S. A “proper subset” of set S, however, is strictly contained in set S and excludes at least one member of set S.
In the context of the present disclosure, the term “oblique” means at an angle that is not an integer multiple of 90 degrees. Two lines, linear structures, or planes, for example, are considered to be oblique with respect to each other if they diverge from or converge toward each other at an angle that is at least about 5 degrees or more away from parallel, or at least about 5 degrees or more away from orthogonal.
In the context of the present disclosure, the terms “wavelength band” and “wavelength range” are equivalent and have their standard connotation as used by those skilled in the art of color imaging and refer to a range of light wavelengths that are used to form one or more colors in polychromatic images. Different wavelength bands are directed through different color channels, such as to provide red, green, and blue primary colors in conventional color imaging applications.
As an alternative to real image projection, an optical system can produce a virtual image display. In contrast to methods for forming a real image, a virtual image is not formed on a display surface. That is, if a display surface were positioned at the perceived location of a virtual image, no image would be formed on that surface. A virtual image display has a number of inherent advantages for an augmented reality display. For example, the apparent size of a virtual image is not limited by the size or location of a display surface. Additionally, the source object for a virtual image may be small; a magnifying glass, as a simple example, provides a virtual image of its object. In comparison with systems that project a real image, a more realistic viewing experience can be provided by forming a virtual image that appears to be some distance away. Providing a virtual image also obviates any need to compensate for screen artifacts, as may be necessary when projecting a real image.
In the context of the present disclosure, the term “coupled” is intended to indicate a physical association, connection, relation, or linking, between two or more components, such that the disposition of one component affects the spatial disposition of a component to which it is coupled. For mechanical coupling, two components need not be in direct contact, but can be linked through one or more intermediary components. A component for optical coupling allows light energy to be input to, or output from, an optical apparatus. The terms “beam expander” and “pupil expander” are considered to be synonymous, used interchangeably herein.
When used as a part of a virtual display system, in-coupling diffractive optic 110 couples each of a plurality of angularly related in-coming image-bearing light beams WI from an imager, via suitable front end optics (not shown), into the substrate S the waveguide 22. The input light beams WI are diffracted by in-coupling diffractive optic 110. For example, first order diffracted light propagates as an angularly related set of beams WG along the substrate S, moving toward the right in the
The perspective view of
The grating vectors, generally designated k and shown with subscripts where they are specific to light within a color channel, extend parallel to the plane of the waveguide surface and are in the direction of the periodicity of the in-coupling and out-coupling diffractive optics 110 and 120, respectively.
In considering a light guide design used for imaging it should be noted that image-bearing light traveling within a waveguide is effectively encoded by the in-coupling optics, whether the in-coupling mechanism uses gratings, holograms, prisms, mirrors, or some other mechanism. Any reflection, refraction, and/or diffraction of light that takes place at the input must be correspondingly decoded by the output in order to re-form the virtual image that is presented to the viewer.
A turning grating TG, placed at an intermediate position between the input and output couplings, such as the in-coupling and out-coupling diffractive optics 110 and 120, is typically chosen to minimize any changes on the encoded light. As such, the pitch of the turning grating preferably matches the pitch of the in-coupling and out-coupling diffractive optics 110 and 120. In addition, the virtual image can be preserved by orienting the turning grating at around 60 degrees to in-coupling and out-coupling diffractive optics 110 and 120 in such a way that the encoded ray bundles are turned 120 degrees by one of the 1st reflection orders of the turning grating TG. The diffractive effects of the turning grating TG are most pronounced on the vector component of the incoming rays that are parallel to the grating vector of the turning grating. Turning gratings so arranged redirect ray bundles within the guide substrate while minimizing any changes to the encoded angular information of the virtual image. The resultant virtual image in such a designed system is not rotated. If such a system did introduce any rotation to the virtual image, the rotational effects could be non-uniformly distributed across different field angles and wavelengths of light, thus causing unwanted distortions or chromatic aberrations in the resultant virtual image.
The use of turning grating TG as envisioned for certain embodiments described herein preserves an inherent geometrical accuracy to the design of the light guide 20 so that the input beam and output beam are symmetrically oriented with respect to each other. With proper grating TG spacing and orientation, grating vectors k direct the light from the in-coupling diffractive optic 110 to the out-coupling diffractive optic 120. It should be noted that the image that is formed for the imaging light guide viewer is a virtual image, focused at infinity or at least well in front of the light guide 20, but with the relative orientation of output image content to input image content preserved. A change in the rotation about the z axis or angular orientation of incoming light beams WI with respect to the x-y plane can cause a corresponding symmetric change in rotation or angular orientation of outgoing light from out-coupling diffractive optic (ODO) 120. From the aspect of image orientation, turning grating TG is intended to function as a type of optical relay, providing expansion along one axis of the image that is input through the in-coupling diffractive optic (IDO) 110 and redirected to out-coupling diffractive optic (ODO) 120. Turning grating TG is typically a slanted or square grating or, alternately, can be a blazed grating. Reflective surfaces can alternately be used for turning the light toward the out-coupling diffractive optic 120.
Beam expansion in two different dimensions is provided when using the arrangement of
The known imaging light guide 20 that is shown in
One acknowledged shortcoming of the known imaging light guide beam expander relates to color quality. By design, a diffraction grating is optimized for a particular wavelength, with progressively degrading imaging performance as wavelengths deviate further from the specified wavelength. Moreover, not only does performance shift according to wavelength, but changes in incident angle have more pronounced effects that vary with wavelength differences. Because of this, undesirable color shifts can be perceived across an image field when using the known type of diffractive beam expander. The color shift problem proves extremely difficult to compensate for in software, since the amount of color shift can vary widely across the image field.
One approach for addressing the color shift problem is using separate waveguides to serve the different primary color channels, with diffraction elements suitably designed for handling light of different wavelength bands. One proposed approach stacks of multiple waveguides to effect beam expansion. Stacking can be used to delegate the separate red (R), blue (B), and green (G) color channels to individual waveguides, wherein the diffractive components for each waveguide are designed suitably for light of different wavelength bands. Cross-talk between color channels is reduced using stacked waveguides with separate diffraction gratings and optional color filters.
While stacking approaches can achieve some measure of channel separation, the added weight, size, complexity, and cost of stacked waveguide solutions can be significant. It can readily be appreciated that solutions that would provide separate color channels within a single waveguide, without appreciable color channel crosstalk, would be advantageous for helping to reduce color shifts and improve color quality overall.
Double-Sided Imaging Light Guide
It should be noted that any of a number of arrangements of color channels and their associated bandwidth ranges can be used, such as including green and red wavelength bands within one color channel and blue wavelength bands in another color channel.
Cross-Talk Concerns
Cross-talk between color channels can be a problem with any type of imaging system, including arrangements using multiple stacked waveguides, but is a particular concern for designs using a single waveguide. One approach for defeating crosstalk separates the optical paths within the light guide as much as is possible, both in terms of angle and of distance. For the example, as shown in
For a better understanding of the solutions proposed herein, it is instructive to examine the behavior of different parts of the optical system in light of the cross-talk prevention strategy outlined above.
Because it is a side view,
The grating direction, corresponding to the grating vectors kR and kBG, determines the path of light that is diffracted by each in-coupling diffractive optic 110R and 110BG. Peak separation between paths is achieved when the paths of the R and BG light beams are orthogonal to each other; this maximum path separation occurs when rotation angle ϕ is at or very near 90 degrees. As angle ϕ decreases somewhat from 90 degrees, entry of light into the wrong path and resulting cross-talk become increasingly more likely.
In each color channel CBG and CR, the respective turning grating TGBG and TGR redirect incident light from the waveguide at a nominal 60 degree angle. The turning gratings TGBG and TGR are designed and oriented specifically to provide this behavior and generally operate to accept diffracted light input and provide redirected light output at this comparatively fixed angle.
Out-coupling diffractive optics 120BG and 120R that face each other (formed on opposite surfaces along a common normal) provide best performance with input light that is orthogonal. Out-coupling diffractive optics 120BG and 120R then have their relative grating angles at orthogonal to each other. At the out-coupling optics 120BG and 120R, the likelihood of color channel cross-talk increases as grating angles and incident angles diverge from orthogonal.
The geometric constraints on respective angles needed for best performance of in-coupling and out-coupling diffraction gratings, as outlined above, cannot be met without making at least some type of compromise. The turning grating, for example, provides some small degree of adjustability for turning angle θ, based on the pitch Pnew, which can be generally computed based on the input pitch Pinput, using:
Pnew=Pinput(2 cos θ)
Thus, for turning light from an in-coupling diffractive grating 110 having a 350 nm pitch, a turning grating TG having a 305 nm pitch would be required to provide a turning angle θ of 55 degrees. Achieving a smaller turn angle would require a very high pitch that might easily be too difficult or costly to fabricate. For example, a 272 nm pitch grating would be required for a turning angle θ of 50 degrees. Thus, although it can be possible to adjust the turning angle by a few degrees, it is far more practical to make some adjustment to the respective rotational angles ϕIN and ΦOUT between in-coupling diffractive optics 110R and 110BG and out-coupling diffractive optics 120R and 120BG to angles less than the ideal orthogonal angle.
Adjusting the gratings rotation angles so that components fit within the conventional waveguide footprint and so that rotation angles for facing diffraction gratings differ by the largest possible angle yields the beam expander 140 design shown in
The arrangement shown in
While color crosstalk that results from channel proximity remains a factor that must be considered, gratings rotation angle differences ϕ of much less than 60 degrees can provide more favorable performance than the arrangement of
In
The graph of
When the diffraction gratings of in-coupling diffractive optics 110BG and 110R are rotated so that angle ϕ is below about 40 degrees, diffraction efficiency is less than 20% so that very little first-order diffraction of light at 40 degree angular incidence occurs. When this is the case, blue/green incident light beams at 40 degrees can simply reflect from the red in-coupling 110R grating surface, as in conventional TIR. As rotation angle ϕ increases above 50 degrees, however, first order reflective diffraction increases dramatically. At 60 degrees, first-order reflective diffraction approaches a maximum, at nearly 75% for a target wavelength.
Notably,
Comparing
As is shown in
The perspective view of
According to an alternate embodiment of the present disclosure, as shown in
Although in the above examples the front and back surfaces of the waveguide substrate S support pairings of diffractive optics for separately conveying different color channels, the opposite side diffractive optics can also be arranged for conveying different portions of the field of view, where the opposite side diffractive optics are optimized for conveying different angular ranges of the image-bearing light beams. That is, the diffractive optics can be optimized for diffracting different ranges of wavelengths or different ranges of incident angles or a combination of the two.
In addition, the two-sided light guides for conveying different ranges of wavelengths or different angularly distinguished portions of the field of view can be combined with other single or two-sided light guides in a stack as previously practiced for single-sided waveguides to further separate the conveyance of different ranges or wavelengths or portions of the field of view. For example, a compound imaging light guide can be provided with three separate color channels, formed using a double-sided light guide arranged as a beam expander for first and second wavelength bands, and using a second single-sided light guide arranged as a beam expander for the third wavelength band.
An exploded side view diagram of
It can be appreciated that the embodiment shown in
Imaging Light Guide Fabrication
Various processes can be used to fabricate and assemble the imaging light guides. In-coupling diffractive optics 110 and out-coupling diffractive optics 120 can be diffraction gratings or formed as volume holograms, or formed from a holographic polymer dispersed liquid crystal, for example. At least one of the in-coupling and out-coupling diffractive optics can be a surface relief diffraction grating. The waveguide substrate of the imaging light guide is a transparent optical material, typically glass or optical polymer material with sufficient index of refraction for supporting TIR transmission between in-coupling diffractive optic, turning grating, and out-coupling diffractive optic.
In-coupling diffractive optics 110, turning gratings TG, and out-coupling diffractive optics 120 have different grating periods appropriate to their respective color channels. Typically the grating pitch, or grating period, is a value from 75 to about 90 percent of the central wavelength for a color channel. For example, the in-coupling diffractive optic 110R for the red channel (620-670 nm), in an exemplary embodiment, has a period of 510 nm, a depth of 205 nm, 50/50 fill, and a 45-degree slant.
After proper surface preparation of a glass substrate blank, the diffraction components are formed on one or both outer surfaces of the waveguide substrate S using nano-imprinting methods, for example. At least one of the in-couplings and out-couplings can be a surface relief diffraction grating.
The invention has been described in detail with particular reference to a presently preferred embodiment, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2017/012340 | 1/5/2017 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2017/120341 | 7/13/2017 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
8233204 | Robbins et al. | Jul 2012 | B1 |
8320032 | Levola | Nov 2012 | B2 |
20060126179 | Levola | Jun 2006 | A1 |
20070188837 | Shimizu et al. | Aug 2007 | A1 |
20100202725 | Popovich | Aug 2010 | A1 |
20100214659 | Levola | Aug 2010 | A1 |
20130051730 | Travers et al. | Feb 2013 | A1 |
20130314789 | Saarikko | Nov 2013 | A1 |
20140140654 | Brown | May 2014 | A1 |
20140300966 | Travers | Oct 2014 | A1 |
20150125109 | Robbins et al. | May 2015 | A1 |
20170322419 | TeKolste et al. | Nov 2017 | A1 |
Number | Date | Country |
---|---|---|
2196729 | Jun 2010 | EP |
2007219106 | Aug 2007 | JP |
2008523434 | Jul 2008 | JP |
2012189947 | Oct 2012 | JP |
2017531840 | Oct 2017 | JP |
2015096859 | Jul 2015 | WO |
Entry |
---|
International Search Report for International Application No. PCT/US2017/012340 dated Mar. 13, 2017. |
International Written Opinion for International Application No. PCT/US2017/012340 dated Mar. 13, 2017. |
Japanese Patent Office, Notice of Reasons for Refusal, JP Patent Application No. 2018-532307, dated Jul. 16, 2019. |
European Patent Office, Extended European Search Report, EP Patent Application No. 17736339.7, dated Aug. 7, 2019. |
Number | Date | Country | |
---|---|---|---|
20200278543 A1 | Sep 2020 | US |
Number | Date | Country | |
---|---|---|---|
62275558 | Jan 2016 | US |