Patent Application
20240085714
Near-eye display (NED) technology may be used to create a virtual image in the field of view (FoV) of one or both eyes of a user. Such technology may be incorporated into wearable displays such as head-mounted displays (HMDs), which can be implemented in the form of different devices. Common implementations include helmet-mounted displays, eyeglasses, visors, and other eyewear. Rather than creating a real image on a surface, a near-eye display presents the virtual images to the eye such that they appear at a distance, making such technology well-suited for applications in augmented reality (AR), virtual reality (VR), and mixed reality (MR).
Near-eye displays generally include a projector and various imaging optics components depending on the specific application. The projector may comprise a light-emitting display (e.g., displays utilizing light-emitting diodes (LEDs), microLEDs (μLEDs), or organic light-emitting diodes (OLEDs)), or an illuminated light-modulating device (e.g., liquid-crystal displays (LCDs), liquid-crystal on silicon (LCOS) displays, or digital micromirror devices (DMDs)). The attainable image resolution, contrast, and color accuracy is a function of a type of projector implemented along with the imaging optics utilized.
One class of imaging optics commonly used for NEDs includes waveguide optics. These systems implement a waveguide that collects light at the input and relays it to the eye, allowing for the projector and other components to be located out of the FoV of a user. Additionally, waveguide optics allow for the integration of multiple optical functions into a thin, transparent, lightweight substrate. For example, the waveguide outcouples light at a multiplicity of points, allowing the exit pupil to be replicated and thus expanding the effective eyebox of the NED.
Examples are disclosed that relate to near-eye display systems including an array of projectors and a one-dimensional exit pupil expander. The array of projectors can be arranged along a first dimension and can output image light towards an input coupler within a waveguide that provides one-dimensional exit pupil expansion. In some implementations, arrays of monochromatic projectors are implemented and arranged in offset columns. The input coupler couples the image light from the array of projectors into a TIR path within the waveguide. Various optical elements, including diffractive and reflective optics, can be implemented as the input coupler. The image light travels within the waveguide until it interacts with an output coupler. Upon interaction with the output coupler, the image light is expanded in a second dimension transverse to the first dimension and is coupled out of the waveguide. Different optical elements, including diffractive and reflective optics, may be implemented as the output coupler.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
For illustrative purposes, it is to be understood that the figures of the present disclosure are not drawn to scale unless stated otherwise.
In some near-eye display systems, a display image is projected and redirected towards a user's eye using various imaging optics. To the eye, the virtual image appears at a distance and appears larger relative to the projector and the optics used to create the image. However, one challenge in this area is to present the display image over a sufficiently large exit pupil. In display applications, this translates to a larger eyebox. One solution is to use multiple projectors to directly provide a larger exit pupil. However, depending on the desired resolution, FoV, and eyebox, the number of projectors can be prohibitively high. Fresnel lenses and pancake optics have been considered. However, both approaches are bulky and non-transparent and therefore suited more for VR or video-passthrough MR applications than optical AR applications.
Solutions utilizing a single projector along with exit pupil expanders have been proposed for providing a sufficiently large exit pupil. An exit pupil expander replicates a single pupil created by a small display engine to multiple points in front of the user's eye, which form the eyebox. One-dimensional exit pupil expanders relying on an anamorphic or large projector have been proposed. Other approaches resort to large and bulky optics to achieve a large eyebox. However, the size and weight of such systems can be unacceptable to a user. More compact solutions use diffractive or reflective structures to provide two-dimensional exit pupil expansion. For example, near-eye display systems have been proposed where the exit pupil of the optical system is expanded using diffraction gratings or partially reflective mirrors in a waveguide structure. In some approaches, the system uses an in-coupling grating to redirect light from a projector into the waveguide. The in-coupled light travels to a second grating that redirects a portion of the light at each grating interaction while the remaining portion continues to travel in the same direction. The grating interactions repeat for the remaining portion of light, and the image is effectively replicated at each interaction to provide exit pupil expansion in one dimension. The redirected portions of light travel to a third grating, which out-couples a portion of the light towards the user's eye at each grating interaction. Similar to the second grating's interactions, the remaining portion continues to travel in the same direction, and the grating interactions are repeated to provide exit pupil expansion in a second dimension. In a typical implementation, the pupil is expanded in two orthogonal directions. For ease of reference, the two orthogonal directions may be referred to as vertical and horizontal directions.
In practical display applications, which demand high color uniformity and large FoVs, implementing two-dimensional exit pupil expansion is a difficult problem that requires balancing size, cost, performance, and manufacturability. For example, designing and testing appropriate diffractive structures can involve modeling and simulating the millions of grating interactions that will occur inside the waveguide. For a waveguide with three separate grating areas, the number of computations and difficulty in manufacturing result in an extensive, time-consuming design and testing process. Another drawback in such systems is light efficiency. More complex grating architectures result in an increase in grating interactions, which will reduce total light efficiency due to interference and general losses of light at grating interactions. Further, light traveling and diffracting within the waveguide can result in multiple light paths that travel to the same point at the out-coupler grating. This can create interference that manifests itself as an output intensity variation and color degradation.
In view of the observations above, examples are disclosed that relate to near-eye displays utilizing an array of projectors and a waveguide for one-dimensional exit pupil expansion in accordance with various implementations of the present disclosure.
As shown, the system 100 includes an array of projectors 102 in communication with a controller 103. Different configurations of projectors may be utilized depending on the application. For example, full color applications may implement multiple single-color projectors. In some implementations, scanned projectors are implemented. For example, projectors implementing scanning elements such as a single two-dimensional scanning mirror or two one-dimensional scanning mirrors can be utilized for forming an image. In other implementations, a single one-dimensional mirror is utilized with a line of LEDs. The controller 103 may be implemented using a logic processor and memory, which can include volatile and/or non-volatile memory. The memory stores instructions, which, when executed by the logic processor, enable operation of the near-eye display. The controller 103 can provide instructions to the array of projectors 102. In other implementations, the controller 103 also provides instructions to additional dynamic components, such as movable mechanic parts, of the near-eye display. In some implementations, the controller 103 is implemented on a printed circuit board in proximity to the array of projectors 102. In other implementations, the controller 103 is implemented as a separate device, such as a personal computer or mobile device, in wired or wireless communication with the near-eye display. For simplicity purposes, controllers are omitted from later figures.
The array of projectors 102 outputs image light 104 towards an input coupler 106, which in-couples the image light 104 into a total internal reflection (TIR) path within a waveguide 108. The array of projectors 102 may be arranged along a first dimension to provide image light 104 similar to image light that have had exit pupil expansion performed in one dimension. As such, the waveguide 108 and input coupler 106 may be designed to receive image light that had exit pupil expansion performed in one dimension. For example, the input coupler 106 may be extended or elongated to accommodate the expanded image light. In the depicted system 100, the projectors 102 are arranged in a row along the Y-Axis indicated in
The input coupler 106 may be implemented using various different optical elements. For example, the input coupler 106 may include a grating, a prism, and/or a mirror. In many applications, the input coupler 106 is designed to have a relatively high efficiency for in-coupling the image light 104 to minimize the amount of light that is loss in the waveguide 108. In the depicted system 100, the input coupler 106 comprises a mirror.
The image light 104 is coupled into the waveguide 108 and travels in a TIR path until it interacts with an output coupler 110. The output coupler 110 may be implemented using various different optical elements. In various examples, the output coupler 110 may include a grating and/or a partially reflective mirror. The output coupler 110 is designed and constructed to have an efficiency profile such that a portion 112 of incident light is redirected out of the waveguide 108 while the remaining portion 114 continues in TIR, resulting in subsequent interactions 116, 118 with the output coupler 110. In the depicted system 100, the output coupler 110 comprises a series of partially reflective mirrors designed to out-couple a portion of incident light while allowing the remaining portion to pass. To help avoid a noticeable dimming of output light along a length of output coupler 110, the efficiency profile of the output coupler 110 can vary in a direction of light propagation. Since the total amount of incident light on subsequent partially reflective mirrors decreases due to the portions that are out-coupled by preceding partially reflective mirrors, the subsequent partially reflective mirrors may be implemented and arranged sequentially to have an increasing efficiency profile in order to out-couple a similar amount of light as preceding partially reflective mirrors. For a specific pixel traveling within the waveguide 108, the set of propagating rays will include rays having complimentary angles to each other. As such, some rays may hit the output coupler 110 at a wrong angle and are not out-coupled. These rays can create noise in the waveguide and may be dealt with using a variety of methods, including designing the waveguide 108 and optical elements 106, 110 such that the noise remains trapped within the waveguide 108 or absorbed at the end.
At each interaction with the output coupler 110, a portion of image light is out-coupled, effectively replicating the image and expanding the exit pupil along the direction in which the image light 104 is traveling. The array of projectors 102 and output coupler 110 can be oriented to expand the exit pupil in a second dimension that is transverse to the first dimension. In some implementations, the second dimension is orthogonal to the first dimension. In the depicted system 100, the image light 104 projected from the array of projectors 102 is effectively expanded along the Y-Axis by the array of projectors 102 and is then expanded in the X-Axis direction by the output coupler 110. Consequently, the out-coupled light 112 is expanded in two dimensions when it is directed towards the user's eye 120. The eye positions that allow the user to see the image form an eyebox 122. Exit pupil expansion enlarges the eyebox 122.
As discussed above, the input and output couplers may be implemented using different optical elements. In the depicted systems of
The systems described above can provide two-dimensional exit pupil expansion using a waveguide designed for exit pupil expansion in only one dimension. Such designs may lower the complexity of the waveguide and, consequently, the manufacturing difficulty and yield. For example, as described above, systems for two-dimensional exit pupil expansion utilize waveguides having three optical elements—a first diffractive element for coupling light into the waveguide, a second diffractive element for exit pupil expansion in a first dimension, and a third diffractive element for exit pupil expansion in a second dimension while simultaneously coupling the light out of the waveguide. In contrast, waveguides in accordance with various implementations of the present disclosure are designed with an input coupler for in-coupling light expanded in a first dimension and an output coupler for expanding light in a second dimension and for coupling the light out of the waveguide. Since the waveguide is designed to receive light that is effectively expanded in a first dimension, an intermediary optical component for exit pupil expansion is not necessary for two-dimensional exit pupil expansion.
Near-eye display systems in accordance with various implementations of the present disclosure provide for architectures that advantageously allow for different manufacturing processes than other systems. For example, the projectors utilized may be simpler and easier to manufacture compared to a single, higher specification projector typically utilized in other near-eye displays. For example, the array of projectors may comprise a single stack of lenslet arrays and a single display device. Further, one-dimensional exit pupil expander waveguides, such as the example depicted in
In some implementations, a plastic waveguide is implemented with bird-bath optics and a semi-transparent reflector to collimate the image light from the array of projectors. This may reduce the cost and size of the near-eye display.
Another advantage in employing waveguides with simpler optics includes implementing full color displays. In near-eye displays using diffraction gratings, implementing full color can utilize different grating layers for each individual RGB color. Solutions based on multiplexing two or more gratings have been proposed for reducing the number of grating layers. However, complexity in manufacturability and design becomes an even larger issue. By implementing one-dimensional exit pupil expanding waveguides, the design of the optics is simplified. For example, multiple monochromatic projectors may be utilized to implement full color in the near-eye display. By using three monochromatic projectors instead of a single full color projector, the cost and complexity of the device increases. However, the optics of each projector are simpler. For example, compared to other methods, correction for chromatic aberrations can be avoided. Issues with color uniformity in diffractive waveguides for two-dimensional exit pupil expansion results from light taking multiple paths and then interfering. With one-dimensional exit-pupil expanding waveguides, the light travels in one path. This avoids interference. Such implementations can result in better color uniformity than waveguides for two-dimensional exit pupil expansion. In some current two-dimensional exit pupil expanding waveguide NEDs, two or even three separate waveguides are used to accommodate the red, green, and blue channels. The simpler one-dimensional exit pupil expanding waveguides can avoid this increase in size, cost, complexity, and weight.
In the depicted system 600 of
In addition to the use of different optical elements for the input coupler, different configurations in the placement of the optical elements can be implemented. For example, implementing full color in near-eye display systems can include the use of multiple sets of monochromatic projectors. In some configurations, each set of monochromatic projectors—e.g., a set of RGB projectors—can be placed at different points relative to the waveguide.
Multiple sets of monochromatic projectors can be implemented as appropriate depending on the application. In some implementations, a first set of projectors is implemented for outputting light within a wavelength range of 600 nm-770 nm, a second set of projectors is implemented for outputting light within a wavelength range of 495 nm-600 nm, and a third set of projectors is implemented for outputting light within a wavelength range of 430 nm-495 nm. In such implementations, the input coupler is designed accordingly to effectively in-couple light from the projectors.
While the projectors 900 are shown here as being in a regular grid, other arrangements are possible.
In near-eye display systems utilizing an array of projectors, each projector may be arranged and configured to output image light corresponding to a section of the image. As the position of the projector shifts, so does the part of the image that it creates.
In implementations where the projectors are not in line (e.g., the projectors are in a packing arrangement with a row or column offset), the input coupling can be adapted to the specific projector arrangement. One way to adapt input coupling into the waveguide is to break the FOV of the projectors into two or more portions.
By using multiple projectors, curved waveguides may be implemented.
Another aspect provides a near-eye display system comprising an array of projectors arranged to output image light having an exit pupil expanded in a first dimension, the array of projectors arranged along the first dimension, and a waveguide comprising an input coupler to in-couple the image light from the array of projectors into the waveguide, and an output coupler to expand an exit pupil of the near-eye display system along a second dimension transverse to the first dimension, and out-couple the image light out of the waveguide. In this aspect, additionally or alternatively, the waveguide comprises plastic. In this aspect, additionally or alternatively, the waveguide comprises glass. In this aspect, additionally or alternatively, the input coupler comprises one or more of a holographic diffraction grating, a surface relief grating, a prism, or a mirror. In this aspect, additionally or alternatively, the array of projectors comprises a first plurality of projectors for outputting light within a wavelength range of 600 nm-770 nm, a second plurality of projectors for outputting light within a wavelength range of 495 nm-600 nm, and a third plurality of projectors for outputting light within a wavelength range of 430 nm-495 nm. In this aspect, additionally or alternatively, the input coupler comprises a dichroic filter. In this aspect, additionally or alternatively, the output coupler comprises one or more of a holographic diffraction grating, a surface relief grating, or a partially reflective mirror. In this aspect, additionally or alternatively, the waveguide is curved, and the array of projectors is arranged in a curved configuration. In this aspect, additionally or alternatively, the array of projectors comprises a first column of projectors and a second column of projectors offset from the first column. In this aspect, additionally or alternatively, the input coupler comprises a first optical element for in-coupling image light from a first projector in the array of projectors having a first portion of a field of view, and a second optical element for in-coupling image light from a second projector in the array of projectors having a second portion of the field of view different from the first portion of the field of view.
Another aspect provides a waveguide comprising an extended input coupler to in-couple image light expanded in a first dimension into the waveguide, and an output coupler to expand the in-coupled image light in a second dimension transverse to the first dimension and to out-couple the image light out of the waveguide. In this aspect, additionally or alternatively, the waveguide comprises plastic. In this aspect, additionally or alternatively, the waveguide comprises glass. In this aspect, additionally or alternatively, the extended input coupler comprises one or more of a holographic diffraction grating, a surface relief grating, a prism, a mirror, or a dichroic filter. In this aspect, additionally or alternatively, the output coupler comprises one or more of a holographic diffraction grating, a surface relief grating, or a partially reflective mirror. In this aspect, additionally or alternatively, the waveguide is curved.
Another aspect provides a method for providing two-dimensional exit pupil expansion, the method comprising projecting image light using an array of projectors arranged in a first dimension, using an input coupler, redirecting the projected image light towards an output coupler within a waveguide in a total internal reflection path, using the output coupler, expanding the redirected image light in a second dimension transverse to the first dimension, and using the output coupler, out-couple the expanded image light out of the waveguide. In this aspect, additionally or alternatively, the array of projectors comprises a first plurality of projectors for outputting light within a wavelength range of 600 nm-770 nm, a second plurality of projectors for outputting light within a wavelength range of 495 nm-600 nm, and a third plurality of projectors for outputting light within a wavelength range of 430 nm-495 nm. In this aspect, additionally or alternatively, the array of projectors comprises a first column of projectors and a second column of projectors offset from the first column. In this aspect, additionally or alternatively, the input coupler comprises one or more of a diffraction grating, a prism, a mirror, or a dichroic filter, and the output coupler comprises one or more of a one or more of a holographic diffraction grating, a surface relief grating, or a partially reflective mirror.
It will be understood that the configurations and/or approaches described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. As such, various acts illustrated and/or described may be performed in the sequence illustrated and/or described, in other sequences, in parallel, or omitted. Likewise, the order of the above-described processes may be changed.
The subject matter of the present disclosure includes all novel and non-obvious combinations and sub-combinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.
