The present disclosure relates to illumination devices, and in particular to illuminators usable in visual display systems, and related methods.
Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays, such as TV sets, display images to several users, and some visual display systems, such s near-eye displays or NEDs, are intended for individual users.
An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user. The near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications. For example, in an AR system, a user may view both images of virtual objects (e.g., computer-generated images (CGIs)) and the surrounding environment by seeing through a “combiner” component. The combiner of a wearable display is typically transparent to external light but includes some light routing optic to direct the display light into the user's field of view.
Because a display of HMD or NED is usually worn on the head of a user, a large, bulky, unbalanced, and/or heavy display device with a heavy battery would be cumbersome and uncomfortable for the user to wear. Head-mounted display devices require compact and efficient illuminators that provide a uniform, even illumination of a display panel or other objects or elements in the display system.
Exemplary embodiments will now be described in conjunction with the drawings, in which:
While the present teachings are described in conjunction with various embodiments and examples, it is not intended that the present teachings be limited to such embodiments. On the contrary, the present teachings encompass various alternatives and equivalents, as will be appreciated by those of skill in the art. All statements herein reciting principles, aspects, and embodiments of this disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
As used herein, the terms “first”, “second”, and so forth are not intended to imply sequential ordering, but rather are intended to distinguish one element from another, unless explicitly stated. Similarly, sequential ordering of method steps does not imply a sequential order of their execution, unless explicitly stated. In
An illuminator may use a pupil-replicating waveguide to expand the illuminating beam across a surface area to be illuminated such as a display panel, for example. The replicating waveguide expands the illuminating beam by bouncing off opposed parallel surfaces of the waveguide, which may include, for example, a plano-parallel plate. The illuminating beam propagates in the waveguide, and portions of the illuminating beam are out-coupled along the waveguide's length dimension by an out-coupler, typically a grating structure coupled to one of the parallel surfaces.
For efficiency reasons, it may be desirable to increase the angle of propagation of the light inside the waveguide. The angle of propagation may be selected to be large enough such that the beam of light clears the in-coupling structure upon first reflection. Unfortunately, larger angles of propagation may cause illumination intensity drops to appear along the waveguide. This happens because the locations where the propagating light beam illuminates the grating out-coupler may be spaced apart too far, such that no light is out-coupled out of the waveguide between these locations.
In accordance with this disclosure, the problem of dark locations and/or non-uniformity of illumination provided by a waveguide-based illuminator may be mitigated by using at least a pair of light beams in-coupled and co-propagating in the waveguide. The light beams may be coupled at a same edge and/or at opposite edges of the waveguide, and may be configured to fill each other's dark spots between out-coupled beam portions. To further improve the illumination uniformity, the out-coupling grating strength and/or grating thickness may be spatially varied along the waveguide. The two beams may be in-coupled at orthogonal polarizations to suppress optical interference between them. Furthermore, a low coherence length light source may be selected to provide the light beams propagating in the waveguides. The coherence length may be lower than an optical path length difference between neighboring light paths in the waveguide.
In accordance with the present disclosure, there is provided an illuminator comprising a slab of transparent material for in-coupling the first and second light beams into the slab for propagation therein by a series of zigzag reflections from opposed surfaces of the slab along a length dimension of the slab. An out-coupler is provided for out-coupling offset parallel portions of the first and second light beams from the slab along the length dimension. The first light beam portions are offset from one another by a series of gaps spaced along the length dimension, and the second light beam portions are offset from one another by a series of gaps spaced along the length dimension. The gaps between the first light beam portions overlap with the second light beam portions, and the gaps between the second light beam portions overlap with the first light beam portions, for providing a continuous illumination along the length dimension.
In some embodiments, a diameter D of the first and second light beams, a thickness t of the slab between the opposed surfaces, and an angle α of the first and second light beams w.r.t. a normal to the first and second surfaces are selected satisfy the condition t*tan(α)≥D. In some embodiments, full width at half maximum (FWHM) of the gaps between the first light beam portions may be substantially equal to a FWHM of the second light beam portions, and a FWHM of the gaps between the second light beam portions may be substantially equal to a FWHM of the first light beam portions. The first and second light beams emitted by the light source may be orthogonally polarized to reduce optical interference effects.
The out-coupler of the illuminator may include a polarization volume grating (PVH), a volume Bragg grating (VBG), and/or a surface-relief grating (SRG). In embodiments where the out-coupler comprises a PVH, the first and second light beams emitted by the light source may be orthogonally circularly polarized. A thickness of the PVH may vary along the length dimension of the slab for evening out optical power density of the illumination provided by the illuminator along the length dimension of the slab. A coherence length of the light source may be selected to be less than an optical path difference between neighboring optical paths of the first and second light beams, to reduce optical interference effects.
In some embodiments, the light source comprises a directional source for providing a directed light beam, and a grating coupled to the directional source for splitting the directed light beam into the first and second light beams at an angle to each other for joint propagation in the slab generally in a same direction along the length dimension of the slab. The grating may be tunable in pitch.
In embodiments where the light source comprises first and second directional sources for providing the first and second light beams respectively, the first and second light beams may be coupled at opposite edges of the slab to propagate towards each other. In such embodiments, first and second directional sources may be configured for edge-coupling the first and second light beams, respectively, into the slab to propagate towards each other.
In accordance with the present disclosure, there is provided a display device including a display panel for providing an image in linear domain and an illuminator described herein. An ocular lens may be provided for converting the image in linear domain into an image in angular domain to be directly observed by a user's eye placed at an eyebox of the display.
In accordance with the present disclosure, there is further provided a method for illuminating a display panel. The method includes using a light source to provide first and second light beams, in-coupling the first and second light beams into a slab of transparent material, propagating the first and second light beams in the slab by a series of zigzag reflections from opposed surfaces of the slab along a length dimension of the slab, and out-coupling offset parallel portions of the first and second light beams from the slab along the length dimension. The first light beam portions are offset from one another by a series of gaps spaced along the length dimension, and the second light beam portions are offset from one another by a series of gaps spaced along the length dimension. The gaps between the first light beam portions overlap with the second light beam portions, and the gaps between the second light beam portions overlap with the first light beam portions, for providing a continuous illumination of the display panel along the length dimension.
In some embodiments, a diameter D of the first and second light beams, a thickness t of the slab between the opposed surfaces, and an angle α of the first and second light beams w.r.t. a normal to the first and second surfaces satisfy the condition D≥t*tan(α). The first and second light beams emitted by the light source may be orthogonally polarized to reduce unwanted optical interference and fringing. The first and second light beams may propagate in the slab in a same direction or towards each other.
Referring now to
Turning to
The slab 206 receives the first 203 and second 204 light beams. The first 203 and second 204 light beams propagate in the slab 206 towards each other by a series of reflections, e.g. TIRs, from opposed first 221 and second 222 surfaces of the slab 206 in a zigzag pattern along a length dimension 212 of the slab 206. In
The latter point is illustrated in
t*tan(α)=D (1)
When condition (1) is fulfilled, the first light beam 203 shifts by two beam diameters D, which means that the width W of the inter-beam gap 215 is equal to D. When the condition (1) is fulfilled for both the first 203 and second 204 light beams, the width of the first light beam portions 213 is equal to the gap 216 between the second light beam portions 214, and vice versa. In other words, the width of the second light beam portions 214 is equal to the gap 215 between the second light beam portions 213, and vice versa. For light beams having a bell-shaped optical power density distribution, such as a Gaussian distribution for a non-limiting example, a full width at half maximum (FWHM) of the gaps 215 between the first light beam portions 213 may be substantially equal to a FWHM of the second light beam portions 214, and a FWHM of the gaps between 216 the second light beam portions 214 may be substantially equal to a FWHM of the first light beam portions 213. Thus, the first 213 and second 214 light beam portions fill each other's gaps, causing the output illumination to be much more uniform. This is illustrated in
Referring to
In some embodiments, the in-coupling grating 425 may be a polarization-splitting grating such as, for example, a Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating described in U.S. Pat. No. 10,678,116 B1 entitled “Active Multi-Color PBP Elements” to Lam et al., which is incorporated herein by reference. The PBP LC grating can split the light beam emitted by the light source 401 into right circular polarized (RCP) first light beam 403 and left-circular polarized (LCP) second light beam 404. When the first 403 and second 404 light beams are orthogonally polarized, the neighboring first 413 and second 414 light beam portions are also nearly orthogonally polarized, which reduces their mutual optical interference and resulting fringe patterns, thereby further improving spatial uniformity of the output illumination. More generally, any orthogonal or nearly orthogonal polarizations, linear, circular, elliptical, etc., may be used to reduce mutual interference of the interleaved output beam portions.
Turning to
The type of the input grating couplers 107 of
In some embodiments, the strength of the out-coupler grating may be spatially varied to offset illumination non-uniformity inherent to an optical path where a light beam travels within a waveguide and portions of the light beam are out-coupled from the waveguide in sequential manner. As the light beam travels in the waveguide, its optical energy is drained, such that subsequent out-couplings yield less optical power if the out-coupling efficiency is not spatially varied. Due to this effect, the strength of the out-coupling grating needs to be increased along the direction of travel of the light beam to even out the spatial distribution of output illumination's optical power density. Referring to
The illuminators disclosed herein may be used to illuminate a display panel of a display device. Referring to
Turning to
In some embodiments of the method 900, the diameter D of the first and second beams, the thickness t of the slab between the opposed surfaces, and an angle α of the first and second light beams w.r.t. a normal to the first and second surfaces (
Turning to
The purpose of the eye-tracking cameras 1038 is to determine position and/or orientation of both eyes of the user to enable steering the image light to the locations of the user's eyes as disclosed herein. The illuminators 1062 illuminate the eyes at the corresponding eyeboxes 1036, to enable the eye-tracking cameras 1038 to obtain the images of the eyes, as well as to provide reference reflections i.e. glints. The glints may function as reference points in the captured eye image, facilitating the eye gazing direction determination by determining position of the eye pupil images relative to the glints images. To avoid distracting the user with the light of the illuminators 1062, the light illuminating the eyeboxes 1036 may be made invisible to the user. For example, infrared light may be used to illuminate the eyeboxes 1036.
Turning to
In some embodiments, the front body 1102 includes locators 1108 and an inertial measurement unit (IMU) 1110 for tracking acceleration of the HMD 1100, and position sensors 1112 for tracking position of the HMD 1100. The IMU 1110 is an electronic device that generates data indicating a position of the HMD 1100 based on measurement signals received from one or more of position sensors 1112, which generate one or more measurement signals in response to motion of the HMD 1100. Examples of position sensors 1112 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU 1110, or some combination thereof. The position sensors 1112 may be located external to the IMU 1110, internal to the IMU 1110, or some combination thereof.
The locators 1108 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of the entire HMD 1100. Information generated by the IMU 1110 and the position sensors 1112 may be compared with the position and orientation obtained by tracking the locators 1108, for improved tracking accuracy of position and orientation of the HMD 1100. Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space.
The HMD 1100 may further include a depth camera assembly (DCA) 1111, which captures data describing depth information of a local area surrounding some or all of the HMD 1100. The depth information may be compared with the information from the IMU 1110, for better accuracy of determination of position and orientation of the HMD 1100 in 3D space.
The HMD 1100 may further include an eye tracking system 1114 for determining orientation and position of user's eyes in real time. The obtained position and orientation of the eyes also allows the HMD 1100 to determine the gaze direction of the user and to adjust the image generated by the display system 1180 accordingly. The determined gaze direction and vergence angle may be used to adjust the display system 1180 to reduce the vergence-accommodation conflict. The direction and vergence may also be used for displays' exit pupil steering as disclosed herein. Furthermore, the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc. An audio system may also be provided including e.g. a set of small speakers built into the front body 1102.
Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system. An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user. By way of non-limiting examples, artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof. Any of this content may be presented in a single channel or in multiple channels, such as in a stereo video that produces a three-dimensional effect to the viewer. Furthermore, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
The present disclosure is not to be limited in scope by the specific embodiments described herein. Indeed, other various embodiments and modifications, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Thus, such other embodiments and modifications are intended to fall within the scope of the present disclosure. Further, although the present disclosure has been described herein in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the present disclosure may be beneficially implemented in any number of environments for any number of purposes. Accordingly, the claims set forth below should be construed in view of the full breadth and spirit of the present disclosure as described herein.