The present disclosure relates visual display devices and related components, modules, and methods.
Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays such as TV sets display images to several users, and some visual display systems such as near-eye displays (NEDs) are intended for individual users.
An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user. The near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications. For example, in an AR system, a user may view images of virtual objects (e.g., computer-generated images (CGIs)) superimposed with the surrounding environment by seeing through a “combiner” component. The combiner of a wearable display is typically transparent to external light but includes some light routing optic to direct the display light into the user's field of view.
Because a display of HMD or NED is usually worn on the head of a user, a large, bulky, unbalanced, and/or heavy display device with a heavy battery would be cumbersome and uncomfortable for the user to wear. Consequently, head-mounted display devices can benefit from a compact and efficient configuration, including efficient light sources and illuminators providing illumination of a display panel, high-throughput combiner components, ocular lenses, and other optical elements in the image forming train.
Exemplary embodiments will now be described in conjunction with the drawings, which are not to scale, in which like elements are indicated with like reference numerals, and in which:
While the present teachings are described in conjunction with various embodiments and examples, it is not intended that the present teachings be limited to such embodiments. On the contrary, the present teachings encompass various alternatives and equivalents, as will be appreciated by those of skill in the art. All statements herein reciting principles, aspects, and embodiments of this disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
As used herein, the terms “first”, “second”, and so forth are not intended to imply sequential ordering, but rather are intended to distinguish one element from another, unless explicitly stated. Similarly, sequential ordering of method steps does not imply a sequential order of their execution, unless explicitly stated.
AR and VR displays may use pupil-replicating lightguides to carry images to an eyebox and/or to illuminate display panels that generate images to be displayed. Herein the term “eyebox” means a geometrical area for the user's eye where a good-quality image may be observed by a user of the NED. A pupil-replicating lightguide may include grating structures for in-coupling a light beam into the lightguide, and/or for out-coupling portions of the light beam along the waveguide surface. In accordance with this disclosure, a grating structure of a pupil-replicating lightguide may include a tunable/switchable grating with switchable or tunable diffraction efficiency, grating pitch or grating period, blazing angle, etc. The terms “grating pitch” and “grating period” are used herein interchangeably. The term “tunable” encompasses both continuously tunable and switchable between two or more states. The term “diffraction efficiency” refers to aspects of the performance of the diffraction grating in terms of power throughput of the diffraction grating. In particular, the diffraction efficiency can be a measure of the optical power diffracted into a given direction compared to the power incident onto the diffractive element. In examples described herein, the diffraction efficiency is typically a measure of the optical power diffracted by the grating or a segment thereof in the first order of diffraction relative to the power incident onto the grating or the segment thereof. The term “output efficiency” as used herein refers to a fraction of the optical power of a light source of a display apparatus that is available to the user for viewing images.
An aspect of the present disclosure relates to a display system comprising a pupil replicating lightguide configured to convey images to a viewing area (“eyebox”). The lightguide is configured to receive image light emitted by an image light source and to convey the image light to the eyebox for presenting to a user in an angular domain within a field-of-view (FOV) of the display. The term “field of view” (FOV), when used in relation to a display system, may refer to an angular range of light propagation supported by the system or visible to the user. A two-dimensional (2D) FOV may be defined by angular ranges in two orthogonal planes. For example, a 2D FOV of a NED device may be defined by two one-dimensional (1D) FOVs, which may be a vertical FOV, for example +\−20° relative to a horizontal plane, and a horizontal FOV, for example +\−30° relative to the vertical plane. With respect to a FOV of a NED, the “vertical” and “horizontal” planes or directions may be defined relative to the head of a standing person wearing the NED. Otherwise the terms “vertical” and “horizontal” may be used in the present disclosure with reference to two orthogonal planes of an optical system or device being described, without implying any particular relationship to the environment in which the optical system or device is used, or any particular orientation thereof to the environment. The term “eyebox” refers to a viewing area, i.e. a spatial region, where a user's eye may be located for a satisfactory image quality, typically near an output region of the lightguide for embodiments described herein. In the context of this specification, the terms “viewing area” and “eyebox” are used interchangeably.
Embodiments described herein relate to a pupil replicating lightguide operable to convey an image to a viewer (“user”) in a manner adaptive to the position of a viewer's eye within an eyebox of the display system. Such eye-adaptive lightguides may include segmented output diffraction gratings with individual segments switchable between a diffracting state and a substantially non-diffracting state depending on the eye/eye pupil position and, optionally, gaze direction. Typically, e.g. for a NED or a heads-up display, having a large eyebox is advantageous as it allows accommodating users with different interpupillary distance, and generally relaxes many requirements on the display and the positioning of the user's head relative to the display. Supporting a large eyebox however may require a large-area out-coupler, e.g. a large-area out-coupling (“output”) grating, only a portion of which is actually useful for any specific eye position within the eyebox. Adapting an active area of the out-coupler to the eye position, e.g. by switching off diffraction from the unused portion ore segments of the out-coupler, may enable increasing the lightguide throughput, and thus making the image brighter for the viewer, and may also reduce the appearance of some visual artifacts. In some embodiments, adjusting the diffraction efficiency in the useful portion of the out-coupler to the eye position, may enable a greater uniformity of the image across the FOV.
Accordingly, an aspect of the present disclosure provides a display apparatus comprising a lightguide for relaying image light to an eyebox, the lightguide comprising a substrate and an out-coupler integral with the substrate, and an eye detector configured to detect a position of an eye of a user in the eyebox. The out-coupler comprises a plurality of grating segments, each grating segment configured for diffracting at least a portion of the image light out of the substrate toward a corresponding portion of the eyebox, the grating segments being separately electrically tunable responsive to a control signal from the eye detector. The control signal may be indicative of the position of the eye pupil in the eyebox. The image light may carry an image in angular domain within an image field-of-view (FOV).
In some implementations, the grating segments are switchable between a diffracting state and a substantially non-diffracting state responsive to the control signal. In some implementations, the display apparatus may comprise a controller coupled to the out-coupler and the eye detector. The controller may be configured to switch to the substantially non-diffracting state those of the grating segments that are located outside of the image FOV from the eye pupil position in the eyebox. In some implementations the grating segments may have tunable diffraction efficiency in the diffracting state. The controller may be configured to selectively tune the diffraction efficiency of those of the grating segments that remain in the diffracting state. In some implementations at least one of the grating segments may have a grating pitch that is electrically tunable responsive to the control signal.
In some implementations, the plurality of grating segments comprises a liquid crystal layer between two transparent electrodes, wherein at least one of the transparent electrodes comprises a plurality of electrode segments. In some implementations, the plurality of grating segments comprises a fluidic grating.
In any of the above implementations, the display apparatus may further comprise an input coupler for coupling the image light into the substrate, the substrate comprising two opposing surfaces for guiding the image light within the substrate by total internal reflection (TIR) from the surfaces, the grating segments extending along the two surfaces.
In any of the above implementations, the display apparatus may further comprise a source of the image light.
An aspect of the present disclosure provides a method for displaying an image to a user, the method comprising: coupling image light into a lightguide having an output coupler adjacent a viewing area, the output coupler comprising a plurality of separately tunable grating segments, each grating segment operable to diffract at least a portion of the image light toward a corresponding segment of the viewing area; detecting a position of an eye pupil of the user in the viewing area; and tuning a first subset of the grating segments to a substantially non-diffracting state, the first subset being selected responsive to the position of the eye pupil.
In some implementations, the method is for displaying the image in an image FOV, and the first subset comprises the grating segments located outside of the image FOV when viewed from the position of the eye pupil. In some implementations the method comprises adjusting a diffraction efficiency of a second subset of the grating segments, the second subset comprising the grating segments located within the image FOV when viewed from the position of the eye pupil.
The method may include determining a change in the position of the eye pupil; responsive to the change, switching a grating segment from the first subset to a diffracting state, and switching another grating segment to the substantially non-diffracting state, the other grating segment being located within the image FOV for the position of the eye pupil before the change.
The tuning may include changing a voltage applied to the grating segments of the first subset to reduce an amplitude of a refractive index modulation therein for at least one polarization of incident light.
The method may include providing an electrical control signal to a voltage source coupled to the grating segments, the electrical control signal comprising information indicative of the position of the eye pupil, and changing a voltage applied to at least some of the segments depending on the electrical control signal.
An aspect of the present disclosure provides a display sub-assembly comprising a lightguide for relaying image light to an eyebox, the lightguide comprising: a substrate of optically transparent material comprising opposed outer surfaces for guiding the image light in the substrate by reflections therefrom, and an out-coupler disposed in or upon the substrate, the out-coupler configured to couple the image light out of the substrate toward the eyebox. The out-coupler comprises a plurality of independently electrically controlled grating segments disposed along the opposed surfaces, the segments being individually switchable between a diffracting state and a substantially non-diffracting state.
The display sub-assembly may comprise an eye detector configured to detect a position of an eye pupil of a user in the eyebox and operatively coupled to the out-coupler.
In some implementations, the plurality of grating segments comprises a liquid crystal layer between layers of electrically conducting optically transparent material, wherein at least one of the layers comprises a plurality of separate electrode segments. In some implementations the plurality of grating segments comprises a fluidic grating.
The ODG 140 includes a plurality of individually tunable grating segments 141i, i=1, . . . , N, which are disposed, e.g. tiled side by side, along the surfaces 121 and 122 to cover an output area of the substrate, e.g. as described below with reference to
In some embodiments, at least some, e.g. two or more, of the segments 141 may be switchable between a diffracting state and a non-diffracting state. In some embodiments, each of the segments 141 may be switchable between a diffracting state and a substantially non-diffracting state. Switching a grating segment to a substantially non-diffracting state may be referred to herein as switching to an inactive state, “turning off”, or “deactivating”. Here “substantially” refers to a reduction in a diffraction efficiency of the segment, in an operating wavelength range of the lightguide, by at least a factor of 5 compared to a diffracting state of the segment. In some of these or other embodiments, the diffraction efficiency of at least some of the segments 141 may be individually continuously or quasi-continuously tunable, e.g. in a diffracting state of the segment, by an electrical signal applied to each segment 141. In some embodiments, the diffraction efficiency of each segment 141 of the ODG 140 may be continuously or quasi-continuously tunable by an electrical signal, e.g. voltage, applied to each segment 141. In some embodiments, at least some of the segments 141 of the ODG 140 may have a grating pitch that is electrically tunable responsive to an electrical control signal.
The display apparatus 100 further includes an eye detector 170 configured to detect the position of an eye 155 of a user in the eyebox 150, and a controller 160 operatively coupled to the eye detector 170 and the ODG 140 and configured to individually control the diffraction efficiency of segments 141 in dependence on a control signal from the eye detector 170. The eye detector 170 may include, for example, an eye-tracking camera for obtaining images of the eye 155 in the eyebox 150, and a processor for processing the images to determine the eye position within the eyebox 150. In some embodiments, the lightguide 120 may form a sub-assembly with the eye detector 170. In some embodiments, the eye detector 170 may be a part of an eye-tracking system which may further include an array of infrared illuminators (not shown) for illuminating the eyebox, with the eye detector 170 configured to obtain images of the eye 155 with reflections (glints) from the illuminators. In some embodiments the eye-tracking system my further include a hot mirror (not shown) for separating infrared and visible light. By detecting the position of glints and the position of the eye pupil, the eye position and orientation may be determined. In some embodiments, it may be sufficient to determine only the eye position, or the position of the eye pupil, in the eyebox 150.
The image projector 103 may be embodied, for example, using a pixelated display panel, e.g. an LC micro display, optionally having suitable optics at its output. It may also be embodied using a light source, such as e.g. one or more light-emitting diodes (LED), superluminescent light-emitting diodes (SLED), side-emitting laser diodes, vertical-cavity surface-emitting laser diodes (VCSEL), etc., followed by an image beam scanner. The image light 101 provided by the projector 103 within the FOV 110 is coupled into the substrate 125 by an input optical coupler, such as e.g. an in-coupling (“input”) diffraction grating (IDG) 130 disposed in an input region of the lightguide as illustrated in
As noted above, for each location of the eye 155 within the eyebox 150, only a portion of the ODG 140 is visible to the eye 155 within the FOV 110, with any portion of the image light that is diffracted from the rest of the ODG 140 not reaching the pupil of the eye 155. Accordingly, the controller 160 may be configured to deactivate, responsive to a control signal from the eye detector 170, those of the segments 141 of the ODG 140 that are positioned outside of the FOV 110 for the current eye position. By deactivating one or more of the segments 141 that do not contribute image light to the eye 155, the optical loss in the lightguide 120 may be lessened, and the throughput (output efficiency) of the lightguide improved, providing a brighter image. The size, along the surface of the substrate, of an active portion of the ODG 140 depends on the size of a region of the eyebox 250 where the pupil of the eye 155 is known to be located, the image FOV supported by the display, and a distance 157 between the ODG 140 and the eyebox 150.
In some embodiments, e.g. where a currently active portion of the ODG 140 contains a suitably large number of individually tunable grating segments 141, those of the segments 141 that are active may be tuned to provide a desired spatial profile of the diffraction efficiency, e.g. in the direction of light propagation along the ODG 140 (y-axis), to facilitate a more uniform light output across the currently active portion of the ODG 140. For example, the diffraction efficiency of the segments may be set to rise with the distance from the in-coupler along the optical path of the image light, which corresponds to the y-axis in
Referring to
An active area of the ODG 240 and, optionally, a spatial profile of the diffraction efficiency in the active area, may be adjusted based on a position of an eye of a user in the eyebox 255. By way of example, when the user's eye is located in a small region 250A of the eyebox 250, only a portion 240A of the ODG 240 is visible to the eye within the image FOV, and thus contributes into the visible image. When the user's eye is located in a small region 255B of the eyebox 255, only a portion 240B of the ODG 240 is visible to the eye within the image FOV, and thus contributes into the visible image. In
In some embodiments, the ODG 240 may be operated so that when an eye of the user is detected in the eyebox region 250A, the portion 240A of the ODG 240 is active, i.e. in a diffracting state wherein it diffracts image light propagating therethrough toward the eyebox region 250A of the eyebox 250, while the rest of the ODG 240, e.g. portions 240B, 240C, and 240D or at least parts thereof, may be inactive, i.e. in a substantially non-diffracting state. E.g. the ODG 240 may be segmented, and grating segments within the ODG portions 240B, 240C, and 240D may be switched to a substantially non-diffracting state. When an eye of the user is detected in the eyebox region 250B of the eyebox 250, the portion 240B of the grating is active and diffracts the image light propagating therethrough toward the eyebox region 250B, while the rest of the ODG 240, e.g. portions 240A, 240C, and 240D or at least parts thereof, may be inactive. For a segmented ODG 240, grating segments within the ODG portions 240B, 240C, and 240D may be switched to a substantially non-diffracting state.
In embodiments configured for AR applications, i.e. where the region of the lightguide 220 including the ODG 240 is see-through and combines image light carrying AR images with ambient light carrying real life scenery on the other side of the slab, switching at least a portion of the output grating to a substantially non-diffracting state may have an advantage of eliminating see-through artifacts such as the rainbow artifact, and to improve throughput for the ambient light being transmitted through the slab.
Furthermore, adapting the active area of an output grating of a lightguide to an eye position within the eyebox allows increasing output efficiency and therefore image brightness for an eyebox of a given size, increasing the size of the eyebox while maintaining the output efficiency of the lightguide, or some combination thereof. By suitably adjusting the spatial profile of the grating's diffraction efficiency across the output area of the ODG 240 to the smaller eyebox area, e.g. 250A or 250B, the image brightness visible to the user's eye from said are may be significantly increased.
In some embodiments, this adjustment includes deactivating portions of the ODG 240 that are outside of the image FOV when viewed from an eyebox area, e.g. 250A or 250B, where the user's eye and/or the eye pupil, is located, as described above. In some embodiments, the adjustment includes tuning the diffraction efficiency of the currently active portion of the ODG 240, e.g. so that most, if not all, in-coupled image light propagating through the ODG 240 is diffracted out of the waveguide within the currently active portion thereof. In some embodiments, e.g. when a currently active portion of the ODG 240 contains a suitably large number of individually tunable grating segments, the diffraction efficiency of the active segments may be tuned to facilitate a more uniform light output across the currently active portion of the ODG 240, e.g. in the direction of light propagation along the ODG 240. For example, the diffraction efficiency of the segments may be set to rise with the distance from the in-coupler along the optical path of the image light.
Referring now to
Referring to
The input coupler 405 may be, for example, a diffraction grating or gratings extending across the input region 401 along one of the outer surfaces, or a prism coupler. In some embodiments the input coupler 405 may be 4 be selective with respect to the polarization of light incident thereon. The folding grating 410 is disposed to receive the in-coupled light 13 from the input coupler 405 and to re-direct it toward the output coupler 440 as laterally offset sub-beam 413. The output coupler 440 may be in the form of a segmented diffraction grating including a plurality of individually tunable grating segments 441, e.g. as described above with reference to
The input coupler 405 is configured to direct the in-coupled light beam 13 to propagate along the first direction in the plane of the substrate, e.g. along the x-axis, toward the folding grating 410. The folding grating 410 may be aligned with the input coupler 405 in the first direction, and is configured to re-direct the in-coupled light beam 13 to propagate along the second direction (y-axis) toward the output region 403. In the illustrated embodiment, the folding grating 410 may be a suitably configured diffraction grating or gratings having a length in the first direction (x-axis) sufficient to split the in-coupled light beam 13 into multiple laterally offset sub-beams 413, as illustrated in
In the illustrated embodiment, the folding grating 410 is segmented, including a sequence of grating segments 411 aligned along the general direction of propagation of the in-coupled light 13 (x-axis). Although four segments 411 is shown by way of example, either smaller or greater number of segments 411 may be present. Similar to the grating segments 441 of the output coupler 440, each of the grating segments 411 is switchable between a diffracting, or active, state, in which segment 411 diffracts a portion of the in-coupled beam 13 toward the output coupler 440, and an inactive state, i.e. substantially non-diffracting, which doesn't change the direction of propagation of the in-coupled beam 13. Responsive to a control signal from an eye detector (not shown), selected segments 411 of the folding grating 410 may be switched to the inactive state in coordination with switching selected grating segments 441 of the output coupler 440, with the segments selected depending on a position of the eye of the used in the eyebox. In some embodiments, the diffraction efficiency of those of the segments 411 that remain active may be adjusted so that substantially all, or most, of the in-coupled light beam energy is diffracted toward the output coupler 440 by the active segments 411.
Example embodiments described above include pupil-replicating lightguides incorporating one or more grating structures that have variable, e.g. switchable between two or more states or continuously tunable, diffraction efficiency. Some of such grating structures may have other tunable parameters, e.g. the grating pitch and/or the blazing angle that defines the orientation of the grating grooves, or fringes, relative to the input/output surfaces of the lightguide. Some of such switchable or tunable gratings include a material with electrically tunable refractive index, such as but not exclusively a liquid crystal (LC) medium.
Referring to
In some embodiments, the material of layer 543 may contain LC medium, in which case the tunable diffraction grating 540 may be referred to as an LC grating. The LC medium may include e.g. nematic-type liquid crystals. Nematic liquid crystals may be composed of rod-like molecules that may have non-zero dipole moments and can be approximately aligned by an electrical filed. In another example, the liquid-crystal medium may include cholesteric liquid crystals, in which a molecular stack has a twisted, helical or heliconical structure. The liquid-crystal medium may also include any suitable mixture of nematic liquid crystals, which may have larger, better defined dipole moments and relatively high birefringence, and cholesteric-type liquid crystals, which may have smaller dipole moments but may have the advantage of responding more quickly to changing electric fields. For example, a layer of nematic liquid crystals may be doped with chiral dopants, which may increase the response time of the nematic liquid crystals. The application of an electric field, e.g., by applying a suitable voltage between the electrodes 541, may orient the dipole moments of LC molecules. For example, the application of an electric field to an LC layer, e.g. layer 543, may cause the formation of a molecular orientation pattern of the LC molecules, e.g., for nematic liquid crystals, or may modify an existing orientation pattern of the LC molecules, e.g., for cholesteric liquid crystals.
In some embodiments grating 540 may be an LC grating in which the period of the grating pattern is defined e.g. by pattering a photo-sensitive LC alignment layer, or by a surface relief pattern at an interface between the layer 543 and a substrate. In the case of tunable surface relief gratings (SRG), LC molecules between the surface relief groves have a different refractive index than the material of the groves. In the absence of the electric field the LC molecules are aligned horizontally, i.e. parallel to the substrate and along the groves, diffracting light polarized along the groves. A voltage applied across the LC layer may align the LC molecules along the electric filed direction, i.e. normally to the layer, thereby substantially eliminating the diffraction.
The surface-relief grating structure 704 may be polymer-based, e.g. it may be formed from a polymer having an isotropic refractive index np of about 1.5, for example. The LC fluid has an anisotropic refractive index. For light polarization parallel to a director of the LC fluid, i.e. to the direction of orientation of the nematic LC molecules 710, the LC fluid has an extraordinary refractive index ne, which may be higher than an ordinary refractive index no of the LC fluid for light polarization perpendicular to the director. For example, the extraordinary refractive index ne may be about 1.7, and the ordinary refractive index no may be about 1.5, i.e. matched to the refractive index np of the surface-relief grating structure 704.
When the voltage Vis not applied (left side of
In some embodiments of the LC surface-relief grating 700, the surface-relief grating structure 704 may be formed from an anisotropic polymer with substantially the same or similar ordinary no and extraordinary ne refractive indices as the LC fluid. When the LC director aligns with the optic axis of the birefringent polymer, the refractive index contrast is close to zero at any polarization of impinging light, and there is no diffraction. When the LC director is misaligned with the optic axis of the birefringent polymer e.g. due to application of an external electric field, the refractive index contrast is non-zero for any or most polarizations of the impinging light, and accordingly there is diffraction and beam deflection.
In some embodiments, the electrically tunable diffraction grating 540 may be a holographic polymer-dispersed liquid crystal (H-PDLC) grating that may be manufactured by causing interference between two coherent laser beams in layer 743, containing a photosensitive monomer/liquid crystal (LC) mixture, between the two substrates 741 having a conductive coating. Upon irradiation, a photoinitiator contained within the mixture initiates a free-radical reaction, causing the monomer to polymerize. As the polymer network grows, the mixture phase separates into polymer-rich and liquid-crystal rich regions. The refractive index modulation between the two phases causes light passing through the layer 743 to be scattered in the case of traditional PDLC2 or diffracted in the case of H-PDLC. When an electric field is applied across the cell, the index modulation is removed and light passing through the cell is unaffected. A description of such tunable diffraction gratings, which may be switched on and off, is provided in an article entitled “Electrically Switchable Bragg Gratings from Liquid Crystal/Polymer Composites” by Pogue et al., Applied Spectroscopy, v. 54 No. 1, 2000, which is incorporated herein by reference in its entirety.
In some embodiments, the electrically tunable diffraction grating 540 may be a polarization volume hologram (PVH) and/or a Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating. Such gratings may be controlled either directly by applying an electric field to the LC layer, or indirectly by providing a serially coupled half-wave plate (HWP). When the electric field is applied to the LC layer, LC molecules are aligned in the electric field, changing effective refractive index, depending on polarization state of the impinging light.
In some embodiments, the layer 543 of the electrically tunable diffraction grating 540 may include a flexoelectric LC. LC molecules typically are electrical dipoles having a non-zero dipole moment, which usually do not exhibit spontaneous polarization because of equal probability for the dipoles to point to two opposite directions respectively, but become polarized in an external electric field. However LC molecules that do not have a perfect rod-shaped structure, but have e.g. a bend-shaped or a pear-shaped structure, may exhibit spontaneous polarization, termed flexoelectric polarization or flexoelectric effect. In materials with a low dielectric anisotropy and a non-zero flexoelectric coefficient difference (e1−e3), where e1 and e3 are the splay and bent flexoelectric coefficients, respectively, electric fields exceeding certain threshold values may result in a transition from the homogeneous planar state to a spatially periodic one, producing a diffraction grating in the layer 543. The field-induced grating is characterized by rotation of the LC director about the alignment axis in the alignment layer(s) adjacent the layer 543, with the wavevector of the grating oriented perpendicular to the initial alignment direction. The rotation sign is defined by both the electric field vector and the sign of the (e1−e3) difference. The wavenumber characterizing the field-induced periodicity is increased linearly with the applied voltage starting from a threshold value of about it/d, where d is the thickness of the layer. Examples of suitable flexoelectric LC materials, and of LC gratings incorporating such materials that may be used in embodiments of the present disclosure, are described in e.g. in an article entitled “Dynamic and Photonic Properties of Field-Induced Gratings in Flexoelectric LC Layers” by Palto in Crystals 2021, 11, 894, and a U.S. Pat. No. 10,890,823 assigned to the assignee of the present application, both which being incorporated herein by reference in its entirety.
In some embodiments, layer 543 of the electrically tunable diffraction grating 540 having a variable diffraction efficiency, grating period, or a slant angle may include helical and helicoidal LC. Cholesteric LCs (CLC), which have intrinsic periodicity in the form of the helical supramolecular structure, may be obtained e.g. by doping the nematic LC matrix with chiral components. The LC molecules in the mixture may self-organize into a periodic helically twisted configuration including helical structures extending between the top and bottom surfaces of the LC layer 543. Depending on a type of alignment conditions at the layer surfaces, the helical twist axes of the helical structures may be normal to the surfaces or tilt. The helical structures may form a volume grating that acts as a Bragg grating with the Bragg period equal to one half of the distance P, termed cholesteric pitch, along the helical axis where the LC director and the optic axis rotate by 360°. By varying the applied electrical field, the cholesteric pitch P and thus the Bragg period P/2 of the LC grating may be varied. In some embodiments of LC grating, e.g. some of those including a planar-aligned CLC layer, a diffractive pattern may appear when the applied electric field exceeds a threshold, and may vary in amplitude with the applied field, thereby enabling tuning the diffraction efficiency. In some embodiments a tunable LC grating may include oblique helicoidal LCs, in which the LC director is tilted at an oblique angle to the helical axis. Such LC gratings may have superior tunability because the applied electric field may tune the oblique angles and the pitch lengths in a relatively wide range without disturbing the helical axis orientation. Tunable gratings with oblique helicoidal LCs have been described e.g. in an article entitled “Electrooptic Response of Chiral Nematic Liquid Crystals with Oblique Helicoidal Director” by Xiang et al. Phys. Rev. Lett. 112, 217801, 2014, which is incorporated herein by reference in its entirety.
In at least some embodiments, an LC-based grating 540 such as those described above may be polarization selective. Such gratings may selectively diffract a light beam having a first polarization, e.g. linear or circular, but transmit a light beam having a second, typically orthogonal, polarization with negligible diffraction. In such embodiments, the display apparatuses described above may operate with polarized image light, e.g. to enhance the display's efficiency, and/or may include various polarizers and polarization converters, such as e.g. quarter-wave plates (QWP), half-wave plates (HWP), a-plates, and lightguides incorporating the same.
Tunable diffraction gratings other than LC grating may also be used in the example embodiments described above. In some embodiments, switchable/tunable gratings may be formed on a surface of the lightguide by providing a surface acoustic wave as disclosed e.g. in an article entitled “Status of Leaky Mode Holography” by Smalley et al., Photonics 2021, 8, 29, 2 which is incorporated herein by reference in its entirety. Such diffraction gratings may be tunable in both the grating pitch, by tuning the frequency of the acoustic wave, and the diffraction efficiency, by tuning its amplitude.
Diffraction gratings with a tunable/switchable diffraction efficiency may also be implemented as fluidic gratings. A fluidic grating may include two immiscible fluid layers, like water and oil, whose interface deforms when a spatially inhomogeneous electric field is applied. The spatially inhomogeneous electric field may be provided e.g. by using spatially inhomogeneous and/or discrete electrodes.
Referring to
At least one of the first 821 and second 822 electrode structures may be patterned for imposing a spatially variant electric field onto the 801 and second 802 fluids. For example, in 8A and 8B, the first electrode 821 is patterned, and the second electrodes 822 is not patterned, i.e. the second electrodes 822 is a backplane electrode. In the embodiment shown, both the first 821 and second 822 electrodes are substantially transparent. For example, the first 821 and second 822 electrodes may be indium tin oxide (ITO) electrodes.
The application of the spatially variant electric field causes the inter-fluid boundary 803 to distort as illustrated in
Portions of a patterned electrode may be individually addressable. In some embodiments, the first electrode 821 may be replaced with a continuous, non-patterned electrode coupled to a patterned dielectric layer for creating a spatially non-uniform electric field across the first 801 and second 802 fluids. Also in some embodiments, the backplane electrode is omitted, and the voltage is applied between the segmented electrodes themselves.
The thickness of the first 821 and second 822 electrodes may be e.g. between 10 nm and 50 nm. The materials of the first 821 and second 822 electrodes besides ITO may be e.g. indium zinc oxide (IZO), zinc oxide (ZO), indium oxide (TO), tin oxide (TO), indium gallium zinc oxide (IGZO), etc. The first 801 and second 802 fluids may have a refractive index difference of at least 0.1, and may be as high as 0.2 and higher. One of the first 801 or second 802 fluids may include polyphenylether, 1,3-bis(phenylthio)benzene, etc. The first 811 and/or second 812 substrates may include e.g. fused silica, quartz, sapphire, etc. The first 811 and/or second 812 substrates may be straight or curved, and may include vias and other electrical interconnects. The applied voltage may be varied in amplitude and/or duty cycle when applied at a frequency of between 100 Hz and 100 kHz. The applied voltage can change polarity and/or be bipolar. Individual first 801 and/or second 802 fluid layers may have a thickness of between 0.5-5 micrometers, more preferably between 0.5-2 micrometer.
To separate the first 801 and second 802 fluids, surfactants containing one hydrophilic end functional group and one hydrophobic end functional group may be used. The examples of a hydrophilic end functional group are hydroxyl, carboxyl, carbonyl, amino, phosphate, sulfhydryl. The hydrophilic functional groups may also be anionic groups such as sulfate, sulfonate, carboxylates, phosphates, for example. Non-limiting examples of a hydrophobic end functional group are aliphatic groups, aromatic groups, fluorinated groups. For example, when polyphenyl thioether and fluorinated fluid may be selected as a fluid pair, a surfactant containing aromatic end group and fluronirated end group may be used. When phenyl silicone oil and water are selected as the fluid pair, a surfactant containing aromatic end group and hydroxyl (or amino, or ionic) end group may be used. These are only non-limiting examples.
Referring to
In some embodiments, the method may include displaying the image within an image FOV, and step or operation 930 may include selecting, for the first subset of the grating segments, those of the grating segments located outside of the image FOV when viewed from the detected position of the eye. In some embodiments, the method may include (940) adjusting the diffraction efficiency of grating segments from a second subset of the grating segments, the second subset being in a diffracting state. In some embodiments, the grating segments from the second subset may be located at least in part within the image FOV when viewed from the detected position of the eye.
In some embodiments, the method may include: determining a change in the position of the eye; and, responsive to the change, switching at least one segment from the first set to a diffracting state, and switching at least one other of the grating segments from the diffracting state to the substantially non-diffracting state. In some embodiments, the method may include providing an electrical control signal to the out-coupler, the electrical control signal comprising information indicative of the position of the eye, and changing a voltage applied to the at least one of the segments depending on the electrical control signal.
Example embodiments described above have been described by way of example to assist in better understanding of salient features of their operation, and are capable of many variations and modifications. For example in some cases the example embodiments described above may be effective for monochromatic image light. For color images, the image light of different colors may be spatially and/or temporally multiplexed. In some embodiments, two or more stacked lightguides may be used to guide different color channels. In some embodiments, the grating pitch of the input and output couplers of the same lightguide may be tuned to accommodate different color channels in a time multiplexed manner. In at least some embodiments, more than one diffraction grating may be used to couple light out of the lightguide. Some embodiments may utilize more than one input diffraction grating and/or more than one output diffraction gratings, e.g. to support a 2D FOV. When two or more diffraction gratings are used for the in-coupling or the out-coupling, the gratings may be superimposed to form a 2D grating structure, e.g. at a same outer surface of the lightguide's substrate. In other embodiments, different in-coupling gratings or different out-coupling gratings may be disposed at the opposite outer surfaces of the substrate. Embodiments in which one or more input gratings or one or more output gratings are disposed in the bulk of the substrate are also within the scope of the present disclosure. In embodiments where the image light may get diffracted by N≥2 diffraction gratings with grating vectors ki, i=1, . . . , N in succession, the grating periods may be adjusted so that the grating vectors ki, i=1, . . . , N, sum to zero, i.e.
Σ1Nki=0. (1)
In some embodiments, the grating periods of two or more of the diffraction gratings may be adjusted, e.g. when a change in the location of the eye of a user is detected, so that equation (1) holds.
Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system. An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user. By way of non-limiting examples, artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof. Any of this content may be presented in a single channel or in multiple channels, such as in a stereo video that produces a three-dimensional effect to the viewer. Furthermore, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
Referring to
The purpose of the eye-tracking cameras 1004 is to determine position and/or orientation of both eyes of the user. The eyebox illuminators 1006 illuminate the eyes at the corresponding eyeboxes 1012, allowing the eye-tracking cameras 1004 to obtain the images of the eyes, as well as to provide reference reflections i.e. glints. The glints may function as reference points in the captured eye image, facilitating the eye gazing direction determination by determining position of the eye pupil images relative to the glints images. To avoid distracting the user with the light of the eyebox illuminators 1006, the latter may be made to emit light invisible to the user. For example, infrared light may be used to illuminate the eyeboxes 1012.
Turning to
In some embodiments, the front body 1102 includes locators 1108 and an inertial measurement unit (IMU) 1110 for tracking acceleration of the HMD 1100, and position sensors 1112 for tracking position of the HMD 1100. The IMU 1110 is an electronic device that generates data indicating a position of the HMD 1100 based on measurement signals received from one or more of position sensors 1112, which generate one or more measurement signals in response to motion of the HMD 1100. Examples of position sensors 1112 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU 1110, or some combination thereof. The position sensors 1112 may be located external to the IMU 1110, internal to the IMU 1110, or some combination thereof.
The locators 1108 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of the entire HMD 1100. Information generated by the IMU 1110 and the position sensors 1112 may be compared with the position and orientation obtained by tracking the locators 1108, for improved tracking accuracy of position and orientation of the HMD 1100. Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space.
The HMD 1100 may further include a depth camera assembly (DCA) 1111, which captures data describing depth information of a local area surrounding some or all of the HMD 1100. The depth information may be compared with the information from the IMU 1110, for better accuracy of determination of position and orientation of the HMD 1100 in 3D space.
The HMD 1100 may further include an eye tracking system 1114 for determining orientation and position of user's eyes in real time. The obtained position and orientation of the eyes also allows the HMD 1100 to determine the gaze direction of the user and to adjust the image generated by the display system 1180 accordingly. The determined gaze direction and vergence angle may be used to adjust the display system 1180 to reduce the vergence-accommodation conflict. The direction and vergence may also be used for displays' exit pupil steering as disclosed herein. Furthermore, the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc. An audio system may also be provided including e.g. a set of small speakers built into the front body 1102.
The present disclosure is not to be limited in scope by the specific embodiments described herein. Indeed, other various embodiments and modifications, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Thus, such other embodiments and modifications are intended to fall within the scope of the present disclosure. Further, although the present disclosure has been described herein in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the present disclosure may be beneficially implemented in any number of environments for any number of purposes. Accordingly, the claims set forth below should be construed in view of the full breadth and spirit of the present disclosure as described herein.
This application claims priority from U.S. Provisional Patent Application No. 63/286,349 entitled “Active Gratings in Pupil-Replicated Displays and Illuminators”, and U.S. Provisional Patent Application No. 63/286,230 entitled “Active Fluidic Optical Element”, both filed on Dec. 6, 2021 and incorporated herein by reference in their entireties.
Number | Date | Country | |
---|---|---|---|
63286349 | Dec 2021 | US | |
63286230 | Dec 2021 | US |