This disclosure relates generally to optical systems and, more particularly, to optical systems for electronic devices with displays.
Electronic devices often include displays that present images close to a user's eyes. For example, virtual and augmented reality headsets may include displays with optical elements that allow users to view the displays.
Devices such as these can be challenging to design. If care is not taken, the components used to display images in these devices can be unsightly and bulky and may not exhibit a desired optical performance.
An electronic device may have a display system. The display system may include a waveguide, an input coupler, and a surface relief grating (SRG) structure. The input coupler may couple image light into the waveguide. The image light may propagate down the waveguide via total internal reflection. The SRG structure may perform a cross-coupling operation in which the SRG structure expands the image light in a direction perpendicular to the direction of propagation. The SRG structure may also perform an output coupling operation in which the SRG structure couples the expanded image light out of the waveguide and towards an eye box. The SRG structure may be modulated across its lateral area to maximize the optical efficiency of the system.
For example, the SRG structure may include at least a first SRG and a second SRG. The second SRG may at least partially overlap the first SRG in one or more layers of SRG substrate. The first SRG may expand the image light in a first direction. The second SRG may expand the image light in a second direction opposite the first direction. The first SRG may couple the image light expanded by the second SRG out of the waveguide. The second SRG may couple the image light expanded by the first SRG out of the waveguide. The first SRG may have a grating strength that decreases from a brow region to a cheek region of the SRG structure. The second SRG may have a grating strength that decreases from the cheek region to the brow region. The first and second SRGs may exhibit the same grating strength in a region between the brow and cheek regions. Any desired modulation functions may be used to modulate the grating strengths of the SRGs in the SRG structure. If desired, the diffraction efficiency of the SRG structure may additionally or alternatively be varied between a nasal region and a temple region of the SRG structure.
System 10 of
The operation of system 10 may be controlled using control circuitry 16. Control circuitry 16 may include storage and processing circuitry for controlling the operation of system 10. Circuitry 16 may include storage such as hard disk drive storage, nonvolatile memory (e.g., electrically-programmable-read-only memory configured to form a solid state drive), volatile memory (e.g., static or dynamic random-access-memory), etc. Processing circuitry in control circuitry 16 may be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio chips, graphics processing units, application specific integrated circuits, and other integrated circuits. Software code may be stored on storage in circuitry 16 and run on processing circuitry in circuitry 16 to implement operations for system 10 (e.g., data gathering operations, operations involving the adjustment of components using control signals, image rendering operations to produce image content to be displayed for a user, etc.).
System 10 may include input-output circuitry such as input-output devices 12. Input-output devices 12 may be used to allow data to be received by system 10 from external equipment (e.g., a tethered computer, a portable device such as a handheld device or laptop computer, or other electrical equipment) and to allow a user to provide head-mounted device 10 with user input. Input-output devices 12 may also be used to gather information on the environment in which system 10 (e.g., head-mounted device 10) is operating. Output components in devices 12 may allow system 10 to provide a user with output and may be used to communicate with external electrical equipment. Input-output devices 12 may include sensors and other components 18 (e.g., image sensors for gathering images of real-world object that are digitally merged with virtual objects on a display in system 10, accelerometers, depth sensors, light sensors, haptic output devices, speakers, batteries, wireless communications circuits for communicating between system 10 and external electronic equipment, etc.).
Display modules 20A may be liquid crystal displays, organic light-emitting diode displays, laser-based displays, or displays of other types. Optical systems 20B may form lenses that allow a viewer (see, e.g., a viewer's eyes at eye box 24) to view images on display(s) 20. There may be two optical systems 20B (e.g., for forming left and right lenses) associated with respective left and right eyes of the user. A single display 20 may produce images for both eyes or a pair of displays 20 may be used to display images. In configurations with multiple displays (e.g., left and right eye displays), the focal length and positions of the lenses formed by system 20B may be selected so that any gap present between the displays will not be visible to a user (e.g., so that the images of the left and right displays overlap or merge seamlessly).
If desired, optical system 20B may contain components (e.g., an optical combiner, etc.) to allow real-world image light from real-world images or objects 28 to be combined optically with virtual (computer-generated) images such as virtual images in image light 38. In this type of system, which is sometimes referred to as an augmented reality system, a user of system 10 may view both real-world content and computer-generated content that is overlaid on top of the real-world content. Camera-based augmented reality systems may also be used in device 10 (e.g., in an arrangement in which a camera captures real-world images of object 28 and this content is digitally merged with virtual content at optical system 20B).
System 10 may, if desired, include wireless circuitry and/or other circuitry to support communications with a computer or other external equipment (e.g., a computer that supplies display 20 with image content). During operation, control circuitry 16 may supply image content to display 20. The content may be remotely received (e.g., from a computer or other content source coupled to system 10) and/or may be generated by control circuitry 16 (e.g., text, other computer-generated content, etc.). The content that is supplied to display 20 by control circuitry 16 may be viewed by a viewer at eye box 24.
If desired, waveguide 50 may also include one or more layers of holographic recording media (sometimes referred to herein as holographic media, grating media, or diffraction grating media) on which one or more diffractive gratings are recorded (e.g., holographic phase gratings, sometimes referred to herein as holograms). A holographic recording may be stored as an optical interference pattern (e.g., alternating regions of different indices of refraction) within a photosensitive optical material such as the holographic media. The optical interference pattern may create a holographic phase grating that, when illuminated with a given light source, diffracts light to create a three-dimensional reconstruction of the holographic recording. The holographic phase grating may be a non-switchable diffractive grating that is encoded with a permanent interference pattern or may be a switchable diffractive grating in which the diffracted light can be modulated by controlling an electric field applied to the holographic recording medium. Multiple holographic phase gratings (holograms) may be recorded within (e.g., superimposed within) the same volume of holographic medium if desired. The holographic phase gratings may be, for example, volume holograms or thin-film holograms in the grating medium. The grating media may include photopolymers, gelatin such as dichromated gelatin, silver halides, holographic polymer dispersed liquid crystal, or other suitable holographic media.
Diffractive gratings on waveguide 50 may include holographic phase gratings such as volume holograms or thin-film holograms, meta-gratings, or any other desired diffractive grating structures. The diffractive gratings on waveguide 50 may also include surface relief gratings formed on one or more surfaces of the substrates in waveguides 26, gratings formed from patterns of metal structures, etc. The diffractive gratings may, for example, include multiple multiplexed gratings (e.g., holograms) that at least partially overlap within the same volume of grating medium (e.g., for diffracting different colors of light and/or light from a range of different input angles at one or more corresponding output angles). Other light redirecting elements such as louvered mirrors may be used in place of diffractive gratings in waveguide 50 if desired.
As shown in
Optical system 20B may include one or more optical couplers (e.g., light redirecting elements) such as input coupler 52, cross-coupler 54, and output coupler 56. In the example of
Waveguide 50 may guide image light 38 down its length via total internal reflection. Input coupler 52 may be configured to couple image light 38 from display module 20A into waveguide 50, whereas output coupler 56 may be configured to couple image light 38 from within waveguide 50 to the exterior of waveguide 50 and towards eye box 24. Input coupler 52 may include an input coupling prism, an edge or face of waveguide 50, a lens, a steering mirror or liquid crystal steering element, or any other desired input coupling elements. As an example, display module 20A may emit image light 38 in direction +Y towards optical system 20B. When image light 48 strikes input coupler 52, input coupler 52 may redirect image light 38 so that the light propagates within waveguide 50 via total internal reflection towards output coupler 56 (e.g., in direction +X within the total internal reflection (TIR) range of waveguide 50). When image light 38 strikes output coupler 56, output coupler 56 may redirect image light 38 out of waveguide 50 towards eye box 24 (e.g., back along the Y-axis). A lens such as lens 60 may help to direct or focus image light 38 onto eye box 24. Lens 60 may be omitted if desired. In scenarios where cross-coupler 54 is formed on waveguide 50, cross-coupler 54 may redirect image light 38 in one or more directions as it propagates down the length of waveguide 50, for example. In redirecting image light 38, cross-coupler 54 may also perform pupil expansion on image light 38.
Input coupler 52, cross-coupler 54, and/or output coupler 56 may be based on reflective and refractive optics or may be based on diffractive (e.g., holographic) optics. In arrangements where couplers 52, 54, and 56 are formed from reflective and refractive optics, couplers 52, 54, and 56 may include one or more reflectors (e.g., an array of micromirrors, partial mirrors, louvered mirrors, or other reflectors). In arrangements where couplers 52, 54, and 56 are based on diffractive optics, couplers 52, 54, and 56 may include diffractive gratings (e.g., volume holograms, surface relief gratings, etc.).
The example of
Waveguide 50 may be provided with a surface relief grating structure such as surface relief grating structure 74. Surface relief grating (SRG) structure 74 may be formed within a substrate such as a layer of SRG substrate (medium) 76. In the example of
SRG structure 74 may include at least two partially-overlapping surface relief gratings. Each surface relief grating in SRG structure 74 may be defined by corresponding ridges (peaks) 78 and troughs (minima) 80 in the thickness of SRG substrate 76. In the example of
The example of
If desired, SRG structure 74 may be distributed across multiple layers of SRG substrate, as shown in the example of
In practice, it is desirable for the output coupler on waveguide 50 to fill as large of an eye box 24 with as uniform-intensity image light 38 as possible. SRG structure 74 may perform the functionality of both a cross-coupler and an output coupler for waveguide 50. SRG structure 74 may therefore be configured to expand image light 38 in one or more dimensions while also coupling image light 38 out of waveguide 50. By using SRG structure 74 as both a cross-coupler and an output coupler, space may be conserved within the display (e.g., space that would otherwise be occupied by separate cross-coupler and output couplers). Space within the display may be more efficiently utilized by co-locating multiple surface relief gratings for redirecting (expanding) image light 38 in different directions (e.g., in an overlapping or interleaved arrangement in or on waveguide 50). The surface relief gratings in SRG structure 74 may overlap in physical space (e.g., when viewed in the −Y direction of
The grating vector k for each SRG in SRG structure 74 is oriented perpendicular to the direction of the peaks 78 and troughs 80 in the SRG. The direction of grating vector k will therefore also describe the direction of the peaks 78 and troughs 80 in the SRG. The magnitude of grating vector k corresponds to the widths and spacings (e.g., the period) of the peaks 78 and troughs 80 in the SRG, as well as to the wavelengths of light diffracted by the SRG. Surface relief gratings often have a relatively wide bandwidth. The bandwidth of each SRG in SRG structure 74 may encompass each of the wavelengths in image light 38, for example (e.g., the entire visible spectrum, a portion of the visible spectrum, portions of the infrared or near-infrared spectrum, some or all of the visible spectrum and a portion of the infrared or near-infrared spectrum, etc.).
In the example of
Image light 38 may be conveyed to SRG structure 74 through waveguide 50 (e.g., via total internal reflection). First SRG 100 may be configured to diffract image light 38 about a first axis (e.g., a first reflective axis in a reflective mode) whereas second SRG 102 is configured to diffract image light 38 about a second axis (e.g., a second reflective axis) that is different from the first axis. SRGs 100 and 102 may be configured to perform dual functions (e.g., diffraction operations) on image light 38. For example, each SRG may be configured to redirect image light 38 both in a vertical direction (parallel to the Z-axis) and may be configured to redirect image light 38 out of waveguide 50 (e.g., parallel to the Y-axis).
As shown in the example of
In order to maximize the efficiency of the display, SRG structure 74 may be modulated across the lateral (spatial) area of SRG structure 74 (e.g., in the X-Z plane of
SRG 100 and SRG 102 may be modulated by varying the strength of the SRGs across the height of SRG structure 74 (parallel to the Z-axis). For example, SRG 100 may have relatively high strength within brow region 100, relatively low strength or no strength within cheek region 114, and intermediate or gradient strength within central region 112. Conversely, SRG 102 may have relatively high strength within cheek region 114, relatively low strength or no strength in brow region 110, and intermediate or gradient strength within central region 112. Configuring SRG 100 to be strongest in brow region 110 and configuring SRG 102 to be strongest in cheek region 114 may serve to maximize the overall efficiency of the display because most of the image light to be expanded in the −Z direction by SRG 100 will be incident upon the upper half of SRG structure 74 and most of the image light to be expanded in the +Z direction by SRG 102 will be incident upon the lower half of SRG structure 74.
Graph 132 of
Curves 120 and 122 need not be linear and may, if desired, be continuously curved between edges 116 and 118, as shown by exemplary curves 128 and 130 respectively. As another example, SRG 100 may be modulated such that the SRG exhibits a strength characterized by curve 126 and SRG 102 may be modulated such that the SRG exhibits a strength characterized by curve 124. In this example, SRG 100 exhibits maximum strength in brow region 110, minimum or no strength in cheek region 114, and a linear gradient strength within central region 112. Similarly, SRG 102 exhibits maximum strength in cheek region 114, minimum or no strength in brow region 110, and a linear gradient strength within central region 112. When modulated in this way, in physical space, SRG structure 74 may have a checkerboard pattern (e.g., a two-dimensional grating pattern) within central region 112 (e.g., from the intersection of similarly-strong SRGs 100 and 102), may have a substantially linear pattern (e.g., a one-dimensional grating pattern) within brow region 110 (e.g., from SRG 100), and may have a substantially linear pattern within cheek region 114 (e.g., from SRG 102).
The example of
If desired, SRG structure 74 may also be modulated to provide SRG structure 74 with different diffraction efficiencies along its length.
SRG structure 74 may have a central region 146, a first (left) peripheral region 144 between central region 146 and left edge 140, and a second (right) peripheral region 148 between central region 146 and right edge 142. Central region 146 may span any desired amount of the length of SRG structure 74 parallel to the X-axis (e.g., 25%, 10%, 30%, 50%, more than 50%, less than 50%, more than 10%, more than 20%, more than 30%, more than 40%, less than 40%, less than 30%, less than 20%, etc.). Peripheral region 144 may sometimes be referred to herein as nasal region 144 (e.g., because region 144 sits at or adjacent to the user's nose when the user is viewing the display). Peripheral region 148 may sometimes be referred to herein as temple region 148 (e.g., because region 148 sits at or adjacent to the user's temple when the user is viewing the display). This is merely illustrative and, in practice, region 144 may be a temple region and region 148 may be a nasal region (e.g., depending on the location of SRG structure 74 within the system).
In the example of
As one example, SRG 100 and SRG 102 may each be modulated such that each SRG exhibits a diffraction efficiency characterized by curve 152 of graph 150. In this example, as shown by curve 152, SRG 100 and SRG 102 exhibit maximum (e.g., 100%) diffraction efficiency within peripheral region 148, minimum (e.g., 0%) diffraction efficiency within peripheral region 144, and a linear gradient diffraction efficiency within central region 146 from peripheral region 148 to peripheral region 144. While the maximum diffraction efficiency is sometimes referred to herein as 100% diffraction efficiency, this percentage is a relative value measured with respect to the overall peak diffraction efficiency of the SRG (e.g., the overall maximum diffraction efficiency each SRG may be less than 100% diffraction efficiency in practice).
As another example, SRG 100 and SRG 102 may each be modulated such that each SRG exhibits a diffraction efficiency characterized by a step function, as shown by curve 154 (e.g., with a single intermediate diffraction efficiency within central region 146. These examples are merely illustrative. Some or all of curve 154 may be curved rather than linear. Some or all of curve 152 may be curved rather than linear. Curve 154 may have any desired number of steps. In general, any desired modulation function may be used across the length of SRG structure 74 (e.g., a continuously curved modulation function from left edge 140 to right edge 142, a linear gradient function from left edge 140 to right edge 142, combinations of two or more of these arrangements, etc.).
The diffraction efficiency of SRG structure 74 may be modulated in this way by varying the geometry of the peaks and troughs used to form each of the SRGs and/or by increasing the number of grating vectors in SRG structure 74 along the X-axis, as examples. SRG structure 74 may be modulated along the X-axis as shown in
The examples of
Arrow 170 schematically represents the first diffraction operation performed by SRG 102 on the image light 38 incident upon SRG structure 74. This first diffraction performs the cross-coupler function of SRG 102, helping to expand the image light (e.g., in the +Z direction as shown in
Arrow 174 schematically represents the first diffraction operation performed by SRG 100 on the image light 38 incident upon SRG structure 74. This first diffraction performs the cross-coupler function of SRG 100, helping to expand the image light (e.g., in the −Z direction as shown in
Arrow 172 schematically represents the second diffraction operation performed by SRG 100, on the image light 38 that has already been expanded in the +Z direction by SRG 102. This second diffraction performs the output coupler function of SRG 100, serving to couple the +Z-expanded image light out of waveguide 50 (e.g., in the −Y direction as shown in
Arrow 178 schematically represents the second diffraction operation performed by SRG 102, on the image light 38 that has already been expanded in the −Z direction by SRG 100. This second diffraction performs the output coupler function of SRG 102, serving to couple the −Z-expanded image light out of waveguide 50 (e.g., in the −Y direction as shown in
In practice, the cross-coupling function performed by SRGs 100 and 102 can introduce undesirable back reflection into SRG structure 74. The back-reflection occurs when image light 38 incident upon an SRG at a certain incident angle is reflected backwards by the SRG (e.g., at a 180-degree angle with respect to the incident angle) rather than being diffracted onto the desired output angle. If care is not taken, this back-reflected light can leak out the sides of the SRG structure, thereby limiting the maximum brightness achievable at eye box 24. In the example of
The examples shown in
In accordance with an embodiment, a display system is provided that includes a waveguide configured to propagate image light in a first direction via total internal reflection; and a surface relief grating (SRG) structure at the waveguide, the SRG structure has a lateral area and includes a first SRG configured to diffract a first portion of the image light in a second direction that is different from the first direction, and a second SRG that at least partially overlaps the first SRG and that is configured to diffract a second portion of the image light in a third direction that is different from the first and second directions, the first SRG is configured to diffract the second portion of the image light that has been diffracted by the second SRG out of the waveguide, the second SRG is configured to diffract the first portion of the image light that has been diffracted by the first SRG out of the waveguide, and the first SRG has a grating strength that is modulated across the lateral area of the SRG structure.
In accordance with another embodiment, the second SRG has an additional grating strength that is modulated across the lateral area of the SRG structure.
In accordance with another embodiment, the SRG structure has a first edge and a second edge opposite the first edge, the grating strength of the first SRG has a first value at the first edge and a second value at the second edge, and the second value is less than the first value.
In accordance with another embodiment, the additional grating strength of the second SRG has a third value at the second edge and a fourth value at the first edge, the fourth value being less than the third value.
In accordance with another embodiment, the grating strength of the first SRG decreases in a linear gradient from the first edge to the second edge and the additional grating strength of the second SRG decreases in a linear gradient from the second edge to the first edge.
In accordance with another embodiment, the SRG structure has a third edge and a fourth edge opposite the third edge, the first SRG and the second SRG are configured to exhibit a first diffraction efficiency at the third edge, and the first SRG and the second SRG are configured to exhibit a second diffraction efficiency at the fourth edge, the second diffraction efficiency being greater than the first diffraction efficiency.
In accordance with another embodiment, the first and second edges of the SRG structure extend parallel to the first direction.
In accordance with another embodiment, the display system includes a SRG substrate layered on a lateral surface of the waveguide, the first SRG and the second SRG are formed in the SRG substrate.
In accordance with another embodiment, the SRG structure includes a third SRG that at least partially overlaps the first SRG and that is configured to mitigate back-reflection of the image light by the first SRG.
In accordance with an embodiment, a display system is provided that includes a waveguide configured to propagate image light via total internal reflection; and a surface relief grating (SRG) structure on the waveguide, the SRG structure has a first region, a second region, and a third region, the second region being laterally interposed between the first region and the third region, the SRG structure includes a first SRG configured to contribute a first amount of diffraction to the image light in the first region, a second amount of diffraction to the image light in the second region, and a third amount of diffraction to the image light in the third region, the second amount of diffraction being less than the first amount of diffraction and the third amount of diffraction being less than the second amount of diffraction, the SRG structure includes a second SRG that at least partially overlaps the first SRG, the second SRG being configured to contribute the third amount of diffraction to the image light in the first region, the second amount of diffraction to the image light in the second region, and the first amount of diffraction to the image light in the third region, and the SRG structure is configured to couple the image light out of the waveguide.
In accordance with another embodiment, the first SRG and the second SRG are each configured to expand the image light.
In accordance with another embodiment, the first SRG is configured to expand the image light in a first direction, the second SRG is configured to couple the image light expanded in the first direction by the first SRG out of the waveguide, the second SRG is configured to expand the image light in a second direction different from the first direction, and the first SRG is configured to couple the image light expanded in the second direction by the second SRG out of the waveguide.
In accordance with another embodiment, the display system includes an SRG substrate layered on the waveguide, the first SRG and the second SRG are formed in the SRG substrate.
In accordance with another embodiment, the waveguide includes a first waveguide substrate having a first lateral surface and a second waveguide substrate having a second lateral surface, the display system includes a first SRG substrate layered on the first lateral surface, the first SRG is formed in the first SRG substrate; and a second SRG substrate layered on the second lateral surface, the second SRG is formed in the second SRG substrate.
In accordance with another embodiment, the SRG structure includes a fourth region, a fifth region, and a sixth region, the fifth region is laterally interposed between the fourth region and the sixth region, the fourth, fifth, and sixth regions each overlap the first region, the second region, and the third region, and the first SRG and the second SRG are configured to exhibit a first diffraction efficiency in the fourth region, a second diffraction efficiency in the fifth region that is greater than the first diffraction efficiency, and a third diffraction efficiency in the sixth region that is greater than the second diffraction efficiency.
In accordance with another embodiment, the display system includes an input coupler configured to couple the image light into the waveguide, the fourth region of the SRG structure is optically interposed between the input coupler and the fifth region of the SRG structure.
In accordance with an embodiment, a head mounted display device is provided that includes a waveguide; an input coupler configured to couple image light into the waveguide; a surface relief grating (SRG) structure on the waveguide, the SRG structure is configured to expand the image light, the SRG structure is configured to couple the expanded image light out of the waveguide, the SRG structure has a brow region and a cheek region, and the SRG structure includes a first SRG having a first strength that decreases from the brow region to the cheek region, and a second SRG that at least partially overlaps the first SRG and that has a second strength that decreases from the cheek region to the brow region.
In accordance with another embodiment, the first SRG is configured to expand a first portion of the image light in a first direction, the second SRG is configured to expand a second portion of the image light in a second direction opposite the first direction, the first SRG is configured to couple the second portion of the image light expanded by the second SRG out of the waveguide, and the second SRG is configured to couple the first portion of the image light expanded by the first SRG out of the waveguide.
In accordance with another embodiment, the SRG structure has a nasal region and a temple region that is different from the nasal region, the nasal region overlaps the brow region and the cheek region, the temple region overlaps the brow region and the cheek region, the SRG structure is configured to receive the image light at the nasal region, the first SRG and the second SRG have a first diffraction efficiency in the nasal region, and the first SRG and the second SRG have a second diffraction efficiency that is greater than the first diffraction efficiency in the temple region.
In accordance with another embodiment, the SRG structure has a nasal region and a temple region that is different from the nasal region, the nasal region overlaps the brow region and the cheek region, the temple region overlaps the brow region and the cheek region, the SRG structure is configured to receive the image light at the temple region, the first SRG and the second SRG have a first diffraction efficiency in the nasal region, and the first SRG and the second SRG have a second diffraction efficiency that is less than the first diffraction efficiency in the temple region.
The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
This application is a continuation of International Patent Application No. PCT/US2022/027678, filed May 4, 2022, which claims priority to U.S. Provisional Patent Application No. 63/185,198, filed May 6, 2021, which are hereby incorporated by reference herein in their entireties.
Number | Date | Country | |
---|---|---|---|
63185198 | May 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2022/027678 | May 2022 | US |
Child | 18489762 | US |