This relates generally to optical systems and, more particularly, to optical systems for displays.
Electronic devices may include displays that present images to a user's eyes. For example, devices such as virtual reality and augmented reality headsets may include displays with optical elements that allow users to view the displays.
It can be challenging to design devices such as these. If care is not taken, the components used in displaying content may be unsightly and bulky and may not exhibit desired levels of optical performance.
An electronic device such as a head-mounted device may have one or more near-eye displays that produce images for a user. The head-mounted device may be a pair of virtual reality glasses or may be an augmented reality headset that allows a viewer to view both computer-generated images and real-world objects in the viewer's surrounding environment.
The near-eye display may include an emissive display panel that emits image light and an optical system that redirects the image light towards an eye box. The optical system may include an input coupler and an output coupler formed on a waveguide. The input coupler may be an input coupling prism that couples the image light into the waveguide so that the image light propagates in the waveguide towards the output coupler. The output coupler may couple the image light out of the waveguide and towards the eye box. A collimating lens may direct the image light from the display panel towards the input coupler.
Optical components may be optically coupled between the display panel and the collimating lens. The optical components may provide the image light with a field angle dependent pupil size upon coupling of the image light into the waveguide by the input coupler. For example, the optical components may independently transmit the image light emitted by the display panel, to the collimating lens, within respective angular ranges for each pixel in the display panel. This may prevent light that would otherwise pass into the waveguide at angles unsuitable for total internal reflection from passing to the collimating lens, thereby mitigating stray light in the system and optimizing contrast in the image light received at the eye box. The optical components may include an array of apertures, an array of microlenses, an array of tapered optical tunnels, or an array of optical fibers, as examples.
An illustrative system having a device with one or more near-eye display systems is shown in
The operation of system 10 may be controlled using control circuitry 16. Control circuitry 16 may include storage and processing circuitry for controlling the operation of system 10. Circuitry 16 may include storage such as hard disk drive storage, nonvolatile memory (e.g., electrically-programmable-read-only memory configured to form a solid state drive), volatile memory (e.g., static or dynamic random-access-memory), etc. Processing circuitry in control circuitry 16 may be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio chips, graphics processing units, application specific integrated circuits, and other integrated circuits. Software code (instructions) may be stored on storage in circuitry 16 and run on processing circuitry in circuitry 16 to implement operations for system 10 (e.g., data gathering operations, operations involving the adjustment of components using control signals, image rendering operations to produce image content to be displayed for a user, etc.).
System 10 may include input-output circuitry such as input-output devices 12. Input-output devices 12 may be used to allow data to be received by system 10 from external equipment (e.g., a tethered computer, a portable device such as a handheld device or laptop computer, or other electrical equipment) and to allow a user to provide head-mounted device 10 with user input. Input-output devices 12 may also be used to gather information on the environment in which system 10 (e.g., head-mounted device 10) is operating. Output components in devices 12 may allow system 10 to provide a user with output and may be used to communicate with external electrical equipment. Input-output devices 12 may include sensors and other components 18 (e.g., image sensors for gathering images of real-world object that are digitally merged with virtual objects on a display in system 10, accelerometers, depth sensors, light sensors, haptic output devices, speakers, batteries, wireless communications circuits for communicating between system 10 and external electronic equipment, etc.).
Display modules 14A may include reflective displays (e.g., liquid crystal on silicon (LCOS) displays, digital-micromirror device (DMD) displays, or other spatial light modulators), emissive displays (e.g., micro-light-emitting diode (uLED) displays, organic light-emitting diode (OLED) displays, laser-based displays, etc.), or displays of other types. Light sources in display modules 14A may include uLEDs, OLEDs, LEDs, lasers, combinations of these, or any other desired light-emitting components. Arrangements in which display modules 14A include emissive displays are sometimes described herein as examples.
Optical systems 14B may form lenses that allow a viewer (see, e.g., a viewer's eyes at eye box 24) to view images on display(s) 14. There may be two optical systems 14B (e.g., for forming left and right lenses) associated with respective left and right eyes of the user. A single display 14 may produce images for both eyes or a pair of displays 14 may be used to display images. In configurations with multiple displays (e.g., left and right eye displays), the focal length and positions of the lenses formed by components in optical system 14B may be selected so that any gap present between the displays will not be visible to a user (e.g., so that the images of the left and right displays overlap or merge seamlessly).
If desired, optical system 14B may contain components (e.g., an optical combiner, etc.) to allow real-world image light from real-world images or objects 25 to be combined optically with virtual (computer-generated) images such as virtual images in image light 22. In this type of system, which is sometimes referred to as an augmented reality system, a user of system 10 may view both real-world content and computer-generated content that is overlaid on top of the real-world content. Camera-based augmented reality systems may also be used in device 10 (e.g., in an arrangement which a camera captures real-world images of object 25 and this content is digitally merged with virtual content at optical system 14B).
System 10 may, if desired, include wireless circuitry and/or other circuitry to support communications with a computer or other external equipment (e.g., a computer that supplies display 14 with image content). During operation, control circuitry 16 may supply image content to display 14. The content may be remotely received (e.g., from a computer or other content source coupled to system 10) and/or may be generated by control circuitry 16 (e.g., text, other computer-generated content, etc.). The content that is supplied to display 14 by control circuitry 16 may be viewed by a viewer at eye box 24.
If desired, waveguide 26 may also include one or more layers of holographic recording media (sometimes referred to herein as holographic media, grating media, or diffraction grating media) on which one or more diffractive gratings are recorded (e.g., holographic phase gratings, sometimes referred to herein as holograms). A holographic recording may be stored as an optical interference pattern (e.g., alternating regions of different indices of refraction) within a photosensitive optical material such as the holographic media. The optical interference pattern may create a holographic phase grating that, when illuminated with a given light source, diffracts light to create a three-dimensional reconstruction of the holographic recording. The holographic phase grating may be a non-switchable diffractive grating that is encoded with a permanent interference pattern or may be a switchable diffractive grating in which the diffracted light can be modulated by controlling an electric field applied to the holographic recording medium. Multiple holographic phase gratings (holograms) may be recorded within (e.g., superimposed within) the same volume of holographic medium if desired. The holographic phase gratings may be, for example, volume holograms or thin-film holograms in the grating medium. The grating media may include photopolymers, gelatin such as dichromated gelatin, silver halides, holographic polymer dispersed liquid crystal, or other suitable holographic media.
Diffractive gratings on waveguide 26 may include holographic phase gratings such as volume holograms or thin-film holograms, meta-gratings, or any other desired diffractive grating structures. The diffractive gratings on waveguide 26 may also include surface relief gratings formed on one or more surfaces of the substrates in waveguides 26, gratings formed from patterns of metal structures, etc. The diffractive gratings may, for example, include multiple multiplexed gratings (e.g., holograms) that at least partially overlap within the same volume of grating medium (e.g., for diffracting different colors of light and/or light from a range of different input angles at one or more corresponding output angles).
Optical system 14B may include collimating optics such as collimating lens 34. Lens 34 (sometimes referred to herein as image optics 34 or image lenses 34) may include one or more lens elements that help direct image light 22 towards waveguide 26. If desired, display module 14A may be mounted within support structure 20 of
As shown in
Optical system 14B may include one or more optical couplers such as input coupler 28, cross-coupler 32, and output coupler 30. In the example of
The example of
Waveguide 26 may guide light 22 down its length via total internal reflection. Input coupler 28 may be configured to couple light 22 from display module 14A (lens 34) into waveguide 26, whereas output coupler 30 may be configured to couple light 22 from within waveguide 26 to the exterior of waveguide 26 and towards eye box 24. For example, display module 14A may emit light 22 in direction+Y towards optical system 14B. When light 22 strikes input coupler 28, input coupler 28 may redirect light 22 so that the light propagates within waveguide 26 via total internal reflection towards output coupler 30 (e.g., in direction X). When light 22 strikes output coupler 30, output coupler 30 may redirect light 22 out of waveguide 26 towards eye box 24 (e.g., back along the Y-axis). In scenarios where cross-coupler 32 is formed at waveguide 26, cross-coupler 32 may redirect light 22 in one or more directions as it propagates down the length of waveguide 26, for example.
Input coupler 28, cross-coupler 32, and/or output coupler 30 may be based on reflective and refractive optics or may be based on holographic (e.g., diffractive) optics. In arrangements where couplers 28, 30, and 32 are formed from reflective and refractive optics, couplers 28, 30, and 32 may include one or more reflectors (e.g., an array of micromirrors, partial mirrors, or other reflectors). In arrangements where couplers 28, 30, and 32 are based on holographic optics, couplers 28, 30, and 32 may include diffractive gratings (e.g., volume holograms, surface relief gratings, etc.).
In one suitable arrangement that is sometimes described herein as an example, output coupler 30 is formed from diffractive gratings or micromirrors embedded within waveguide 26 (e.g., volume holograms recorded on a grating medium stacked between transparent polymer waveguide substrates, an array of micromirrors embedded in a polymer layer interposed between transparent polymer waveguide substrates, etc.), whereas input coupler 28 is formed from a reflective prism mounted to an exterior surface of waveguide 26 (e.g., an exterior surface defined by a waveguide substrate that contacts the grating medium or the polymer layer used to form output coupler 30).
In the example of
As shown in
In practice, lens 34 may provide light 22 and prism 36 may couple light 22 into waveguide 26 at a range of incident angles θ (e.g., relative to the normal axis of waveguide surface 38). For example, as shown in
However, if care is not taken, some of light 22 is incident upon prism 36 and waveguide 26 at angles such that the light at those angles is not coupled into waveguide 26 (e.g., such that the light does not reflect off of waveguide surfaces 40 and 38 via total internal reflection). For example, light incident at angles greater than the maximum incident angle associated with rays 48, less than the minimum incident angle associated with rays 50, or at other incident angles may not be satisfactorily coupled into waveguide 26. This light that is not coupled into waveguide 26 forms stray light that can scatter through system 14B and that minimizes the overall contrast of the image light that is received at eye box 24.
In some scenarios, masking materials are provided on waveguide 26 and/or prism 36 to help mitigate this stray light. However, these masking materials can consume an excessive amount of space, can present manufacturing issues, may not be fully reliable, and/or can unnecessarily complicate the design and operation of optical system 14B. In order to mitigate this stray light without adding masking materials to optical system 14B, display module 14A (
Each pixel 62 in display panel 60 may emit light 22 within a corresponding light cone. The light emitted by pixels 62 may be characterized by angle relative to the normal axis of display panel 60 (e.g., the spread of angles ϕ of the light 22 emitted by each pixel 62 defines the light cone of that pixel). Lens 34 (e.g., a lens having one or more lens elements that have any desired surfaces such as spherical surfaces, free form surfaces, aspherical surfaces, etc.). Lens 34 converges the light 22 emitted by each pixel 62 in display panel 20 at pupil 42, which is located within waveguide 26 of
As shown in
Optical components 64 may perform these operations by conveying only a subset (range) of the angles ϕ of light 22 emitted by each pixel 62 to lens 34. Optical components 64 may independently convey light 22 from different subsets of angles ϕ to lens 34 for different pixels 62 in display panel 60 (e.g., optical components 64 cause the angles ϕ of light 22 that is provided to lens 34 to vary depending upon which pixel 62 emitted the light). For example, as shown in
Different ranges of angles Δϕ may be blocked by optical components 64 for different pixels 62 across display panel 60 such that, collectively, no light 22 (or relatively little light 22) that would not have been coupled into waveguide 26 by prism 36 is passed to lens 34 in the first place. This may serve to mitigate stray light at waveguide 26, thereby optimizing the maximum contrast of the images displayed at eye box 24 (e.g., without requiring additional masking layers in optical system 14B).
Optical components 64 may include any desired optical components for providing light 22 with a field angle dependent pupil size upon coupling into waveguide 26 by prism 36.
As shown in
The array of apertures may control the telecentricity of the light 22 emitted by display panel 60. Each aperture 72 may have a size and a lateral position over a respective pixel 62 such that a desired subset a of the angles of light 22 emitted by that pixel 62 is passed through optical components 64 to lens 34 (
For example, as shown in
For example, as shown in
The example of
As shown in
The size and shape of tapered optical tunnel 90 may be selected to provide light 22 to lens 34 within a desired range of output angles βEXIT (e.g., corresponding to the ranges of angles α of
Each core 114 may be aligned with a respective pixel 62 in display panel 60. The light 22 emitted by each pixel 62 may enter a corresponding core 114 in optical fiber array 110. Lenses or other microstructures may be used to help couple light 22 into cores 114 if desired. Because of the difference in refractive indices nc and ng, light 22 propagate down cores 114 via total internal reflection and is emitted by core 114 over a range of output angles γ (e.g., corresponding to the ranges of angles α of
Each core 114 may have an index of refraction nc that is selected so that the core 114 only emits light 22 within a corresponding range of output angles γ to lens 34. The range of angles γ may independently vary for each pixel 62 in display panel 60.
For example, as shown in
The example of
As shown in
The example of
If desired, a single lens may be provided over array 110 to help direct light 22 to lens 34. For example, as shown in
In accordance with an embodiment, a display system is provided that includes an emissive display panel configured to emit image light, a waveguide, an input coupling prism mounted to the waveguide, the input coupling prism is configured couple the image light into the waveguide, an output coupler on the waveguide and configured to couple the image light out of the waveguide and towards an eye box, a lens configured to direct the image light towards the input coupling prism, and optical components optically coupled between the emissive display panel and the lens, the optical components are configured to provide the image light with a field angle dependent pupil size upon coupling of the image light into the waveguide by the input coupling prism.
In accordance with another embodiment, the display panel includes first and second pixels that emit the image light, the optical components are configured to provide the image light emitted by the first pixel to the lens within a first range of angles, and the optical components are configured to provide the image light emitted by the second pixel to the lens within a second range of angles that is different from the first range of angles.
In accordance with another embodiment, the optical components include an aperture array.
In accordance with another embodiment, the aperture array includes a first aperture overlapping the first pixel and a second aperture overlapping the second pixel, the first aperture transmits the image light within the first range of angles, and the second aperture transmits the image light within the second range of angles.
In accordance with another embodiment, the aperture array includes a light stop between the first and second apertures.
In accordance with another embodiment, the optical components include a microlens array.
In accordance with another embodiment, the microlens array includes a first microlens overlapping the first pixel and a second microlens overlapping the second pixel, the first microlens provides the image light to the lens within the first range of angles, and the second microlens transmits the image light to the lens within the second range of angles.
In accordance with another embodiment, the first microlens has a first optical axis oriented in a first direction and the second microlens has a second optical axis oriented in a second direction that is different from the first direction.
In accordance with another embodiment, the optical components include an array of tapered optical tunnels.
In accordance with another embodiment, the array of tapered optical tunnels includes a first tapered optical tunnel overlapping the first pixel and a second tapered optical tunnel overlapping the second pixel, the first tapered optical tunnel provides the image light to the lens within the first range of angles, and the second tapered optical tunnel provides the image light to the lens within the second range of angles.
In accordance with another embodiment, the first tapered optical tunnel has a first input face and a first output face, the first output face is larger than the first input face, the second tapered optical tunnel has a second input face and a second output face, and the second output face is larger than the second input face.
In accordance with another embodiment, the first input face has a first area and the second input face has a second area that is different from the first area.
In accordance with another embodiment, the optical components include an optical fiber array.
In accordance with another embodiment, the optical fiber array includes a first optical fiber core overlapping the first pixel and a second optical fiber core overlapping the second pixel, the first optical fiber core provides the image light to the lens within the first range of angles, and the second optical fiber core provides the image light to the lens within the second range of angles.
In accordance with another embodiment, the first optical fiber core has a first index of refraction and the second optical fiber core has a second index of refraction that is different from the first index of refraction.
In accordance with another embodiment, the first optical fiber core has a first output facet oriented at a first angle and the second optical fiber core has a second output facet oriented at a second angle that is different from the first angle.
In accordance with another embodiment, the display system includes an additional lens that is mounted to and that overlaps the optical fiber array.
In accordance with another embodiment, the display system includes a first microlens overlapping an output face of the first optical fiber core and a second microlens overlapping an output face of the second optical fiber core.
In accordance with an embodiment, a display system is provided that includes an emissive display panel having an array of pixels configured to emit image light, a waveguide having an input coupler configured to couple the image light into the waveguide and having a holographic output coupler configured to direct the image light towards an eye box, a collimating lens configured to direct the image light towards the input coupler, and an array of apertures in a layer of opaque material, each aperture in the array of apertures overlaps a respective pixel in the array of pixels, the array of apertures includes apertures having different sizes, and the apertures having different sizes are configured to transmit the image light emitted by the array of pixels to the collimating lens within different respective angular ranges.
In accordance with an embodiment, a display system is provided that includes an emissive display panel having an array of pixels configured to emit image light, a waveguide having an input coupler configured to couple the image light into the waveguide and having a holographic output coupler configured to direct the image light towards an eye box, a collimating lens configured to direct the image light towards the input coupler, and an array of microlenses, each microlens in the array of microlenses overlaps a respective pixel in the array of pixels, the array of microlenses includes microlenses having different orientations, and the microlenses having different orientations are configured to provide the image light emitted by the array of pixels to the collimating lens within different respective angular ranges.
The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
This application is a continuation of international patent application No. PCT/US2020/050914, filed Sep. 15, 2020, which claims the benefit of U.S. provisional patent application No. 62/905,675, filed Sep. 25, 2019, which are hereby incorporated by reference herein in their entireties.
Number | Date | Country | |
---|---|---|---|
62905675 | Sep 2019 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2020/050914 | Sep 2020 | US |
Child | 17475850 | US |