If an Application Data Sheet (ADS) has been filed on the filing date of this application, it is incorporated by reference herein. Any applications claimed on the ADS for priority under 35 U.S.C. §§ 119, 120, 121, or 365(c), and any and all parent, grandparent, great-grandparent, etc., applications of such applications are also incorporated by reference, including any priority claims made in those applications and any material incorporated by reference, to the extent such subject matter is not inconsistent herewith.
The present application claims the benefit of the earliest available effective filing date(s) from the following listed application(s) (the “Priority Applications”), if any, listed below (e.g., claims earliest available priority dates for other than provisional patent applications or claims benefits under 35 U.S.C. § 119(e) for provisional patent applications, for any and all parent, grandparent, great-grandparent, etc., applications of the Priority Application(s)). In addition, the present application is related to the “Related Applications,” if any, listed below.
This application is a divisional of U.S. Non-Provisional Patent Application No. 16/459,045, filed on Jul. 1, 2019, titled “Out-of-Plane Computer-Generated Multicolor Waveguide Holography”, issuing on Jan. 3, 2023 as U.S. Pat. No. 11,543,774, which claims priority under 35 U.S.C. § 119(e) to U.S. Provisional Patent Application No. 62/692,907, filed on Jul. 2, 2018, titled “Systems and Methods for Out-of-Plane Computer-Generated Multicolor Waveguide Holography,” both of which are hereby incorporated by reference in their entireties.
If the listings of applications provided above are inconsistent with the listings provided via an ADS, it is the intent of the Applicant to claim priority to each application that appears in the Priority Applications section of the ADS and to each application that appears in the Priority Applications section of this application.
All subject matter of the Priority Applications and the Related Applications and of any and all parent, grandparent, great-grandparent, etc., applications of the Priority Applications and the Related Applications, including any priority claims, is incorporated herein by reference to the extent such subject matter is not inconsistent herewith.
This disclosure relates to waveguide hologram formation. More specifically, this disclosure relates to multicolor, computer-generated holograms that do not rely on traditional interference patterns of reference and object waves recorded on a photosensitive medium.
Non-limiting and non-exhaustive embodiments of the disclosure are described herein, including various embodiments of the disclosure with reference to the figures listed below.
This disclosure includes various systems, apparatuses, and methods for generating multicolor out-of-plane holograms, including via multilayer, all-dielectric waveguide holography systems. In various embodiments, a multicolor waveguide holography system includes an input grating coupler to couple three colors of free-space optical radiation at different incident angles into a waveguide. The waveguide conveys the optical radiation in-plane to a binary metasurface hologram. The binary metasurface hologram decouples the optical radiation for out-of-plane propagation to generate a multicolor holographic image, within a region bounded by a range of target propagation angles in free space.
In various embodiments, a controller calculates an independent hologram for each color of the optical radiation. The color-specific holograms are multiplexed to determine a single multicolor hologram that can be reproduced based on the binary metasurface hologram. The optical radiation of each color propagates within the waveguide with a distinct propagation constant prior to being decoupled by the binary metasurface hologram for propagation at different angles in free space to form an out-of-plane (off-plane) multicolor holographic image.
The input grating coupler may receive light from three different color laser sources (e.g., red, green, and blue) and couple the received light into a waveguide. The input grating coupler may be, for example, a single-period grating to couple each color of the optical radiation into the waveguide for propagation at a distinct spatial frequency. In various embodiments, the system may incorporate an all-dielectric waveguide to convey the optical radiation to the binary metasurface hologram. The binary metasurface hologram may be fabricated or dynamically tuned to match a computer-generated hologram.
The multicolor holographic image is decoupled to form the target image in the far field based on a computer-generated binary metasurface hologram. The described systems can be manufactured without beam splitters, prisms, mirrors, or lenses. Accordingly, ultraminiature systems can be manufactured for use with, for example, augmented and virtual reality displays.
A multicolor waveguide holography system may include subwavelength-diffractive elements and metamaterials for precise control of a wavefront as it is propagated into free space. In some embodiments, the binary metasurface hologram is manufactured to match a computer-generated hologram calculated to produce a target out-of-plane image hologram. In other embodiments, the binary metasurface hologram comprises active subwavelength-diffractive elements and/or metamaterials that can be dynamically tuned or controlled to reproduce a calculated computer-generated hologram.
For example, a controller may dynamically modify the phase, amplitude, polarization, and/or one or more nonlinear electromagnetic wave properties of one or more subwavelength elements in a metasurface to correspond to a computer-generated hologram. A controller may calculate a holographic pattern corresponding to a target multicolor image and then modify a dynamically reconfigurable metasurface to approximate the calculated holographic pattern. In some examples, the calculated holographic pattern may be a binary holographic pattern. In such instances, the dynamically reconfigurable metasurface may be modified to perfectly approximate or closely approximate the calculated binary holographic pattern.
In contrast to the above-identified holography techniques, the presently described systems and methods provide an input grating coupler that couples and combines three colors of light incident at different angles into a waveguide without the use of beam splitters, prisms, lenses, etc. Optical radiation inside the waveguide propagates orthogonally to the binary metasurface hologram, which results in a relatively large phase variation when compared with traditional beam-split free-space holography approaches and the transmission or reflection metasurface holography. Many embodiments of the presently described waveguide holography systems and methods utilize binary metasurface holograms that are much simpler to calculate, manufacture, and/or tune than the holograms required for traditional reflection and transmission metasurface holography. Additionally, many embodiments of the presently described waveguide holography systems and methods can be easily combined with other optical and/or electrical circuits and allow for multilayer, all-dielectric fabrication.
In various embodiments, a single input grating coupler is fabricated to accommodate all three colors. Fabricating the input grating coupler for all three colors in a single lithography step improves the quality of the holography system by providing for improved registration and reproduction of features). In various embodiments, light-emitting diodes (LED) lasers may transmit optical radiation (e.g., red, green, and blue) that is incident on the input grating coupler at different angles.
Most of the embodiments and examples described herein feature external optical radiation sources incident on the grating coupler at various angles. However, many of these embodiments can be adapted to utilize in-plane illumination from optical sources, such as in-plan LEDs. In-plane multicolor illumination embodiments may include an edge-excited metasurface hologram as part of a multicolor, all-dielectric, multilayer waveguide holography system. Accordingly, the examples and embodiments described herein may be modified to utilize in-plan illumination from in-plane optical sources. The waveguide holography techniques described herein may utilize adaptations of the edge-excited principles described in the References section of “Out-of-plane computer-generated multicolor waveguide holography” by Z. Huang et al. Optica, Vol. 6, No. 2 (2019) available at https://doi.org/10.1364/OPTICA.6.000119 (hereinafter, the “Optica Paper”), which is hereby incorporated by reference in its entirety to the extent it is not inconsistent herewith.
Red, green, and blue laser light is used in many of the examples herein as an example of three colors that can be used to generate holograms having a relatively wide color gamut. However, alternative colors may be used and/or fewer than three colors may be used in applications in which a narrower color gamut is acceptable. For example, a two-color system may be suitable in some applications. In some embodiments, in-plane LED sources may produce the optical light beams that are coupled into the waveguide via an in-plane grating coupler.
Throughout the figures, different colors are represented by different line patterns and fill patterns. For example, short dashed lines and lighter fill patterns are generally used to represent red; medium dashed lines and medium fill patterns are generally used to represent green, and solid lines and darker fill patterns are generally used to represent blue. In many instances, corresponding color drawings can be found in the provisional patent application to which this application claims priority and in the Optica Paper incorporated by reference above.
Many existing computing devices and infrastructures may be used in combination with the presently described systems and methods. Some of the infrastructure that can be used with embodiments disclosed herein is already available, such as general-purpose computers, computer programming tools and techniques, digital storage media, and communication links. A computing device or controller may include a processor, such as a microprocessor, a microcontroller, logic circuitry, or the like. A processor may include one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a programmable array logic (PAL), a programmable logic array (PLA), a programmable logic device (PLD), a field-programmable gate array (FPGA), or another customizable and/or programmable device. The computing device may also include a machine-readable storage device, such as non-volatile memory, static RAM, dynamic RAM, ROM, CD-ROM, disk-based memory, tape-based memory, magnetic memory, optical memory, flash memory, or another machine-readable storage medium. Various aspects of certain embodiments may be implemented using hardware, software, firmware, or a combination thereof.
The components of the disclosed embodiments, as generally described and illustrated in the figures herein, could be arranged and designed in a wide variety of different configurations. Furthermore, the features, structures, and operations associated with one embodiment may be applied to or combined with the features, structures, or operations described in conjunction with another embodiment. In many instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of this disclosure.
The embodiments of the systems and methods provided within this disclosure are not intended to limit the scope of the disclosure but are merely representative of possible embodiments. In addition, the steps of a method do not necessarily need to be executed in any specific order, or even sequentially, nor do the steps need to be executed only once.
In the illustrated embodiment, the letters “D” and “E” are projected in blue, the letter “K” is projected in green, and the letter “U” is projected in red. The binary metasurface hologram 130 embodies a computer-generated hologram calculated by a computer, controller, or another electronic device. In some embodiments, the metasurface hologram 130 is tuned, programmed, or fabricated to modify the wavefront of the optical radiation conveyed by the waveguide 120 to generate the multicolor holographic image 150. In many of the embodiments described herein, the metasurface hologram 130 may be a binary metasurface hologram. In other embodiments, increased wavelength selectivity, increased phase and/or amplitude control, and/or improved imaging may be obtained by using a non-binary metasurface hologram. A non-binary metasurface hologram may increase the size, cost, and/or complexity of the waveguide holography system. Accordingly, a binary metasurface hologram may be preferred for some applications, and a non-binary metasurface hologram may be preferred in other applications.
The example K-space diagram in
mK^=K
x,inc−Kr Equation 1
In Equation 1, m is an integer, K^ is the wave vector relating to the grating, and Kr corresponds to the fundamental propagation constant of each respective color in the waveguide. The radii of the concentric semicircles in the K-space diagram represent the amplitudes of the wave vectors for different colors in the air (top half) and waveguide regions (bottom half), respectively.
With continued reference to
Any of a wide variety of nanofabrication techniques may be utilized to fabricate the illustrated multicolor waveguide holography structure. For example, plasma-enhanced chemical vapor deposition (PECVD) may be used to deposit the relatively thin (e.g., two micrometers) SiO2 waveguide cladding layer 202 on the Si substrate 201. Electron-beam lithography (EBL) may be used to form the grating for the input grating coupler 225 and/or to form the subwavelength elements (e.g., metamaterials) of the binary metasurface hologram 275 in a ZEP layer 203. The grating in the input grating coupler 225 may, for example, be formed using EBL with an electron beam resist of ZEP-520A (or simply “ZEP,” as used herein) or TiO2. The ZEP layer 203 may be, for example, 300 nanometers. The ZEP layer 203 may be applied via spin coating to achieve a target thickness based on spin speed and dilution with another solution.
In various embodiments, the etch depth and feature sizes of the diffraction grating in the input grating coupler 225 and other subwavelength elements in the metasurface hologram 275 may be, for example, between approximately 30 nanometers and 100 nanometers. The metasurface hologram 275 may be rectangular or square with a perimeter between approximately 300 micrometers and 1200 micrometers. Different sizes, dimensions, etch depths, feature sizes, perimeter measurements, and shapes are possible and may be useful for particular applications. For example, a circular metasurface hologram may be utilized instead of the illustrated rectangular metasurface hologram 275.
In the illustrated embodiment, a flower 350 exists in the real world and may be visible through the binary metasurface hologram 340 and the liquid crystal layer 380. A generated holographic image produced by the binary metasurface hologram 340 may, at least from the perspective of the user's eye 390, overlap the real-world flower 350. Active control of the visibility, relative brightness, effective transparency, and other visual characteristics of the real-world flower 350 may be modified by the liquid crystal 380 or another spatial light modulator system.
The augmented reality system 300 allows for controlled interactions between projected holographic images and real-world objects. Fixed gratings may be patterned over the liquid crystal 380 (or another spatial light modulator) so that the K-vectors or spatial frequency vectors of the superimposed fixed and adjustable gratings sum together to provide an adjustable range of spatial frequencies that are diffracted to a target range of angles. For example, liquid crystal-based modulators using liquid crystal on silicon (LCOS) or liquid crystal on indium tin oxide (LCITO) coated conductive substrates can form a waveguide slab which forms part of the binary metasurface hologram 340.
The direction of the liquid crystal domains may be modulated by applying a voltage to the domains. Voltage-controlled spatial modulation of the liquid crystal 380 allows for precise control of the refractive index and birefringence of the liquid crystal 380 inside the guiding structure. The liquid crystal 380 can be voltage-controlled to form gratings that diffract and decouple the multicolor optical radiation to form multicolor target image holograms.
In another embodiment, longitudinal gratings are formed in a waveguide slab using an acoustic-optic modulator (AOM), for example, made with a tellurium dioxide (TeO2) or silicon dioxide (SiO2) waveguide layer. While many of the systems and methods described herein are provided in the context of visual hologram image reconstruction, many of the systems, methods, and techniques described herein may be repurposed and/or adapted for other known uses for holograms, including without limitation information storing, processing and computing, anti-counterfeit technology, smart-phone holographic displays, augmented reality systems, virtual reality systems, displays, advertising, productivity systems, etc.
As illustrated, when the waves are guided by the dielectric layers, no input fields exist as the mode is substantially confined to the metasurface ZEP layer, such that: ER−=EL+=0. On the other hand, the fields on the right side of a ZEP layer are related to those on the left side through a transfer matrix with coefficients of A, B, C, and D such that ER−=CEL++DEL−. Since EL−≠0, the propagation constants for guided modes correspond to the coefficient D=0 case, and all possible modes can be obtained. For a sufficiently thin guiding layer, only the fundamental mode for each color is considered, since it has the largest propagation constant and most of the energy is confined within the waveguide.
Accordingly, given an input target image, such as the multicolor lettering in the real-world object 500, a computer-generated hologram needs to be programmed into the binary metasurface hologram. In various embodiments, the output angles from the metasurface hologram for each of the different colors are mapped to disjoint regions of the colors' spatial frequencies in a single Fourier space. The hologram reassembles the different color components into a common field of view, creating a multicolor image. Full-color images over a wide gamut of colors are possible by spatially mixing the red, green, and blue color components, as illustrated in the Optica Paper cited above. However, the illustrated examples maintain spatially separate red, green, and blue letters to illustrate the principle.
As previously described in conjunction with
The spatially distinct multicolor optical radiation is conveyed by the waveguide to the programmed binary metasurface hologram. The programmed binary metasurface hologram decouples the optical radiation for free-space propagation to form a target image hologram within a region defined by the propagation angles of the binary metasurface hologram.
Otherwise, if an ideal binary hologram has not been calculated at 711, an inverse-fast-Fourier transform is performed 715, and an amplitude is enforced in the far field 717 to identify a new object field 719. The new object field 719 is used as the basis to perform another fast-Fourier transfer 707, and the process is repeated until the enforced binary hologram 709 is sufficiently close to an ideal hologram, at 711, for the process to end.
This disclosure has been made with reference to various exemplary embodiments, including the best mode. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of the present disclosure. While the principles of this disclosure have been shown in various embodiments, many modifications of structure, arrangements, proportions, elements, materials, and components may be adapted for a specific environment and/or operating requirements without departing from the principles and scope of this disclosure. These and other changes or modifications are intended to be included within the scope of the present disclosure.
This disclosure is to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope thereof. Likewise, benefits, other advantages, and solutions to problems have been described above with regard to various embodiments. However, benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as critical, required, or essential features or elements. This disclosure should, therefore, be determined to encompass at least the following claims.
These inventions were made with government support under Federal Grant Nos. FA9550-12-1-0491 and FA9550-18-1-0187 awarded by the AFOSR. The government has certain rights in the inventions.
Number | Date | Country | |
---|---|---|---|
62692907 | Jul 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16459045 | Jul 2019 | US |
Child | 18149253 | US |