This disclosure relates to refractive structures with direction-selective filtering. For example, an array of Fourier-transforming optically transmissive elements can map optical radiation at various angles of incidence and to corresponding coordinate locations.
According to various embodiments, systems, apparatuses, and methods are described herein that relate to mapping optical radiation between specific coordinate locations and angle of incidence. For example, an optical apparatus may comprise one, two or three basic layers. Some embodiment may utilize a single layer, according to combinations of one or more of the embodiments described herein. Other embodiments may utilize two layers or three layers, according to combinations of one or more of the embodiments described herein.
A first layer may comprise a plurality of optically transmissive elements forming an array to receive, transmit, or transmit and receive optical radiation. Each of the optically transmissive elements may be a Fourier-transforming optically transmissive element to map optical radiation between each of a plurality of angles of incidence and corresponding coordinate locations. The Fourier-transforming optically transmissive elements are referred to herein as simply “transmissive elements” for short and may have the characteristics and/or properties of a combination of one or more of the embodiments described herein. In some embodiments, a support material may maintain the structural integrity or otherwise maintain the optically transmissive elements in an array.
Each of the transmissive elements in the array may have a relatively narrow field of view (e.g., 15-45 degrees), a moderate field of view (e.g., 45-90 degrees), moderately wide field of view (e.g., 90-135 degrees) or a wide field of view (e.g., 135-180 degrees). The specific field or fields of view in a given plane or direction may depend on the application, a target thickness/thinness of the array, cost, material selections, and other practical considerations or design choices. In some embodiments, each transmissive element in the array has a field of view with a solid angle between approximately π and 2π steradian.
Each of the Fourier-transforming optically transmissive elements may be arranged in a substantially planar array with a fill factor exceeding a highest possible fill factor of uniform diameter circles within a rectangular region. For example, the array of Fourier-transforming optically transmissive elements may have a relative fill factor exceeding approximately 80%, or even exceeding 90% of the optical apparatus in its entirety including, for example, the support material. The efficiency of the optical apparatus may depend, in part on the transmittance of the array of Fourier-transforming optically transmissive elements. Maximizing the fill factor for a given shape and planar array shape (e.g., a flat, curved, or conformal planar array) and/or maximizing the individual transmittance of each transmissive element may increase the efficiency of the optical apparatus. In various embodiments, the transmittance of each transmissive element in the array may have a transmittance greater than 80%. The transmittance of the overall radiation efficiency, including its non-transmissive structural elements may exceed 70%.
As a receiver or in a receive mode, each transmissive element may comprise a diffractive lens with a distribution of dielectric constants to effectuate the mapping of the optical radiation received at each of the plurality of angles of incidence to each respective coordinate location. As a transmitter or in a transmit mode, each transmissive element may comprise a diffractive lens with a distribution of dielectric constants to effectuate the mapping of optical radiation to each of the plurality of angles of incidence based on the coordinate location from which the optical radiation originated. In various embodiments, a transmissive element or an array of transmissive elements may selectively operate in receive or transmit modes. In other embodiments, a transmissive element or an array of transmissive elements may operate simultaneously or be time-modulated in both transmit and receive modes.
Each transmissive element of the array may comprise a refractive lens with a distribution of dielectric constants to effectuate the mapping of the optical radiation between each of the plurality of angles of incidence and each respective coordinate location. Each transmissive element may comprise a gradient refractive index lens (GRIN lens). In some embodiments, each transmissive element in an array is modeled as or physically comprises a plurality of voxels (three-dimensional volumes in a three-dimensional space akin to two-dimensional pixels in a two-dimensional space) with discrete dielectric constants approximating a continuous distribution of dielectric constants of a continuous-gradient refractive index lens (GRIN).
Each of the transmissive elements of the array may map a visible band of optical radiation received at each of the plurality of angles of incidence to each respective coordinate location. The mapping may be made regardless of frequency, or as a function of frequency. For example, green light at a given angle of incidence may be mapped to one coordinate location, while red light at the same angle of incidence may be mapped to a different location. The array may function to map optical radiation for a continuous band or one or more plurality of narrow bands. For example, in display or imaging embodiments, the transmissive elements may be configured to map specific bands of red, green and blue (or magenta cyan, and yellow). The mapping of narrow bands to coordinate locations based on the angle of incidence (or to angles of propagation based on originating coordinate location) may be independent of frequency and/or a function of frequency, as previously described.
In various embodiments, a plurality of narrow bands may be selected to allow for the reproduction of a gamut of colors when combined (e.g., red, a green, and a blue). Each transmissive element in the array may operate to perform a Fourier transform of optical radiation properties from transverse wavenumbers to transverse coordinate locations adjacent to said transmissive elements. In some embodiments, at least one of a plurality of voxels of at least one of the transmissive elements in the array may be a metamaterial with a target refractive index for an operational bandwidth. An optical apparatus may be configured to operate in one or more bandwidths, such as bands including one or more of infrared light, visible light, and ultraviolet light.
In various embodiments, each of the transmissive elements in the array is round. In other embodiments, the transmissive elements may be non-round (e.g., rectangular, oval, hexagonal, or the like). Especially in high-fill factor arrays, non-round elements may be utilized. For example, hexagonal transmissive elements may be used with a fill factor approaching one hundred percent.
The optical apparatus may include an array of transmissive elements forming any of a wide variety of shapes, curves, sizes, etc., regardless of the shape of the individual transmissive elements. For instance, the optical apparatus may include a first layer of transmissive elements in an array to form a rounded-shaped optical apparatus, a hexagonal-shaped optical apparatus, rectangular-shaped optical apparatus, a portion of a windshield, or another shape to perform a different function.
The optical apparatus may be sandwiched between interior and exterior layers of optically transparent materials. For instance, the optical apparatus may be embedded within layers of a windshield or, alternatively, form the windshield of a vehicle, aircraft, boat, recreational vehicle, or spacecraft.
In various embodiments, the transmissive elements of the first layer may have a largest dimension (e.g., the diameter of the surface of optical radiation incidence) that is approximately 1 millimeter. In other embodiments, larger diameters of approximately 1 centimeter may be utilized. In still other embodiments, such as those visualized at larger distances, the largest dimension may be approximately 10 centimeters. Thus, a range of dimensions between approximately 1 millimeter up to 100 millimeters may be utilized depending on the application and desired resolution.
The transmissive elements in the array may comprise Maxwell-Luneburg lenses, or modified or reshaped versions thereof. For example, the transmissive elements may comprise a transformation optics-transformed Maxwell-Luneburg lens. As a more specific example, the transformation optics-transformed Maxwell-Luneburg lens may be formed by a quasi-conformal transformation of a Maxwell-Luneburg lens or a flattened Maxwell-Luneburg lens with at least one flattened surface.
In embodiments utilizing flattened Maxwell-Luneburg lenses, the transmissive elements may comprise flattened Maxwell-Luneburg lenses that are flattened on two opposing surfaces such that each flattened Maxwell-Luneburg lens comprises a disk-shaped lens. Each disk-shaped lens may be a cylinder, a rectangular prism, or a hexagonal disk with flat opposing surfaces for incident optical radiation. Each disk-shaped lens comprises a circular disk with flat opposing surfaces.
Each transmissive element in the array may map the optical radiation received at each of a plurality of angles of incidence to a corresponding coordinate location as a focal spot on a plane (e.g., a flat plane or a curved planar surface). In various embodiments, at least some of the transmissive elements may include silica glass, aerogel, porous silica, anti-reflective coatings, or other optically transparent layers.
The optical apparatus may include a modulation matrix of optically modulating sub-elements that are optically coupled to the array of transmissive elements, where each of the transmissive elements in the array may be configured and/or function according to any of the various embodiments described herein. Each of the transmissive elements in the array may map optical radiation between each of the transmissive elements at each of the plurality of angles of incidence to one of the optically modulating sub-elements of the modulation matrix.
The optical apparatus, including at least the first layer of transmissive elements and a modulation matrix layer of optically modulating sub-elements, may operate to receive optical radiation at the first layer and map the optical radiation to specific sub-elements of the modulation matrix based on the angle of incidence. The optical apparatus may operate to propagate or transmit optical radiation through the first layer at a transmission angle of incidence from the transmissive elements based on from which of the plurality of sub-elements optical radiation originated.
In some embodiments, the optical apparatus may further include an immersion medium as an interface between the modulation matrix and the array of transmissive elements. Examples of suitable immersion mediums include, but are not limited to, an oil, a glycerin, and a trapped gas.
The optically modulating sub-elements may include active optically modulating sub-elements to generate an image for transmission through the transmissive elements. The image may be part of a set of three-dimensional images at different locations relative to the transmissive elements for autostereoscopic visualization.
As described above, a transmissive element together with a modulation matrix of optically modulating sub-elements function as a multi-layer direction-selective refractive element. Each multi-layer direction selective refractive element may operate as a varifocal lens responsive to a focus input control. A controller is configured to vary the focal length of at least some of the varifocal lenses via the focus input control to allow for a viewer to accommodate to a focal depth approximately equal to a vergence distance for a stereoscopically viewed image.
The two-layer optical apparatuses described herein may be configured as part of glasses, a visor, or a headset to be worn by a user. A focus input control may allow a viewer or operator to accommodate a focal depth to a target distance. The focus input control may be electrically, mechanically, or acoustically controlled. For instance, the focus input control may be an electrical bias, a mechanical bias, an applied mechanical pressure, a thermal input, an applied acoustic pressure, or other pressure bias.
In some embodiments, the focus input control of an optical apparatus configured to function as a varifocal lens may include an acoustic input that can compress or elongate elements to change their focal lengths. The focus input control may instead be a mechanical pressure stimulus to compress and change refractive indices of one or more of the multi-layer direction-selective refractive elements. In still other embodiments, the optical apparatus may include a compressive transmissive layer of aerogel, a mems actuator, or a capacitive actuator. The multi-layer direction-selective refractive elements may be tunable via mechanical deformation. In some embodiments, mechanical deformation of the entire array of multi-layer direction-selective refractive elements may translate to a known tuning state of each of the multi-layer direction-selective refractive elements. In other embodiments, one or more of the multi-layer direction-selective refractive elements may include a tunable metamaterial.
The optical apparatus may be configured to provide images that are part of a video stream for presenting a virtual reality via, for example, glasses, a visor, a headset, or the like. The modulation matrix may include a first subset of optically modulating sub-elements to generate an image for transmission through the transmissive elements, and a second subset of optically modulating sub-elements to modify optical radiation received from the transmissive elements for image capture.
In some embodiments, multiple optical apparatuses may be used together to form an optical cloaking device. For instance, first and second optical apparatuses may function as a limited bandwidth cloaking device, with each optical apparatus being aligned coplanar to one other on opposite sides of an object to be cloaked and connected via an analog or digital signal transmission line, such that they can each display an image received by the paired device and transmitted via the transmission line. An optical cloaking device in this context is a particular kind of an optical illusion device, which in turn is a kind of an augmented reality system.
In some embodiments, a modulation matrix of optically modulating sub-elements may include an image sensor to capture images based on the optical radiation transmitted through the optically modulating sub-elements. At least one control input in communication with the modulation matrix of optically modulating sub-elements may be used to selectively modify transmission of optical radiation from at least one of the unique locations on the surface of the first layer to the image sensor. The array of optically transmissive elements may autostereoscopically map optical radiation to an image sensor. The optical apparatus may include optically modulating sub-elements that are selectively controllable to modify images captured by the image sensor from the optically transmissive elements.
Another application of the embodiments described herein relate to defensive structures to protect users from optical attacks. A defensive structure may selectively modify the transmittance of the optically modulating sub-elements to retroreflect optical radiation from at least one target angle of incidence. For instance, the optical apparatus may selectively prevent the transmittance of optical radiation through the optically modulating sub-elements at the coordinate locations mapped to by each of the transmissive elements of the array at the at least one target angle of incidence. The defensive structure may selectively modify a transmittance of the optically modulating sub-elements to retroreflect optical radiation. The defensive structure may retroreflect optical radiation from at least one target angle of incidence by selectively reducing the transmittance of optical radiation through the optically modulating sub-elements at the coordinate locations mapped to by each of the transmissive elements of the array.
The number of transmissive elements in an optical apparatus and the number of optically modulating sub-elements may depend on the particular application and desired resolution. Each transmissive element of the array of transmissive elements may be, for example, associated with between 100 and 10,000 optically modulating sub-elements. At least some of the optically modulating sub-elements of the modulation matrix may be controllable to selectively modify a transmittance, reflectance, optical extinction, optical absorption, filtering functionality, polarization, backscattering or retroreflection of the optical radiation incident on the optically modulating sub-elements.
The optical apparatus may form a retroreflective beam that is focused back at the source of an incident beam. Optically modulating sub-elements may be adjustable via one or more control inputs to change a filtering functionality, bandwidth(s) of filtering, polarization state (e.g., adjustments to linear or circular polarization).
In still other embodiments, some of the optically modulating sub-elements of the modulation matrix are controllable to shift the frequency of the optical radiation and/or amplify the optical radiation transmitted therethrough. For example, the modulation matrix may be configured to amplify optical radiation received at certain angles of incidence corresponding to optical radiation from a first spatial region. The optical radiation received by a second subset of optically modulating sub-elements may operate to dim optical radiation received at angles of incidence corresponding to a second spatial region.
In a specific embodiment, the optical apparatus is part of a windshield with a first subset of optically modulating sub-elements of the modulation matrix are at coordinate locations of transmissive elements corresponding to angles of incidence in a frontal spatial region. That is, optical radiation received at angles of incidence corresponding to a region directly in front of the windshield. Modulating sub-elements of a second subset of optically modulating sub-elements are at coordinate locations of transmissive elements corresponding to angles of incidence in periphery spatial regions. Accordingly, the optical radiation received at angles of incidence from, for example, oncoming headlights in a different lane could be automatically dimmed based on the angle from which the optical radiation originates.
In some embodiments, the modulation matrix of the optical apparatus may operate to increase or decrease the total dynamic range of received optical radiation. In some embodiments, the modulation matrix of the optical apparatus may comprise frequency-converting elements, such as phosphor-based elements to up-convert or down-convert the frequency of optical radiation.
In some embodiments, the optical apparatus may further include an optical inversion layer (e.g., as part of the first layer of transmissive elements or as a separate layer). In some embodiments, the modulation matrix may operate to overlay an image or text on the optical radiation transmitted therethrough or therefrom. The optical apparatus may function as a heads-up display (HUD) for a vehicle, such as a car, boar, or aerial vehicle. The optical apparatus may modify optical radiation by superimposing text and/or images as part of a virtual or augmented reality.
The optical apparatus may include a first layer of optically transmissive elements to Fourier-transform received optical radiation for mapping to a modulation matrix of optically modulating sub-elements. According to various embodiments, the optical apparatus may further include an array of inverse Fourier-transforming optically transmissive elements to inverse-map optical radiation between the optically modulating sub-elements of the modulation matrix for propagation at angles corresponding to the angles of incidence from which the optical radiation and the corresponding transmissive elements of the array.
In such an embodiment, optical radiation passes through with imperceptible differences when the modulation matrix is set to allow passthrough without modulation of any type. However, the modulation matrix can be selectively controlled to implement direction-selective modulation in which modulation is applied to the optical radiation based on the direction of travel (e.g., angle of incidence). In some embodiments, an additional inversion layer may be included as a fourth layer and/or functionally incorporated into the Fourier-transforming or inverse Fourier-transforming layer.
The inverse Fourier-transforming optically transmissive elements of the optical apparatus may be embodied as flattened Maxwell fish-eye lenses. In various embodiments, at least one surface of each Maxwell-Luneburg lens is substantially flat. The modulation matrix of optically modulating sub-element may form a planar layer optically coupled to the flattened Maxwell-Luneburg lenses (first layer) and the inverse-Fourier-transforming transmissive elements (second layer), which may be embodied as Maxwell-Luneburg lenses in combination with an inversion layer.
As previously described, each of the flattened Maxwell-Luneburg lenses (first and/or second layer) may be embodied as a quasi-conformal transformation of a Maxwell-Luneburg lens, according to any of the various embodiments described herein. In some embodiments, the optical radiation received at the first layer is Fourier-transformed based on the angle of incidence for mapping to a particular optically modulating sub-element of the modulation matrix associated with a particular transmissive element. The optical radiation can be selectively modified on a direction-selective basis. The inverse Fourier-transforming layer of transmissive elements may propagate the modified (or unmodified) optical radiation in the same direction in which it was received
Some embodiments of an optical apparatus may be configured to focus optical radiation. The focus spot of such embodiments may be non-circular due to refractive anomalies in the transmissive elements of the array. In such instances, the inverse Fourier-transforming optically transmissive elements of the array may be configured to correct for the refractive anomalies.
In various embodiments, transmissive elements of a first layer may focus optical radiation to distinct sub-elements of a modulation matrix based on the angle of incidence of the optical radiation. Each of the transmissive elements of the first layer may focus optical radiation received at each angle of incidence to a distinct sub-element of the modulation matrix.
At least some of the inverse Fourier-transforming optically transmissive elements of the array in the third layer may function as varifocal lenses responsive to a focus input control. As in related embodiments providing varifocal lenses, the controller may vary the focal length to allow a viewer to accommodate to a target focal depth.
A three-layer device, including a modulation matrix positioned between an array of Fourier-transforming transmissive elements and an array of inverse Fourier-transforming transmissive elements. Such a device may be configured for use as part of corrective lenses such as eyeglasses or contact lenses, a visor, a headset, or another personal-use device. Some such embodiments may include varifocal capabilities at the first or second layers of Fourier-transforming and inverse Fourier-transforming arrays of transmissive elements. Varifocal input controls may be based on one or more of an electrical bias, a mechanical bias, mechanical deformation, acoustic-based deformations, mems actuators, capacitive actuators, or the like. In some embodiments, the optical apparatus may include a sensor system to detect a location of a user's eye location and automatically adjust the varifocal lens. A sensor system may specifically track vergence of a user's eyes and automatically adjust the varifocal lens.
As previously described, mechanical deformation of the optical apparatus may result in a controlled deformation of each transmissive element in the inverse Fourier-transforming layer. In some embodiments, tunable metamaterials may be utilized to manufacture the Fourier-transforming and/or inverse Fourier-transforming.
Any of the multi-layer embodiments described herein may be used to provide a retroreflective beam focused back at the source of an incident beam. For example, an optical apparatus may be part of an optical defensive system with least some of the optically modulating sub-elements of the modulation matrix controllable to selectively form a retroreflective beam focused back at the source of an incident beam.
Any of the multi-layer embodiments described herein may also be used to generate an overlay on optical radiation from the transmissive elements of the array. Such embodiments may be useful as part of a windshield of a vehicle to provide informational overlays or other visual overlays overlay. Other embodiments may modify the optical radiation to provide for an augmented reality experience on a personal user device, a window, a display, a windshield, a wall, or the like. An overlay may augment images transmitted through the array of transmissive elements to form the augmented reality.
An optical apparatus may include a modulation matrix of optically modulating sub-elements between a layer of Fourier-transforming transmissive elements and a layer of inverse Fourier-transforming transmissive elements. Each transmissive element may be associated with a plurality of sub-elements, depending on the target direction-selectivity. The number and size of the transmissive elements may depend on the target resolution of the optical apparatus. Such an optical apparatus may operate to provide vision-altering effects to a user, such as vision correction of myopia or hypermetropia, vision enhancement, user-selectable zooming capabilities, contrast enhancement, band shifting, light amplification, light reduction, focus shifting, other vision modifications, and/or combinations thereof.
The optical apparatus may additionally or alternatively provide vision protection. The vision protection may include physical vision protection, such as protection from objects impacting the eyes of the user. Vision protection may additionally or alternatively include protection from harmful optical radiation by dimming, frequency shifting, retroflecting, or otherwise preventing harmful optical radiation from damaging the eyes or eye of a user of the optical apparatus.
Such an optical apparatus may be embodied as or as part of corrective lenses such as contact lenses and eyeglasses, goggles, a windshield, a visor, sunglasses, a mask, a helmet, various user-word devices, and the like. The vision-alerting effects may be direction-selective. That is, the effects may be applied to only the optical radiation originating at certain angles of incidence relative to the Fourier-transforming array of transmissive elements.
In some embodiments, the optically modulating sub-elements of the modulation matrix operate to provide band shifting of one or more frequency bands. For example, the modulation matrix may operate to shift non-visible electromagnetic radiation to frequencies within the visible spectrum. Non-visible electromagnetic radiation, such as infrared and/or ultraviolet light may be frequency-converted to frequencies within the visible spectrum. The modulation matrix may enhance the contrast and/or adjust the dynamic range of the optical radiation passed through the optical apparatus to a user.
Each of the transmissive elements, including those in the Fourier transforming layer and the inverse-Fourier transforming layer, may comprise a distribution of dielectric constants to effectuate the mapping between the angle of incidence and coordinate location. The materials used in any of the three layers or sub-layers may be selected for a particular frequency band and/or to function better as a transmitter or a receiver. In various embodiments, the individual lenses may be idealized as graded-permittivity structures having a continuous distribution of dielectric constants, such that there are no abrupt changes in permittivity across the structure. Given the finite bandwidth of typical systems, a discretized piecewise-continuous approximation of the graded-permittivity structure may be electromagnetically equivalent for a given bandwidth.
Thus, in various embodiments, each transmissive element may be divided into a plurality of sub-wavelength voxels. That is, each transmissive element may be conceptually thought of as a plurality of voxels (three-dimensional pixels) whose largest dimension is smaller than a wavelength within the relevant bandwidth (in at least one direction). For example, each voxel may have a maximum dimension in at least one direction that is less than half of a wavelength (e.g., the smallest wavelength) within an operational frequency range. In some embodiments, the voxels may be cubes, parallelepipeds, tetrahedrons, prisms, various regular polyhedrons, or other polyhedrons. In some embodiments, a voxel may have one or two dimensions that are sub-wavelength while the other dimension(s) are larger than a wavelength.
In various embodiments, a combination of voxel shapes and/or sizes may be used. Moreover, voxels may be shaped and/or sized such that little or no space, gaps, or voids exist between voxels. Alternatively, voxels may be arranged such that gaps or voids of various sizes and/or shapes exist intentionally. In some embodiments, the gaps or voids may be ignored and/or negligible in calculating the volumetric dielectric constants. Alternatively, the gaps or voids may be assigned one or more dielectric constants corresponding to a vacuum or to air or another fluid that fills the gaps or voids.
In various embodiments, the transmissive elements may be conceptually discretized to facilitate the use of optimization algorithms, while the physically constructed transmissive elements may not be physically discretized. In other embodiments, the transmissive elements may be physically discretized (e.g., a transmissive element may be printed using a three-dimensional printer). Examples of optimizations and calculations for determining distributions of dielectric constants to accomplish a given design are described in U.S. patent application Ser. No. 14/638,961 filed on Mar. 4, 2015, titled “Holographic Mode Conversion for Electromagnetic Radiation,” which application and all applications that claim priority thereto are hereby incorporated by reference in their entireties.
In some embodiments, the distribution of dielectric constants may comprise a distribution of only dielectric materials. The transmissive elements may be manufactured to be porous and/or comprise foam, composite materials, fiber-bundles, stratified layers, micro-rod materials, nano-rod materials, and/or the like. In various embodiments, metamaterials may be utilized. For example, a metamaterial may be utilized that has an effective dielectric constant less than 1 and/or a complex permittivity value or values for an operational frequency range. Multiple different types of metamaterials may be utilized for various dielectric constants less than 1 and/or complex permittivity.
Sub-wavelength voxels may be utilized to attain an effective dielectric constant distribution at specific bandwidths of optical radiation. Examples of suitable materials to construct transmissive elements with target distributions of dielectric constants to map optical radiation between each of a plurality of angles of incidence and corresponding coordinate locations include, but are not limited to: porcelain, glass, plastic, air, nitrogen, sulfur hexafluoride, perylene, mineral oil, ceramic, paper, mica, polyethylene, aluminum oxide, and other optically transmissive and non-optically transmissive materials. In some embodiments, a non-superluminal low-loss dielectric (NSLLD) material may be utilized. Sub-wavelength voxels of non-optically transmissive materials may be utilized, in some embodiments, to attain a target distribution of dielectric constants without significantly reducing the overall transmittance of the optical apparatus.
In some embodiments, the transmissive elements may be manufactured having discretized sub-wavelength voxels of materials having various dielectric constants. For example, an array of transmissive elements, and (optionally) a support material to hold the transmissive elements together, may be printed with a three-dimensional printer. In other embodiments, the discretized sub-wavelength voxels may be manufactured using a wide variety of known techniques, such as etching, chemical deposition, masking, molten extrusion, injection molding, heating, ultrasonication, and/or other fabrication techniques known in the art for the materials utilized in a particular embodiment.
According to any of the various embodiments described herein, or combinations thereof, an optical system may provide direction selectively filtering via a multi-layer refractive element or an array of multi-layer refractive elements. Each multi-layer refractive element may include a Fourier-transforming layer of transmissive elements to map optical radiation to discrete sub-elements of a modulation matrix based on the angle of incidence. Each multi-layer refractive element may also include an inverse Fourier-transforming layer to inverse map the optical radiation, as modified by the modulation matrix, for propagation at predetermined transmit angles of incidence based on the specific sub-element from which the optical radiation originated.
Accordingly, a system may be configured to receive optical radiation on an input surface of a first optically transmissive layer at each of a plurality of angles of incidence and map the optical radiation received at each of the plurality of angles of incidence to one of a plurality of locations on an output surface of the first layer. A modulation matrix, for example, may modify the transmission of optical radiation from the output surface of the first layer to a second optically transmissive layer at one or more of the plurality of unique locations. The second optically transmissive layer may inverse-map optical radiation from each of the plurality of unique locations for propagation at angles corresponding to the received angles of incidence associated with each unique location.
As previously described, an optical apparatus may be specifically configured to function as an autostereoscopic display with multi-layer direction-selective filtering. Such a device may include a layer of selectively activated sub-elements to generate optical radiation at distinct locations. An optically transmissive layer may propagate the optical radiation generated at each distinct location at a distinct, pre-programmed or pre-configured angle of propagation. The device may include at least one control input in communication with the layer to selectively activate the sub-elements to modify the generation of optical radiation at the distinct locations. A controller may be in communication with each of the at least one control inputs to control the selective activation of the sub-elements to provide direction-selective modifications to the optical radiation.
Similarly, an optical apparatus may be configured to function in the opposite direction for capturing autostereoscopic images. That is, a camera for still photos or video capture may utilize a multi-layer direction selective filter to capture images with knowledge of the angle of incidence of received optical radiation to allow for the reconstruction of an autostereoscopic image. For example, a first optically transmissive layer may map optical radiation received at each of a plurality of angles of incidence to one of a plurality of locations on an output surface of the first layer. A modulation matrix of optically modulating sub-elements coupled to the output surface of the first layer may allow for the selective modulation (modification, overlay, dimming, amplifying, etc.). An image sensor may capture an image of the optical radiation transmitted through the optically modulating sub-elements. One or more control inputs may be controlled by a controller to communicate with the modulation matrix to provide a default, user-selected, optimized, or arbitrary modulation of received optical radiation for image and/or video capture.
In still other embodiments, a bi-directional autostereoscopic video communications device may utilize a multilayer optical apparatus to provide direction-selective filtering for autostereoscopic video display and concurrent video capture. An optically transmissive layer may map optical radiation received on an exposed surface at each of a plurality of angles of incidence to one of a plurality of locations on an opposing surface of the optically transmissive layer. The optically transmissive layer may also map optical radiation from each of the plurality of unique locations on the opposing surface of the optically transmissive layer for propagation at each of a plurality of unique angles of propagations. The optical apparatus may include a modulation matrix of optically modulating sub-elements coupled to the opposing surface of the optically transmissive layer. In various embodiments, at least one layer of imaging elements is optically coupled to the opposing surface of the optically transmissive layer via the modulation matrix of optically modulating sub-elements. The imaging elements may, for example, comprise a plurality of light-producing elements to generate optical radiation for selective transmission through the modulation matrix of optically modulating sub-elements to some of the unique locations on the opposing surface of the optically transmissive layer. The optically modulating sub-elements may further include a plurality of sensor elements to capture an image corresponding to the optical radiation selectively transmitted through the modulation matrix of optically modulating sub-elements from the unique locations on the opposing surface.
Various combinations of the numerous embodiments described herein are possible. For example, an autostereoscopic camera and an autostereoscopic display may be combined as a single unit that can both capture optical radiation from external sources and simultaneously, or substantially simultaneously from a user's perspective, display an autostereoscopic image, sequence of images, and/or video. A controller or control circuitry may control one or more control inputs off the modulation matrix of to selectively modify transmission of optical radiation from at least one of the unique locations on the output surface of the first layer to an image sensor.
Various techniques and approaches, including optimization approaches, manufacturing techniques, approximation approaches, various enhancements, and the like may be utilized as known in the art. Examples of useful teachings that may be employed, further enable, explain, and/or may otherwise be combined with the specific embodiments described herein include the following, each of which is hereby incorporated by reference in its entirety:
SHIN, et al., “Broadband Electromagnetic Cloaking with Smart Metamaterials,” Nature Communications, Nov. 20, 2012, 3.1213, DOI: 10.1038/ncomms2219, Macmillan Publishers Ltd., www.nature.com/naturecommunications;
HUNT, et al., “Broadband Wide Angle Lens Implemented with Dielectric Metamaterials,” Sensors, Aug. 12, 2011, Vol. 11, p. 7982-7991; DOI 10.3390/s110807982, MDPI, Basel, Switzerland, www.mdpi.com/journal/sensors;
SCHURIG, et al., “Calculation of Material Properties and Ray Tracing in Transformation Media,” Optics Express, Oct. 16, 2006, Vol. 14, No. 21, p. 9794-9804, Optical Society of America, www.osapublishing.org;
PAUL, et al., “Construction of Invisibility Cloaks of Arbitrary Shape and Size Using Planar Layers of Metamaterials,” AIP: Journal of Applied Physics, Jun. 20, 2012, Vol. 111, 9 pp, 123106; DOI: 10.1063/1.4729012, American Institute of Physics, dx.doi.org/10.1063/1.4729012;
URZHUMOV, et al., “Cross-Section Comparisons of Cloaks Designed by Transformation Optical and Optical Conformal Mapping Approaches,” Journal of Optics, Nov. 16, 2010, Vol. 13, 12 pp, 024002; DOI: 10.1088/2040-8978/13/2/024002, 10P Publishing Ltd., stacks.iop.org/12/024002;
RAHM, et al., “Design of Adaptive Optics by Finite Embedded Coordinate Transformations,” 2008, psu.edu;
RAHM, et al., “Design of Electromagnetic Cloaks and Concentrators Using Form-Invariant Coordinate Transformations of Maxwell's Equations,” Photonics and Nanostructures—Fundamentals and Applications, Aug. 8, 2007, Vol. 6, p. 87-95; DO1.1016/j.photonics.2007.07.013, Elsevier B. V., elsevier.com/locate/photonics;
POPA, et al., “Design of Layered Transformation-Optics Devices of Arbitrary Shape,” Physical Review A, Sep. 30, 2010, Vol. 82, 5 pp, 033837, DOI: 10.1103/PhysRevA.82.033837, The American Physical Society, journals. aps. org/pra/abstract/10.1103/PhysRevA.82.033837;
KUNDTZ, et al., “Electromagnetic Design with Transformation Optics,” Proceedings of the IEEE, October 2011, Vol. 99, No. 10, p. 1622-1633, DOI: 10.1109/JPROC.2010.2089664, IEEE;
KUNDTZ, et al., “Extreme-Angle Broadband Metamaterial Lens,” Nature Materials, February 2010, Vol. 9, p. 129-132, Macmillan Publishers Ltd., www. nature/com/naturematerials;
URZHUMOV, et al., “Low-Loss Directional Cloaks Without Superluminal Velocity or Magnetic Response,” OPTICS LETTERS, Nov. 1, 2012, Vol. 37, No. 21, p. 4471-4473, Optical Society of America, www.osapublishing.org;
CUMMER, et al., “Material Parameters and Vector Scaling in Transformation Acoustics,” New Journal of Physics, Nov. 27, 2008, Vol. 10, 12 pp, 10P Publishing Ltd. and Deutsche Physikalische Gesellschaft, www.njp.org;
RAHM, et al., “Optical Design of Reflectionless Complex Media by Finite Embedded Coordinate Transformations,” arXiv:0711.1846 v.2 [physics.optics], Dec. 4, 2007, www.arxiv.org/abs/0711.1846;
ROBERTS, et al., “Optical Lens Compression Via Transformation Optics,” OPTICS EXPRESS, Sep. 14, 2009, Vol. 17, No. 19, p. 16535-16542, Optical Society of America, www.osapublishing.org;
HUNT, et al., “Perfect Relay Lens at Microwave Frequencies Based on Flattening a Maxwell Lens,” Journal of the Optical Society of America B, August 2011, Vol. 28, No. 8, p. 2025-2028, Optical Society of America, www.osapublishing.org;
CHEN, et al., “Special Issue on Transformation Optics,” Journal of Optics, 2016, 040201, 3 pp, D01:10.1088/2040-8978/18/4/040201, 10P Publishing Ltd;
Werner, et al., “Transformation Electromagnetics and Metamaterials—Fundamental Principles and Applications,” 2014, 499 pp, Springer-Verlag, London;
HUNT, et al., “Transformation Optics Compressed Rotman Lens Implemented with Complementary Metamaterials,” Proceedings of the Society of Photo-Optical Instrumentation Engineers (SPIE), 2010, Vol. 8021, 7 pp, D01:10.1117/12.884319, Radar Sensor Technology XV, www.spiedigitallibrary.org;
URZHUMOV, et al., “Transformation Optics with Photonic Band Gap Media,” Phys. Rev. Lett. 105, 163901, arXiv:1007.3227 [physics.optics], Jul. 19, 2010, 4 pp, www.arxiv.org/abs/1007.3227;
SCHURIG, et al., “Transformation-Designed Optical Elements,” Optics Express, October 2007, Vol. 15, No. 22, 11 pp, Optical Society of America, www.osapublishing.org; and
SHIN, et al., “A Versatile Smart Transformation Optics Device with Auxetic Elasto-Electromagnetic Metamaterials,” Scientific Reports, Feb. 13, 2014, 4:4084, DOI: 10.1038/srep04084, www. nature. com/scientificreports.
The generalized descriptions of the systems and methods herein may be utilized and/or adapted for utilization in a wide variety of industrial, commercial, and personal applications. For example, the systems and method described herein may be utilized in communication systems, windshield devices, protection devices, defensive shields, games, electronic toys entertainment devices, and the like. Many of the illustrated embodiments show two-dimensional depictions of three-dimensional arrays to simplify the illustrations.
In Equation 1, the index of refraction nL is a function of the radius r and is unity on the surface of the bounding sphere of radius a and √{square root over (2)} at the center. In the theoretically ideal embodiment, the Luneburg lens focuses parallel rays from an infinitely distant source to a single point on the opposite side of the sphere. Close approximations to this theoretically ideal embodiment are often sufficient for various practical applications and relatively narrow bandwidths. Optical radiation incident on the surface of the sphere will be mapped to a unique coordinate location.
If, for example, sensor elements with a finite area larger than a point are placed on one hemisphere of the sphere, each sensor element could be configured to receive optical radiation from a specific angle of incidence (with a range of angles being mapped to the same sensor based on the dimensions of each sensor element).
Similarly, if an array of light emitting diodes (LEDs), or other optical radiation transmitter elements, are positioned on one hemisphere, light emitted by a given LED will be mapped for propagation as parallel rays in a specific angular direction that can be defined relative to an angle of incidence on the surface of the opposing hemisphere where the optical radiation is propagated into, for example, free space. As used herein, the term “angle of incidence” relative to a surface is used to describe the intersection of optical radiation with a surface in either a transmit or receive mode in which optical radiation is being received, transmitted, simultaneously received and transmitted, or time-multiplexed between receiving and transmitting.
Examples of such optical transformations using quasi-conformal coordinate transformations can be found in LANDY, et al., “Approaches to Three-Dimensional Transformation Optical Media Using Quasi-Conformal Coordinate Transformations,” arXiv:1007.4363 v1 [physics.optics], Jul. 26, 2010, www.arxiv.org/abs/1007.4363, which is hereby incorporated by reference in its entirety.
In Equation 2, n0 is the index of refraction for a given bandwidth of optical radiation at the center of the lens, where a is the radius of the lens, and the index of refraction n is a function of the distance r from the center. As described in SMITH, et al., “Enhancing Imaging Systems Using Transformation Optics,” Optics Express, Sep. 22, 2010, Vol. 18, No. 20, p. 21238-21251, Optical Society of America, www.osapublishing.org, which is hereby incorporated by reference in its entirety, the Maxwell fisheye lens 400 can be flattened using a coordinate transformation shown in transformation Equation 3 below:
Transformation Equation 3 maps a cylindrical region of radius a into a rectangular region of width w and height l.
As illustrated, the Maxwell-Luneburg lens combination 501, 505, and 502 operates to perform a Fourier-transformation to map optical radiation 530 between angles of incidence on the surface of the lens to a coordinate location 510 on a planar surface. The flattened Maxwell lens portion 505 inverts the optical radiation from the coordinate location 510 to a corresponding “inverted” coordinate location 511. The second inverse Fourier-transforming lens portion 502 maps the optical radiation from the coordinate location 511 for propagation as optical radiation 535 at an angle corresponding to that of the received optical radiation 530.
In some embodiments, optical radiation from (or to) a particular angle is mapped to more than one sub-element of the modulation matrix 620. For example, optical radiation at each of a plurality of angles incident on one quadrant of a two-dimensional surface of an optically transmissive element may be mapped to a unique sub-element of the modulation matrix 620. Optical radiation incident on other quadrants (or other partitions) of the two-dimensional surface of the optically transmissive element may be mapped to a different subset of sub-elements of the modulation matrix 620. Thus, for a given number of partitions, optical radiation may be mapped to a corresponding number of sub-elements.
The optically transmissive elements 610 and 630 for Fourier- and inverse Fourier-transformation may comprise Luneburg and/or Maxwell lenses with one or more flattened services (generally referred to as Luneburg-Maxwell lenses with one or more flattened surfaces. The modulation matrix 620 may comprise a plurality of sub-elements that can be individually controlled or controlled in subsets to selectively modify the optical radiation passing therethrough in any of a wide variety of ways, as described herein in detail.
Similarly, the length and width dimensions of each transmissive element in the array of Fourier-transforming optically transmissive elements and the array of inverse Fourier-transforming optically transmissive elements may be selected based on a target resolution for a particular application. Likewise, the number of optically modulating sub-elements per optically transmissive element may be selected based on a desired angular selectivity. The number of sub-elements in each dimension of the two-dimensional array associated with opposing Fourier- and inverse Fourier-transforming optically transmissive elements may be selected based on a target angular selectively for direction-selective filtering (i.e., modification to the optical radiation) in each dimension.
For instance, a particular application may configure each of the transmissive elements to have a field of view between 120 and 180 degrees in a horizontal dimension and between 90 and 120 in a vertical dimension. To maintain an angular selectively of 1.5 degrees, the two-dimensional array of optically modulating sub-elements may include between 80 and 120 sub-elements in the horizontal dimension and between 60 and 80 sub-elements in the vertical dimension.
Optically modulating sub-element 852 may be driven by a controller to generate second optical radiation. The double flattened hexagonal transmissive element 800 inverse Fourier-transforms the second optical radiation to map the optical radiation from the optically modulating sub-element 852 for propagation 842 at a second angle of incidence relative to the surface 801.
As illustrated, neither of the optically modulating sub-elements 853 and 854 is modifying the mapped optical radiation 833 and 843, so the optical radiation 833 and 843 passes through the optically modulating sub-elements 853 and 854 and diverges as divergent optical radiation 834 and 844.
For example, the controller 1160 may selectively cause specific sub-elements of the modulation matrix layer 1120 corresponding to optical radiation received at one or more angles of incidence to modify the optical radiation from the specific angles. The modification of optical radiation may include amplifying, dimming, frequency shifting, or other modification as described herein. In some embodiments, the controller 1160 may drive some sub-elements of the modulation matrix layer 1120 to emit optical radiation to produce, for example, a heads-up display or an augmented reality.
The optical radiation 1140 incident on one of the transmissive elements is shown close-up, at 1150, with the optical radiation transformed from the angle of incidence to a coordinate location corresponding to one of the sub-elements of the modulation matrix layer 1120. The optical radiation, as direction-selectively modified by the modulation matrix layer 1120, is inverse Fourier-transformed from coordinate locations (e.g., specific sub-elements) for the propagation of optical radiation 1145 at angles of incidence on the output surface of the transmissive elements of the inverse Fourier-transforming layer 1130.
The optical radiation, as direction-selectively modified by the modulation matrix layer 1120, is inverse Fourier-transformed from coordinate locations (e.g., specific sub-elements) for the propagation of optical radiation 1175 at angles of incidence on the output surface of the transmissive elements of the inverse Fourier-transforming layer 1130.
Comparing
In some embodiments, the selectable control options 1370 may include only one option. For example, the two-dimensional modulation matrix array 1310 may allow for direction-selective blocking of optical radiation. In another embodiment, the two-dimensional modulation matrix array 1310 may allow for direction-selective augmentation of optical radiation passed from a Fourier-transforming layer to an inverse Fourier-transforming layer.
The optical apparatuses, systems, and methods described herein may be utilized in a wide variety of applications. Some applications and implementations may utilize a Fourier-transformation layer, a modulation matrix layer, and an inverse Fourier-transformation layer. In other embodiments, some applications and implementations may utilize only a modulation matrix layer with an inverse Fourier-transformation layer for propagating optical radiation generated by the modulation matrix layer at propagation angles based on the originating sub-element of the modulation matrix layer. Examples of two-layer embodiments include, for example, autostereoscopic displays. In other embodiments, an optical apparatus may include a modulation matrix layer for receiving optical radiation from a Fourier-transformation layer of transmissive elements.
In other embodiments, a defensive structure selectively modifies a transmittance of the optically modulating sub-elements to retroreflect optical radiation from at least one target angle of incidence by selectively reducing the transmittance of optical radiation through the optically modulating sub-elements at the coordinate locations mapped to by each of the transmissive elements of the array at the at least one target angle of incidence.
The direction-selective filtering may, for example, operate to provide augmented reality, add a heads-up display, provide polarization filtering on a direction-selective basis, block or dim light from one or more directions, amplify light, increase contrast, color shift, or otherwise provide direction-based modifications. Any of the various direction-selective modifications may be implemented in a vehicle windshield, including defensive applications, as illustrated in
Displays may include two-layer optical apparatuses to provide, for example, autostereoscopic displays. Optical radiation from sub-elements of a modulation matrix mapped to one eye of the user may display a first image. Optical radiation from sub-elements of the modulation matrix mapped to the other eye of the user may display a second image. The first and second images can be selected to provide an autostereoscopic image or video.
Many existing computing devices and infrastructures may be used in combination with the presently described systems and methods. Some of the infrastructure that can be used with embodiments disclosed herein is already available, such as general-purpose computers, computer programming tools and techniques, digital storage media, and communication links. A computing device or controller may include a processor, such as a microprocessor, a microcontroller, logic circuitry, or the like. A processor may include one or more special-purpose processing devices, such as application-specific integrated circuits (ASICs), programmable array logic (PAL), programmable logic array (PLA), programmable logic device (PLD), field-programmable gate array (FPGA), or other customizable and/or programmable device. The computing device may also include a machine-readable storage device, such as non-volatile memory, static RAM, dynamic RAM, ROM, CD-ROM, disk, tape, magnetic, optical, flash memory, or another machine-readable storage medium. Various aspects of certain embodiments may be implemented using hardware, software, firmware, or a combination thereof.
The components of the disclosed embodiments, as generally described and illustrated in the figures herein, could be arranged and designed in a wide variety of different configurations. Furthermore, the features, structures, and operations associated with one embodiment may be applied to or combined with the features, structures, or operations described in conjunction with another embodiment. In many instances, well-known structures, materials, or operations are not shown or described in detail in order to avoid obscuring aspects of this disclosure.
The embodiments of the systems and methods provided within this disclosure are not intended to limit the scope of the disclosure but are merely representative of possible embodiments. In addition, the steps of a method do not necessarily need to be executed in any specific order, or even sequentially, nor do the steps need to be executed only once. As described above, descriptions and variations described in terms of transmitters are equally applicable to receivers, vice versa, and as transceivers for continuous transceiving and/or time-gated or time modulated receiving/transmitting.
This disclosure has been made with reference to various embodiments, including the best mode. However, those skilled in the art will recognize that changes and modifications may be made to the various embodiments without departing from the scope of the present disclosure. While the principles of this disclosure have been shown in various embodiments, many modifications of structure, arrangements, proportions, elements, materials, and components may be adapted for a specific environment and/or operating requirements without departing from the principles and scope of this disclosure.
These and other changes or modifications are intended to be included within the scope of the present disclosure.
This disclosure is to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope thereof. Likewise, benefits, other advantages, and solutions to problems have been described above with regard to various embodiments. However, benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature or element. This disclosure should, therefore, be determined to encompass at least the claims submitted herewith, and combinations thereof.
If an Application Data Sheet (ADS) has been filed on the filing date of this application, it is incorporated by reference herein. Any applications claimed on the ADS for priority under 35 U.S.C. §§ 119, 120, 121, or 365(c), and any and all parent, grandparent, great-grandparent, etc., applications of such applications are also incorporated by reference, including any priority claims made in those applications and any material incorporated by reference, to the extent such subject matter is not inconsistent herewith. The present application claims the benefit of the earliest available effective filing date(s) from the following listed application(s) (the “Priority Applications”), if any, listed below (e.g., claims earliest available priority dates for other than provisional patent applications or claims benefits under 35 U.S.C. § 119(e) for provisional patent applications, for any and all parent, grandparent, great-grandparent, etc., applications of the Priority Application(s)). In addition, the present application is related to the “Related Applications,” if any, listed below. NONE If the listings of applications provided above are inconsistent with the listings provided via an ADS, it is the intent of the Applicant to claim priority to each application that appears in the Priority Applications section of the ADS and to each application that appears in the Priority Applications section of this application. All subject matter of the Priority Applications and the Related Applications and of any and all parent, grandparent, great-grandparent, etc., applications of the Priority Applications and the Related Applications, including any priority claims, is incorporated herein by reference to the extent such subject matter is not inconsistent herewith.