The presented disclosure is related to image sensors, and more particularly to broadband polarization splitters manufactured using CMOS fabrication technology.
Throughout this document the term “broadband” is referred to wavelength ranges for which the fractional bandwidth is greater or equal to 0.1. The term “fractional bandwidth” is defined as: (highest wavelength−lowest wavelength)/(0.5*(highest wavelength+lowest wavelength). As an example, the bandwidth of 3.5 to 4 um is considered as broadband because fractional bandwidth is calculated as (4−3.5)/(0.5*(4+3.5))=0.133 which is greater than 0.1
Optical systems are typically designed via modular combinations of elements to achieve complex functions. For example, lenses and diffractive optics can be combined to perform hyperspectral imaging. This approach is intuitive and flexible, providing access to a wide range of functions from a limited set of elements. However, the overall size and weight of the optical system may limit its scope of applications. Recent advancements in nanofabrication may alleviate this constraint by replacing bulky elements with metasurfaces-planar arrays of resonant nanostructures with sub-wavelength thickness. By engineering the scattering of individual elements within the array, these devices can reproduce the multi-functionality of complex optical systems in a single element. However, efforts to combine multiple metasurfaces for more complex functionality have been stymied by reduced scattering efficiency, which scales inversely with the number of simultaneous tasks.
The inherent trade-off between multi-functionality and efficiency in these systems is due to the finite number of degrees of freedom, which scales with the volume of the device and the maximum refractive index contrast. In particular, this limits the range of independent functions achievable by any ultrathin system, such as sorting light according to frequency, polarization, and incident angle. By contrast, three-dimensional scattering elements with thicknesses greater than a wavelength commonly encode many simultaneous functions, albeit so far only with low efficiency due to weak scattering and low index-contrast.
Historically, optical design has been modular, a paradigm that provides an intuitive way to build and reconfigure optical setups. With the advancement of nanofabrication technologies, it became possible to make structures with sub-wavelength feature size that enabled multi-functional optical elements combining the functionality of more complex setups. Examples include metasurface lenses that can split different polarizations and spectral bands. However, the degree of performance and functionality that can be achieved with metasurfaces and other planar structures is inherently limited by the number of optical modes that can be controlled.
Structuring the refractive index with high contrast at sub-wavelength scale provides an expansive optical design space that can be harnessed for demonstrating multi-functional optical elements. So far this has been used mostly in two dimensional structures, or metasurfaces. However, their performance is limited by the available optical degrees of freedom.
Sensing the polarization state of light allows for imaging beyond standard spatial and spectral techniques. For example, because of the way light polarizes on reflection from a surface, orientation of surfaces can be understood by looking at various polarization components of received light on a camera sensor. Polarimetry is conventionally done with bulky optical components.
Through some previous work, it has been shown that polarization sensing can be achievable with metasurfaces but not demonstrated over large bandwidths. Such previous work relied upon six measurements [reference 1].
Practically, a sensing element being able to measure the full polarization state of light over a broad band is highly desired. Moreover, the integration of such sensing element with modern day camera technology is also a very desirable feature.
In order to categorize the polarization state of light including accounting for the not fully polarized state, four measurements of the input light must be made. Each of these measurements needs to compute the projection of the input polarization vector onto one of four known polarization state vectors. By maximally spacing these known polarization state vectors on the Poincare sphere, these four measurements can be used to reconstruct the polarization state of the incoming light. This technique is already known and was demonstrated with an optical element that splits these polarization states [reference 2]. However, in order to make this technique more practical, it would be very useful to split the polarization states onto the four vectors directly on the image sensor. If the splitters are designed on the pixel level, cameras having custom functionalities that vary spatially can be made. Some areas on the sensor can be measuring polarization and some can be measuring spectral information for example. Moreover, one can choose which type of splitter to place above each set of pixels on the camera sensor.
The disclosed methods and devices address the problems as described above.
Complex three-dimensional (3D) scattering structures allowing the splitting of polarization with higher efficiency are disclosed in the present application.
The disclosed scattering structures can be integrated into modern-day camera sensors. Polarization splitting pixels that are analogous to a typical Bayer filter pixel in a modern-day CMOS camera array [reference 3] are also described. The disclosed devices are designed to split over a broad band based on polarization state instead of sort different colors to different sensors. As a result, such devices can turn an RGB camera into a polarization camera. The disclosed teachings can be adapted for different wavelengths, such as mid infrared.
Cost-effective and large-scale fabrication of such structures poses significant challenges on the design process. The objective is to achieve the best performance given the inherent constraints associated with high-volume CMOS fabrication processes.
The disclosed methods and devices also address the described challenges and provide practical solutions to the above-mentioned problem.
In particular, the disclosed methods and devices teach various steps to design 3D scattering structures using a scalable fabrication process. Currently, the most scalable fabrication that can handle dimensions smaller than 100 nm is the CMOS foundry fabrication process. In the CMOS process, it is possible to fabricate very complex networks of copper wires stacked on top of each other and embedded in SiO2.
Exemplary structures designed this for the mid-infrared as a target for fabrication with direct write lithography [references 4, 5] are presented. As will be described in more detail, the described structure is split into ten distinct layers to show it is amenable to a layered fabrication technique. A scaled version of such design can be used to create a visible light polarization camera sensor when combined with a regular CMOS imaging array.
One of the benefits of a more broadband approach as disclosed is that it allows a camera to receive more signal without needing monochromatic light illuminating a scene. Otherwise, light would need to be filtered around the band where the device operates (e.g., either with an actual filter or using a detector with a narrow absorption response). The broader the device can work with the same polarization states, the more signal can be received into the camera while still reconstructing the polarization state (assuming the polarization states being sensed in a scene are constant across that bandwidth).
According to a first aspect of the present disclosure, an image sensor comprising a three dimensional (3D) scattering structure and a focal plane having four sub-pixels is provided, wherein: the 3D scattering structure comprises a plurality of dielectric pillars, and across a broad bandwidth with a fractional bandwidth of at least 0.1, the plurality of dielectric pillars are configured to split an incident electromagnetic wave along four polarization state vectors and to focus the split incident electromagnetic wave onto the four sub-pixels corresponding to the four polarization state vectors.
According to a second aspect of the present disclosure, a method of splitting an electromagnetic wave, across a broad bandwidth with a fractional bandwidth of at least 0.1 um into four waves with different polarization states is disclosed, the method comprising: applying the electromagnetic wave to a three-dimensional (3D) scattering structure at a first side thereof, the 3D scattering structure being formed into a set 3D pattern in correspondence with four polarization states; and scattering off the electromagnetic wave to generate four electromagnetic waves with four different polarization states, the plurality of electromagnetic waves exiting the 3D scattering structure at a second side thereof.
Further aspects of the disclosure are provided in the description, drawings and claims of the present application.
With reference to
With reference to
The functionality of the exemplary embodiments of
In accordance with embodiments of the present disclosure, the 3D scattering structure (201) of
In order to further clarify the above-disclosed teachings, reference is made to , i=0, . . . , 3 represent four pure states of polarization, i.e., the four polarization state vectors along which the input polarization is projected. |wi
, i=0, . . . , 3 represent four output state of polarizations. αi, i=0, . . . , 3 are complex coefficients for mapping of polarization to magnitude. The measurements along each direction are based on intensities and are represented by terms {circumflex over (Q)}l=αi|wi
vi|, i=0, . . . , 3, such terms essentially representing intensity from measurement with specific phase difference.
With further reference to
With continued reference to
I
i
=
v
i
|{circumflex over (Q)}
l
T
Q
l
|v
i
,i=0, . . . ,3
With reference to
With reference to
In order to further clarify the layered manufacturing approach discussed above, reference is made to
As a further example, the inventor has designed and fabricated a 3D scatterer for broadband polarization splitting using a stack of ten different layers, and over a bandwidth of 3.5 to 4 um. The ten layers are stacked on top of one another along a direction parallel to the direction of the incident light. The size of the fabricated device is 30×30×25 um with a focal length of 36 um. In other words, each of the ten layers has a vertical height of 2.5 um.
Referring back to
In order to overcome such a challenge, and according to the teachings of the present disclosure, an iterative approach guided by gradient descent may be implemented, wherein starting from an initial index distribution, full-wave simulations (FDTD) is used to calculate the sensitivity of the focusing efficiency with respect to perturbations of the refractive index. The sensitivity may be calculated from just two simulations, allowing efficient optimization of three-dimensional devices with modest resources. Based on the sensitivity, the initial design is modified in order to maximize the performance while conforming to fabrication constraints. This update process is repeated until the optimized device can efficiently perform the target function.
In order to further clarify what is described above, reference is made to
wherein nmax and nmin represent the maximum and minimum values of the refractive index respectively. This distribution is continually updated to maximize the electromagnetic intensity at the target location in focal plane, f(n({right arrow over (x)}))=|{right arrow over (E)}({right arrow over (x)}0)|2. This objective function serves as a proxy for focusing efficiency while simplifying the sensitivity calculation. The sensitivity,
is computed, step 74, from the electromagnetic fields in two FDTD simulations (forward and adjoint), steps (72, 73), according to the following expression:
where {right arrow over (E)}fwd are the electric fields within the cube when illuminated from above with a plane wave, step (72), and {right arrow over (E)}adj are the electric fields within the cube when illuminated from below, step (73) with a point source at the target location. The phase and amplitude of the point source are given by the electric field at the target location in the forward simulation. The sensitivity may be calculated for multiple polarizations across a broad bandwidth (e.g., 3.5 to 4 um), assigning each polarization to a different quadrant. The sensitivity is then used to update the refractive index of the device, step (74), using the following formula:
The step size α may be fixed at a small fraction (e.g., α=0.001) to ensure that the change in refractive index can be treated as a perturbation in the linear regime. The sensitivity is recalculated after each update. After several iterations, the algorithm converges to the optimized design, step (75), wherein the resulting structure focuses incident light with the desired efficiency. As mentioned previously, based on some existing work, it has been shown that polarization sensing can be achievable with metasurfaces but not demonstrated over large bandwidths. Such previous work relied upon six measurements [reference 1]. As described above, the disclosed methods and devices can use four measurements to implement broadband polarization sensing.
The present application is a continuation in part of U.S. patent application Ser. No. 16/657,640 filed on Oct. 18, 2019, titled “CMOS Color Image Sensors with Metamaterial Color Splitting”, the contents of which are incorporated herein by reference in their entirety. The present application also claims priority to U.S. Prov. App. No. 63/078,425, filed on Sep. 15, 2020, titled “Polarization Splitter Based on Volumetric Meta-Optics”, the contents of which are incorporated herein by reference in their entirety. The present application is related to U.S. patent application Ser. No. 16/777,491 filed on Jan. 30, 2020, titled “Metasurface Mask for Full-Stokes Division of Focal Plane Polarization of Cameras”, the contents of which are incorporated herein by reference in its entirety.
This invention was made with government support under Grant No. HR0011-17-2-0035 awarded by DARPA. The government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
63078425 | Sep 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16657640 | Oct 2019 | US |
Child | 17475167 | US |