This disclosure is related to spectropolarimeters and their use in separating, identifying, and imaging spectral, spatial, and polarization components of electromagnetic radiation (EMR) and in constructing spectral images, often called spectral maps.
Spectrometers are used for gathering electromagnetic radiation from a scene, and typically operate by separating the spectral components of the gathered radiation into individual wavelengths or narrow spectral bands (i.e. narrowest resolvable spectral pattern within a broader spectral range) and directing the spectral components to a detector, which detects and measures the spectrally separated radiation and converts the resulting spectral information to electrical signals that are representative of the spectral composition of the radiation. Mapping spectrometers, including multispectral and hyperspectral imagers, associate these spectra with a position on a spatial or angular map. Multispectral and hyperspectral detection and imaging have applications in a broad array of fields such as medicine, robotics, autonomous vehicles, environmental monitoring, planetary science, and satellite surveillance. Hyperspectral imagers and associated methods of analysis are also useful for tracking and detecting chemical or physical markers. In manufacturing or food processing, spectral imaging is employed for quality assurance purposes, for example, the verification that spectral markers in a product or component meet specific parameters.
Many currently available spectral imaging systems require numerous optical components, complex spectroscopic instrumentation, and precision alignment, and are large, heavy, and expensive.
Many hyperspectral imaging systems utilize spatial scanning, i.e., scanning thin swaths of a scene in a single spectral image frame, which uses motion such as the rastering of a mirror or movement of an airplane or satellite across a region of landscape or a planet for capturing the image swaths. An entire spectral image or scene can be assembled and processed after all the swaths have been captured.
One alternative to spatial scanning is spectral scanning, such as with etalon-based hyperspectral imagers, which are typically complex and have limited spectral band resolution or spectral grasp. Spectrometers that use for example tunable bandpass filters filter most of the incident radiation, resulting in undesirable tradeoffs including weak signals at the radiation detector, large collection optics, concomitant long integration times, and spectral maps with low signal-to-noise ratios (SNRs).
Spectrometers that use superpixel detector configurations or spectral filter arrays, including fixed filter mosaics, are known to sacrifice spatial resolution (i.e., the number of spatial samples in a spectral map) in order to enhance spectral resolution. Some spectrometers that use subpixel filter arrays can have misalignments among the spectral components due to inherent spectral filter structure, resulting in data misalignment. Some spectral imagers may require costly, irreversible integration between the focal plane array (FPA) detector array and spectral filters.
This disclosure provides an apparatus for analyzing radiation using a metasurface and a detector array. The apparatus constructs a spectral map of the electromagnetic radiation in each spectral band that is incident on the metasurface for the plurality of spectral bands spanning the detector array. The disclosure provides an imaging spectropolarimeter, sometimes called a mapping spectropolarimeter. The disclosure combines a metasurface with a detector array, such as focal plane array sensor, to analyze the spectral content and polarization state of electromagnetic radiation at each point in the one-dimensional (1D) view of the scene. The resulting spectral map is a 1D image or spatial map that contains the spectral intensity of each point in the map, i.e., the spectral intensity of electromagnetic radiation (EMR) as a function of wavelength. Furthermore, the map contains a polarization characterization for each point in the map as a function of wavelength.
The polarization of EMR can be a wide range of states, including linearly polarized, right-hand circularly polarized (RCP), left-hand circularly polarized (LCP), elliptically polarized, partially polarized, and unpolarized. According to embodiments described herein, spectral patterns such as spectral intensity information, spatial information, and/or polarimetric information about the radiation whose passing to the detector array is controlled by the metasurface can be determined and the resulting information can be used in constructing a spectral map of electromagnetic radiation that is incident on the metasurface.
The disclosure provides a metasurface that is sometimes called a multifunction metasurface because it is designed to control electromagnetic radiation (EMR) in ways that perform more than a single function (e.g., focusing). The metasurface focuses EMR to three or more patterns (i.e., foci) to analyze the polarimetric information. These patterns are separated in one direction on the detector array. Each of the focused patterns is spectrally dispersed to analyze spectral intensity information into small spectral bands. The direction of the spectral dispersion is approximately orthogonal to the direction of separation of the patterns on the detector array. In some embodiments, each of the patterns is spread to map spatial information in the same direction as the direction of pattern separation on the detector array.
Embodiments described herein provide solutions to numerous problems encountered with the use of other systems for constructing spectral maps. By way of example, in other systems a spectral filter array such as a color filter array or bandpass filter array may be used to pass only radiation that is within a selected spectral band or bands of interest, such as for example red light, green light, and/or yellow light. That is, only specific and often narrow bands of radiation (red light, green light, yellow light) pass through the bandpass filter array to pixels on a detector array, the selected pixels being determined by the placement of each color filter in the filter array. Information about radiation received at a detector array can be used to construct spectral and spatial maps of, for example, a scene.
In contrast to existing systems for constructing spectral maps, embodiments described herein can be very compact, light-weight, fast, inexpensive, mechanically robust, and produce highly detailed spectropolarimetric maps. In addition, embodiments described herein enable use of a metasurface that can be reversibly integrated with any of a variety of detectors, including current commercially available detectors.
Embodiments described herein are useful in numerous applications including for example scene imaging, satellite imaging, identification of remote objects, analysis of chemical and physical markers in a variety of settings, and medical imaging. Additional applications include chemical analysis of emissions, detection of improvised explosive devices, and protection from directed-energy weapons that target personnel, missiles, vehicles, and optical devices. Some Embodiments are also useful for multispectral infrared (IR) hyperspectral imaging to provide for visualization of images through obscurants such as smoke, dust, and camouflage and can be used for nighttime automated passive detection and identification of objects over large scene areas. In some embodiments the 1D spectral map is extended into a 2D spectral map by scanning angularly or sweeping spatially such as using the scanning pushbroom imaging technique.
Throughout this application including in the claims, the symbol “˜”, which means “approximately”, and the term “about” indicate that a value includes plus or minus 10% of the value. For example, “about 4” or “˜4” means from 3.6-4.4 inclusive of the endpoints 3.6 and 4.4, and “about 1 nm” means from 0.9 nm to 1.1 nm inclusive of the endpoints 0.9 nm and 1.1 nm. As used herein, the term “equal” and its relationship to the values or characteristics that are “substantially equal” would be understood by one of skill in the art. Typically, “substantially equal” can mean that the values or characteristics referred to may not be mathematically equal but would function as described in the specification and/or claims. All size ranges described herein are inclusive of the lower and upper limit values.
The citation of any references herein is not an admission that such references are prior art for the present invention. It should be understood that the detailed description and the specific examples, while indicating specific embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art from this detailed description. Other objects, features and advantages of the present invention will become apparent from the following detailed description.
The following drawings form part of the present specification and are included to further demonstrate certain aspects of the invention. Embodiments of the invention may be better understood by reference to one or more of these drawings in combination with the detailed description of specific embodiments presented herein.
This disclosure provides a design process and apparatus for measuring the spectral intensity and polarization properties of electromagnetic radiation (EMR) collected within the device's aperture as a function of angle of incidence in the y direction. To be used in conjunction with a detector array, such as a focal plane array (FPA) sensor or other suitable camera, the device enables extraction of both the spectral intensity content (how much optical energy is at each electromagnetic wavelength or frequency) and the polarization state (such as the Stokes parameters) at each frequency (i.e., wavelength). The device (a ‘metasurface’) is a single, ultra-thin (thinner than 2 wavelengths) surface comprising common dielectric materials, such as silicon (Si), silicon dioxide (SiO2), zinc selenide (ZnSe), zinc sulfide (ZnS), silicon nitride (Si3N4), germanium (Ge), or titanium dioxide (TiO2). The multifunction metasurface can have a circular footprint, square, elliptical, or any other two-dimensional shape large enough to pass the EMR. When placed in front of a detector array at a proper tilt angle, the device passes substantially collimated EMR incident on the aperture of the device and interferes it on the detector array surface. The metasurface is designed to focus distinct wavelengths to distinct positions (i.e., patterns) along the tilted dispersion axis (according to diffractive dispersion laws). For each wavelength, a number (≤3) of focused spectral patterns in the orthogonal axis are encoded and produced by the device, with diffractive power correlated to the incident polarization state. After calibration, and by correlating optical power at each position with spectral and polarization information (i.e., spectral intensity and polarization state), the apparatus allows simultaneous retrieval of spectral and polarimetric data by processing of the 2D data sensed by the detector array. In some embodiments, instead of locating a detector array at the focal plane, relay optics such as a scattering plate and imaging lens can be used to pass the focal plane image to a detector array.
This disclosure solves three un-met needs simultaneously: Improvement of size, weight, and power (SWaP), offering a holographic means for simultaneous extraction of spectral and polarization information designable across a wide range of frequencies (i.e., wavelengths), and the removal of the requirement of mechanical (moving) parts for polarimetry. This apparatus combines a metasurface with a detector array, such as a focal plane array (FPA) sensor, to measure the spectral intensity and polarization state of electromagnetic radiation at each point in the one-dimensional (1D) view of the scene. The resulting 1D image or spatial map contains the spectral intensity of each point in the map. Furthermore, the map contains a polarization characterization for each point in the map as a function of wavelength. According to embodiments described herein, spectral intensity information, spatial information, and/or polarimetric information about the radiation whose passing to the detector array is controlled by the metasurface can be determined and the resulting information can be used in constructing a spectral map of electromagnetic radiation that is incident on the metasurface. The metasurface itself is ultra-thin and ultra-light, greatly compactifying the optical system, which needs only the metasurface, detector array, simple passive optics, and enclosure. Unlike many conventional spectrometers, the apparatus described herein includes polarimetry capabilities. Therefore, the SWaP of a spectropolarimeter incorporating the device is greatly improved. Furthermore, while conventional polarimetry methods require moving parts (such as rotating waveplates and/or polarizers), the holographic nature of this apparatus eliminates this requirement. This not only increases the robustness of a spectropolarimeter by eliminating points of failure, it also decreases the time interval of data collection (i.e., no rotation is needed to measure a single data point). This means the temporal resolution may be increased compared to conventional systems. In some embodiments, the apparatus produces spectral maps at video frame rates or higher, producing, for example, hyperspectral video for a 1D image.
The metasurface is designed to have the three functions: focusing, polarization sensitivity, and spectral dispersion. It comprises an array of ‘meta-atoms’ or ‘meta-units’ of dielectric material that simultaneously and arbitrarily control the phase and polarization state of EMR within the bandwidth of operation. These meta-units are herein referred to as nanofeatures (e.g. nanostructures). The nanostructures can be a wide range of geometric shapes. In some embodiments, the nanostructures are nanopillars. In some embodiments, the nanostructures are voids in the patterned dielectric layer, for example, pits with an elliptical cross section. In some embodiments, the array of nanostructures is periodic in both the x and y directions, with center-to-center spacing of P. Seen in
The phase shifts ϕR and ϕL are related to the geometric parameters described above based on the following derivation. For EMR passing through a nanopillar type of nanofeature as described above, the output electric field |Eout is related to the input electric field |Ein as
where
and rot(θ) is the rotation matrix for angle θ.
For RCP incidence,
For LCP incidence,
Setting
ϕR=ϕprop+2θ and ϕL=ϕprop−2θ.
This derivation shows that for any nanopillar design these three parameters, txx and tyy and θ, provide dependent control of phase shift for RCP and LCP, which in this embodiment are the two orthogonal polarization components of EMR, p1 and p2, propagating though the nanofeature. The expressions for the phase shifts ϕRand ϕL as a function of geometric parameter θ and the complex transmittance parameters txx and tyy, appear in the derivation shown above. The values of the parameters txx and tyy are each dependent on the nanofeature cross section dimensions Dx and Dy and can be computed using EM modeling and simulation. The dimensions Dx and Dy are varied to construct a library of nanofeature geometries that completely cover the range of necessary phase shifts. Simulation results for one embodiment are shown in
The precise shape of the nanofeature cross section can be elliptical, rectangular, rectangular with rounded corners, and many other shapes. The shape of the cross section need only to have two-fold rotational symmetry, so that the two independent widths, Dx and Dy, can be used to control phase shifts ϕR and ϕL independently. The exact shape is taken into account when performing EM modeling and simulations. In some embodiments the cross section is elliptical, which is readily microfabricated.
The EM simulation results, such as those shown in
The multifunctional metasurface is designed to be illuminated by substantially collimated EMR. As shown in the schematic in
where zF=F cos(α) and xF=F sin (α).
The coordinates (xF, yF, zF) indicate the position of the focal spot, with the meta-optic centered at (0,0,0). The yF term provides vertical offset of the focal spot by yF in the y direction. In some embodiments, as shown in
In this embodiment, the component metasurface A separates RCP and LCP EMR, focusing them to two separate patterns, which in some embodiments are centered at y=+3y0/2 and at y=−3y0/2 respectively. Component metasurface B focuses RCP and LCP EMR to a single spot separate from the others, which in some embodiments is centered at y=+y0/2. Similarly, component metasurface C focuses RCP and LCP EMR to a single spot but with a π/2 phase shift added to the LCP component; this spot is separate from the others, which in some embodiments is centered at y=−y0/2. The EMR exiting the metasurface transmits through a linear polarizer called an analyzer. The analyzer between the metasurface and the detector array passes only EMR that is not polarized in the y direction. The analyzer also forces the passed linearly polarized EMR at each location to interfere, giving the measured irradiance patterns (I1, I2, I3, and I4) of the four spectral patterns a complete set of information about the polarization state of the incident EMR. The detector array is aligned with this spectral spread to measure the four spectral patterns as a function of wavelength.
The measured irradiance at each wavelength in each of the dispersed foci patterns is called In(λ). In embodiments with four dispersed patterns the measured irradiance is I1(λ), I2(λ), I3(λ) and I4(λ). These four measured intensities are used to retrieve a complete description of the polarization state of the incident EMR using all four Stokes parameters or any other commonly used polarization descriptors. The three interlaced component metasurfaces are designed to encode this information into the irradiance of the linearly polarized component of the four focused spectral patterns as a function of wavelength. The local phase shifts for each of the three interlaced metasurfaces (A, B, and C) that combine to make the multifunction metasurface in the embodiments described above are expressed as follows:
The polarization state of the incident EMR can be described by the four Stokes parameters (S0, S1, S2, S3), which are sometimes called the polarization vector and represented as (I, Q, U, V). Other commonly used descriptors of polarization state can also be easily derived, such as the degree of polarization (DoP) or the degree of linear polarization (DoLP). The theoretical algebraic expressions for retrieving polarization state parameters from the irradiances of the four focused patterns are:
These equations show the straightforward retrieval of a complete description of the incident polarization state. The four Stokes parameters completely describe the polarization state of the incident EMR and are calculated using the four focused pattern intensities measured at each wavelength, i.e., location on the detector array. These parameter values identify the polarization of the incident EMR, be it linear, circular, or elliptical. For example, when S1=S2=0 and S3=S0 the incident EMR is RCP. Other commonly used descriptors of polarization state can also be easily derived, such as the degree of polarization (DoP) or the degree of linear polarization (DoLP). The algebraic expressions for retrieving DoP and DoLP are
The detector array senses EMR intensity data and sends it to a computation module that converts the data into the spectral map using the equations listed above to derive spectral intensity and polarization state for each location in the map, i.e., image pixel. In some embodiments, the detector array is an FPA linked to a computer or microprocessor to perform the calculations and output spectral maps. The computational algorithm converts the four measured intensities, I1(λ), I2(λ), I3(λ), and I4(λ), into descriptors of polarization state, particularly the Stokes parameters. Each of the four polarization-dependent patterns extends in the y dimension to map the image information.
The ray trace simulation in
In one embodiment, nanofabrication follows the hard mask process shown in
The linear p-polarization of the EMR that reaches the focal plane (403) can be chosen to maximize coupling into the detector array (602). EMR at the center wavelength is incident at an oblique angle of approximately 72° from normal. Fresnel reflections at the interface from air to the detector array can be large at such a steep angle. However, in this embodiment, the analyzer leaves only p-polarized EMR at the detector array to take advantage of the low Fresnel reflectivity near the Brewster's angle. For example, in this embodiment a Si FPA sensor can be used as the detector array, and Si has a refractive index of ˜3.7 at a center wavelength 729 nm, making the Brewster's angle approximately 75°. The incident focused EMR diffracts at approximately 35° for the center wavelength and is incident at the FPA at angle approximately 72°, which is close enough to the Brewster's angle to keep Fresnel reflections to less than 1%, reducing stray EMR and increasing SNR. Unwanted reflection of EMR from the detector array can be further reduced in the future using an antireflective layer. In some embodiments the spectropolarimeter optical design includes highly absorptive ultra-black coatings inside its walls (1105) and on the internal baffling to reduce scattered EMR and maximize SNR at the detector array.
In one embodiment, illustrated in
The computational algorithm for the spectropolarimeter rapidly retrieves data describing the spectral intensity and polarization state of incident radiation. Computation can be implemented on a standard computer or on a compact compute module for control, processing, and communication functions. The metasurface is designed such that the spectral data can be directly retrieved from the spectrally spread patterns at the focal plane. The algorithm collects and combines the four focused spectral patterns from the detector array at the focal plane. In some embodiments the computational algorithm performs a variable scaling operation to compensate for the slightly bowed mapping of the four focused patterns to the detector array. The scaling operation is generally referred to as a distortion correction computation. In some embodiments the computational algorithm can include an initial process for spectral and spatial calibration. Using known incident EMR, spatial calibration measures the actual mapping of the four spectral patterns at the focal plane and any residual misalignments in the optics. Once calibrated, the data collection combines the four patterns and performs distortion correction based on the initial spatial calibration. The computational algorithm also processes the one-dimensional imaging information. For each measured frame from the detector array, the algorithm calculates the spectral intensity and polarization state of incident radiation for every point in the map (image). The computational algorithm combines and collates the detected data from the regions occupied by the four spectral patterns.
In some embodiments the computational algorithm stores the spectropolarimetric data for each frame. In some embodiments the data passes to other information systems. The spectropolarimetric map is generated for each frame with the option of storing and/or assembling full 2D spectropolarimetric images when used in a pushbroom or scanning configuration. In some embodiments, the algorithm concatenates 1D spectropolarimetric map data to form a spectral data cube containing a synthetic 2D image with spectropolarimetric data for each image pixel (or map element).
In some embodiments the multifunction metasurface is designed with two or more interlaced component metasurfaces to focus EMR to three or more spectrally dispersed patterns. The details above describe a common embodiment in which three component metasurfaces are interlaced to focus to four spectrally dispersed patterns that fully characterize the polarization state of the incident EMR. In some embodiments, two interlaced component metasurfaces focus to three dispersed patterns, providing a partial characterization of the polarization state of the incident EMR. In some embodiments, the interlaced component metasurfaces can be designed to focus to dispersed patterns that provide either a partial or full characterization of the polarization state of the incident EMR but also provide specific polarization characterization, for example, a focus that specifically corresponds to a particular polarization state such as LCP.
This disclosure includes embodiments in which the multifunctional metasurface is designed to be illuminated by EMR with near-normal incidence. In other embodiments, the multifunctional metasurface is designed to be illuminated by EMR with a larger, non-zero angle of incidence. In these embodiments, spectral resolution can be altered and/or improved.
As illustrated in the schematic in
This disclosure includes embodiments in which a single multifunction metamaterial is designed and fabricated to perform the three functions of focusing incident EMR while simultaneously analyzing spectral intensity and polarization state. Optical metamaterials generally occupy a volume rather than just a surface. Optical metasurfaces are the single-layer form of metamaterials and have been applied to a wide range of optical phenomena, including ultrathin focusing lenses or metalenses. Like optical metasurfaces, optical metamaterials can be designed to have multiple function, including the imaging spectropolarimeter described herein.
This disclosure includes embodiments that measure EMR. Embodiments can be designed to measure one or more of the following types of EMR: x-rays, ultraviolet light, visible light, IR light, millimeter wave radiation, or any other radiation considered to be part of the electromagnetic spectrum.
The terms “focal plane” and “focal plane array” are common terms that may refer to planar surfaces or surfaces that are only approximately planar or surfaces that are substantially curved, such as concave or convex surfaces. The term “focal plane” refers to the plane-like surface that EMR is commonly focused to by an optic, even though the surface may not be perfectly planar. The term “focal plane array” refers to a detector array used to sense and transduce incident EMR, even though some FPAs are not strictly planar and may be curved.
While the invention has been described with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof to adapt to particular situations without departing from the scope of the disclosure. Therefore, it is intended that the claims not be limited to the particular embodiments disclosed, but that the claims will include all embodiments falling within the scope and spirit of the appended claims.
Upon reading this disclosure, a person having ordinary skill in the art will be able to understand the embodiments described herein that use a metasurface to construct a spectropolarimeter for analyzing EMR in a variety of different settings. Select embodiments can be useful for identifying materials, quantifying airborne aerosols, and for revealing electronic or vibrational transitions in a material. Some material when excited by lasers may exhibit Raman emission modes and chemically unique spectroscopic signatures that can be determined and mapped using the device described herein to determine a material's composition and/or microstructure. In some aspects, by comparing a spectral map or data array determined using the embodiments described herein with spectra from a database or a spectral model, it is possible to identify chemical, mineral, and biological elements. In some aspects, useful methods for comparing spectra include matched filters and correlation analysis. In addition, the use of spatial sensitivity and spatial mapping can provide additional information that can be exploited for the identification of structures. By way of example only, camouflaging may affect perception or appearance of a structure or scene such that it visually appears to be identical to a different structure or scene of an environment. However, when certain embodiments are used to determine the spectral signature of the camouflaged structure or region, the signature is unique and identifiable as being different from the item or region it was intended to resemble or mimic. Furthermore, the spatial extent of the camouflage can be determined from the spectral map. In another exemplary embodiment a pair of spectral maps may be used to form a spectrally resolved disparity map, which can increase the accuracy of passive computer stereo vision relative to intensity disparity maps.
This application claims the benefit of U.S. Provisional Patent Application No. 63/142,357 (filed Jan. 27, 2021), which is incorporated by reference herein in its entirety.
This invention was made with government support under grant number 80NSSC19C0591 awarded by the National Aeronautics and Space Administration. The government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
63142357 | Jan 2021 | US |