Patent Application
20190235300
It is now feasible to fabricate sensor arrays with a pitch in the sub-micron range; far below the diffraction limit. There can thus be (e.g.) 50-100 such sub-diffraction-limited (SDL) pixels within a diffraction limited spot under typical imaging situations. Optical and electrical crosstalk increase as image sensor devices approach the diffraction limit. This impacts SNR and the performance of conventional color filter arrays (CFA) used for color capture. The conventional Bayer pattern, shown in
One way to reduce crosstalk is to create a black-matrix, or guard-bands around each RGB or CMY subpixel, with associated penalty in light efficiency. There are also proposals to create a similar approach but with a light efficient CFA. In one proposal, by Anzagira and Fossum, shown in
It is against this background that the techniques described herein have been developed.
Disclosed herein is an imaging system that includes an imaging sensor with an array of pixels, wherein the size of each pixel is less than a diffraction limit of the imaging system; a lens; and a color switch. The color switch includes a first polarizer and a second polarizer; a retarder stack filter positioned between the first and second polarizers; and an achromatic switch positioned between the first and second polarizers, wherein the achromatic switch can be modulated between a pair of polarization states that are orthogonal to each other.
The achromatic switch may include a liquid crystal switch. The liquid crystal switch may be driven by an electrical signal whose state determines a color state of the color switch. The color switch may switch between two states, a green state and a magenta state. Each pixel may have a plurality of color subpixels, wherein the subpixels are spatially distributed in each pixel so that red subpixels and blue subpixels are immediately adjacent to green subpixels. The imaging sensor may include a color filter array. The size of each pixel may be less than a micron.
Also disclosed is an imaging system that includes an imaging sensor with an array of pixels; a color filter with an array of color subpixels, the array of color subpixels being aligned with the array of pixels of the imaging sensor, the array of color subpixels including at least two different colors of subpixels, a first color of subpixels allowing light of a first color spectrum to pass therethrough and a second color of subpixels allowing light of a second color spectrum to pass therethrough; and a color switch that controls the color of light reaching each pixel in the imaging sensor, wherein the color switch includes at least two operational states, a first state that allows light of a third color spectrum to pass therethrough and a second state that allows light of a fourth color spectrum to pass therethrough. When the color switch is in the first state, light reaching the pixels of the imaging array that are aligned with the first color of pixels is maximized and light reaching the pixels of the imaging array that are aligned with the second color of pixels is minimized. When the color switch is in the second state, light reaching the pixels of the imaging array that are aligned with the second color of pixels is maximized and light reaching the pixels of the imaging array that are aligned with the first color of pixels is minimized.
The first color spectrum of the first color of subpixels may include a significant amount of light in green wavelengths and a minimal amount of light in red and blue wavelengths and the second color spectrum of the second color of subpixels includes a significant amount of light in red and blue wavelengths and a minimal amount of light in green wavelengths. The color filter array may be arranged into rows and columns of color subpixels, where adjacent subpixels in the same row are not of the same color and adjacent subpixels in the same column are not of the same color. The color switch may include a liquid crystal switch. The liquid crystal switch may be driven by an electrical signal whose state determines a color state of the color switch. The color switch may switch between two states, a green state and a magenta state.
Further disclosed herein is an imaging system that includes an imaging sensor with an array of pixels, wherein the size of each pixel is less than a micron; a lens; and a color switch. The color switch includes a first polarizer and a second polarizer; a retarder stack filter positioned between the first and second polarizers; and an achromatic switch positioned between the first and second polarizers, wherein the achromatic switch can be modulated between a pair of polarization states that are orthogonal to each other.
The achromatic switch may include a liquid crystal switch. The liquid crystal switch may be driven by an electrical signal whose state determines a color state of the color switch. The color switch may switch between two states, a green state and a magenta state. Each pixel may have a plurality of color subpixels, wherein the subpixels are spatially distributed in each pixel so that red subpixels and blue subpixels are immediately adjacent to green subpixels. The imaging sensor may include a color filter array. The size of each pixel may be less than a diffraction limit of the imaging system.
While the embodiments disclosed herein are susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawings and are herein described in detail. It should be understood, however, that it is not intended to limit the invention to the particular form disclosed, but rather, the invention is to cover all modifications, equivalents, and alternatives of embodiments of the invention as defined by the claims. The disclosure is described with reference to the drawings, wherein like reference numbers denote substantially similar elements.
One of the benefits of new SDL sensor designs, such as the Quanta Image Sensor, is the potential for rapid field rate. This facilitates a time-sequential color acquisition (eliminating the need for a CFA), or a hybrid scheme using a CFA in combination with a color switching mechanism. The conventional approach is to use a filter wheel, which can be suitable for instrumentation, but not for (e.g.) compact consumer devices.
The techniques taught herein use, for example, a liquid-crystal based color switch in combination with an SDL sensor to facilitate high spatial resolution with low color cross-talk. An example of an LC switchable filter is described in U.S. Pat. No. 5,751,384 (incorporated herein by reference), which includes two stages. A first stage switches between a first additive primary color and the complementary subtractive primary color (e.g. blue/yellow), and the second stage switches between a second additive primary color and the complementary subtractive primary color (e.g. red/cyan). The product of the transmission of each stage produces a full-color switch.
The arrows of
Examples of the implementation of the retarder stack filter 46 are described in U.S. Pat. No. 5,751,384, and co-pending U.S. patent application Ser. No. 16/037,934 (US Patent Publication No. 2019/0018177, Wide-Angle Compensation Of Uniaxial Retarder Stacks), the entire contents of each of which are incorporated herein by reference. In one example, the linear polarizers 44 and 45 have absorption axes parallel to one-another. The retarder-stack 46 converts the SOP of light in the green spectral range to the orthogonal polarization, while preserving the input polarization for light in the blue and red spectral bands. In the absence of polarization switch 47, the second polarizer transmits magenta light while absorbing green light. The purpose of the polarization-switch is to effectively switch the orientation of the analyzing polarizer by 90°. For example, in a first voltage state 48, the polarization switch may appear effectively isotropic, transmitting all light with no change in the SOP. In a second voltage state, the polarization switch may switch the SOP of all incident light to the orthogonal SOP in transmission. In so doing, the analyzing polarizer may be effectively rotated by 90°, such that the spectrum of transmitted light is the inverse of that transmitted when the polarization switch is in the first voltage state. In the event that such complementary spectral switching is required over a broad range of incidence angles, structures that preserve normal-incidence behavior at large angles off-normal can be utilized. Such structures are described in co-pending U.S. patent application Ser. No. 16/037,934 (referenced above), which shows specific examples of green-magenta filters.
The polarization switch can be any electro-optic device that effectively switches the transmitted light between orthogonal states of polarization. Exemplary devices provide uniform polarization switching over an extended wavelength range (e.g. 420-680 nm), and over an extended range of incidence angles. Such liquid-crystal switches are described in co-pending U.S. patent application Ser. No. 16/195,618 (Self-Compensating LC Retardation Switch), the entire contents of which are incorporated herein by reference. The polarization switch is not limited to a liquid-crystal device and can be any device that provides the same switching function.
Using the hybrid approach, color crosstalk is greatly reduced, while permitting conventional CFA designs. While time sequential operation halves the light efficiency, it also enables smaller color pixels and thus higher spatial resolution. Conversely, the temporal efficiency loss can be recovered by maintaining the same spatial resolution for each full-color pixel (e.g. a Bayer color pixel sized the same as a more complex RGBCY pixel). Specifically, the Bayer pattern may allow larger sub-pixels relative to more complex CFA to achieve the same spatial resolution, and therefore improved light gathering.
For video applications, temporal artifacts can be mitigated by using a sensor with high field rate in conjunction with a rapidly switchable filter. LC devices can be switched at sub-millisecond speeds. Ferroelectric LC devices can be switched in tens of microseconds.
The filter device need not be polarization-based. For example, a Fabry-Perot resonator filter can be switched between (e.g.) transmission of green and magenta light via a device that switches between two phase states. An electro-optic phase shifter can change the refractive index, changing the cavity spacing, and thus the resonant wavelength(s) of the filter. Piezo devices can also be used to electrically change the cavity spacing.
Other rapidly switchable filter technologies are also possible using (e.g.) holographic polymer dispersed liquid crystal devices, surface plasmonic filters, use of metamaterials, and MEMS (micro electromechanical) devices. The switchable filter can be placed in the optical train anywhere between the scene to be captured and the sensor. The switchable filter may proceed the imaging lens, it may be mounted directly above the sensor, or it may be integrated into the imaging lens design.
The invention is not limited to color switching. The basic concept of a hybrid spatial/sequential spectral capture can be applied to light with wavelengths both shorter and longer than the visible band. For instance, multi-spectral capture that may include visible and near-infrared bands may benefit from the invention.
While the embodiments of the invention have been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered as examples and not restrictive in character. For example, certain embodiments described hereinabove may be combinable with other described embodiments and/or arranged in other ways (e.g., process elements may be performed in other sequences). Accordingly, it should be understood that only example embodiments and variants thereof have been shown and described.
This application claims priority to U.S. Provisional Application No. 62/623,484, filed Jan. 29, 2018, the contents of which are incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 62623484 | Jan 2018 | US |
