The disclosure relates to focal plane arrays, and, more particularly, to multiple resolution focal plane arrays.
Digital detection of visual and infrared (IR) images is a very widely used technology, having applications ranging from consumer-oriented cameras and video apparatuses to law enforcement and military equipment. For virtually all of these applications, there is a growing demand for higher image pixel counts, higher pixel density, increased sensitivity, improved dynamic range, lower power consumption, faster image processing, and the ability to switch between modes offering different balances of these characteristics, dependent on the requirements present at a given time.
At the heart of all digital imaging systems, which may be referred to generally as Solid State Area Array Imaging Devices (SSAAIDs), is the Focal Plane Array (“FPA”), which is a two-dimensional array of elements upon which an image is focused, whereby each of the FPA elements or “pixels” develops an analog output “signal charge” that is proportional to the intensity of the electromagnetic radiation that is impinging on it over a given interval of time. This signal charge can then be measured and used to produce an image.
Current SSAAIDs, however, can only operate at a single resolution or, if they are able to operate at alternate resolutions, do not consume less power by doing so. This results in current SSAAIDs, which must be designed to accommodate the highest required resolution, consuming more power than is necessary during normal usage, which limits their usage and/or resolution in power-sensitive applications.
What is needed, therefore, is a cost-effective way to reduce SSAAID power requirements while obtaining less than full resolution images.
A multi-resolution uncooled FPA using microbolometers as electromagnetic radiation detecting elements that offers significant power and performance benefits is herein disclosed.
In embodiments, the FPA can be operated in a high resolution, higher power mode and then switched to a ½× resolution, lower power mode while maintaining full fill factor and field of view. In embodiments, processing ¼ of the pixels when full resolution is not needed yields a comparable reduction in system power, making this solution ideal for handheld, battery-powered applications.
In embodiments, resolution and power reduction is accomplished by forming 2×2 composite pixels made up of series/parallel microbolometer combinations. The approach, using the teachings provided herein, can be extended to 3×3, 4×4, . . . , N×N, composite pixels. In such embodiments, the electrical behavior yields response and noise performance equivalent to a single bolometer implementation.
The thermal properties of embodiments of the composite pixel disclosed herein allow for increased biasing, yielding enhanced Noise equivalent temperature difference (NETD) performance relative to a single pixel.
Embodiments require only the addition of switches outside of the input cell array combined with control circuitry and enable innovative imaging system implementations with lower Size, Weight, Power, and Cost (SWaP-C).
One embodiment of the present disclosure provides a multiple resolution focal plane array, the multiple resolution focal plane array comprising: a focal plan array comprising a plurality of bolometers arranged into a plurality of columns and rows and a readout integrated circuit connected to the plurality of bolometers, wherein the readout integrated circuit is configured to accumulate signal-induced current collected from each bolometer during an integration interval and then transfer the resultant signal onto output taps for readout, and wherein the readout integrated circuit is configured to allow a selection between at least two bolometer configurations, a first configuration where bolometers are combined into super pixels comprising N×N series/parallel groupings of bolometers and a second configuration where the bolometers are used individually, forming pixels comprising only a single bolometer.
Another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein selection between the at least two bolometer configurations is accomplished using switches internal to the readout integrated circuit that are positioned between adjacent columns of pixels.
A further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein selection between the at least two bolometer configurations is enabled by connecting detector common and column bus lines of adjacent columns of the readout integrated circuit with switches.
Yet another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the switches are added below a bottom portion of the focal plane array.
A yet further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein a total of seven switches are used to connect detector common and column bus lines of adjacent columns of the readout integrated circuit.
Still another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the readout integrated circuit is configured to use a dual row bias per line time to maximize pulse bias time.
A still further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the selection between at least two bolometer configurations is accomplished electronically through the use of switches that, when used in combination with one another, re-configure row select signals and column interconnect signals between an input cell array and column signal processing circuitry.
Even another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the selection between at least two bolometer configurations is performed on-FPA.
An even further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein each parallel/series grouping of bolometers uses at least two thermal-only contacts and at least 4 thermal/electrical contacts to connect adjacent bolometers when in the first configuration.
A still even another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the bolometers connected in series are connected to one another by thermal contacts only and the bolometers connected in parallel are connected to the readout integrated circuit and to adjacent series-connected bolometers by thermal/electrical contacts, when in the first configuration.
A still even further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the thermal/electrical contacts are tungsten posts.
Still yet another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the tungsten posts connect the bolometers to the readout integrated circuit.
A still yet further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein bolometers in a column are connected in series.
Even yet another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein bolometers in each row of the focal plane array are selected simultaneously through a set of switches on the readout integrated circuit.
An even yet further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the switches are controlled by hardware.
Still even yet another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the switches are controlled by software.
A still even yet further embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the software enables the first or second configuration automatically, based on criteria selected from the group consisting of battery power, required image quality, and altitude.
Yet still even another embodiment of the present disclosure provides such a multiple resolution focal plane array wherein the focal plane array is configured to operate at a higher bias voltage when in the first configuration, as compared to the second configuration.
One embodiment of the present disclosure provides a multiple resolution focal plane array multiple resolution focal plane array, the multiple resolution focal plane array comprising: a focal plan array comprising a plurality of bolometers arranged into a plurality of columns and rows and a readout integrated circuit connected to the plurality of bolometers, wherein the readout integrated circuit is configured to accumulate signal-induced current collected from each bolometer during an integration interval and then transfer the resultant signal onto output taps for readout, and wherein the readout integrated circuit is configured to allow a selection between at least two bolometer configurations, a first configuration where bolometers are combined into super pixels comprising N×N series/parallel groupings of bolometers and a second configuration where the bolometers are used individually, forming pixels comprising only a single bolometer, wherein selection between the at least two bolometer configurations is enabled by connecting detector common and column bus lines of adjacent columns of the readout integrated circuit with switches, and wherein the switches are added below a bottom portion of the focal plane array.
One embodiment of the present disclosure provides a multiple resolution focal plane array, the multiple resolution focal plane array comprising: a focal plan array comprising a plurality of bolometers arranged into a plurality of columns and rows and a readout integrated circuit connected to the plurality of bolometers, wherein the readout integrated circuit is configured to accumulate signal-induced current collected from each bolometer during an integration interval and then transfer the resultant signal onto output taps for readout, and wherein the readout integrated circuit is configured to allow a selection between at least two bolometer configurations, a first configuration where bolometers are combined into super pixels comprising N×N series/parallel groupings of bolometers and a second configuration where the bolometers are used individually, forming pixels comprising only a single bolometer, wherein selection between the at least two bolometer configurations is enabled by connecting detector common and column bus lines of adjacent columns of the readout integrated circuit with switches, wherein the switches are added below a bottom portion of the focal plane array, and wherein the bolometers connected in series are connected to one another by thermal contacts only and bolometers connected in parallel are connected to the readout integrated circuit and to adjacent series-connected bolometers by thermal/electrical contacts, when in the first configuration.
The features and advantages described herein are not all-inclusive and, in particular, many additional features and advantages will be apparent to one of ordinary skill in the art in view of the drawings, specification, and claims. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and not to limit the scope of the inventive subject matter.
As a preliminary matter, a microbolometer 102 is a specific type of bolometer 102, which is an electrical instrument for measuring radiant energy that may be thought of as a resistor. Among other uses, microbolometers 102 are suitable for use as detector elements in thermal cameras.
In a typical microbolometer 102, infrared radiation with wavelengths between 7.5-14 μm strikes a detector material, heating it. This change in temperature changes the sensor's electrical resistance in a predictable fashion, allowing for the intensity of incident radiation in this range during a given time to be inferred based on the measured change in electrical resistance over this same period. Although the term microbolometer 102 has a specific meaning, as defined above, the behavior of microbolometers 102 and bolometers are identical for the purposes of the present disclosure and the terms may be used interchangeably herein when describing their behavior.
Furthermore, pixel binning, which may also be referred to as CCD binning, is the process of combining neighboring pixels on an image sensor (e.g. a CCD) into a “super pixel”. This super pixel represents the area of all the individual pixels contributing to the charge. For example, in 2×2 pixel binning, the charge from a square of 4 adjacent pixels is combined into 1, and in 3×3 CCD binning, the charge from a square of 9 adjacent pixels is combined into 1.
Pixel binning provides several benefits, including: an increase in signal equal to the number of pixels binned, which allows the sensor to detect fainter signals and reduces exposure time; an increase in frame rate, due to the reduction in exposure time and a reduction in the number of pixels to be measured; an increase in the Signal to Noise Ratio (SNR), which results from a single read error being applied to the charge of the binned pixels rather than the addition of multiple read errors if the pixels were read individually; and an increase in the dynamic range of the sensor, which results from the larger charge capacity of the summing node. Pixel binning, however, also results in a loss of image resolution equal to the binning level and an increase in dark current proportional to the number of pixels binned. Most pertinent to the present disclosure is the improvement in SNR provided by pixel binning.
Pixel binning “on-FPA”, or within the focal plane array itself, in accordance with embodiments of the present disclosure, reduces system power requirements, since FPA data does not need to be transferred at high speeds and the data does not need to be processed externally. Embodiments also provide a method for reducing overall system power through a reduction of system resolution and, consequently, total image data.
In embodiments, N×N groups of microbolometers (resistors) 102 are electrically and/or thermally combined in a series/parallel configuration so as to create a composite resistance equal to that of an individual pixel bolometer 102. This yields a composite microbolometer 102 with the ability to achieve better signal-to-noise ratio at the expense of pixel density (i.e. resolution). The proposed approach realizes the composite N×N pixels without changes to a readout integrated circuit (ROIC) input cell. Instead, embodiments electronically re-configure row select signals and column interconnect signals between an input cell array and a column signal processing circuitry to allow for both creation of composite N×N pixels as well as allowing for various groupings of pixels that result in different resolutions and power requirements.
Embodiments of the present solutions can be performed on-FPA, rather than within an imaging engine, as is common in the prior art. In embodiments, an imaging engine is used to perform signal processing functions such as real-time spatial non-uniformity correction (NUC) and other functions necessary to generate an image that is suitable for display or further processing. In on-FPA embodiments, the pixel binning process is more efficient, significantly reducing output data rates and eliminating the need for external signal binning. The signal binning process occurs, in embodiments, through proper electrical and thermal interconnection of an N×N group of microbolometers 102 and requires no additional signal processing circuitry. The new methods and circuits disclosed herein use existing interconnect wiring and require a minimum of new circuitry.
Now referring to
Now referring to
In embodiments, microbolometers 102 in a column are connected in series to effectively allow for one post per pixel. In such embodiments, bolometers 102 in each row are selected simultaneously through a set of switches 302 on an ROIC. By changing the switch 302 configuration, a group of 4 microbolometers 102, in the case of a 2×2 group of microbolometers 102, can be connected in a series/parallel arrangement, yielding the same effective resistance as a single bolometer 102. This reduces the resolution in both dimensions by a factor of 2 and the total number of pixels which need to be read out by a factor of 4. Both FPA and imaging engine power is thereby reduced in such embodiments, at the expense of resolution. Importantly, the configuration state of such embodiments can be set through software and/or hardware that controls the state of these switches 302, allowing for full resolution where it is needed and lower resolution where the power-saving benefits of that configuration outweigh the need for enhanced resolution.
Furthermore, since the individual microbolometers 102 remain physically connected to the substrate through their respective posts 100/104, their individual thermal behavior remains unchanged→Thermal time constant and pulse bias self-heating behavior is the same in either mode. It will be shown herein that the FPA sensitivity (SNR) is also maintained between the two operating modes. As would be apparent to one of ordinary skill in the art, the same equivalence can be made for a 3×3, 4×4, etc., composite pixel configuration in accordance with embodiments disclosed herein.
Now referring to
ΔR=αRΔT Equation 1
Bolometer 102 current is then provided by:
The derivative of bolometer 102 current as a function of resistance is then provided by:
Change in current (ΔIBol) as a function of the change in resistance (ΔR), in the case of a single bolometer 102, is then provided by the following equation:
Substitution of Equation 1 into Equation 4 then provides Equation 5, shown below, which describes how current across the bolometer 102 changes as a function of voltage, resistance, and temperature, taking into account the bolometer's 102 Temperature Coefficient of Resistance (TCR):
Now referring to
ΔR=αRΔT Equation 6
Bolometer 102 current is then provided by:
The derivative of bolometer 102 current as a function of resistance is then provided by:
Change in current (ΔIBol) as a function of the change in resistance (ΔR), in the case of a series leg of the 2×2 bolometer 102 circuit shown in
Substitution of Equation 6 into Equation 9 then provides Equation 10, shown below, which describes how current across the series bolometer 102 leg changes as a function of voltage, resistance, and temperature, taking into account the bolometer's 102 Temperature Coefficient of Resistance (TCR):
The sum of the series legs is then provided by equation 11, shown below:
Which simplifies to:
As can be inferred from the above equations, first order analysis of bolometer 102 response based on scene temperature induced resistance change demonstrates that the response (change in current) is the same for a single bolometer 102 and a 4-bolometer 102 (2×2) combination, i.e. equations 5 and 11, which describe how current across the bolometer 102 circuits changes as a function of voltage, resistance, and temperature, taking into account the bolometer's 102 Temperature Coefficient of Resistance (TCR), in the case of a single bolometer 102 and a 2×2 bolometer 102 circuit, respectively, are identical.
In light of the above, it could still be argued that a single bolometer 102 may be more responsive, since it is likely to have a larger area, thereby experiencing a higher scene induced ΔT (e.g. a single bolometer 102 may be 24 μm while a 2×2 circuit of bolometers 102 may be 12 μm×4). However, this is not the case because of the relative scaling of other bolometer 102 parameters that contribute to first order response, which are described below in Equation 12 and Chart 1, which uses typical values to demonstrate this concept.
F=The F/# of the camera optics
nopt=Optical transmission of the camera optics
In Chart 1, above:
As can be seen from the above equation, Equation 12, and chart, Chart 1, for a larger pixel, the thermal capacitance, C, increases. To maintain the same thermal time constant, τ=C/G, the thermal conductance, G, must increase by the same factor. So, regarding first order response, the response remains the same.
Noise equivalence between a single bolometer 102 (
v
n
2=4kTRB Equation 13
vn=RMS noise voltage
k=Boltzmann's constant
R=Bolometer 102 resistance
B=Noise equivalent bandwidth
For the same single bolometer 102 design, equivalent current noise is provided by Equation 14, shown below.
vn=RMS noise voltage
in=RMS current noise
R=Bolometer 102 resistance
For a series leg pair (i.e.
v
N
2
=v
n
2
+v
n
2 Equation 15
Which simplifies to:
v
N
2=2vn2 Equation 15
vN=RMS noise voltage
Substituting equation 13 into Equation 15 then provides another way to describe combined equivalent voltage noise, which is shown below, in Equation 16.
v
N
2=4kT(2R)B Equation 16
vn=RMS noise voltage
k=Boltzmann's constant
R=Bolometer 102 resistance
B=Noise equivalent bandwidth
Equivalent current noise of the series leg pair (
vn=RMS noise voltage
in=RMS current noise
R=Bolometer 102 resistance
Now regarding a parallel combination of series pairs (
i
nT
2
=i
n
2
+i
n
2 Equation 18
Which simplifies to:
i
nT
2=2iN2 Equation 19
inT Total RMS noise current
in=RMS noise current for a single bolometer
Substituting in Equation 14 for in provides Equation 20, shown below:
Which simplifies to:
vn=RMS noise voltage
inT Total RMS noise current
R=Bolometer 102 resistance
Equation 21 provides the current noise of the total series/parallel combination, which is equivalent to that of a single resistor (bolometer 102) of the same total resistance, the current noise of which is described in Equation 14. Said another way, as demonstrated above, first order analysis of bolometer 102 current noise yields the same value for a single bolometer 102 and a 4-bolometer 102 composite (i.e. 2×2). This assumes uncorrelated noise sources, e.g. Johnson noise.
Now referring to
In the embodiment depicted, bolometers 102 are selected, through the use of switches 302, in row pairs 304. Each column has two column lines 306 that connect to respective signal processing chains, which, in embodiments, are analog signal processing chains.
Now referring to
Now referring to
One potential issue with such an embodiment, however, is that capacitance at the bolometer 102 junction, which is due to the long connecting busses, yields a node with a time constant of:
τ=2/[RBol(CBUS+CS/D)]≈0.5μ sec<<TINT, where TINT=26−52μ sec
RBol=Bolometer 102 resistance
CS/D=Capacitance of the MOSFET switch source/drain
TINT=ROIC integrator integration time τ=Node electrical time constant
At the start of integration, charging of this node adds an offset to the signal integrator output. One way to resolve this issue would be to extend the signal integrator reset until the node is fully initialized (˜2 to 3μ sec).
Now referring to
To evaluate the true responsivity difference between the single and composite bolometer 102 configurations, we must understand the detailed behavior of the microbolometer 102, as the actual response performance is somewhat more complicated than the first order expression shown earlier:
F=F/# of the camera optics
nopt=Camera Optics Transmission
A more comprehensive analysis must account for the fact that the bolometer 102 temperature rises as a result of the applied pulse bias by an amount TPB. In typical applications, TPB can be as high as 25° C. As a result, the resistance drops and the response increases. A better approximation can be derived:
The plot shown in
In practice, since each bolometer 102 in the composite (2×2 or four bolometer 102) case experiences half of the overall bias voltage, it experiences a lower TPB and therefore sees less response enhancement. Although the first order linear response is the same for both cases, the composite bolometer 102 must be provided with a higher bias voltage to achieve the same overall response (linear+enhanced). In embodiments, additional necessary bias voltage is only 100 to 300 mV for constant bias time.
In embodiments, the composite array can be operated at higher bias, thereby achieving higher first order response and lower NETD.
In embodiments, operating in the composite mode allows the individual bolometers 102 to operate at a relatively lower bias, preventing them from heating as much as the native array case.
Now regarding power consumption, the following operational changes occur between modes:
Such operational changes result in total composite mode power, in the case of a 2×2 composite bolometer 102 circuit, being 71% of the native format. Although most power scales by 2×, bolometer 102 power is only reduced by 25%.
In conclusion, the multiple resolution FPA disclosed herein offers significant power and performance benefits over the current state of the art. Embodiments of the FPA disclosed herein can be operated in a high resolution, higher power mode and then switched to a ½× resolution, ¼× resolution, etc. lower power mode, while maintaining full fill factor and field of view. Processing ¼ of the pixels (in the case of a 2×2 composite bolometer 102 operating at ½× resolution) yields a comparable reduction in system power when full resolution is not needed. This is ideal for handheld, battery powered applications.
Resolution/Power reduction is accomplished by forming 2×2 composite pixels made up of series/parallel microbolometer 102 combinations. The approach can easily be extended to 3×3, 4×4, etc., composite pixels. The electrical behavior yields response and noise performance equivalent to a single bolometer 102.
The thermal properties of the composite pixel allow for increased biasing, yielding enhanced NETD performance relative to a single pixel.
Approaches disclosed herein only require the addition of switches outside of the input cell array with straightforward control circuitry and enable innovative imaging system implementations with lower SWAP-C.
The foregoing description of the embodiments of the disclosure has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise form disclosed. Many modifications and variations are possible in light of this disclosure. It is intended that the scope of the disclosure be limited not by this detailed description, but rather by the claims appended hereto.