The present invention relates generally to thermal infrared imaging technology. More specifically, but without limitation, the present invention relates to thermal infrared imaging systems and associated methods for radiometrically calibrating such systems.
Thermal infrared (IR) imagers, also known as long wave IR (LWIR) cameras (herinafter a “thermal camera” or simply a “camera”), are used in a tremendously wide range of applications, ranging from environmental monitoring to industrial process control. A growing number of these applications require the camera to be calibrated radiometrically, sometimes in terms of temperature, and other times in terms of radiance [W/(m2 sr)] or a similar optical-power-related quantity. In either case, the calibration typically requires quantitatively relating the camera output to source radiance or temperature. This is most commonly done by measuring the camera's output while it views one or more blackbody sources.
From the image(s) of the blackbody source(s), a calibration for the camera can be determined. If the camera's response is sufficiently time invariant, the calibration can be applied to images taken at a later time. The assumption of time-invariant camera response is not true in the case of a microbolometer camera without a thermoelectric cooler (TEC) on the focal plane array (FPA) (hereinafter “a TEC-less microbolometer”). Without the FPA-temperature stabilization that would be provided by the TEC, the response from these cameras depends on the FPA temperature and the scene temperature or radiance. Without stabilization, these cameras cannot obtain radiometrically calibrated data unless the are used together with one or more external calibration sources.
Honeywell was one of the first to produce a TEC-less microbolometer. This camera achieved calibration by performing a per-pixel calibration for every FPA temperature expected to be experienced during operation (Kruse 2002). Irving Sensors Corporation has also developed methods of compensating for the scene temperature errors that would be observed in a TEC-less microbolometer (U.S. Pat. No. 6,476,392). This was done by determining the error in measured temperature that resulted from changing scene and FPA temperatures.
Illustrative embodiments of the present invention that are shown in the drawings are summarized below. These and other embodiments are more fully described in the Detailed Description section. It is to be understood, however, that there is no intention to limit the invention to the forms described in this Summary of the Invention or in the Detailed Description. One skilled in the art can recognize that there are numerous modifications, equivalents, and alternative constructions that fall within the spirit and scope of the invention as expressed in the claims.
The present invention can provide a thermal infrared (IR) imaging system and associated calibration methods. One illustrative embodiment is a method for calibrating a thermal IR imager, the method comprising determining correction coefficients in a model for an expected change in response of the thermal IR imager for a given temperature of the focal plane array (FPA) of the thermal IR imager with respect to a response of the thermal IR imager at a predetermined reference temperature of the FPA; acquiring a scene image; measuring the temperature of the FPA; and applying a correction to the scene image based on the correction coefficients and the difference between the measured FPA temperature and the predetermined reference temperature of the FPA to produce a FPA-temperature-stabilized image.
Another illustrative embodiment is a thermal IR imaging system, comprising an image-formation subsystem including a lens and a focal plane array (FPA) configured to receive optical input via the lens; and a stabilization and calibration computing subsystem comprising at least one processor and a memory containing a plurality of program instructions configured to cause the at least one processor to determine correction coefficients in a model for an expected change in response of the image-formation subsystem for a given temperature of the FPA with respect to a response of the image-formation subsystem at a predetermined reference temperature of the FPA, acquire a scene image, measure the temperature of the FPA, and apply a correction to the scene image based on the correction coefficients and the difference between the measured FPA temperature and the predetermined reference temperature of the FPA to produce a FPA-temperature-stabilized image.
Another illustrative embodiment is a method for calibrating a thermal IR imager, the method comprising determining a per-pixel ratio between a blackbody image and a shutter image as a function of shutter temperature, a shutter image being an image of a shutter of the thermal IR imager in a closed position; acquiring a scene image; acquiring a shutter image; measuring the temperature of the shutter; converting the shutter image to an equivalent blackbody image based on the determined per-pixel ratio at the measured shutter temperature; and subtracting the equivalent blackbody image from the scene image to produce an offset-corrected scene image.
Yet another illustrative embodiment is a thermal IR imaging system, comprising an image-formation subsystem including a lens, a focal plane array (FPA) configured to receive optical input via the lens, and a shutter configured to control when the optical input is permitted to reach the FPA; and a stabilization and calibration computing subsystem comprising at least one processor and a memory containing a plurality of program instructions configured to cause the at least one processor to determine a per-pixel ratio between a blackbody image and a shutter image as a function of shutter temperature, a shutter image being an image of the shutter in a closed position; acquire a scene image; acquire a shutter image; measure the temperature of the shutter; convert the shutter image to an equivalent blackbody image based on the determined per-pixel ratio at the measured shutter temperature; and subtract the equivalent blackbody image from the scene image to produce an offset-corrected scene image.
These and other embodiments are described in further detail herein.
Various objects and advantages and a more complete understanding of the present invention are apparent and more readily appreciated by reference to the following Detailed Description and to the appended claims when taken in conjunction with the accompanying Drawings, wherein:
The invention presented here is a set of techniques that allow for stabilization and subsequent radiometric calibration of TEC-less microbolometer cameras without stabilization of the FPA temperature. The first technique uses only the FPA temperature and the current camera response to produce a stabilized response. In some embodiments of the invention, this is achieved through software rather than through physical stabilization of the camera's FPA temperature. In this FPA-temperature-only technique, the response of the camera to a scene is stabilized to the response the camera would experience at a reference FPA temperature for the scene.
The second technique is a method of using the internal shutter of the camera as an equivalent external blackbody source. This shutter is typically used to perform a flat-field non-uniformity correction every few minutes during normal operation. With proper characterization, an image of this shutter can be converted to an equivalent external blackbody image. This equivalent external blackbody image can then be used in a radiometric calibration in which the camera FPA-temperature-dependent offset is canceled. This offset contains a significant portion of the camera's dependence on FPA temperature.
Various illustrative embodiments of the invention include some or all of the following elements: a) a TEC-less microbolometer camera; b) an internal sensor that measures the temperature of the detector or focal plane array (FPA); c) an internal sensor that measures the temperature at or near the internal shutter, which can be the same sensor as the FPA-temperature sensor; d) a shutter capable of filling the camera field of view; e) laboratory measurements of an external blackbody to derive the coefficients of the FPA-temperature compensation; f) laboratory measurements of the internal shutter to external blackbody conversion; g) laboratory measurements to quantify the camera's gain; h) laboratory measurements to quantify the camera's offset. The shutter and subsequent characterization (component d and g) are not necessary if the shutter-based-external-blackbody technique is not utilized. Measurement of the stabilized camera gain (component g) is not needed if radiometric calibration is not required in a particular application. Measurement of the stabilized camera offset (component h) is not needed if the shutter-based-blackbody technique is used to cancel out the camera's offset.
These two techniques; the FPA-temperature-only stabilization and the shutter-based equivalent blackbody source, can be used to provide stable radiometric calibrations for TEC-less microbolometer cameras. Each of these techniques can be used independently to provide a level of calibration accuracy, or can be used in tandem to provide an improved level of accuracy. The shutter-based correction is of particular importance during times of rapid FPA temperature change, such as just after system power up, where the shutter-based correction can be used to improve the stability of the camera response beyond that of the FPA-temperature-only stabilization alone.
Referring now to the drawings, where like or similar elements are designated with identical reference numerals throughout the several views, and referring in particular to
The image-formation subsystem includes lens 205, shutter 210, FPA detector 220, and readout and processing electronics 710. Shutter 210 controls when optical input is permitted to reach FPA detector 220. In this illustrative embodiment, the image-formation subsystem also includes FPA-temperature sensor 705. FPA detector 220 outputs digital image data, as indicated in
The stabilization and calibration computing subsystem includes memory for data storage 715 and stabilization and calibration processor 720. Calibrated output images from the stabilization and calibration computing subsystem may be stored, displayed, or both (725). In this illustrative embodiment, stabilization and calibration processor 720 includes memory for storing a plurality of program instructions that are configured to cause stabilization and calibration processor 720 to carry out the various calibration methods described herein, separately or in combination.
In this embodiment, the scene image (not shown in
Alternatively, the camera may be directed to close the shutter and capture an image of the shutter, either just before or just after the scene image. Whichever image is captured first is stored in memory for data storage 715. Once both images have been collected, stabilization and calibration processor 720 can apply the shutter-based-blackbody offset correction technique (see
In some embodiments, the stabilization and calibration computing subsystem is integrated with the image-formation subsystem in a single thermal IR imaging device (e.g., a thermal camera). In other embodiments, the stabilization and calibration computing subsystem resides in a computer that is separate from the image-formation subsystem. In such embodiments, the two separate devices (e.g., camera and computer) are capable of communicating with each other, in some embodiments over a local- or wide-area network.
The response of a microbolometer-based LWIR camera can be described as a radiance-to-system-output transfer function, similar in form to the following equation:
r=R
L
L+D. (1)
Here RL is the system responsivity to the scene radiance, which contains values such as electronic gain, direct response to incoming radiance, the extent of the camera's field of view, and the size of the entrance pupil of the camera. The value D is the dark noise or offset within the camera. This is the response to a zero-radiance scene.
In a TEC-less microbolometer the FPA-temperature dependence can be modeled as a temperature-dependent transfer function. Where RL has been replaced with a temperature-dependent responsivity (RT), and the offset D replaced with a temperature-dependent offset (DT). This gives the following equation:
r=R
T
L+D
T, (2)
where r is the response from the camera, RT is the FPA-temperature-dependent responsivity, DT is the FPA-temperature-dependent offset, and L is the scene radiance (a function of scene temperature through the Planck equation and camera bandwidth). The terms RT and DT can be broken down into the following equations.
R
T
=R
m
T+R
o (3)
D
T
=D
m
T+D
o (4)
In equation 3, Rm is the FPA-temperature-dependent portion of the system responsivity, Ro is the FPA-temperature-independent portion of the system responsivity, Dm is the FPA-temperature-dependent portion of the offset, and Do is the FPA-temperature-independent portion of the offset. Using these equations, the FPA-temperature-dependent transfer function for a TEC-less microbolometer can be written as
r=(RmT+Ro)L+DmT+Do. (5)
Stabilization using only the FPA Temperature
The technique described in this section is based on using the FPA-temperature-dependent response (r) at a FPA temperature (T) for a scene to calculate a stabilized or corrected response (rcor) that would be experienced at a given reference FPA temperature (Tref) for the same scene. In some embodiments, this stabilization takes place through software rather than through physical stabilization of the camera's FPA temperature. With a software-based stabilization of the camera's response, the usability of these TEC-less cameras is increased and a true radiometric calibration of these cameras can be performed. This correction involves an equation similar to the following:
In this equation, the corrected response rcor is calculated using the error-containing raw response r, the difference between the current FPA temperature and the reference temperature ΔT, and correction coefficients m and b. Through the use of this equation, the response of the camera can be essentially locked to the response at the reference temperature. This reference temperature, in some embodiments, is selected to lie at the center of the expected operating temperature range of the camera.
If the camera views a blackbody radiator that is held at a constant temperature while the camera FPA temperature is changed from the reference temperature Tref to T2, the response can be represented by the following:
r
ref=(RmTref+Ro)L+DmTref+Do and (7)
r
2=(RmT2+Ro)L+DmT2+Do. (8)
In equations 7 and 8, the scene radiance does not change, but the response of the camera is expected to change due to the change in the FPA temperature. To characterize the difference caused by the change in FPA temperature, a difference between these two equations can be taken, giving
r
ref
−r
2=((RmTref+Ro)L+DmTref+Do)−((RmT2+Ro)L+DmT2+Do) (9)
which can be reduced to
r
ref
−r
2
=LR
m(Tref−T2)+Dm(Tref−T2). (10)
At this point the following substitutions will be made to simplify the results:
Δr=rref−r2 (11)
ΔT=Tref−T2, or in a general case (12.a)
ΔT=Tref−TFPA. (12.b)
With these substitutions made, equation 10 can be rewritten as
Δr=LRmΔT+DmΔT. (13)
This change in camera response with FPA temperature can be used to represent the response measured at each camera temperature in the following way:
r
2
=r
ref
−Δr and (14)
r
ref
=r
2
+Δr. (15)
The desired correction can be used to convert from one response to the other in a manner similar to the method shown above. Therefore, the difference in camera response at a given temperature can be determined in the following way (see equation 16).
Δr=rrefmΔT+bΔT (16)
In this equation, m and b are coefficients used to calculate the expected change in response for any FPA temperature, given the response rref at the reference temperature Tref and the difference in FPA temperature from the reference temperature. As mentioned above, the difference in camera response can be represented by equation 13. If equation 16 is a valid representation of the response temperature dependence, then these two equations (13 and 16) should be equivalent. Setting these two equations equal gives
LR
m
ΔT+D
m
ΔT=r
ref
mΔT+bΔT. (17)
Now, expanding the rref using equation 6 will yield the following
LR
m
ΔT+D
m
ΔT=((RmTref+Ro)L+DmTref+Do)mΔT+bΔT. (18)
Distributing the term mΔT results in
LR
m
ΔT+D
m
ΔT=(RmTref+Ro)LmΔT+DmTrefmΔT+DomΔT+bΔT. (19)
There are two parts to equation 19: a portion that contains the scene radiance L and a portion that does not contain the radiance. As these two types of terms show up on both sides of the equation, they must be pair-wise equal. This allows the equation to be broken into two parts (one containing L and one without L):
LR
m
ΔT=(RmTref+Ro)LmΔT and (20)
D
m
ΔT=D
m
T
ref
mΔT+D
o
mΔT+bΔT. (21)
We can use these two equations to solve for the coefficient terms m and b. First, dividing equation 20 by L and ΔT gives the following:
R
m=(RmTref+Ro)m. (22)
This equation can now be solved for m, giving
Dividing equation 20 by ΔT gives
D
m
=D
m
T
ref
m+D
o
m+b, (24)
which can be solved for b to obtain
b=D
m
−m(DmTref+Do) or (25)
These equations contain only camera parameters and other known values, such as the reference temperature to which the camera response is stabilized. The value for m as solved for in equation 23 is simply the temperature-dependent portion of the camera's responsivity divided by the camera's responsivity at the reference temperature. However, the value for b expressed by equation 24 is more complicated. This value contains the temperature-dependent portion of the offset Dm, from which the offset at the reference temperature scaled by the value m is subtracted.
The method above was derived to allow for the calculation of Δr, the difference or error in a camera response for a temperature difference ΔT, given the known response at the reference temperature rref. This is not quite what is desired, but these coefficients can be used to calculate a FPA-temperature-corrected response given the measured error-containing response r2 through the following manipulation. Remember that equation 14 gave the following method of representing the response from the camera, and that equation 16 gave the following method of calculating the error or change in camera response, Δr:
r
2
=r
ref
−Δr and (From equation 14)
Δr=rrefmΔT+bΔT. (From equation 16)
Equation 14 could be re-written as in equation 15, but the coefficients m and b are dependent on the method of correction. These equations can be combined to give the following.
r
2
=r
ref
−r
ref
mΔT−bΔT or (27)
r
2
=r
ref(1−mΔT)−bΔT. (28)
From these equations the response rref; which would be the response at a FPA temperature Tref, can be calculated from the error-containing r2 at T2 using the coefficients m and b, and the difference between T2 and Tref. Using rref as the FPA-temperature-corrected camera response rcor, the FPA-temperature-corrected camera response can be calculated for any scene using the following equation:
This equation locks the camera response to the value the camera would experience at the reference temperature. In some illustrative embodiments, this temperature is selected to lie at the center of the expected operating temperature range of the camera.
This above illustrative embodiment provides a technique that allows for correction of the FPA-temperature-dependent errors in the response of TEC-less microbolometer cameras. This correction is unique from other techniques in that it allows for the correction to take place without requiring a full radiometric calibration of the camera. This correction can take place without knowing specific information about the camera (e.g., spectral characteristics) that would be required in the previous techniques that have been used for camera stabilization. In operation, the response data from the camera can be adjusted for the FPA-temperature-induced errors, thus stabilizing the response of these cameras. Radiometric calibration or other data processing can then be performed on the stabilized camera response.
A method of calculating the value of m and b is presented below in the section entitled “Method of determining the coefficients of the FPA-temperature correction.”
Stabilization using an Internal Shutter as an External Calibration Source
Various illustrative embodiments of the invention include a technique for obtaining a radiometric calibration for a thermal infrared camera without an external blackbody source. In this technique, an internal shutter is used as an equivalent external blackbody source. Various illustrative embodiments include some or all of the following elements: a) an internal shutter; b) an internal sensor that measured the temperature at or near the shutter; c) and internal sensor that measures the temperature at or near the detector array (this could be the same as the shutter-temperature sensor; d) laboratory measurements of an external blackbody to derive the effect of the intervening optics between the shutter and external scene; and e) laboratory measurements to quantify the camera's responsivity and the change in responsivity with temperature. In operation, the camera can be deployed without an external blackbody source but achieves radiometric calibration through the combined use of a temperature-adjusted responsivity and a real-time offset determined by the internal shutter.
Characterization of the shutter with external blackbody differences allows for full removal of the FPA-temperature-dependent offset, leaving only the FPA-temperature-dependent responsivity that requires further temperature compensation to achieve a stable calibration. A description of the method of correcting and deriving the temperature dependence in the responsivity is described in previous sections.
In various illustrative embodiments of the invention, the internal shutter of the camera is used as an equivalent external blackbody source. This shutter is typically used to perform a flat-field non-uniformity correction every few minutes during normal operation. We have shown that, with proper characterization, this shutter can be used as a blackbody source by recording an image of the closed shutter and modifying the shutter image based on measured properties of the camera and the attached lens to produce an equivalent external-blackbody image. This equivalent external blackbody image can be used to perform a radiometric offset correction to the camera that can be measured consecutively with (within a short time before or after) the scene image. This is particularly important for microbolometer detectors operated without a TEC on the FPA. In such TEC-less systems, the signal output form the camera is dependent on both the scene and the temperature of the camera FPA. Using the described shutter-based equivalent-blackbody reference cancels out the temperature dependence of the camera offset calibration, thereby requiring only compensation for the temperature-dependent change in responsivity.
In one illustrative embodiment, the shutter is not directly used to produce a blackbody reference; rather, the image of the shutter is modified to represent an equivalent external blackbody source. This modification to the image is performed because the radiometry is not consistent between viewing a blackbody source outside the camera and viewing the shutter as an internal blackbody source. These different layouts are shown in
P
DBB
=L
BB
A
LΩLτLτF [Watts] (external blackbody scene) (30)
P
DS
=L
S
A
PΩSτF [Watts] (internal shutter) (31)
In the prior-art approach of
In contrast with
When viewing the blackbody through the lens, the power on a single pixel at the detector, PDBB, is determined as a function of the following: the radiance emitted from the blackbody, LBB, the area of the lens, ΩL, the projected solid angle defining the field of view for the lens detector-pixel system, ΩL, transmission of the lens, τL, and the transmission of the filter attached to the focal plane array, τF. This changes when the shutter is closed as the detector no longer views the scene through the lens, but rather it views the shutter directly. In this case the power on the detector, PDS, is determined as a function of the following: the radiance emitted from the shutter, LS, the area of a single detector pixel, AP, the projected solid angle field of view for the detector and shutter system, ΩS, and the transmission of the filter attached to the focal plane array, τF. The measured per-pixel ratio between the powers detected when viewing an external blackbody, PDBB, and detected when viewing the internal shutter, PDS, can be used to convert an image of the internal shutter to an equivalent external blackbody source.
With this technique, the offset and scene are both measured with the same FPA temperature. Thus, the calculated offset contains both temperature-independent and temperature-dependent components. Therefore, by measuring the shutter and image in rapid succession, the FPA-temperature-dependent portion of the offset cancels out of the calibration equation. The result is that only the responsivity term of the calibration equation requires compensation for changes in FPA temperature.
The conversion of the internal shutter to equivalent external blackbody is based on the assumption that shutter acts as a blackbody at the measured shutter temperature. When both the blackbody and the shutter are at the same temperature, the radiances of both sources, LBB and LS, are equivalent. Solving for the radiance values from equations 30 and 31 gives the following:
external blackbody
internal shutter:
Setting these radiances equal gives
This equation can be rearranged to give PDBB, the power measured when viewing an external blackbody. τF appears on both sides of the equations and cancels out, leaving:
In this equation the only difference between PDBB and PDS is a scaling factor in square brackets. This scale factor depends on properties of the camera which are generally stable in time but vary from pixel to pixel. This equation can be rewritten as the ratio between the powers measured in each case to give:
This equation shows that the differences between the internal shutter image and the external blackbody images can be measured as a per-pixel ratio of the external-blackbody and the internal-shutter signal. By measuring this ratio over the range of temperatures expected to be experienced by the camera, any temperature dependence can be determined. Once measured, the inverse of this ratio can be applied to shutter images, allowing any image of the shutter to act as an equivalent external blackbody source.
Above, we stated that consecutively recording images of the shutter and the scene will cancel out the FPA-temperature-dependent offset contained in the data. Demonstration of this with mathematics starts with the linear calibration equation used to calibrate linear-response thermal cameras:
L=gr
cor
+o
c (37)
In this equation 37, L is the measured scene radiance, rcor is the FPA-temperature-corrected response, g is a laboratory-measured calibration gain, and oc is the calibration offset determined from a shutter-based blackbody technique. Before calibration, the raw response from the camera can optionally be corrected to compensate for FPA temperature. This is done by removing errors from the temperature-dependent change in responsivity and temperature-dependent change in offset, through equation 38.
In this equation 38, r is the raw response from the camera, rcor is the corrected response after the removal of the FPA temperature dependence, ΔT is the difference in temperature from a reference temperature (typically chosen to lie in the center of the expected operating FPA temperature range), m is the correction coefficient for the temperature-dependent responsivity, and b is the correction coefficient for the temperature-dependent offset. The coefficients have been measured in a laboratory setting, usually with a thermal chamber and blackbody. Substituting equation 38 for rcor in the calibration equation, equation 37, gives:
The offset term, oc is measured using the internal-shutter-to-external-blackbody technique described here. This value is determined by multiplying the laboratory measured calibration gain, g, by an equivalent external blackbody image of the shutter, rsbbcor (which has been corrected for FPA temperature), and subtracting this product from the calculated radiance for a blackbody at the shutter temperature, LS as is shown in equation 40.
o
c
=L
S
−gr
sbbcor (40)
The correction of the camera response for the FPA temperature takes place after the conversion of the internal shutter to an external-blackbody. Therefore, the shutter-based equivalent blackbody after correction is expressed by equation 41.
In this equation, the shutter image is first converted to an equivalent external blackbody image by scaling the raw per-pixel response rs by the inverse of the internal-shutter-to-external-blackbody temperature-dependent ratio SR(Ts), where Ts is the shutter temperature. The scaled image is then corrected for FPA temperature. Substituting equation 41 into equation 40 gives a full equation for the offset calculation.
Replacing the offset, oc, in equation 39 with equation 42 gives:
This can be rearranged to consolidate variables giving:
The temperature dependence in the camera offset, bΔT, appears twice, but with opposite signs. Thus this portion of the FPA temperature dependence simply cancels out, giving a final calibration equation:
Thus, we see that the use of a shutter image as a blackbody reference, taken at the same FPA temperature that is in effect for the scene image, causes the temperature-dependent offset to cancel out, leaving only the temperature dependence of the responsivity. Experimentation has shown that the temperature-dependence is smaller for the responsivity than for the offset.
The above technique simplifies the FPA-temperature compensation in TEC-less microbolometer cameras and allows the internal shutter of any thermal-imaging camera to act as an equivalent external blackbody source.
A method of calculating the value SR(Ts) is presented below.
Stabilization of the Camera Response using only the FPA Temperature
Refer to
Stabilization and Radiometric Calibration using only the FPA Temperature
Refer to
Stabilization and Radiometric Calibration using only the Shutter-Based Blackbody
Refer to
This image (525) is multiplied by the camera calibration gain 545 (measured at an FPA temperature within the operating range of the camera; in one embodiment, this FPA temperature is at the center of the operating range). The resulting image is then added to a calculated radiance (535) for a blackbody at the measured shutter (or FPA) temperature (this blackbody radiance is calculated at Block 530). This process provides a radiometric calibration (measured radiance 550) without using the FPA-temperature correction (see
Stabilization and Radiometric Calibration using a Combined Technique
Refer to
Then, using the calculated values for the coefficient for the temperature dependence of the responsivity (m) and the calibration gain measured at Tref (625), a calibration gain 615 is calculated (Block 610) for the current FPA temperature and multiplied by the offset-corrected scene image 525. This value is then added to the calculated radiance 535 for a blackbody at the shutter temperature (calculated at Block 530). This process provides the most accurate radiometric calibration (measured radiance 630), but requires both the shutter and FPA-temperature correction and therefore requires the most characterization of the camera of any of the methods describe here.
In
The FPA-temperature correction coefficients m and b can be calculated through the following method. First, a series of measurements are taken with the camera viewing a blackbody source while the temperature of the camera is changed. If a constant-temperature blackbody is viewed with the camera at a minimum of three different temperatures, a correction can be built. One FPA temperature is selected as a reference temperature; for example, use T1 as the reference FPA temperature. The following three responses are obtained from the camera:
r
1=(RmT1+Ro)L+DmT1+Do, (46)
r
2=(RmT2+Ro)L+DmT2+Do, and (47)
r
3=(RmT3+Ro)L+DmT3+Do. (48)
Using T1 as the reference temperature the following differences can be determined
Δr12=r1−r2, (49)
Δr13=r1−r3, (50)
ΔT12=T1−T2, and (51)
ΔT13=T1−T3. (52)
To solve for m and b the following matrix can be created.
Inverting this matrix and solving for m and b gives:
It is important to note that in this correction the absolute temperature or radiance of the blackbody target is not needed. The blackbody target is only required to remain stable during the temperature measurements. The correction is performed using only the responses and the FPA temperature of the camera. Therefore, no additional information about the camera's spectral response, the temperature of the blackbody, or imperfections in the blackbody is needed. This is true as long as these values remain constant, which is a valid assumption in most laboratory situations. Performing this technique at two blackbody temperatures improves the accuracy of the coefficients in the correction. In this case you would have two reference responses, one for each blackbody temperature. This would cause the matrix to be over determined, and a pseudo matrix inversion would be required.
The function for the shutter temperature dependent ratio SR(Ts) used to convert an internal shutter image to an equivalent external blackbody can be calculated through the following method. First, a series of measurements are taken with the camera viewing a blackbody in a thermal chamber. The thermal chamber is held at a constant temperature while the FPA temperature stabilizes. While the camera FPA temperature stabilizes, the controlled blackbody is continually being set to be equal to the camera temperature. Once the camera temperature is stable and the blackbody has been at the same temperature as the camera for a sufficient length of time, a series of images is taken, alternating between images of the shutter and images of the blackbody. The flat-field function of the camera should be used during this data collection if a flat-field correction is to be used during deployment.
Once a sufficiently-sized data set has been collected at the current FPA temperature, the thermal chamber temperature is increased. The process is then repeated again, allowing the camera to stabilize and the blackbody to match the camera temperature.
In post processing, the ratio between the blackbody image and the shutter image is calculated through an equation such as the following:
In this equation, SR is the per-pixel shutter ratio of the blackbody image (PDL) to the shutter image (PDS). If this is repeated for multiple camera temperatures, one obtains a series of ratios for each pixel such as the following:
After collecting data at a sufficient number of data points, a function SR(Ts) can be fit for each pixel between the calculated ratio SR and the shutter temperature Ts, allowing the shutter ratio to be calculated given any shutter temperature Ts. It has been found that a first-order linear fit was sufficient to characterize SR(Ts) for at least one specific type of camera.
In one particular experiment, a TEC-less microbolometer camera was placed inside an environmental chamber while viewing a blackbody that filled the entire field of view for the camera. The data were collected as the chamber air temperature varied based on data from a weather station to simulate the camera being outside on a summer day in Bozeman, Mont. As the chamber air temperature varied, the blackbody temperature was also varied but on a much slower time scale. When the blackbody temperature was changed, it was set to a multiple of 10° C. between 10° C. and 50° C. and then held constant at the new temperature for a variable length of time, no shorter than 70 minutes and no longer than 320 minutes.
During this experiment, the internal temperature of the FPA and shutter images was collected consecutively with the blackbody images. In post processing, the combined technique was used in which the temperature-dependent responsivity and offset correction for stabilizing the data is used in conjunction with the shutter-based-external-blackbody correction for radiometric calibration. For much of the 24-hour period for which data was analyzed, the difference between the camera's reported temperature and the blackbody temperature fell within the bounds of the blackbody uncertainty.
In many thermal infrared imaging applications, use of the above techniques can eliminate the costly and space-intensive blackbody source, provide radiometric calibration of otherwise uncalibrated TEC-less cameras, and improve the stability and accuracy of data from thermal imaging cameras. Specific market areas in which this technique may be applied include, without limitation, the following: measuring atmospheric and cloud radiation for environmental and climate studies; measuring atmospheric radiation for characterizing free-space optical communication paths; and ground-, air-, and satellite-based remote-sensing sensors for military, defense, or homeland-security applications, etc.
The above techniques benefit, for example, any application in which a thermal camera is required and wherein the cost, space, or weight of an external blackbody is not desired or practical. Because these techniques remove the need for an external blackbody source, it reduces cost, reduces space, and reduces weight of the thermal infrared imaging system. If carefully implemented, some embodiments can produce a radiometric uncertainty on the order of 0.3 W/(m2 sr) or approximately 0.4° C. for a 25° C. scene (viewed by a camera that integrates across the long-wave infrared band of approximately 8-14 μm wavelength). This is better than the calibration uncertainty of 1-2° C. that is typically available for thermal cameras used with laboratory calibration without an external blackbody source.
The application of these techniques is not limited to TEC-less microbolometer cameras. This type of correction could be applied to non-microbolometer based thermal cameras, some of which are TEC-less and operate without other forms of temperature stabilization. These corrections could be applied to TEC-stabilized microbolometer based thermal cameras. Even with a TEC element, the FPA temperature can vary, causing a similar error as observed in a TEC-less camera, though smaller in magnitude. The invention described here could be used to improve the stability of the camera response beyond the stability obtainable from a TEC alone. There are also applications beyond thermal imaging in stabilization and calibration of other temperature-sensitive sensors.
In conclusion, the present invention provides, among other things, a thermal IR imaging system and associated methods for calibrating such a system. Those skilled in the art can readily recognize that numerous variations and substitutions may be made in the invention, its use, and its configuration to achieve substantially the same results as achieved by the embodiments described herein. Accordingly, there is no intention to limit the invention to the disclosed exemplary forms. Many variations, modifications, and alternative constructions fall within the scope and spirit of the disclosed invention as expressed in the claims.
This application claims priority under 35 U.S.C. §119(e) from the following commonly owned and assigned U.S. Provisional Patent Applications: Application No. 61/023,684, Attorney Docket No. MONT-103/00US, entitled “Radiometric Calibration of Thermal Infrared Imagers Using an Internal Shutter as an Equivalent External Blackbody Source,” filed on Jan. 25, 2008; and Application No. 61/050,133, Attorney Docket No. MONT-103/01US, entitled “Radiometric Calibration of Thermal Infrared Imagers Using an Internal Shutter as an Equivalent External Blackbody Source,” filed on May 2, 2008; both of which are incorporated herein by reference in their entirety.
This invention was made with government support under contracts NNS05AB25H and NMO710820 awarded by the National Aeronautics and Space Administration. The government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
61023684 | Jan 2008 | US | |
61050133 | May 2008 | US |