This application is based upon and claims the benefit of priority from prior Japanese Patent Application No. 2011-227208 filed on Oct. 14, 2011 in Japan, the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to an infrared solid state imaging device.
Infrared rays make it possible to image temperature distribution of an object even in darkness. Furthermore, since infrared rays have a merit that its permeability is high with respect to smoke and fog as compared with visible light, infrared imaging is possible night and day. Furthermore, since temperature information of an object can also be obtained in the infrared imaging, the infrared imaging has a wide application range as in surveillance cameras and fire alarm cameras not to speak of the defense field.
In recent years, development of “uncooled infrared solid state imaging element” which does not need a cooling mechanism has become vigorous. The uncooled, i.e., thermal type infrared solid state imaging device converts incident infrared rays having a wavelength of approximately 10 μm to heat by using an absorption structure, and converts a temperature change in a heat sensitive portion generated by the converted feeble heat to an electric signal by using some thermoelectric conversion elements. The uncooled infrared solid state imaging device obtains infrared image information by reading out the electric signal. When converting incident infrared rays to heat, it is necessary to thermally insulate the absorption structure of incident infrared rays from the substrate and usually the thermal type infrared solid state imaging element is made to operate in the vacuum.
One of indexes which represent performance of the infrared sensor is NETD (Noise Equivalent Temperature Difference) which represents the temperature resolution of the infrared sensor. It is important to make the NETD small, i.e., make the temperature difference of an infrared detection element which is equivalent to noise small. Furthermore, when converting light to temperature, the thermal type infrared detection element has a determinate thermal time constant, and it cannot follow an object which changes fast. The pixel sensitivity and the thermal time constant are in the antinomic relation. If the thermal insulation property is enhanced in order to improve the sensitivity, heat becomes hard to escape and consequently the thermal time constant is aggravated. In other words, since the thermal time constant is aggravated, only an infrared image containing an afterimage is obtained.
In the X-ray inspection device, a method of calculating an attenuation rate “r” of an afterimage, subtracting r times an output signal measured last time from (1+r) times an output signal measured this time, and thereby correcting the afterimage is known. In this case, the ratio of the output signal measured last time which should be subtracted to the output signal measured this time becomes r/(1+r), and there is a drawback that it becomes less than the afterimage r which is actually included.
An infrared solid state imaging device according to the present embodiment includes an infrared detection element unit having heat sensitive pixels, an AD conversion unit which conducts analog-digital conversion on an infrared image signal obtained by the infrared detection element unit, and a digital signal processing unit which converts the image signal converted to a digital signal. The digital signal processing unit stores an image value produced from a digital signal, and acquired in a frame immediately preceding a current frame, and conducts processing of multiplying the image value acquired in the immediately preceding frame by a predetermined constant α in the range of 0 to 1, subtracting a resultant image value from an image value acquired in the current frame, and multiplying a resultant difference image value by 1/(1−α).
Hereafter, embodiments will be described with reference to drawings.
In the present embodiment, the imaging area has, for example, heat sensitive pixels (such as diodes) arranged in a 3×3 matrix and each heat sensitive pixel has sensitivity for infrared rays. The reason why the imaging area has the 3×3 matrix is that description concerning operation of the infrared solid state imaging device according to the present embodiment is simplified. Typically, the imaging area has a larger number of heat sensitive pixels arranged in an m×n matrix. Each heat sensitive pixel has, for example, at least one pn junction diode.
Readout operation of pn junction diodes which are heat sensitive pixels arranged in the 3×3 matrix form shown in
Anodes of pn junction diodes which are heat sensitive pixels on the same row are connected to the row selection circuit 31 by the same interconnection. In
If the bias voltage Vd is applied to pn junction diodes on the row selection line r1 at certain time t1, then (pn)11, (pn)12 and (pn)13 differ in temperature Tp(t) according to a signal of an object and consequently they differ in Vf, i.e., Vd-Vf, as well. And the voltages Vd-Vf of (pn)11, (pn)12 and (pn)13 are input to the column amplifiers 201 through the vertical signal lines 34, amplified therein, and read out in order column by column by the vertical selection circuit 32. A resultant serial signal is sent out from the analog detection unit 1 via the buffer 202. The serial signal is sent to the digital signal processing unit 5 through the AD conversion unit 4 which will be described later. At subsequent time t2, the bias voltage Vd is applied to pn junction diodes on the row selection line r2, and voltages Vd-Vf of (pn)21, (pn)22 and (pn)23 are input to the column amplifiers 201 through the vertical signal lines 34, amplified therein, and read out in order column by column by the vertical selection circuit 32. A resultant serial signal is sent out from the analog detection unit 1 via the buffer 202. The serial signal is sent to the digital signal processing unit 5 in the same way. At further subsequent time t3, the bias voltage Vd is applied to pn junction diodes on the row selection line r3, and voltages Vd-Vf of (pn)31, (pn)32 and (pn)33 are input to the column amplifiers 201 through the vertical signal lines 34. A resultant serial signal is sent out from the analog detection unit 1 via the buffer 202. The serial signal is sent to the digital signal processing unit 5 in the same way. The buffer 202 has a function of conducting impedance matching when transmitting a signal from the analog detection unit 1 to the digital signal processing unit 5 and preventing signal interference between the analog detection unit 1 and the digital signal processing unit 5. Time (t3−t1) represents a time period of one frame in the infrared solid state imaging device according to the present embodiment.
A structure of a heat sensitive pixel (pn)ij (i, j=1, 2, 3) in the infrared detection element unit 1 according to the present embodiment will now be described with reference to
The infrared absorption film 191 generates heat due to incident infrared rays. The diodes 192 convert the heat generated by the infrared absorption film 191 to an electric signal. The support structure 162 is formed long and narrowly to surround the periphery of the thermoelectric conversion element 161. As a result, the thermoelectric conversion element 161 is supported over the SOI substrate in the state in which heat is nearly insulated from the SOI substrate. Owing to such a hollow heat insulation structure, the heat sensitive pixel 12 can accumulate heat generated according to the incident infrared rays and output a voltage based on the heat to a signal line. The bias voltage Vd from the row selection line is transferred to the diodes 192 via the interconnection 162b. A cathode side voltage of the diodes 192, i.e., the signal voltage is transferred to vertical signal lines 34(1), 34(2) or 34(3) via the interconnection 162b.
Owing to such a structure, the heat sensitive pixel 12 can accumulate heat generated according to the incident infrared rays and output a voltage based on the heat to a signal line.
A temperature rise of the thermoelectric conversion element at the time when the thermoelectric conversion element has received infrared rays from a heat source will now be described quantitatively.
Denoting a temperature change of an object at certain time t by Tt(t) and a temperature change of the thermoelectric conversion element 161 by Tp(t), a relation between them is represented by the following Equation (1).
Here, τ is a thermal time constant of a heat sensitive pixel, and it is typically in the range of approximately 10 ms to 100 ms. Equation (1) represents that a result obtained by performing convolution integral on the object temperature Tt(t) with an exponential function becomes the temperature Tp(t) of the thermoelectric conversion element 161. The convolution integral represented by Equation (1) can be rewritten as shown in the following Equation (2).
Here, letting t′=t−tf in the integral in the first term of the second formula.
In Equation (2), the first term is a product of the contribution from all past frames and exp(−tf/τ), and the second term is information in the current frame. The first term represents afterimage information of the past frames. In other words, Equation (2) represents that the afterimage information can be removed by subtracting the product of all frame information and exp(−tf/τ) from the current frame information. In other words, the afterimage signal is contained in the pixel by a rate which is represented accurately by the following Equation (3).
αth=exp(−tf/τ) (3)
Schematically representing information along the time axis shown in
In
A function of the digital signal processing unit 5 will now be described.
The image value is input to the digital signal processing unit 5. The digital signal processing unit 5 includes a frame memory 41, a constant multiplication unit 42, a subtracter 43, and a constant multiplication unit 44. An image value A(i−1, x, y) of the preceding frame is stored in the frame memory in a stage of the preceding frame. This value is multiplied by a predetermined arbitrary multiplier α in the constant multiplication unit 42. This multiplier α represents an afterimage reduction rate. If, for example, α=20% (0.2) is set in the case where one heat sensitive pixel produces an afterimage signal of αth=30%, the afterimage is reduced accurately to 0.3−0.2=0.1 (10%). In the subtracter 43, αA(i−1, x, y) is subtracted from an image value A(i, x, y) of the current frame. As a result, A(i, x, y)−αA(i−1, x, y) is output from the subtracter 43. For example, when A(i, x, y)=100, A(i−1, x, y)=100, and α=20%, a calculation result of A(i, x, y)−αA(i−1, x, y) becomes 80 which is lower as compared with the case where the afterimage reduction is not conducted. The calculation result is multiplied by a constant 1/(1−α) in the constant multiplication unit 44 in order to adjust the luminance. When α=20%, the constant 1/(1−α) becomes 1.25 and the calculation result 80 is restored to 80×1.25=100. As a result, A′(i, x, y)={1/(1−α)}×{A(i, x, y)−αA(i−1, x, y)} is output as an image value after the afterimage reduction.
Even when imaging an object with very strong infrared rays, the temperature rise of the thermoelectric conversion element 161 in the infrared detection element unit 1 is minute, and consequently the thermal time constant τ is always constant. In other words, the afterimage signal is constant. Even if α is set uniformly for all pixels beforehand, therefore, problems are hardly posed.
According to the present embodiment, the afterimage signal can be reduced effectively with simple means regardless of the signal from the object, as described heretofore.
In a CMOS image sensor which is a visible light sensor, it is possible to output a signal level (dark level) at the time when imaging is not conducted every pixel and correct unevenness of the dark level among pixels by electrically resetting signal charges stored on photodiodes. In the thermal type infrared detection element unit, however, each heat sensitive pixel always reflects some object temperature signal. Unless physical light interception operation using a mechanical shutter is conducted, therefore, the thermal dark level cannot be acquired. Especially in the thermal type infrared detection element unit, unevenness of the dark level among heat sensitive pixels is several digits greater than the object temperature signal. Therefore, dark level correction becomes indispensable.
During the light interception operation using the mechanical shutter, information from the object is interrupted. In an application which needs continuous imaging, therefore, it is desirable to make the light interception operation as short as possible.
Furthermore, for acquiring the dark level, it is necessary to average electrical random noise and improve the precision of a dark level image (an image of a fixed pattern). For this purpose, averaging is conducted over several frames to several tens frames. The several frames to several tens frames for averaging are referred to as averaging frame group.
During several frames after the light interception is started, the afterimage of the object information becomes remarkable as described above. If frames having the remaining afterimage information are included in the averaging frame group, then the image of the afterimage in the object signal remains in the dark level image and consequently the image of the afterimage in the object signal at this time sticks after the correction.
In a frame during which the shutter is closed, such an influence of the object signal can be removed by setting the constant α just equal to αth determined from a product of the heat capacity and a thermal resistance of the pixel according to Equation (3). In other words, the afterimage can be reduced to just 0%.
According to the present embodiment, the light interception operation time period using the mechanical shutter can be shortened and the afterimage signal can be reduced effectively regardless of the signal from the object by completely removing the object signal which remains during the light interception operation time period using the mechanical shutter, as described heretofore.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein can be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein can be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2011-227208 | Oct 2011 | JP | national |