The present invention relates to a method for processing a raw image collected by an imager provided with a matrix array of bolometers. In particular, the processing method according to the present invention is intended to correct the nonuniformities due to the dispersions in the characteristics of the bolometers of the imager.
The present invention also relates to a computer program capable of implementing all of the steps of the method according to the present invention.
The invention lastly relates to an imager comprising bolometers and a computer implementing the computer program.
An infrared detector known in the prior art in general comprises bolometers organized into a matrix array of n rows and m columns.
When they are exposed to a scene with a view to acquiring an image, these bolometers, which are sensitive to the temperature of the scene, see their electrical resistance vary. In other words, the current flowing through each of the bolometers is dependent on the temperature of the scene, but also on the ambient temperature.
In particular, the measurement Sp(i,j) of the bolometers Bpix_(i,j) of a matrix array of bolometers varies according to the following relationship:
Sp(i,j)=Resp(Tamb)(Tscene−Tamb)+S0,T
where:
The term Resp(Tamb) depends on the materials used to produce the bolometer and on the architecture of the latter.
The deduction of the scene temperature requires the ambient temperature Tamb to be known, and hence the imager is in general also provided with a temperature sensor.
The imager may also be provided with additional bolometers, called blind bolometers, which are not exposed to the scene. The current flowing through the latter then depends only on the ambient temperature.
Thus, in such a configuration, the determination of the variation in the resistance of an exposed bolometer is based on a differential measurement between the currents flowing through said exposed bolometer and a blind bolometer.
In general, each column of the matrix array of bolometers is associated with a blind bolometer that is employed for each of the bolometers of said column during the differential measurement. However, other configurations may be envisaged, and in particular the use of a single common blind bolometer for a plurality of columns of bolometers.
The raw image (
In particular, the image illustrated in
The image also has a columnar aspect that is due to the dispersion of the electrical resistances between the blind bolometers.
In order to mitigate these problems, various solutions have been envisaged.
It has in particular been proposed to place a mechanical shutter on the imager. In particular, the mechanical shutter is placed in front of the detector so as to collect a reference image relative to the ambient temperature, which is subsequently subtracted from the image of the scene.
This arrangement, which is relatively simple in principle, is however unsatisfactory.
Specifically, the implementation of a shutter, and the motorization that is associated therewith, create problems both of cost and of bulk.
Moreover, the reference image must be refreshed when the ambient temperature varies.
Alternatively, it has been proposed to characterize the temperature response of the detector, and in particular of each of its bolometers.
This characterization comprises reference measurements at various temperatures with all of the bolometers of the imager closed with a shutter.
The reference measurements then allow the variation in temperature of each of the bolometers to be determined and thus calibration tables that are stored in a memory space of the detector to be constructed.
Thus, in operation, the detector corrects the raw image by subtracting, for each bolometer, values obtained by interpolation from the calibration tables.
This solution, which allows the effect of nonuniformity of the image from one bolometer to the next to be decreased, is however unsatisfactory.
Specifically, the procedure used to acquire the reference measurements is time-consuming, and increases the cost of manufacture of the detector.
Moreover, the memory space dedicated to saving the calibration tables, because of the cost that is associated therewith, is undesirable.
Lastly, a third method based on algorithms allowing the nonuniformity of the image to be corrected has been proposed in EP2940991B1 and US2010237245A1.
These known prior-art methods are also unsatisfactory.
Specifically, these methods are generally tedious to implement, and their robustness is debatable.
Moreover, these methods require powerful computing means to be employed, which have a corresponding negative influence on the costs of the detectors in which they are employed.
One aim of the present invention is to provide a method for processing images collected by an imager provided with bolometers that is simpler than the known prior art techniques, and that does not require mechanical parts and the automation that is associated therewith to be employed.
Another aim of the invention is to provide a method allowing the columnar effect observed in a raw image to be corrected.
The aims of the present invention are at least partially achieved with a method for processing a raw image characterized by raw measurements Sp(i,j) that are associated with active bolometers Bpix_(i,j) of an imager, which bolometers are arranged in a matrix array of n rows and m columns, the imager being at an ambient temperature Tamb and furthermore comprising blind bolometers Bb_(k), each blind bolometer Pb_(k) being employed for the differential measurement of the active bolometers Bpix_(i,j) of at least one column of bolometers that is specific thereto, each blind bolometer Bb_(k) advantageously being associated with one single column of active bolometers Bpix_(i,j), the method, which is executed by a computer that is provided with a memory, comprising the following steps:
a) a step of calculating the electrical resistances RTc(i,j) and RTc(k), at the temperature Tamb, of the active and blind bolometers, respectively, from their respective electrical resistances RTr(i,j) and RTr(k) at a reference temperature Tr, said resistances being stored in the memory;
b) a step of determining the temperatures Tsc(i,j) actually measured by each of the active bolometers Bpix_(i,j) from the electrical resistances calculated in step a) and from the raw measurements Sp(i,j).
According to one embodiment, step a) of calculating the electrical resistances RTc(i,j) and RTc(k), at the temperature Tamb, is executed based on an activation energy Ea representative of the material forming each of the active and blind bolometers Bpix_(i,j) and Bb_(k).
According to one embodiment, the electrical resistances RTamb(i,j) and RTamb(k) are calculated using the following relationships:
According to one embodiment, the temperature Tsc(i,j) actually measured by an active bolometer Bpix_(i,j) respects the following relationship:
SP(i,j)=Resp(Tamb,i,j)(Tsc(i,j)−Tamb)+S0,T
where:
According to one embodiment, the value S0,Tamb(i,j) associated with an active bolometer Bpix_(i,j) of a column is dependent on the difference between the currents I0,pix(i,j) and I0,b(j) capable of flowing through said active bolometer Bpix_(i,j) and the blind bolometer Bb_(k) with which the column is associated, respectively, for a temperature actually measured equal to the ambient temperature.
According to one embodiment, step a) is preceded by a step a1) of acquiring raw measurements Sp(i,j) with capacitive transimpedance amplifiers that are arranged so that all of the active bolometers Bpix_(i,j) of each column and the blind bolometer Bb_(k) with which said column is associated are connected to a negative input of one of the capacitive transimpedance amplifiers, the positive input of said amplifier receiving a reference voltage.
According to one embodiment, switching devices, in particular transistors, controlled by the computer are interposed between each of the, active and blind, bolometers and the capacitive transimpedance amplifier to which the latter are connected.
According to one embodiment, prior to the implementation of the method, a step of measuring the electrical resistances RTr(i,j) and RTr(k) is executed.
According to one embodiment, the determination of the electrical resistance RTr(i,j) and RTr(k) of an active bolometer Bpix_(i,j) of a column or of the blind bolometer Bb_(k) with which said column is associated comprises a measurement of the current capable of flowing through the bolometer in question.
According to one embodiment, the measurement of the current capable of flowing through the bolometer in question comprises closing the switch interposed between said bolometer in question and the capacitive transimpedance amplifier, the other switches being kept open.
The invention also relates to a computer program which, when it is implemented by a computer, allows the method according to the present invention to be executed.
The invention also relates to an imager provided with
The invention also relates to the use of the imager according to the present invention for detection, in particular the detection of people, in a room.
Other features and advantages will become apparent from the following description of a method for processing an image, given by way of nonlimiting examples, with reference to the appended drawings, in which:
The present description will now be described with reference to
A bolometer indexed i, j corresponds to a bolometer placed at the intersection of row i with column j.
The imager of
Each blind bolometer Pb_(k) is employed for the differential measurement of the active bolometers Bpix_(i,j) of at least one column of bolometers that is specific thereto.
In particular, each blind bolometer Bb_(k) is associated with a single column (Cj) of active bolometers Bpix_(i,j).
The imager 1 furthermore comprises a computer 4 equipped with a computational processor intended to execute the various steps of the method according to the present invention.
The computer may also comprise a memory space for saving the raw measurements, and/or parameters useful to the operation of the imager 1.
Lastly, the imager 1 may comprise a temperature probe 5 intended to evaluate the temperature of the environment in which said detector is found. The temperature probe may, for example, comprise a PN junction.
Each of the active bolometers Bpix_(i,j) of a column and the blind bolometer Bb_(j) with which said column is associated, is connected to a common line BL(j) via a switching device I, and in particular a transistor, controlled by the computer.
The end of each of the common lines BL(k) is connected to a negative input E− of a capacitive transimpedance amplifier CTIA. The positive input E+ is for its part raised to a reference voltage Vbus.
The use of the switching devices I allows each of the active or blind bolometers to be addressed individually and thus their output signal to be measured with one of the capacitive transimpedance amplifiers CTIA.
The method according to the present invention proposes to correct the defects of a raw image characterized by raw measurements Sp(i,j) associated with the active bolometers Bpix_(i,j).
The method according to the present invention comprises a step a) of calculating the electrical resistances RTc(i,j) and RTc(k), at the temperature Tamb, of the active and blind bolometers Bpix_(i,j) and Bb_(k), respectively.
These electrical resistances are in particular calculated from the respective electrical resistances RTr(i,j) and RTr(k), of said bolometers, at a reference temperature Tr, said resistances being stored in the memory of the computer.
The electrical resistances RTr(i,j) and RTr(k) of the active bolometers Bpix_(i,j) and of the blind bolometers Bb_(k), respectively, at the reference temperature Tr, may be determined prior to step a), in a step a1).
For example, a step a1) is executed during the manufacture of the imager.
Step a1) then comprises a first substep a11) of determining the electrical resistances of the reference temperature of each of the active bolometers Bpix_(i,j).
The first substep a11) employs a mask kept at the reference temperature Tr and placed in front of the imager 1 (it will be understood that the imager is also kept at the reference temperature Tr).
The current flowing through each of the active bolometers Bpix_(i,j) is then measured individually.
In particular, the measurement of the current Ipix_(a,b) of a given active bolometer Bpix_(a,b) comprises closing the switching device connecting it to the common line BL(b), the other switches being kept open. The switches GSK associated with the blind bolometers are also kept open so as to cancel out the current capable of flowing therethrough.
The equivalent circuit diagram resulting from this configuration is shown in
The voltage VCTIA at the output S of the capacitive transimpedance amplifier CTIA associated with column “b” respects the following relationship (1):
Cint being a capacitance of the amplifier CTIA and Tint an integration time in the step of measuring the current Ipix_(a,b).
Moreover, the current Ipix_(a,b) is dependent on the geometric and electrical characteristics of the bolometer and on the characteristics controlling the latter.
More particularly, the current Ipix_(a,b) also respects the following relationship (2):
The reference electrical resistance RTr(i,j) at the reference temperature Tr is thus deduced from relationships (1) and (2).
Step a1) then comprises a second substep a12) of determining the electrical resistances, at the reference temperature, of each of the blind bolometers Bb_(k).
Substep a12) is similar to substep a11).
In particular, the second substep a12) also employs the mask kept at the reference temperature Tr and placed in front of the imager 1 (it will be understood that the imager is also kept at the reference temperature Tr).
The current flowing through each of the blind bolometers Bb_(k) is then measured individually.
In particular, the measurement of the current Ib_(l) of a given blind bolometer Bb_(l) comprises closure of the transistor GSK controlling the latter in order to connect it to the common line BL(l), the other switches being kept open.
The equivalent circuit diagram resulting from this configuration is presented in
The voltage VCTIA at the output S of the capacitive transimpedance amplifier CTIA associated with the column “I” respects the following relationship (3):
Moreover, the current Ib_(l) depends on the geometric and electrical characteristics of the bolometer and on the characteristics controlling the latter.
More particularly, the current Ib_(l) also respects the following relationship, relationship (4):
The reference electrical resistance RTr(1) at the reference temperature Tr is thus deduced from relationships (3) and (4).
The determination of the reference electrical resistances RTr(i,j) and RTr(k) thus employs components usually integrated into an imager. In other words, it is not necessary to modify the imager in order to implement the method according to the present invention.
The calculation of the electrical resistances at the ambient temperature Tamb may then involve an activation energy Ea representative of the material forming each of the active and blind bolometers Bpix_(i,j) and Bb)(k).
More particularly, the electrical resistances RTamb(i,j) and RTamb(k) are calculated using the following relationships:
The method according to the present invention also comprises a step b) of determining the temperatures Tsc(i,j) actually measured by each of the active bolometers Bpix_(i,j) based on the electrical resistances calculated in step a) and on the raw measurements Sp(i,j).
In particular, the temperature Tsc(i,j) actually measured by an active bolometer Bpix_(i,j) respects the following relationship (7):
SP(i,j)=Resp(Tamb,i,j)Tsc(i,j)−Tamb)+S0,T
where:
In this respect, the value S0,Tamb(i,j) associated with an active bolometer Bpix_(i,j) of a column Cj is dependent on the difference between the currents I0,pix(i,j) and I0,b(j) capable of flowing through said active bolometer Bpix_(i,j) and the blind bolometer Bb_(j) with which the column Cj is associated, respectively, for a temperature actually measured equal to the ambient temperature.
In other words, for each of the active bolometers, the term S0,Tamb(i,j) respects the following relationship, relationship (8):
the currents I0,pix(i,j) and I0,b(j) depending on the electrical resistances RTamb(i,j) and RTamb(j), respectively.
It is therefore possible to deduce, from relationships (7) and (8), the temperature Tsc(i,j) actually measured by each of the bolometers, using the following relationship:
The processing thus carried out on the raw image allows a temperature-compensated final image that is free from pixelization effect and columnar aspect to be obtained.
The present invention also relates to a computer program that, when it is implemented by a computer, allows the processing method according to the present invention to be executed.
The invention furthermore relates to an imager provided with
Lastly, the invention also relates to a method of using the imager according to the present invention for detection, in particular the detection of people, in a room.
Number | Date | Country | Kind |
---|---|---|---|
1860396 | Nov 2018 | FR | national |
Number | Name | Date | Kind |
---|---|---|---|
10015425 | Saragaglia et al. | Jul 2018 | B2 |
20050077469 | Kaushal | Apr 2005 | A1 |
20090008555 | Dupont | Jan 2009 | A1 |
20090008556 | Dupont et al. | Jan 2009 | A1 |
20090194696 | Mizrahi | Aug 2009 | A1 |
20090212220 | Mizrahi | Aug 2009 | A1 |
20100224787 | Huppertz | Sep 2010 | A1 |
20100237245 | King et al. | Sep 2010 | A1 |
20110068272 | Dupont et al. | Mar 2011 | A1 |
20110290986 | Yon | Dec 2011 | A1 |
20110297828 | Weisbach | Dec 2011 | A1 |
20120037805 | Dupont et al. | Feb 2012 | A1 |
20130218500 | Durand | Aug 2013 | A1 |
20140091220 | Li | Apr 2014 | A1 |
20140231651 | Kim | Aug 2014 | A1 |
20140239180 | Vilain | Aug 2014 | A1 |
20150319387 | Saragaglia | Nov 2015 | A1 |
20170089764 | Lee | Mar 2017 | A1 |
20170111015 | Robert | Apr 2017 | A1 |
20170191868 | Kurth | Jul 2017 | A1 |
20170219436 | Simolon et al. | Aug 2017 | A1 |
20180080830 | Daraio | Mar 2018 | A1 |
20190335118 | Simolon | Oct 2019 | A1 |
20190368941 | Aziz | Dec 2019 | A1 |
20190373192 | Cannata | Dec 2019 | A1 |
Number | Date | Country |
---|---|---|
2012101 | Jan 2009 | EP |
2940991 | Nov 2015 | EP |
WO2010125281 | Nov 2010 | WO |
WO2018132743 | Jul 2018 | WO |
Entry |
---|
French Preliminary Search Report and Written Opinion for French Patent Application Publication No. FR1860396, dated Jul. 1, 2019, 9 pages. |
Number | Date | Country | |
---|---|---|---|
20200149972 A1 | May 2020 | US |