The present invention concerns with automatic detection of fires on Earth's surface and of atmospheric phenomena such as clouds, veils, fog or the like, by means of a satellite system, in particular by exploiting multi-spectral data acquired by multi-spectral sensors of a geostationary or polar satellite system.
As is known, multi-spectral images are images acquired by Remote Sensing (RS) radiometers, each acquiring a digital image (in remote sensing, called a scene) in a small band of visible spectra, ranging from 0.4 μm to 0.7 μm, called red-green-blue (RGB) region, and going to infra-red wavelengths of 0.7 μm to 10 or more μm, classified as NIR (Near InfraRed), MIR (Middle InfraRed), FIR (Far InfraRed) or TIR (Thermal InfraRed). A multi-spectral image is hence a collection of several single-spectral (single-band or monochrome) images of the same scene, each taken with a sensor sensitive to a different wavelength.
Different fire detection techniques, based on threshold criteria and contextual algorithms, have been developed for multi-spectral polar sensors and, in the last years, for geostationary sensors. For a detailed discussion of these techniques reference may, for example, be made to Kaufman, Y. J., Justice, C. O., Flynn, L. P. Kendal, J. D., Prins, E. M., Giglio, L. Ward, D. E. Menzel, W. P. and Setzer, A. W., 1998, Potential global fire monitoring from EOS-MODIS, Journal of Geophysical Research, 103, 32215-32238, and Giglio, L., Descloitres, J., Justice, C. O.& Kaufman, Y. J. (2003), An enhanced contextual fire detection algorithm for MODIS, Rem. Sen. Environment, 87:273-282.
Multi-spectral sensors on polar satellites are characterized by a relatively high spatial resolution, but, due to the long revisit time of polar satellites, the promptness needed for effective fire detection purposes cannot be achieved, even combining all existing multi-spectral polar sensors. On the contrary, multi-spectral geostationary sensors provide very frequent acquisitions, e.g. every 15 minutes for the MSG SEVIRI (Spinning Enhanced Visible and Infra Red Imager) sensor, though characterized by a lower spatial resolution (3×3 km2 and above for infrared channels), which could prevent small fires from being detected.
In order to overcome the spatial resolution limitations, a physical model-based approach for sub-pixel fires detection from geostationary sensors data was recently proposed by E. Cisbani, A. Bartoloni, M. Marchese, G. Elisei, A. Salvati, Early fire detection system based on multi-temporal images of geostationary and polar satellites, IGARSS 2002, Toronto, 2002, and Calle, A., Casanova, J. L., Moclan, C., Romo, A. J., Costantini, M., Cisbani, E., Zavagli, M., Greco, B., Latest Algorithms and Scientific Developments for Forest Fire Detection and Monitoring Using MSG/SEVIRI and MODIS Sensors, IEEE, 2005, 118-123.
In particular, an analytic Radiative Transfer Model (RTM) is proposed which characterizes the radiative phenomena that determine the sensor-detected energy, expressed by means of radiances Rλ (W/m2/sr/μm) for each band λ in atmospherically transparent windows in Near Infrared (NIR), Middle Infrared (MIR) and Thermal Infrared (TIR) spectral regions. As shown in
R
λ=ελτλBλ(TB)+RA; λ+RS; λ, (1)
where, Bλ(T) is the Planck black-body emission at temperature T and wavelength λ. Other RTM models can be exploited as well.
According to C. C. Borel, W. B. Clodius, J. J. Szymanski and J. P. Theiler, Comparing Robust and Physics-Based Sea Surface Temperature Retrievals for High Resolution, Multi-Spectral Thermal Sensors Using one or Multiple Looks, Proc. of the SPIE'99, Conf. 3717-09, the main contribution to the transmittance τλ in the atmospheric windows in the NIR and TIR regions comes from the atmospheric water vapor content and the relations between transmittance and water vapor can be quite appropriately be parameterized by the following expression:
where W is the total water vapour along the path ending/starting at/from the examined pixel and having a zenith angle θ. Parameters Aλ, Bλ and Cλ depend (at least) on the wavelength λ and can be estimated via several MODTRAN (MODerate resolution atmospheric TRANsmission) simulations (computer program designed to model atmospheric propagation of electromagnetic radiation from 100-50000 cm−1 with a spectral resolution of 1 cm−1) and regression methods. Other models/methods to estimate τλ can be considered.
The water vapour W content can be estimated as described in Eumetsat Satellite Application Facility, Software Users Manual of the SAFNWC/MSG: Scientific part for the PGE06, SAF/NWC/INM/SCI/SUM/06, issue 1.0, January 2002, but other methods can be considered.
The solar term RS,λ can be calculated as described in the aforementioned Potential global fire monitoring from EOS-MODIS:
where the ES,λ is the Sun radiance at the top of the atmosphere, τλ (zsE) is the transmittance along the path between Sun and Earth's surface, τλ (zED) is the transmittance along the path between Earth's surface and satellite sensor, and επ is the emissivity of the Earth's surface. Other models/methods can be exploited to calculate RS,λ.
The atmospheric radiance contribution RA,λ describes a complex phenomenon, characterized by smoke, aerosol, and local atmospheric temperatures hard to be modelled. A possible model is the following:
where, referring to
The Dozier formulation as described in J. Dozier, A Method for satellite identification of surface temperature fields of subpixel resolution, Remote Sensing of Environment, 11 (1981) 221-229 and applied to equation (1) (or to other RTM models) makes a sub-pixel description of the radiative process possible, considering the fire extension (pixel fraction f of a pixel of radiance acquired by the satellite sensor) and fire temperature TF:
R
λ=εF; λ·τλ·Bλ(TF)·f+εB; λ·τλ·Bλ(TB)·(1−f)+RA; λ+TS; λ, (5)
where εF,λ and εB,λ are the fire and the background emissivities, respectively, at the wavelength λ.
According to the aforementioned Early fire detection system based on multi-temporal images of geostationary and polar satellites, if two successive acquisitions are considered, the Dozier formulation (5) can be written as follows:
ΔRλ,t≡Rλ,t−Rλ,t-Δt=ελ·τλ,t·[Bλ(TF)−Bλ(TB)]·Δf (6)
where t and t−Δt denote two close acquisition times, and Δf=ft−ft-Δt, and where the following assumptions are done:
The introduced RTM (1) and equations (2), (3), (4), (5), (6) are reliable only if no clouds are in the analyzed scene. Therefore, a reliable cloud masking procedure is necessary to identify the acquisitions that are compatible with the physical model assumptions. Many techniques have been developed for cloud masking by exploiting polar or geostationary sensors. Basically, all these techniques are based on the application of threshold criteria to analytic relations among the different bands of a single acquisition. Methods to retrieve such relations among the spectral bands can be based on physical models or on learning methods based on neural networks, Bayesian networks, support vector machines, all of which require a pre-processing phase for the system training. Also contextual techniques that exploit the spatial information are known in literature.
The Applicant has noticed that the analysis disclosed in the aforementioned Early fire detection system based on multi-temporal images of geostationary and polar satellites and represented by the equation (6), where two successive acquisitions are exploited, suffers from rough approximations and strong restrictions which lead to unsatisfactory results for reliable applications. In particular, while the atmospheric contribution in the RTM can be considered slowly changing with time, the estimation of the atmospheric contribution RA,λ given by equation (4) in combination with equation (2) in the RTM is affected by a large uncertainty due to noise and model inaccuracy, and the non-linear form of the model given by equation (5) amplifies this uncertainty, so making the estimation of the fire parameters unreliable.
Moreover, the Applicant has also noticed that, at each new acquisition, the equation (6) is solved and Δf, TF and TB are estimated without exploiting previously computed results, i.e. Δf, TF and TB computed for the previous acquisitions.
The objective of present invention is to provide an improved automatic technique for fire detection from geostationary satellite multi-spectral data which overcomes the limitations of the known techniques.
This objective is achieved by the present invention in that it relates to a method for automatically detecting fires on Earth's surface and atmospheric phenomena such as clouds, veils, fog or the like, by means of a satellite system, as defined in the appended claims.
The present invention stems from the observation by the Applicant that many physical quantities in equation (1), such as the atmospheric contribution RA,λ, the solar contribution RS,λ, the transmittances τλ and the emissivities ελ are highly temporally correlated. For this reason, knowledge and exploitation of many acquisitions of the same scene allows information of interest, such as fires, clouds and physical parameters estimations, to be retrieved with an higher accuracy and robustness than considering only one or two acquisitions.
In particular, the present invention achieves the aforementioned objective by exploiting, in addition to spectral and spatial information, also temporal information contained in the very frequent acquisitions made by the geostationary sensors, in order to detect even small fires (much smaller than the sensor spatial resolution), and clouds with robustness and accuracy. Preferably, the present invention is based on the combined use of a physical model of the radiative transfer process and a purely mathematical adaptive predictive algorithm to invert (solve) the RTM described by equations (1) and (5) exploiting a high number of acquisitions, much more than two. With respect to the technique based on equation (6), this inversion technique based on many acquisitions and on spectral and spatial information allows the physical parameters of interest to be estimated with higher accuracy and robustness.
For a better understanding of the present invention, preferred embodiments, which are intended purely by way of example and are not to be construed as limiting, will now be described with reference to the attached drawings (all not to scale), wherein:
a) shows schematically different contributions to the radiance acquired by a satellite sensor;
b) shows the geometry of the down-welling thermal radiance emitted by the atmosphere;
a) shows radiances of a region of the Earth with successive fire activities acquired by MSG/SEVIRI sensor during a day;
b) and 2(c) show estimated background temperature and fire extension, respectively, in the region of the Earth of
a) and 3(b) show plots of radiances of a region of the Earth measured and predicted according to a primary aspect of the present invention;
The following description is aimed at enabling a person skilled in the art to make and use the invention. Various modifications to the embodiments will be readily apparent to those skilled in the art, without departing from the scope of the present invention as claimed. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein and defined in the appended claims.
In order to improve the reliability of the estimation of the fire parameters, according to a secondary aspect of the present invention a differential or, more precisely, a finite difference form of the Dozier RTM is conveniently used, where differences of the radiances between two acquisitions at close times are considered:
ΔRλ,t≡Rλ,t−Rλ,t-Δt=εF,λ·τλ,t·Bλ(TF)·[ft−ft-Δt]++εB,λ·τλ,t·[Bλ(TB,t)·(1−ft)−Bλ(TB,t-Δt)·(1−ft-Δt)]+RS,λ,t−RS,λ,t-Δt (7)
In equation (7), the atmospheric term RA,λ has been neglected because assumed unchanged within few acquisitions (order of tens of minutes). Moreover, since different bands are considered, the spectrally uncorrelated part of the disturbances is filtered out in the solution of (7). This equation can be considered for SEVIRI channels in the atmospheric windows in order to form a solvable equation system.
In order to remove the rough approximations affecting equation (6) and the assumptions on which it is based, several parameters have been introduced. Indeed, the ground temperatures TB,t and TB,t-Δt at different times are considered different, the solar terms RS,λ,t and RS,λ,t-Δt are not neglected, and the fire and ground emissivities εFλ and εB,λ are considered different.
Equation (7) has more unknown quantities than equation (6) and can be solved by means of a dynamic system approach. Indeed, the differential (or finite difference) Dozier RTM equation (7) can be considered as a dynamic system with the state variables ft and TB,t:
where t and t−Δt denote two close acquisition times, ΔRλ,t=Rλ,t−Rλ,t-Δt, ΔRS,λ,t=RS,λ,t−RS,λ,t-Δt, and Λ is a set of wavelengths corresponding to the channels available in the atmospheric windows.
The dynamic equation (8) describes the time dynamic behavior of the Dozier RTM, where the quantities at the time t (ft and TB,t) can be estimated by means of the knowledge of the quantities calculated at the previous time t−Δt. In particular, for instance, the solar term can be calculated by means of equation (3) and emissivities as described in the aforementioned Early fire detection system based on multi-temporal images of geostationary and polar satellites, but other method/models can be considered. The transmittance, for instance, can be estimated by means of a parameterization similar to that in equation (2). Sensitivity analysis of equation (8) and test on real data has shown that the fire temperature TF can be considered fixed (for instance at about 700° K) in order to increase the accuracy of the pixel fraction estimation. However, the fire temperature TF could be considered as an unknown quantity, so further generalizing the dynamic equation (8).
The dynamic system approach expressed in equation (8) represents a physical model of the radiative transfer process.
The introduction of further unknown quantities, as shown in equation (7), and the use of the dynamic system approach shown in equation (8) allows the pixel fraction and background temperature to be estimated with higher accuracy and robustness with respect to the approach based on equation (6).
At each acquisition, at least two bands are needed to solve equation (8) and to estimate the state variables ft and TB,t. If further channels are available, their exploitation makes the solution more accurate. The MIR channel (3.9 μm wavelength) is particularly sensitive to the presence of fires and it is used in every algorithm for fire detection from remote sensors. Unfortunately, in the SEVIRI sensor the MIR channel has a low saturation level that does not allow its use for monitoring large fires. Equation (8) can be solved even if the MIR channel cannot be used because saturated. Moreover, the solution of equation (8) is particularly robust to data gaps, occurring when some acquisitions are missing or cannot be used due to cloud coverage. In fact, the fire parameters can be still estimated by using sufficiently close acquisitions instead of two consecutive ones.
The accuracy of estimation of the pixel fraction ft can be notably improved if oscillations with daily period are suppressed with a high-pass filter. This filtering is performed by removing from the last pixel fraction estimated by equation (8) the average of the previous consecutive N available pixel fractions (for instance 5 pixel fractions are enough):
The filtered pixel fraction is usefully exploited for fire detection. In fact, the accuracy of the filtered pixel fraction estimation obtained by using four bands of the SEVIRI/MSG sensor (1 MIR and 3 TIR channels) in the atmospheric windows is about 10−5.
a) shows the SEVIRI radiances (brightness temperature of the middle infrared and thermal infrared bands 3.9 μm, 8.7 μm, 10.8 μm, 12 μm) acquired during about a day in a pixel with successive fire activities, while FIGS. 2(b) and 2(c) show the corresponding estimated background temperature and the estimated pixel fraction, respectively.
A fire is detected when the filtered pixel fraction is above a given threshold. A good compromise between probabilities of detection and of false alarm has been obtained with a threshold that corresponds to an active fire size of about 2000 m2 using MSG/SEVIRI data.
As previously said, accuracy of the estimation of the fire parameters and detection and false alarm performances are significantly reduced when clouds, cloud borders, thin clouds, veils, fog (or the like) and low transmittance atmospheric conditions arise. A reliable cloud masking procedure is necessary to identify the acquisitions that are compatible with the physical model assumptions.
In order to recognize these unfavorable atmospheric conditions, according to a primary aspect of the present invention an adaptive predictive algorithm is proposed which exploits the temporal information and correlations contained in a high number of acquisitions in order to detect clouds and fires.
The idea is that radiances vary slowly during a day and have an intrinsic periodicity of about one day, while the presence of clouds and/or fires adds high frequency oscillations, which also include data gaps. Quasi-periodicity of observed radiances during a clear-sky day without fires can be modeled by using few harmonic functions, and the model needs to be adapted in order to follow seasonal and other slow variations.
In particular, the adaptive predictive algorithm allows realizing an adaptive predictive model, wherein, exploiting SEVIRI/MSG data, a 24-hour spectral radiance sequence made up of a plurality of acquisitions at 96 acquisition times (every 15 minutes) is considered. The model is based on the estimation and filtering of the spectrum of the 24-hours spectral radiance sequence. The spectrum is evaluated by means of a Discrete Fourier Transform; then a low pass filter selects the harmonics of interest and, finally, the low-pass filtered signal is back-transformed. The adaptive predictive model is the back-transformed, low-pass filtered signal which is able to provide radiance predicted values.
In the following the adaptive predictive algorithm will be described step by step.
The first step consists of forming, for each pixel, a vector hλ (hλ(n), n=0, . . . , 95) containing a sequence of 96 time-consecutive spectral radiances Rλ relating to 24 hours and not necessarily acquired during the very same day. Should some acquisitions be unavailable, the relative spectral radiances may be computed by interpolation based on adjacent acquisitions.
In fact, for each pixel, several radiances acquired by the satellite sensor at different times and not affected by clouds or fires are needed.
In particular, the vector hλ may be conveniently formed by considering several neighbouring days. A clouds-free acquisition for each vector element can be recognized as the one assuming the maximum spectral radiance value in a TIR band among those corresponding to the same vector element in the considered days.
An analogous criterion is adopted to recognize fire-free acquisitions in a MIR band. A fire-free acquisition for each clouds-free vector element already selected can be recognized as the one assuming the minimum spectral radiance value in a MIR band among those corresponding to the same vector element in the considered days.
The second step of the adaptive predictive algorithm consists of computing the Discrete Fourier Transform (DFT) of the vector hλ, thus obtaining a vector Hλ with 96 elements defined as:
The third step consists of computing the adaptive predictive model associated to the λ μm band. The adaptive predictive model is a vector mλ made up of 96 elements and defined as:
In particular, mλ is the Inverse Discrete Fourier Transform of the low-pass filtered Discrete Fourier Transform of the vector hλ. The low-pass filter selects the continuous component (harmonic 0) and the first A harmonics (harmonic 1, 2, . . . , A) of the Discrete Fourier Transform of the vector hλ. For instance, with A=2, the model is reliable enough to fit a non-cloudy radiance trend during 24 hours.
Each nth sample of the model mλ contains the predicted value for the spectral radiance acquired at a given time of the day. For this reason, it is necessary to store the index
The fourth step of the adaptive predictive algorithm is the cloud/fire detection which consists of checking if the predicted spectral radiance RPRD,λ differs from the corresponding acquired spectral radiance Rλ using some thresholds. The cloud detection considers data acquired at 10.8 μm or at the 12.0 μm, while the fire detection considers data acquired at 3.9 μm.
In particular, the thresholds used in such detection procedure are three. The first one thDET,10.8 and the second one thDET,12 are used for the cloud detection allowing the comparison between the predicted values at 10.8 μm or at 12 μm and the spectral radiances acquired in such bands. The third threshold thDET,3.9 is used for the fire detection in a similar way in the band 3.9 μm.
More in detail, comparing the predicted value RPRD,λ with the acquired spectral radiance Rλ, a cloud is detected
and a fire is detected, also if a cloud has been detected,
The adaptive predictive algorithm is able to correctly detect two different types of clouds: thick and thin clouds.
a) and 3(b) show plots of radiances measured and predicted according to the adaptive predictive algorithm during cloudy days. In particular, in
The fifth step of the adaptive predictive algorithm consists of updating the vector hλ in order to follow seasonal and other slow variations of the radiances. If an acquisition is valid and it is not identified as a fire or a cloud, it is used to update the vector hλ. Also in this procedure three thresholds, thUPD,10.8, thUPD,12 and thUPD,3.9, are used to identify valid data to be used for updating the vector hλ.
In particular, acquired radiances R10.8, R12 and R3.9 are considered valid if no anomalies are detected:
If the current radiance Rλ is valid, it replaces in the vector hλ the radiance contained in the position
At each new acquisition, the pointer
Note that the algorithm can be generalized and the tests on the validity of the radiances or on the presence of fires or clouds can be applied also to acquisitions at times before the last one, in order to refine previously obtained results based also on the new data as they become available.
The adaptive predictive model has high tracking capabilities even with long time acquisitions series affected by cloud coverage or missing data.
The adaptive predictive algorithm is used as a pre-processing step to determine when physical model can be applied. If no clouds are detected by the adaptive predictive algorithm in the analyzed pixel, along with the adaptive predictive model also the physical model can be exploited in order to detect fires and estimate the fire size (pixel fraction ft) and the background temperature TB; otherwise, when clouds cover the analyzed pixel, only the adaptive predictive algorithm can still detect powerful fires. An example of this second case is shown in
A validation of the automatic fires detection method hereby disclosed has been performed using ground truth data relative to the Italian regions Sardinia, Lazio and Calabria, provided by the Italian Civil Protection Department. Two periods of 15 consecutive days in July 2004 and 15 consecutive days in August 2005 have been considered. These periods were characterized by not very cloudy days and a lot of occurrences of fires, in particular 286 fires occurred in areas greater than one hectare.
The validation has been carried out comparing the results obtained by the automatic fires detection method and the ground truth data. In particular, the fires have been classified in five groups depending on the size of the burned area as reported in the ground truth data. Concerning this, it is important to note that the automatic fires detection method detects the size of the flame frontline, which is the size of the real active fire and is much smaller than the overall burned area, while ground truth data reported only the overall burned area size.
For each burned area size class the probability of detection has been estimated as the detection rate: Pd=NTP/(NTP+NFN), where NTP is the number of true positive cases and NFN the number of the false negative ones. The results are reported in the table shown in
The probability of false alarm does not depend on the fire size, in fact the estimation found in the performed validation has been Pfa=5.36·10−6, that means only 5 pixels per million erroneously detected as fires.
Another interesting index of the reliability of the automatic fires detection method is the false detection rate, defined as Pfd=NFP/(NFP+NTP). This quantity depends on the estimated fire size, i.e. on the estimated pixel fraction (ft). In
From the foregoing, it may be immediately appreciated that the automatic fires detection method hereby disclosed allows to perform a reliable and robust fire detection both in presence and in absence of clouds. In particular, in absence of clouds covering the analyzed pixel, the method is able to reliably detect a fire and estimate the fire size and the background temperature, while, in presence of thin clouds, it is still able to detect fires. Moreover, the adaptive predictive algorithm is able to correctly detect the presence of thin and thick clouds in the analyzed pixel.
Finally, it is clear that numerous modifications and variants can be made to the present invention, all falling within the scope of the invention, as defined in the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
06118139.6 | Jul 2006 | EP | regional |
The following documents are incorporated herein by reference as if fully set forth: U.S. patent application Ser. No. 12/375,381, filed Jul. 1, 2009; PCT/EP2007/057802, filed Jul. 27, 2007; European Patent Application No. 06118139.6, filed Jul. 28, 2006.
Number | Date | Country | |
---|---|---|---|
Parent | 12375381 | Jul 2009 | US |
Child | 13743506 | US |