The present Application is directed towards a system for providing compensation for filter biased radar data, and more particularly, to a frequency compensation for clutter filter biased radar data.
Weather radar data is critical to providing weather prediction and transportation safety guidance. Echoes from ground clutter can contaminate weather radar data, however, making it difficult to identify sonic weather events.
Ground clutter echo can be caused by anything that doesn't move, or that moves slowly, that a radar beam may encounter. For example, parked cars, buildings, trees, trees swaying due to wind, towers, wires, and terrain and power wires can cause ground clutter echo.
Errors caused by ground clutter echoes can cause air traffic controllers to needlessly reroute planes around nonexistent storms, meteorologists to severely overestimate rainfall, and automated warning systems to generate erroneous flash flood alarms. Ground clutter echoes can further mask ongoing high-impact weather from detection, and generally confound the users of radar data.
Ground clutter echoes tend to have a narrow spectrum width in the Doppler spectrum of the radar echo compared with weather signals, with a mean Doppler velocity of zero. For example,
Prior techniques to remove ground clutter from radar data have included applying a Doppler spectrum notch technique to a frequency domain version of the data. The Doppler spectrum notch technique applies a notch filter to the Doppler spectrum of the radar echo to eliminate the part of the Doppler spectrum around zero velocity. By setting the values around zero velocity to zero, much of the ground clutter may be removed. The desired radar variables may then be calculated from the remaining part of the Doppler spectrum. Using a Doppler spectrum notch filter removes low velocity weather data, however.
Other techniques have applied a clutter filter to the time series radar data. For example, some prior methods have weighted the time series radar data generated from the clutter echo (with possible weather echo overlaid) using a window function such as a von Hann window or a Blackman window. The time series radar data is then converted to the Doppler spectrum using a finite discrete Fourier Transform, and a spectrum notch filter is applied.
Another technique for removing ground clutter signals includes applying a regression filter to the time domain signal. One example of using a regression filter to remove ground clutter is provided by Torres, S. and D. Zrnic, 1999: Ground clutter canceling with a regression filter, J. Atmos. Oceanic Technol., 16, 1364-1372. Regression filters approximate their input signals with polynomial functions in the time domain and rely on the feature that the ground clutter echoes tend to vary slowly in time, whereas weather signals typically vary more rapidly in time. In order to remove the slowly varying ground clutter part of the signal from the time series radar data, a regression curve (i.e., a polynomial fit) is fitted to radar time series that represents a radar resolution volume and then the fitted curve is subtracted from the signal, leaving the rapidly-varying weather signal in the residual data.
One disadvantage to filtering time series radar data to remove clutter is that the filter can attenuate the signal and eliminate some of the information provided by the weather signal that is present, thereby biasing the filtered data. The biasing, or attenuation, which may translate to higher measurement standard deviations for the weather signal, has previously been accepted as a necessary feature when using either a frequency (i.e. Doppler) domain or time domain ground clutter filters.
What is needed is a way to preserve the underlying weather data from the bias caused by various ground clutter filtering techniques, without increasing the standard deviation of the radar variable estimates of the weather signal.
A method for removing ground clutter data from tune series radar data is provided. The method comprises receiving the time series radar data, applying a clutter filter to the time series radar data to generate a filtered time series radar data, applying a discrete Fourier transform to the filtered time series radar data to generate a filtered frequency domain data, determining a filter bias for one or more filter biased frequency domain frequencies of the filtered frequency domain data based on a frequency response of the clutter filter, and correcting the filtered frequency domain data by adding the filter bias to the filtered frequency domain data at the one or more filter biased frequency domain frequencies to generate a filtered and bias corrected frequency domain data.
A system for removing ground clutter data from time series radar data is provided. The system comprises a data receiving module operable to receive time series radar data, a filtering module operable to apply a clutter filter to the time series radar data to generate a filtered time series radar data, a domain transfer module operable to apply a discrete Fourier transform to the filtered time series radar data to generate a filtered frequency domain data, and a bias removing module operable to determine a filter bias for one or more filter biased frequency domain frequencies of the filtered frequency domain data based on a frequency response of the clutter filter, and correct the filtered frequency domain data by adding the filter bias to the filtered frequency domain data at the one or more filter biased frequency domain frequencies to generate a filtered and bias corrected frequency domain data.
The same reference number represents the same element on all drawings. The drawings are not necessarily to scale.
Radars typically conduct a raster scan by performing a first azimuthal scan, increasing or decreasing the elevation angle by 0.5-1.5 degrees, and performing a subsequent azimuthal scan.
At each radar antenna pointing direction in a scan, a radar transmits individual pulses and samples the return signal in time, which corresponds to a distance or range from the radar. Consecutive N samples at a particular range define a radar resolution volume. In this way, a series of resolution volumes over a radial range of depths along the pointing direction of the radar is defined. A typical pencil beam radar may have a 1-degree half power beam width, defining a radial cone, at a fixed azimuth and elevation, over a range of distances from the radar. The typical depth for a radar resolution volume is from 150 meters to 2.5 km. The N samples for a particular radar resolution volume comprise time series radar data for that resolution volume. Thus, for each sample time after the radar pulse, a series of time series is constructed for each resolution volume along the radial range from the radar.
For a Doppler radar, the time series radar data include a real part and an imaginary part, also referred to as the in phase and quadrature parts, or the I and Q parts. These data are used to calculate, for example, the power of the signal, and the Doppler velocity of the signal. The real parts and the imaginary parts may be determined from using a quadrature demodulator, or any other method known to those of skill in the art.
As may be seen in time series radar data 300 and 350, both plots show a relatively slow-changing features on a timescale of 1 to 256 ms. These slow-changing features generally correlate to ground clutter signal. Smaller variations over shorter time periods can he seen on top of the slow varying part. Thus, the time series radar data 300 and 350 each further include more rapidly changing features on a timescale of a few ms, that generally correspond to weather signal and/or noise.
Method 200 continues with step 204. In step 204, a clutter filter is applied to the time series radar data to generate a filtered time series radar data.
A clutter filter is a filter designed to remove clutter from radar data. In embodiments, the clutter filter may comprise any type of filter capable of removing at least some low velocity or slowly changing data from radar data. For example, the clutter filter may comprise in part a von Hann window or a Blackman window, as described above.
In embodiments, the clutter filter may comprise a regression filter. A regression filter is a high-pass filter that approximates an input signal with polynomial functions in the time domain. Because the ground clutter signal varies slowly compared to the weather echo signal in the time series radar data, the ground clutter signal may in some circumstances be approximated with a polynomial of a lower degree than that which would be required of the weather echo signal.
The polynomial fit may be performed by projecting the input signal samples V(t), t∈{tm} onto the subspace W spanned by a basis B consisting of p+1 orthonormal polynomials. This set of polynomials may be given by B={b0(t), b1(t), b2(t), . . . , b p(t)}, where each bi(t)(0≤i≤p) is a polynomial of ith degree; that is, bi(t)=coi+c1it+ . . . +ciiti. Then, the projection {circumflex over (V)}(t) (i.e., the clutter signal) may be obtained by constructing a linear combination of the elements of the basis B, that is, the implication is that {circumflex over (V)}(t) is in W, as given by Equation 1:
{circumflex over (V)}(tm)=Σi=0paibi(tm) (Equation 1)
The residue Vf(tm)=V(tm)={circumflex over (V)}(tm) may therefore be associated with the portion of the input signal that is not contained in the clutter subspace W [i.e., it is orthogonal to {circumflex over (V)}(t)]. The ai coefficients are computed using the formula provided by Equation 2;
where V and bi are vectors of the sampled input signal and the bi(t) polynomials, respectively.
Generalization in this analysis is not lost if each element of B is normalized such that ∥bi∥=1, where ∥bi∥2=(bi, bi). In addition, to simplify the notation the basis matrix B and the coefficient vector A may be defined as given in Equations 3 below:
Then, assuming a normalized base, Eqs. (1) and (2) can be rewritten as {circumflex over (V)}=BTA and A=BV, respectively. Substitution of Equation 2 into Equation 1 produces {circumflex over (V)}=BTBV. The residue or filtered signal Vf may therefore be expressed according to Equation 4:
V
f
=V−{circumflex over (V)}=(I−BTB)V=FV, (Equation 4)
whereb I is the identity matrix and the regression filter matrix is defined by Equation 5:
F=I−B
T
B (Equation 5)
In embodiments, the regression filter F may be linear and time varying.
In the embodiment described above, the polynomial functions utilized by the regression filter F comprise orthogonal polynomial functions. This is not intended to be limiting, however. As those in the art will readily understand, in further examples, the regression filter F may comprise any type of orthogonal polynomial functions known to those of skill. For example, the regression filter F may comprise Legendre polynomials.
In examples, the polynomial fit may be performed using least squares methods or, any other method of fitting an equation to data known to those of skill in the art.
Regression filter F may he applied to the time series radar data to generate a plurality of filtered time series radar data. The filtered time series radar data will include the residual time series radar data with at least a portion of the ground clutter signal removed.
Because the ground clutter signal varies slowly compared to the weather echo signal, in embodiments the ground clutter signal may he approximated with a polynomial of a relatively low degree compared to the faster-varying weather data.
Method 200 continues with step 206. In step 206, a discrete Fourier transform is applied to the filtered time series radar data to generate a filtered frequency domain data. In embodiments, the discrete Fourier transform may comprise a fast Fourier transform.
Method 200 continues with step 208. In step 208, a filter bias is determined for one or more filter biased frequency domain frequencies of the filtered frequency domain data based on a frequency response of the clutter filter. Filter bias is the attenuation of the weather signal due to application of a filter in the time domain. Filter bias is most easily visualized in the frequency domain, where some of the high velocity data outside a range of low clutter frequencies is attenuated.
Because regression filter matrix F depends only on polynomial order p and sample size M, in embodiments regression filter matrix F may be precomputed to achieve a specific notch width for a specific sampling scheme. For a specific notch width and/or sampling scheme, regression matrix F may then he used in real-time applications without being recomputed.
The frequency response may he determined directly from the clutter filter, as will be understood by those of skill, and it also may be used without being recomputed for a polynomial order p and a sample size M. In the particular example where the clutter filter is regression filter F, the clutter filter is linear (matrix multiplication is a linear transformation), time varying, and responds to the general inputoutput equation of the form:
y(t1)=Σm=0M−1f(t1, tm)×(tm); l=0, . . . , M−1 (Equation 6)
where f(t1, tm) are the entries of regression filter F defined in Equation 5.
The frequency response H(ω) of a linear shift-invariant system can be defined as the change in magnitude and phase of a complex exponential signal ejωt, which is passed through the system. More precisely, let x(t) and y(t) be the input and output of the clutter filter whose impulse response is given by h(t). If x(t)=ejωt, then the output y(t) can he obtained by convolving x(t) with h(t), that is,
so that H(ω) describes the frequency response at ω.
As previously stated, a regression filter is time varying. However, the output to a given signal of Mf samples is always the same regardless of when this block of Mf samples is encountered in the filtering process. This feature may he exploited by deriving an expression for the frequency response of the regression filter using Equation 6 in an analogous fashion as Equation 7. That is, considering a regression filter whose input is an exponential of the form eejωt. The output of this filter is:
Then, noting the form of Equation 8, it is possible to define:
H(ω, t1)=F1(−ω)exp[−jωt1] (Equation 9)
where F1(ω)=Σm=0M
Using the results of Equation 5, each entry in regression filter F is given by:
f(tl, tm)=δ(tl−tm)−Σi=0pbi(ti)bi(tm) (Equation 11)
where δ(ω) is the usual discrete-time impulse sequence. The DFT of Equation 11 is:
F
1(ω)=exp[−jωt1]−Σi−0pbi(ti)Bi(ω) (Equation 12)
where Bi(ω) is the DFT of bi(t). Then,
and finally frequency response H(ω) of the regression filter F can be given by:
Because frequency response H(ω) is real, the phase response of regression filter F is constant and we only need to be concerned about its magnitude response. The frequency response H(ω) of the regression filter F depends on the number p of elements in B (i.e., the maximum degree of the polynomials used for approximation) and on the number of samples Mf in each processing block.
As may be seen in the detail of frequency response 700, there will be a bias, or attenuation of signal, based on applying a clutter filter to the time series radar data to the power of the filtered frequency domain data within the passband region 752a, 752b. Because the passband region 752a, 752b includes weather data, but is unlikely to include clutter data, this biasing of data is therefore undesirable, and can lead to a lower signal to noise ratio in the weather data.
The one or more filter biased filter biased frequency domain frequencies comprise frequencies inside the passband 752a, 752b that have a filter bias. For example, as may be seen in
Method 200 continues with step 212. In step 212, the filtered frequency domain data is corrected by adding the filter bias to the filtered frequency domain data at the one or more filter biased frequency domain frequencies to generate a filtered and bias corrected frequency domain data.
For example, the filtered frequency domain data may be corrected by adding the filter bias value of 2 dB to filter biased frequency domain frequency value 756a and a filter bias value of 1.5 db to filter biased frequency domain frequency value 756b, to generate the filtered and bias corrected frequency domain data.
By correcting for filter bias generated when filtering time series radar data for clutter, it may be possible to provide a weather radar data with at least one of a lower standard deviation, or a higher signal to noise ratio. This may provide more robust and accurate weather data.
In examples, method 200 may comprise further steps. For example, method 200 may further comprise steps 210 and 212. In step 210, a passband may be received comprising a frequency range, and in step 212 the filtered frequency domain data may be corrected by adding the filter bias to the filtered frequency domain data at the one or more filter biased frequency domain frequencies to generate the filtered and bias corrected frequency domain data may further comprise determining that the one or more filter biased frequency domain frequencies are within the passband. In embodiments, the passband may comprise the absolute value of the frequency range, as described above.
By clearly defining a passband or a stopband, it may be possible to further improve the accuracy of weather radar data.
In further embodiments, method 200 may further comprise step 214. In step 214, one or more radar variables may be determined from the filtered time series radar data. For example, the one or more radar variables may include the total return power, velocity, spectrum width, differential reflectivity, differential phase, or any other radar variable known to those of skill in the art.
System 800 includes data receiving module 802, filtering module 804, domain transfer module 806, a bias removing module 808. Data receiving module 802 may execute step 202, filtering module 804 may execute step 204, domain transfer module 806 may execute step 206, and bias removing module 808 may execute any of steps 208, 210, or 212, as described above.
In further embodiments. System 800 may further include radar variable determination module 810, which may execute step 214, as described above.
System 800 may further perform any of the variations described above with respect to method 200.
The detailed descriptions of the above embodiments are not exhaustive descriptions of all embodiments contemplated by the inventors to be within the scope of the present description. Indeed, persons skilled in the art will recognize that certain elements of the above-described embodiments may variously be combined or eliminated to create further embodiments, and such further embodiments fall within the scope and teachings of the present description. Accordingly, the scope of the embodiments described above should be determined from the following claims.
This invention was made with Government support under awards 20140711 awarded by the National Oceanic and Atmospheric Administration. The United States Government has certain rights in this invention.