This invention relates generally to state estimation after processing measurements with time delays from multiple sensors of systems characterized by state variables and by multidimensional parameters, for which the latter are unknown and may vary arbitrarily in time within known physical bounds. In a particular aspect, the invention relates to the tracking of moving targets using estimation, which takes into consideration delays in reporting measurements from multiple sources, measurement errors, and physical bounds or limits on parameters of the target track.
State-of-the-art tracking systems utilize measurements fed to a processing site from multiple sensors. These sensors may have different measuring accuracies and may be geographically dispersed over a region of interest. Availability of reliable high bandwidth communication media allows such a topology of distributed multiple sensors for real-time processing of the measurements.
In spite of today's high bandwidth and fast switching communication network, physical distances, path diversity and relays may result in different delays from various sensors to the processing site. Let a sensor S1 measure a tracked object at time t1 and a sensor S2 measure that same object at time t2 where t2>t1. It is possible that the measurement from sensor S1 may arrive many sampling intervals after the measurement from sensor S2 has already been processed. A simple decision methodology is to throw out the late-arriving measurement from sensor S1, and not process it at all. However, if sensor S1 is the more accurate sensor, this methodology does not make good use of that sensor.
A difficulty is that accounting for measurements received out of sequence, as frequently happens in situations of multiple sensor tracking with variable communication delays between sensors, greatly complicates the design of a Kalman filter, particularly when more than one subsequent measurement is processed before an out-of-sequence measurement is received as indicated in Y. Bar-Shalom, “Update with Out-of-Sequence Measurements in Tracking: Exact Solution,” IEEE Transactions on Aerospace and Electronic Systems, pp. 769–778, Vol. AES-38, No. 3, July 2002, J. R. Moore and W. D. Blair, “Practical Aspects of Multisensor Tracking,” in Multitarget-Multisensor Tracking: Applications and Advances, Volume III, Y. Bar-Shalom and William Dale Blair, (ed.), Boston, Mass.: Artech House, 2000, pp. 43–44, and Portmann, Moore, and Bath. Currently, even with rapid communications, delays of up to one second are not uncommon. As described below, even such small delays may have a significant effect on multisensor fusion tracking performance. Unlike smoothing and filtering, “how to update the current state estimate with an “older” measurement is a nonstandard estimation problem” as quoted from Y. Bar-Shalom, M. Mallick, H. Chen, and R. Washburn, “One-Step Solution for the General Out-of-Sequence-Measurement Problem in Tracking,” Proceedings of 2002 IEEE Aerospace Conference Proceedings, Volume 4, pp. 1551–1559, March 2002. No one definitive approach has yet been developed for this. The above is the opinion of Y. Bar-Shalom; Y. Bar-Shalom, M. Mallick, H. Chen, and R. Washburn; S. Challa and J. A. Legg, “Track-to-Track Fusion of Out-of-Sequence Tracks,” Proceedings of the Fifth International Conference on Information Fusion, pp. 919–926, July 2002; S. Challa, R. J. Evans, X. Wang, and J. Legg, “A Fixed-Lag Smoothing Solution to Out-of-Sequence Information Fusion Problems,” Communications in Information and Systems, pp. 325–348, Vol. 2, No. 4, December 2002; M. L. Hernandez, A. D. Marrs, S. Maskell, and M. R. Orton, “Tracking and fusion for wireless sensor networks,” Proceedings of the Fifth International Conference on Information Fusion, Vol. 2, pp. 1023–1029, July 2002; M. Ito, S. Tsujimichi, and Y. Kosuge, “Target Tracking with Time-Delayed Data in Multiple Radar System,” Proceedings of the 37th SICE Annual Conference, pp. 939–944, July 1998; J. R. Moore and W. D. Blair; M. Mallick, S. Coraluppi, and C. Carthel, “Advances in Asynchronous and Decentralized Estimation,” Proceedings of 2001 IEEE Aerospace Conference Proceedings, Vol. 4, pp. 1873–1888, March 2001; M. Mallick, J. Krant, and Y. Bar-Shalom, “Multi-sensor Multi-target Tracking using Out-of-sequence Measurements,” Proceedings of the Fifth International Conference on Information Fusion, Vol. 1, pp. 135–142, July 2002. This is particularly true when it is desired that during target maneuvers, the state estimate at the time of the current update (as opposed to at the past time of the “older” measurement, as in smoothing) have minimal covariance.
Filters without plant noise can optimally process out-of-sequence measurements in the order that they are received as stated by G. J. Portmann, J. R. Moore, and W. G. Bath supra. An optimal reduced state estimator has been developed that approximates the higher derivatives of target motion with constant parameters belonging to a multivariate Gaussian distribution as in the patent application entitled “REDUCED STATE ESTIMATOR FOR SYSTEMS WITH PHYSICALLY BOUNDED PARAMETERS,” filed Mar. 16, 2005, in the names of P. Mookerjee and F. Reifler. This estimator does not need the white plant noise required by Kalman filter to cope with the reduced state. Among all estimators (including reduced state Kalman filters) with the same reduced states, the optimal reduced state estimator has minimal covariance. This covariance is the minimal covariance achievable by linearly weighting the predicted states with a new measurement at each successive update of the filter. Since parameter uncertainty is included in the total error covariance that is minimized, the optimal reduced state estimator does not need white plant noise to cope with the reduced state.
Algorithms in the prior art are based on the Kalman filter. These algorithms either set the white process noise to zero while processing an out-of-sequence measurement (which does not achieve good performance), or using a non-zero white process noise, provide solutions for processing measurements which are late by at most a few update intervals. No algorithm exists in the prior art for providing an optimal solution when delays occur that are longer than a few update intervals. It is common, however, that delays may be large such as ten or more update intervals, which the current algorithms do not address.
In the prior art, the solutions are approximate as stated in P. J. Lanzkron and Y. Bar-Shalom, “A Two-Step Method for Out-Of-Sequence Measurements,” Proceedings of the IEEE Aerospace Conference, Big Sky, Mont., March 2004, pp. 2036–2041. These approximations are not available for delays larger than a few update intervals.
Improved or alternative estimators are desired for coping with out-of-sequence measurements that are late by a number of update intervals.
In general, the invention relates to state estimation derived from measurements from multiple sensors with time delays. The invention is particularly applicable to state estimation when some measurements arrive late by large number of update intervals, which may be as much as ten, or even more intervals late.
A method according to an aspect of the invention is for recursively estimating the state of a system having multidimensional parameters in addition to state variables, which parameters are unknown, arbitrarily time-varying, except for known bounded values. For example, the turn rate and tangential acceleration of an aircraft are multidimensional arbitrarily time-varying parameters that have known bounds, in addition to the state of the aircraft given by its position and velocity. Said state estimates are derived from measurements subject to time delays and measurement errors. The state estimates are used to make decisions or to operate a control system or to control a process.
A method according to another aspect of the invention is for estimating the state of a system comprising the steps of observing a system having state variables and also having unknown, multidimensional, arbitrarily time-varying parameters, but which are subject to known bounded values and driven by a time-varying input function that depends on the states, and multidimensional parameters, measuring certain aspects of the state of the system in the presence of measurement errors to produce initial measurements, initializing state estimates and matrices using a priori information and the initial measurements. Then, the update interval is used in determining the system transition matrices and the mean value of unknown but bounded parameters and the input vector.
A method according to another aspect of the invention is determining if the measurement is time-late by testing the sign of the update interval. If the measurement is time-late, apply the measurement to an out-of-sequence estimating filter that explicitly uses a mean square optimization criterion that separately accounts for measurement errors and said bounding values, as well as the delay time, to produce estimates of the true state of the system. If the measurement is not time-late, apply the measurement to an in-sequence estimating filter that explicitly uses a mean square optimization criterion that separately accounts for measurement errors and said bounding values, to produce estimates of the true state of the system. The said estimates are applied to one of (a) make a decision relating to said system, (b) operate a control system, and (c) control a process.
An aspect of the invention relates to estimating the state of a system having multidimensional parameters λ in addition to state variables x(k) at time tk for k=1,2,3, . . . , which parameters λ are unknown, arbitrarily time-varying, but bounded, and driven by the nonlinear input function u(x(k),λ) and governed by the state equation
x(k+1)=Φx(k)+Γu(x(k),λ) (1)
where Φ,Γ are system matrices dependent on the discrete time interval T=tk+1−tk.
Another aspect of the invention relates to measuring aspects of the state of the system governed by the measurement equation
z(k)=Hx(k)+n(k) (2)
where n(k) is the measurement noise with covariance N and measurement matrix H at time tk for k=1,2,3, . . . .
The method comprises the steps of:
The solution of the problem of state estimation after processing measurements with time delays from multiple sensors of systems characterized by state variables and by multidimensional parameters, for which the latter are unknown and may vary arbitrarily in time within known physical bounds requires a completely different method, which is incorporated in an aspect of the invention. The simplified logic flow chart or diagram 200 of
The logic of the invention then flows to a further block 214, which represents calculating the update interval according to
T=tk+1−t (29)
and determining the system transition matrices Φ,Γ, and the mean value {overscore (λ)} of unknown but bounded parameters λ and also the input vector u({circumflex over (x)}(t|k),{overscore (λ)}). Note that for the update interval T=tk+1−t, the time t denotes the time when the filter was last updated, whereas tk+1 is the time of the new measurement, which can be prior to t due to delay. For this case T<0. If there is no delay, then usually t=tk, the time of the previous measurement. For this case T≧0.
From block 214 of
In decision block 218 the latency of the measurement is determined by testing the sign of the update interval, i.e., T<0.
If T<0, the logic of the invention then flows from decision block 218 by way of the YES output and a path 219 to a block 220, in which the matrices F and G are calculated according to
From block 220, the logic of the invention of
From block 222 of
{circumflex over (x)}(k+1|k)=Φ{circumflex over (x)}(t|k)+Γu({circumflex over (x)}(t|k),{overscore (λ)}) (32)
M(k+1|k)=FM(t|k)F′ (33)
D(k+1|k)=FD(t|k)+G (34)
and the calculation of the state covariance S(k+1|k) according to
S(k+1|k)=M(k+1|k)+D(k+1|k)ΛD(k+1|k)′ (35)
Thus, there are several differences between the invention herein as exemplified in
From block 224 of
Q=HS(k+1|k)H′+N (36)
The filter gain matrix K is calculated as
K=[M(t|k)F′+D(t|k)ΛD(k+1|k)′]H′Q−1 (37)
and the matrix L is calculated as
L=I−KHF (38)
where I is the identity matrix.
The logic flows from block 228 of
{circumflex over (x)}(t|k+1)={circumflex over (x)}(t|k)+K[z(k+1)−H{circumflex over (x)}(k+1|k)] (39)
The matrices M(t|k+1) and D(t|k+1) are calculated as
M(t|k+1)=LM(t|k)L′+KNK′ (40)
and
D(t|k+1)=D(t|k)−KHD(k+1k) (41)
respectively. Finally, the matrix of the total covariance S(t|k+1) is calculated as
S(t|k+1)=M(t|k+1)+D(t|k+1)ΛD(t|k+1)′ (42)
and equation (42) represents a mean-square criterion which may be used for a root-mean-square determination. The logic of
Returning now to decision block 218 of
From block 232 of
From block 234 of
{circumflex over (x)}(k+1|k)=Φ{circumflex over (x)}(k|k)+Γu({circumflex over (x)}(k|k),{overscore (λ)}) (45)
M(k+1|k)=FM(k|k)F′ (46)
D(k+1|k)=FD(k|k)+G (47)
and the calculation of the state covariance S(k+1|k) according to
S(k+1|k)=M(k+1|k)+D(k+1|k)ΛD(k+1|k)′ (48)
Thus, another difference between the invention herein and the prior art is that the prior art Kalman filter extrapolates state estimate {circumflex over (x)}(k|k) and state covariance S(k|k) to {circumflex over (x)}(k+1|k) and S(k+1|k), while the current invention extrapolates state estimate {circumflex over (x)}(k|k) and matrices M(k|k),D(k|k) to {circumflex over (x)}(k+1|k) and M(k+1|k),D(k+1|k) respectively.
From block 236 of
Q=HS(k+1|k)H′+N (49)
The filter gain matrix K is calculated as
K=S(k+1|k)H′Q−1 (50)
and the matrix L is calculated as
L=I−KH (51)
where I is the identity matrix.
The logic flows from block 240 of
{circumflex over (x)}(k+1|k+1)={circumflex over (x)}(k+1|k)+K[z(k+1)−H{circumflex over (x)}(k+1|k)] (52)
The matrices M(k+1|k) and D(k+1|k) are calculated as
M(k+1|k+1)=LM(k+1|k)L′+KNK′ (53)
and
D(k+1|k+1)=LD(k+1|k) (54)
respectively. Finally, the matrix of the total covariance S(k+1|k+1) is calculated as
S(k+1|k+1)=M(k+1|k+1)+D(k+1|k+1)ΛD(k+1|k+1)′ (55)
The logic leaves block 242 of
The calculations associated with block 236 of
A salient difference between the prior-art method and that of the invention is the introduction into the equations defining a multidimensional state estimation error covariance denoted above as M(j|k), attributable to measurement error and D(j|k)ΛD(j|k)′, representing the physical bounds of the parameters, and propagating certain coefficients (denoted as D(k|k) and D(k+1|k)). The matrix M(j|k) is defined as the covariance of the state estimation errors at time tj due only to the errors in the measurements z(i) for 1≦i≦k and a priori initial information that is independent of the parameter uncertainty. D(j|k) is defined as the matrix of bias coefficients, which linearly relates state estimation errors to the parameter errors, at time tj (after processing k=0,1,2, . . . measurements). The article by Portmann, Moore, and Bath 1990 mentions, “The optimum approach is to reorder the measurements in time and reprocess them in time order. If the measurements are badly scrambled, however, this can significantly increase the computational burden of the filter and may not be an option open to the filter designer. The SCF filter can be modified to produce a suboptimal estimate for a measurement out of time sequence which requires little more computation than for a measurement in time sequence. The criteria for optimality is somewhat different from that described in the preceding sections, but the form of the filter is very nearly the same.” No algorithm is provided in their article supporting the abovementioned statements.
Thus, the invention uses a novel mean-square optimization criterion (equation (42) or (48)) which explicitly addresses the known physical bounds of the multidimensional parameters, and incorporates analytical modeling of the parameter bounds, whose modeling may be as precise as knowledge of the boundary values permits. The invention provides an exact implementable recursive solution that optimizes the mean-square criterion.
Number | Name | Date | Kind |
---|---|---|---|
4179696 | Quesinberry et al. | Dec 1979 | A |
20050128138 | McCabe et al. | Jun 2005 | A1 |
20050179580 | Cong et al. | Aug 2005 | A1 |