The following disclosure relates generally to cognitive learning using various sensor types and, more particularly, to likelihood tracking for online parameter distribution learning and scoring.
In modern electronic warfare (EW) situations, there is a decreasing amount of reliable a priori information about emitter characteristics due to the increasing complexity and agility of modern emitters. For example, an aircraft flying over unknown territory may encounter the problem of multiple unknown signals from one or many unknown emitters. It can be critical to quickly determine “what is out there”. Is there a single, ground-based, radar? Is a hostile aircraft radar painting its target for a missile launch? Are multiple missiles imminently approaching? A system that receives these unknown signals, processes, and displays them as discrete transmitting sources can make the difference between life and death in combat.
In an exemplary environment there are one or more unknown emitters to track. This/these unknown emitter/emitters (measurement source/sources) is/are potentially using different values for a measured parameter, this is referred to as the likelihood tracking problem. This makes it difficult to associate a set of previous measurements (assumed to be) from a single source such as a radar. When a sample observation is made, it would be important to measure how likely a measured parameter is to belong to a set of previous measurements (assumed to be) from a single source.
Determining if measurements are from a single source can involve the problem of combining scores from one parameter with other parameter types, requiring a common reference frame. Further, the parameter distribution domain of the emitter such as a radar is unknown. The problem of adding new sources (such as missiles versus one radar), can become more difficult with the number of observations, not allowing newer sources to have chance to “score”. Regarding overfitting, assigning a node to every measurement would be costly to maintain and compute, consuming valuable time, especially precious in a combat environment. If any measurement parameter value can be emitted by more than one source, parameter tracking cannot uniquely determine which source generated a measurement with any certainty. To combine scores from one parameter with other parameter types, a common reference frame is needed. Additionally, the parameter distribution domain of the emitter is unknown. While a node could be assigned to every measurement, accurately representing the measured data, this would be costly to maintain and compute and has a tendency to overfit.
What is needed is a system and method to provide a likelihood estimate for tracking signals that permits new, previously unseen sources, minimizes overfitting by accounting for measurement uncertainties, and is computationally efficient at scoring.
An embodiment provides a Radio Frequency (RF) tracking/localizing system for scalar agile parameter estimation for continuous-valued univariate parameters to estimate and track a likelihood of a measurement from at least one RF emitter source where a parameter distribution domain of the at least one RF emitter is unknown, comprising a memory; and a processor configured to receive a signal from an emitter source; measure a feature of the signal; calculate a likelihood of the feature by an initial feature likelihood tracking model; add a new parameter source model by creating a node, based on the feature likelihood; establish a likelihood of a measurement using a measurement likelihood tracking model; start a new feature track, based on the measurement likelihood; assign the feature to a track, wherein a feature track is a collection of nodes; whereby the signal is determined to be from an identified emitter source by association of each feature with at most one the RF emitter source already being tracked. In embodiments, the feature of the signal comprises a measured parameter ƒ, where the feature comprises one or more directly measured parameters; and a standard deviation σƒ of the measured parameter ƒ. In other embodiments, the initial feature likelihood tracking model is for node 1 and comprises the relationship:
p(ƒ)=α(1)w1(ƒ;
where α(1)=initial fraction of the initial feature likelihood tracking model that is driven by data; w1=1; (x,μ,σ) is a normal probability density function (pdf) with mean μ and standard deviation (std) σ; ƒ=a measured parameter; (x;a,b,c,d) is a trapezoid pdf with parameters a,b,c,d; A=assumed agility factor (0<A<1);
α0 and α1 are initial and final fraction where (0<α0≤α1<1); ma=4 times a slope of sigmoid Membership Function (MF) at m60 /2; mα=a number of measurements to get from α0 to α1; W=Σn=1Nwn=a total number of measurements; wn=a number of measurements represented by node n; (x,μ,σ) is a normal probability density function (pdf) with mean μ and standard deviation (std) σ; ƒ=a measured parameter;
mean of nodes. For additional embodiments the processor is configured for setting the agility factor, A, 0<A<1, whereby an unknown parameter distribution domain of the emitter is addressed so that a number of nodes increases over time, and then decreases as a distribution is better learned. In another embodiment, the system generates from the at least one RF emitter source: a parameter from single fixed value; multiple discrete channel values; random selection over a set; and skewed distributions. For a following embodiment, overfitting is reduced by checking, when a node is updated, if a measurement is an extrema, wherein the extrema is either a minimum or a maximum, according to ƒn=ƒ or {right arrow over (ƒ)}n=ƒ; and if ƒ−Nσƒ<{right arrow over (ƒ)}n−1; or if ƒ+Nσƒ>{right arrow over (ƒ)}n+1; then merging corresponding nodes. In subsequent embodiments, when N is less than 3, nodes are merged. In additional embodiments the at least one RF emitter source is characterized as one or more of: a channelized source, wherein only one node is required for each channel; and an agile source, wherein a number of nodes increases over time, and then decreases as a distribution is better learned. In ensuing embodiments the processor is configured to: generate a score for a feature ƒ against existing tracks by computing feature likelihoods; start a new feature track; and update a feature source. In included embodiments the processor is configured to determine if a node exists such that ƒ>n and ƒ<{right arrow over (ƒ)}n1; then update the node with ƒ; else find a node with minimal innovation; if a normalized innovation is less than a threshold; then update the existing node; else create a new node. In yet further embodiments the minimal innovation is defined by: n*=argmin
d
n*=|
For further embodiments the system generates: a parameter from a single fixed value; multiple discrete channel values; random selection over a set; and skewed distributions.
Another embodiment provides a computer readable medium having instructions to perform the steps of scalar agile parameter estimation for continuous-valued univariate parameters to estimate and track a likelihood of a measurement where a parameter distribution domain of an emitter is unknown comprising receiving a signal from an emitter source; measuring a feature of the signal; calculating a likelihood of the feature by an initial feature likelihood tracking model; adding a new parameter source model by creating a node, based on the feature likelihood; establishing a likelihood of a measurement using a measurement likelihood tracking model; starting a new feature track, based on the measurement likelihood; and assigning the feature to a track; whereby the signal is determined to be from an identified emitter by association of each of the emitters with a track. For yet further embodiments, the method comprises Gaussian summation of dynamic nodes determined by:
α0 and α1 are initial and final fraction where (0<α0≤α1<1); ma=4 times a slope of sigmoid Membership Function (MF) at mα/2; mα=a number of measurements to get from α0 to α1; W=Σn=1Nwn=total number of measurements; wn=a number of measurements represented by node n; (x,μ,σ) is a normal probability density function (pdf) with mean μ and standard deviation (std) σ; ƒ=a measured parameter;
ƒa=min((1−A)·
A yet further embodiment provides a method of signals tracking performing a scalar agile parameter estimation for continuous-valued univariate parameters to estimate and track a likelihood of a measurement where a parameter distribution domain of an emitter is unknown, comprising receiving a signal from an emitter source; measuring a feature of the signal; calculating a likelihood of the feature by a feature likelihood tracking model; adding a new parameter source model by creating a node, based on the feature likelihood; establishing a likelihood of a measurement using a measurement likelihood tracking model; starting a new feature track, based on the measurement likelihood; and assigning the feature to a track; whereby the signal is determined to be from an identified emitter by association of each of the emitters with a track. For additional embodiments, the signal is an RF signal.
Implementations of the techniques discussed above may include a method or process, a system or apparatus, or computer software stored on a computer-accessible medium. The details or one or more implementations are set forth in the accompanying drawings and the description below. Other features will be apparent from the description and drawings, and form the claims.
These and other features of the present embodiments will be understood better by reading the following detailed description, taken together with the figures herein described. The accompanying drawings are not intended to be drawn to scale. For purposes of clarity, not every component may be labeled in every drawing.
The features and advantages described herein are not all-inclusive and, in particular, many additional features and advantages will be apparent to one of ordinary skill in the art in view of the drawings, specification, and claims. Moreover, it should be noted that the language used in the specification has been selected principally for readability and instructional purposes, and not to limit in any way the scope of the inventive subject matter. The invention is susceptible of many embodiments. What follows is illustrative, but not exhaustive, of the scope of the invention.
This disclosure relates to a parameter tracker that learns and efficiently represents the observed parameter history using a Gaussian summation of dynamic nodes. Embodiment solutions are general, and can be applied to many types of parameter observations. For example, while RF radar signals from sources such as ground radar and missiles can be tracked; other parameters such as parameters measured from laser or sonar detecting devices can be tracked. In each case measurements from emitter(s) are processed to report the one or more sources (emitters) producing the measured signals.
In likelihood tracking a measurement source (an emitter such as a radar) is potentially using different values for a measured parameter. A sample observation is made and embodiments measure how likely a measured parameter is to belong to a set of previous measurements (assumed to be) from a single source. The value of parameter tracking is that it can be combined with other attributes. This disclosure describes a general approach for continuous-valued univariate parameters.
Implementations of the invention are very flexible with many customizable parameters; therefore, the specific numbers for the parameters are for illustration purposes and parameters can be adjusted depending on the application. Simulation examples show efficacy for sources that generate a parameter from single fixed value, multiple discrete values, random selection over a set, and skewed distributions.
Likelihood tracking involves solving at least four problems: combining scores, unknown emitter parameter distribution, unknown number of new sources, and overfitting. As mentioned previously, the problem of combining scores from one parameter with other parameter types requires a common reference frame. Embodiments use data to estimate/track the likelihood of a measurement. However, the parameter distribution domain of the emitter is unknown. To address this, embodiments assume an agility factor. To address the problem of new sources, embodiments assume that the likelihood of a new (unseen) source from a given source decreases with the number of observations to allow newer sources to have chance to “score”. Regarding overfitting, a node could be assigned to every measurement; however, as previously mentioned, while this may most accurately represent the data, it would be costly to maintain and compute. Instead, embodiments represent the data distribution both as faithfully and efficiently as possible. Embodiment solutions are to utilize estimated measurement error standard deviations to determine when to merge nodes.
To establish the likelihood of a measurement, embodiments use the following likelihood tracking model equation:
p(ƒ)=α(W+1)Σn=1Nwn(ƒ;
Here, each node n has a set of parameters, where each node comprises a set of measured parameters that may or may not be attributable to a specific emitter. This equation includes parameter models, maintains up to nodes, and uses derived data-driven values where:
1) (x;μ,σ) is the normal probability density function (pdf) with mean μ and std σ;
2) (x;a,b,c,d) is the trapezoid probability density function (pdf) with parameters a,b,c,d; and
3)
specifies the weighting of the pdf based on nodes as a function of the number of measurements observed.
For parameter models:
1) α0 and α1 are initial and final fraction of the model that is driven by data/observations where (0<α0≤α1<1)
2) ma=four times the slope of sigmoid Membership Function (MF) at mα/2. Membership function is a term of art, and represents the degree of truth in fuzzy logic.
3) mα=number of measurements to get from α0 to α1 and
4) A=assumed agility factor (0<A<1), as in ƒa=min((1−A)·
Each of up to N nodes maintains the following:
1) wn=number of measurements represented by node n
2)
3) σn=standard deviation of all the measurements in node n
4) n=minimum of all the measurements represented by the node n and
5) {right arrow over (ƒ)}n=maximum of all the measurements represented by the node.
Derived (data driven) values include:
1) W=Σn=1Nwn=total number of measurements across all measured parameters, even if the parameters are of different types.
2) =min n−3σn
3) {right arrow over (ƒ)}=max {right arrow over (ƒ)}n+3σn
4)
5) ƒa=min((1−A)·
6) ƒd=max((1+A)·
The likelihood of feature ƒ is modeled as:
p(ƒ)=α(1)w1 (ƒ;
The system then performs the steps of adding a new parameter source model. When no sources exist in the database, this entails receiving a series of measurements (of some parameter), determining the standard deviation, and assuming the remaining values. Node #1 is created with:
w1=1
n=ƒ
σ1=σƒ
1=ƒ
{right arrow over (ƒ)}1=ƒ
Having derived parameters of:
W=1
=ƒ−3σƒ
{right arrow over (ƒ)}=ƒ+3σƒ
ƒa=(1−A)··ƒ
ƒd=(1+A)·ƒ
As seen in the
The system performs the steps of:
1) scoring ƒ against existing tracks (i.e., compute likelihoods using previous
2) starting a new feature track (following procedures of
3) updating the feature source.
Updating the feature source comprises the following steps:
1) If any node exists such that ƒ>n and ƒ<{right arrow over (ƒ)}n;
2) Then update that node with ƒ;
3) Else, find a node with minimal innovation n*, such that n*=argmin
Further, if dn*, the normalized innovation defined as:
d
n*=|ƒn*−ƒ|/√{square root over (σƒ2+σn*2)} Eq. (3)
is less than a threshold;
Then update the existing node;
Else, create a new node. The normalized innovation dn* is the magnitude of
As seen in the graph of
A key concept for the merging of nodes is to minimize overfitting and reduce computations needed to represent the data distribution as faithfully and efficiently as possible. This is akin to a model order selection problem. As known to one of skill in the art of statistical modeling, the model selection problem refers to choosing, from a set of candidates, a model that is as simple as possible while still retaining a sufficient predictive power. While a node could be assigned to every measurement, and this may most accurately represent the data, it would be costly to maintain and compute, and generally is called overfitting. However, to avoid overfitting, embodiments employ an efficient merging scheme which will be described in more detail in the following paragraph.
For merging, first the nodes are ordered. For fast computations, the nodes are ordered such that
The computing system used for scalar agile parameter estimation for performing (or controlling) the operations or functions described hereinabove with respect to the system and/or the method may include a processor, FPGA, I/O devices, a memory system, and a network adaptor. The computing system includes a program module (not shown) for performing (or controlling) the operations or functions described hereinabove with respect to the system and/or the method according to exemplary embodiments. For example, the program module may include routines, programs, objects, components, logic, data structures, or the like, for performing particular tasks or implement particular abstract data types. The processor may execute instructions written in the program module to perform (or control) the operations or functions described hereinabove with respect to the system and/or the method. The program module may be programmed into the integrated circuits of the processor. In an exemplary embodiment, the program module may be stored in the memory system or in a remote computer system storage media.
The computing system may include a variety of computing system readable media. Such media may be any available media that is accessible by the computer system, and it may include both volatile and non-volatile media, removable and non-removable media.
The memory system can include computer system readable media in the form of volatile memory, such as random access memory (RAM) and/or cache memory or others. The computer system may further include other removable/non-removable, volatile/non-volatile computer system storage media. The computer system can communicate with one or more devices using the network adapter. The network adapter may support wired communications based on Internet, LAN, WAN, or the like, or wireless communications based on CDMA, GSM, wideband CDMA, CDMA-2000, TDMA, LTE, wireless LAN, Bluetooth, or the like.
The present invention may be a system, a method, and/or a computer program product at any possible technical detail level of integration. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, configuration data for integrated circuitry, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
Aspects of the present invention are described herein with reference to a flowchart illustration and/or block diagram of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the Figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
The foregoing description of the embodiments has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of this disclosure. It is intended that the scope of the present disclosure be limited not by this detailed description, but rather by the claims appended hereto.
A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made without departing from the scope of the disclosure. Although operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results.
Each and every page of this submission, and all contents thereon, however characterized, identified, or numbered, is considered a substantive part of this application for all purposes, irrespective of form or placement within the application. This specification is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of this disclosure. Other and various embodiments will be readily apparent to those skilled in the art, from this description, figures, and the claims that follow. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.