Embodiments of the present invention relate generally to data fusion and, more specifically, to systems, methods, and computer-readable media for determining basic probability numbers for use within data fusion methods.
Sensor systems incorporating a plurality of data sources (e.g., multi-sensor systems) are widely used for a variety of military applications including ocean surveillance, air-to-air and surface-to-air defense (e.g., self-guided munitions), battlefield intelligence, surveillance and target detection (classification), and strategic warning and defense. In addition, multi-sensor systems are used for a plurality of civilian applications including condition-based maintenance, robotics, automotive safety, remote sensing, weather forecasting, medical diagnoses, and environmental monitoring (e.g., weather forecasting).
To obtain the full advantage of a multi-source system, an efficient data fusion method (or architecture) may be selected to optimally combine the received data from the multiple data sources (e.g., sensors). For military applications, especially target recognition, a sensor-level fusion process is widely used wherein data received by each individual sensor is fully processed at each sensor before being output to a data fusion processor.
The well-known Dempster-Shafer theory of evidential reasoning provides a means of combining information from different data sources to allow a system to make proper decisions. The Dempster-Shafer theory uses explicit representations of ignorance and conflict to avoid the shortcomings of classical Bayesian probability calculus. The Dempster-Shafer theory uses basic probability numbers, which represent the distribution of probability mass in a system (i.e., how strongly something is believed). The Dempster-Shafer theory, therefore, is based on obtaining degrees of belief for one question from subjective probabilities for a related question and uses Dempster-Shafer's rule for combining such degrees of belief when they are based on independent items or evidence.
A limitation of the Dempster-Shafer theory is determination of the basic probability numbers. Conventionally, basic probability numbers have been determined via expert knowledge, which may not be based on measured data and, therefore, may be subjective.
There is a need for enhanced methods and systems for determination of basic probability numbers for use within data fusion. Specifically, there is a need for methods, systems, and computer-readable media for determining basic probability numbers, for use within data fusion methods, based on measured data.
An embodiment of the present invention comprises a method of defining a basic probability number for use within data fusion. The method may comprise measuring an intensity of a pixel of a radiograph wherein the pixel is associated with an interrogation space of an interrogation volume. The method may also include calculating an assumed intensity of the pixel for each possible configuration of a plurality of possible configurations for the interrogation space. Further, the method may include classifying each possible configuration as a possible target configuration if the measured intensity of the pixel is within an error-factor of the assumed intensity. The method may further include defining a basic probability number of the pixel as a ratio of a number of possible target configurations to a number of possible configurations.
Another embodiment of the present invention includes a method of defining a basic probability number of a pixel of a radiograph for use within the Dempster-Shafer theory. The method may include generating a plurality of possible configurations for an interrogation space associated with a pixel of a radiograph and determining an assumed intensity of the pixel for each possible configuration of the plurality of configurations. The method may further include comparing the assumed intensity of each possible configuration to a measured intensity of the pixel to determine whether each possible configuration comprises a target configuration. Moreover, the method may include dividing a number of target configurations by a number of possible configurations to define a basic probability number for the pixel.
Another embodiment of the present invention includes a method comprising detecting an intensity of each pixel of a radiograph generated by interrogating a target object with a first interrogation method and detecting an intensity of each pixel of another radiograph generated by interrogating the target object with at least one other interrogation method. Additionally, the method may comprise determining basic probability numbers for each pixel of the radiograph and each associated pixel of the other radiograph. A basic probability number for a pixel may be determined by measuring an intensity of the pixel and solving a multi-dimensional integral for each possible configuration of a plurality of possible configurations of an interrogation space associated with the pixel to calculate an assumed intensity of the pixel. Further, the basic probability number for the pixel may be determined by classifying each possible configuration as a possible target configuration if the intensity is substantially equal to the assumed intensity and defining a basic probability number of the pixel as a ratio of a number of possible target configurations to a number of possible configurations. Moreover, the method may include combining associated basic probability numbers from the radiograph and the other radiograph using Dempster-Shafer's orthogonal rule of combination.
Another embodiment of the present invention includes a system. The system may comprise a source configured to transmit a first signal into a target object and a detector configured to receive a second signal emitted from the target object and responsive to the first signal being transmitted into the target object. The system may further include a computer operably coupled to each of the source and the detector. The computer may be configured to determine an assumed intensity of a pixel of a radiograph for each possible configuration of a plurality of possible configurations of an interrogation space associated with the pixel. The computer may also be configured to compare the assumed intensity of each possible configuration to a measured intensity of the pixel to determine whether each possible configuration comprises a target configuration. Additionally, the computer may be configured to define a basic probability number of the pixel as a ratio of a number of target configurations to a number of possible configurations.
Yet another embodiment of the present invention includes a computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform instructions for determining a basic probability number for use within a data fusion method according to an embodiment of the present invention.
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof and in which is shown by way of illustration specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those of ordinary skill in the art to practice the invention, and it is to be understood that other embodiments may be utilized, and that structural, logical, and electrical changes may be made within the scope of the disclosure.
In this description, functions may be shown in block diagram form in order not to obscure the present invention in unnecessary detail. Furthermore, specific implementations shown and described are only examples and should not be construed as the only way to implement the present invention unless specified otherwise herein. Block definitions and partitioning of logic between various blocks represent a specific, non-limiting implementation. It will be readily apparent to one of ordinary skill in the art that the various embodiments of the present invention may be practiced by numerous other partitioning solutions. For the most part, details concerning timing considerations, and the like, have been omitted where such details are not necessary to obtain a complete understanding of the present invention in its various embodiments and are within the abilities of persons of ordinary skill in the relevant art.
When executed as firmware or software, instructions for performing the methods and processes described herein may be stored on a computer-readable medium. A computer-readable medium includes, but is not limited to, magnetic and optical storage devices such as disk drives, magnetic tape, CDs (compact disks), DVDs (digital versatile discs or digital video discs), and semiconductor devices such as RAM, DRAM, ROM, EPROM, and Flash memory.
Referring in general to the following description and accompanying drawings, various embodiments of the present invention are illustrated to show its structure and method of operation. Common elements of the illustrated embodiments are designated with like numerals. It should be understood that the figures presented are not meant to be illustrative of actual views of any particular portion of the actual structure or method but are merely idealized representations, which are employed to more clearly and fully depict the present invention.
A mathematical “inverse problem” may be defined as a problem wherein the answer is known, but the question is unknown. The embodiments described herein may be used to solve an “inverse problem.” More specifically, given a measurement (e.g., an intensity measurement of a pixel of a radiograph) taken in response to interrogation of a target object, the embodiments described herein may be used to assist in determining what one or more materials within the target object caused the measurement.
Moreover, as described more fully below, various embodiments of the present invention include systems, methods, and computer-readable media for determining basic probability numbers for use within a data fusion method (e.g., the Dempster-Shafer theory). More specifically, various embodiments of the present invention are related to systems, methods, and computer-readable media for calculating basic probability numbers for each individual pixel in a radiograph by determining a ratio of possible target configurations to possible configurations of an interrogation space associated with each pixel.
Before describing various embodiments of the present invention related to determining basic probability numbers for use within the Dempster-Shafer theory, a brief, general description of the Dempster-Shafer theory will first be provided. A conventional detection system and a detection system, according to an embodiment of the present invention, will each then be described. Thereafter, a method of determining basic probability numbers for use within a data fusion method (e.g., the Dempster-Shafer theory) in accordance with one or more embodiments of the present invention will be described.
The Dempster-Shafer theory is well known in the art and, therefore, in the following description thereof, some details may be omitted in order to avoid unnecessarily obscuring the invention. The Dempster-Shafer theory is a mathematical theory that allows data from multiple sources to be combined to arrive at a degree of belief. The Dempster-Shafer theory may be based on a) obtaining degrees of belief for one question from subjective probabilities of another, related question; and b) combining such degrees of belief based on independent items of evidence. A method of using the Dempster-Shafer theory may begin by determining a “question of interest.” For example, in the context of a method of detecting one or more “threat materials” (e.g., explosives or illicit drugs), a “question of interest” may comprise “is (are) there a threat(s) (e.g., an explosive material(s)) in a pixel of a radiograph of a target object?” Thereafter, a set of possible answers (also referred to as “hypotheses”) to the “question of interest” may be determined. These hypotheses may also be referred to as a “frame of discernment.” A hypothesis may include, for example, “explosive threat material,” “organic material,” “illicit drugs,” “electrical components,” “machine parts,” “paper products,” or “air.” In the context of explosive detection, a hypothesis may include, for example only, “explosive threat material.”
Furthermore, basic probability numbers for each data source may be determined. A set of possible subsets of Θ, which may be identified as 2Θ, may be defined by the following equation:
2Θ={A|AΘ}. (1)
Furthermore, the belief function, Bel functions, satisfy the following three axioms:
Axiom 1:Bel(φ)=0; (2)
Axiom 2:Bel(Θ)=1; (3)
wherein φ is the null set.
Moreover, for any whole number n, and subsets A1 . . . An, and all subsets of Θ:
Belief may be divided into one or more basic probability numbers (b(A)) and allocated to one or more subsets A, such that:
Σ{b(A)|AΘ}=1. (5)
Furthermore, basic probability numbers may be related to belief functions by the following equation:
Bel(A)−Σ{b(B)|BA}; (6)
wherein B represents proper subsets of A, and the summation is over all sets B.
Two or more pieces of evidence with basic probability numbers assigned thereto may be combined using Dempster-Shafer's orthogonal rule of combinations according to the following equations:
wherein the numerator indicates the summation of the combinations of basic probabilities for a given set of overlapping hypotheses and the denominator indicates one minus the summation of basic probabilities for the combinations of all the considered hypotheses.
Moreover, combined basic probability numbers may be evaluated to determine the strength of evidence of a specific hypothesis.
A conventional detection system will now be described.
Target object 112, which may also be referred to herein as an “object of interest” or an “interrogation volume” is, or includes, a material with respect to which a determination is being made regarding its elemental components. For example, target object 112 may be any item capable of transporting or smuggling explosives. As a more specific example, target object 112 may be a vehicle, a bag, a storage drum, a box, a container, or any combination thereof.
Computer 102 may include a processor 106 and a memory 104. Memory 104 may include a computer-readable medium (e.g., data storage device 108), which may include, but is not limited to, magnetic and optical storage devices, such as disk drives, magnetic tape, CDs (compact disks), DVDs, and semiconductor devices such as RAM, DRAM, ROM, EPROM, and Flash memory. As illustrated, computer 102 may be operably coupled to each source 110 and each detector 114 within detection system 200. According to an embodiment of the present invention, computer 102 may be configured to control operation of each source 110 and receive an output from each detector 114. Memory 104 may include one or more software applications configured for performing various methods described herein. For example, memory 104 may include one or more software applications configured for determining basic probability numbers for each pixel of each generated radiograph according to the methods described herein.
During operation of detection system 200, two or more sources 110 may transmit an associated signal 116 toward target object 112 and a response may be detected by each associated detector 114. Furthermore, each detector 114 may transmit associated data to computer 102. Upon receipt of data from one or more detectors 114, computer 102 may generate associated radiographs and determine basic probability numbers for each pixel of each generated radiograph in accordance with embodiments described herein. Thereafter, computer 102 may fuse data (i.e., combine associated basic probability numbers) according to Demspter's orthogonal rule of combination.
A method of determining a basic probability number for a pixel in a radiograph in accordance with an embodiment of the present invention will first be generally described. Thereafter, the method of determining a basic probability number for a pixel in a radiograph will be described in more detail. Generally, a method may include measuring an intensity of a pixel of a radiograph. Additionally, the method may include calculating, based on known data (e.g., the measured intensity of the pixel, a mass of an interrogation volume (e.g., mass of target object 112), a distance from a source (e.g., source 110) to an associated detector (e.g., detector 114), the number density of electrons associated with the pixel, or a combination thereof), and an assumed intensity of the pixel for each possible configuration of a plurality of possible configurations of an interrogation space (i.e., a space within an interrogation volume that is associated with a pixel of a radiograph). Furthermore, the method may include comparing the assumed intensity calculated for each possible configuration to the measured intensity of the pixel to determine whether each possible configuration may be considered a “possible target configuration.” Moreover, the method may include calculating a ratio of all “possible target configurations” to all “possible configurations” for the pixel.
More specifically, possible configurations of an interrogation space (i.e., a space within an interrogation volume that is associated with a pixel of a radiograph) may be generated by varying, through random number generation, the number of materials presumed to be present within the interrogation space, the types of material assumed to be present within the interrogation space, and the number of electrons associated with each material assumed to be present within interrogation space. Furthermore, each possible configuration may be integrated over known data, assumed data, or both, to calculate an assumed intensity of the associated pixel. For each specific possible configuration, the calculated assumed intensity of the pixel may then be compared to the measured intensity of the pixel and, if the intensities are within a user-defined error factor (e.g., substantially equal within the error factor), the specific possible configuration may be considered a “possible target configuration” and a “possible configuration.” If the intensities are not within a user-defined error factor, the specific possible configuration may be considered as only a “possible configuration.” After each “possible configuration” has been generated, and each calculated assumed intensity has been compared to the measured intensity, a basic probability number (“BPN”) for the pixel may be defined as the ratio of “possible target configurations” to all “possible configurations,” as discussed in more detail below and as provided in the following equation:
A method of determining a basic probability number for a pixel in a radiograph will now be described in more detail. As will be appreciated by a person having ordinary skill in the art, data, which is associated with a detection system (e.g., detection system 200), may be measured, or known, prior to determining basic probability numbers for each pixel within a radiograph. For example, intensities of each pixel within a radiograph may be measured. Furthermore, a mass of an interrogation volume (e.g., target object 112) may be measured according to known methods. Moreover, according to one embodiment, a mass of an interrogation volume may be divided by a number of pixels within a radiograph to determine an assumed mass associated with each pixel (i.e., an assumed mass of an interrogation space). For example, for a 3×3 pixel array having a total mass of 0.9 kg, even distribution of the mass would result in each pixel having 0.1 kg.
According to another embodiment, masses of each pixel may be at least partially related to the distribution of intensities of the pixels. More specifically, by comparing relative intensities of the pixels in a radiograph, a mass may be apportioned to each pixel. For example, if 90% of the measured attenuation is in the middle 10% of pixels of a radiograph, the middle 10% of pixels may be apportioned 90% of measured mass of the interrogation volume. More specifically, in the following example in which a pixel array has a total mass of 0.9 kg, a first pixel of the array has an intensity ratio of 0.0, a second pixel has an intensity ratio of 0.1, a third pixel has an intensity ratio of 0.2, a fourth pixel has an intensity ratio of 0.4, a fifth pixel has an intensity ratio of 0.3, and every other pixel in a radiograph has an intensity ratio of 0.0. Accordingly, in this example, the pixels with intensity ratios of 0.0 would be assigned a mass of 0 kg, the second pixel would be assigned a mass of 0.09 kg, the third pixel would be assigned a mass of 0.18 kg, the fourth pixel would be assigned a mass of 0.36 kg, and the fifth pixel would be assigned a mass of 0.27 kg.
Furthermore, a distance from a source (e.g., source 110) to an associated detector (e.g., detector 114) may also be measured. In addition, a ratio of an intensity of a transmitted signal (e.g., signal 116) to a detected signal (e.g., signal 117) may be determined. Moreover, a number density of electrons within an interrogation space associated with each pixel may be determined from the angle-integrated Klein-Nishina formula, as will be understood by a person having ordinary skill in the art.
According to an embodiment of the present invention, the above-described measured or known data, which may also be referred to as “known variables,” may be used to limit “configurations” to only “possible configurations.” For example, because the mass of the interrogation space may be known, only configurations that may have a mass substantially equal to the mass of the interrogation space are “possible configurations.” Furthermore, because a measured intensity of a pixel and a distance from a source (e.g., source 110) to an associated detector (e.g., detector 114) may be known, only configurations that exhibit these attributes may be “possible configurations.” As a more specific example, if an intensity measurement of a pixel is relatively high and a distance from a source (e.g., source 110) to a detector (e.g., detector 114) is relatively short, it may not be possible for an associated configuration to include only organic products (e.g., fish and flowers). Therefore, in this example, the configuration including only organic products would not be considered a “possible configuration” and, as a result, would not be generated and tested.
The following multi-dimensional integral of equation (10) may be solved for each possible configuration of an interrogation space to calculate an “Assumed Intensity” of a pixel associated with the interrogation space:
Monte Carlo integration may be used for evaluation of multi-dimensional integrals. Monte Carlo integration is well known in the art and, therefore, will not be described in detail. However, a method of randomly identifying variables for generating a configuration of an interrogation space to be evaluated by equation (10) is described below.
One or more integrals of the multi-dimensional integral of equation (10) may be constrained (i.e., limited) by a variable (e.g., the “Number of Materials,” “Material Type,” or both), as described more fully below. With reference to equation (10), initially, a random number may be generated to determine an assumed “Number of Materials” present within an interrogation space. For example, if a number “3” is randomly generated, it may be assumed that the interrogation space includes “3” materials.
Thereafter, random numbers may be generated for each assumed material to determine a “Material Type” of each material. For example, if a number “2,” which is associated with organic materials, is randomly generated for the first of the three materials assumed to be present within the interrogation space, the first material may be assumed to be an organic material (e.g., flowers). As another example, if a number “5,” which is associated with “explosive threat” materials, is randomly generated for the second of the three materials assumed to be present within the interrogation space, the second material may be assumed to be an explosive threat material. It is noted that in the context of “threat material” detection, at least one “threat material” (e.g., explosive or illicit drug) may be assumed to be present within the interrogation space. The process of randomly generating numbers to determine the types of materials assumed to be present within the interrogation space may be repeated for each material assumed to be present to define a material type of each material. Accordingly, as will be appreciated by a person having ordinary skill in the art, the “Number of Materials” and “Material Type” variables may be used to constrain at least two integrals of equation (10).
It may be desirable to interrogate a target object (e.g., target object 112) for a specific material of interest (e.g., Nitroglycerin). Accordingly, in one embodiment of the present invention, a specific material of interest (e.g., Nitroglycerin) may be assumed to be present within the interrogation space. Therefore, in this embodiment, a random number may be generated to determine an assumed “Number of Materials” present within the interrogation space. Thereafter, for each material other than the specific material of interest, random numbers may be generated to determine a “Material Type” of the materials. Accordingly, in this example, the evaluation of equation (10) is not entirely random and, therefore, the variance associated with evaluation thereof may be reduced.
One or more integrals of the multi-dimensional integral of equation (10) may be constrained (i.e., limited) by known or measured data (e.g., “Material Characteristic,” “Distance,” or both), as described more fully below. With continued reference to equation (10), after determining an assumed number of materials present within an interrogation space and a material type for each material assumed to be present, at least one “Material Characteristic” may determined. The term “Material Characteristic” may include a combined mass of the one or more materials presumed to be present within the interrogation space, a number of electrons apportioned to each material assumed to be present within the interrogation space, or a combination thereof.
A number density of electrons in the interrogation space may be determined via use of the angle-integrated Klein-Nishina formula. More specifically, because the mass of the interrogation space, the distance from a source (e.g., source 110) to a detector (e.g., detector 114), and a ratio of an intensity of a transmitted signal (e.g., signal 116) to a detected signal (e.g., signal 117) is known, the angle-integrated Klein-Nishina formula may be used to calculate the number density of electrons in the interrogation space, as will be understood by a person having ordinary skill in the art. Furthermore, because each material assumed to be present within the interrogation volume has been identified as a type of material (e.g., organic, threat, machine part, etc.); each material may be assumed to have a known chemical composition and a known density. Accordingly, a number of electrons may be apportioned to each material assumed to be present within the interrogation space and a number density of electrons may be used as the “Material Characteristic” variable to constrain at least two integrals of equation (10). Moreover, a “Distance” as identified in equation (10) may represent a distance from a source (e.g., source 110) to an associated detector (e.g., detector 114) of a detection system 200 and may be used to constrain at least one integral of equation (10).
For each individual possible configuration, the calculated “Assumed Intensity” of the pixel may then be compared to the measured intensity of the pixel and, if the intensities are within a user-defined error factor (e.g., substantially equal), the individual possible configuration may be considered a “possible target configuration” and a “possible configuration.” If the intensities are not within the user-defined error factor, the individual possible configuration may be considered as only a “possible configuration.” After each possible configuration for a pixel has been generated and a calculated “Assumed Intensity” has been compared to a measured intensity, a basic probability number for the pixel may be defined as the ratio of all “possible target configurations” to all “possible configurations.” It is noted that in the context of explosive detection, a basic probability number for the pixel may be defined as the ratio of all “possible explosive threat configurations” to all “possible configurations.” This method of defining a basic probability number may be repeated for each pixel within a radiograph to determine a basic probability number for each pixel.
It is noted that basic probability numbers associated with different detection modalities (e.g., neutrons, gamma ray, and x-ray), or similar detection modalities at different energies, may be added together using Dempster-Shafer's orthogonal rule of combination as explained above.
Although the embodiments described above are described in relation to explosive detection, the invention is not so limited. Rather, a person having ordinary skill in the art will understand that the systems and methods described above may be used for detection of other materials such as, for example only, illicit drugs, electronics, or organic materials, among other items.
While the present invention has been described herein with respect to certain embodiments, those of ordinary skill in the art will recognize and appreciate that it is not so limited. Rather, many additions, deletions, and modifications to the described embodiments may be made without departing from the scope of the invention as hereinafter claimed, including legal equivalents. In addition, features from one embodiment may be combined with features of another embodiment while still being encompassed within the scope of the invention as contemplated by the inventors.
This invention was made with government support under Contract No. DE-AC07-051D14517 awarded by the United States Department of Energy. The government has certain rights in the invention.