1. Field of the Invention
The present invention is generally directed to scanning items for concealed contraband, including but not limited to explosives, explosive precursors, and narcotics.
2. Background Art
Detection of contraband (such as, for example, explosives, explosive precursors, and narcotics) is a critical need of the U.S. Government (military, border control, and federal law enforcement), state and local law enforcement, and private security companies. Currently available systems for detecting contraband can be grouped into one of two categories: (i) residue-detection methods, which rely on physical residues or vapors to detect contraband; or (ii) nuclear-based methods, which use ionizing radiation to detect contraband.
Both the residue-detection methods and the nuclear-based methods have drawbacks. First, the residue-detection methods require access to a physical sample in order to detect contraband. Oftentimes, however, the contraband may be concealed, making residue detection difficult or impossible. For example, contraband that is odorless may be difficult to detect using residue-detection methods. Second, although nuclear-based methods do not require access to physical samples (like the residue-detection methods), the nuclear-based methods require ionizing (e.g., neutron) radiation, which can have deleterious effects on humans and/or the surrounding environment. Accordingly, nuclear-based methods are limited in their application by safety and cost considerations.
In addition to the residue-detection and nuclear-based methods, the food industry and the semiconductor industry use measurement methods based on the dielectric properties of materials to assess the quality of their respective products. Although the dielectric-based measurement methods do not have the same drawbacks as the residue-detection and nuclear-based methods, the dielectric-based measurement methods used by the food industry and the semiconductor industry are ill-suited for detecting contraband. Specifically, these dielectric-based measurement methods operate over very short ranges, have no imaging capability (e.g., are single voxel system), and are typically only used for sensing the presence of a single, targeted measurand (e.g., moisture content in cookies or purity of a pharmaceutical under manufacture).
For example, U.S. Pat. No. 7,280,940 to Goldfine et al., entitled “Segmented Field Dielectric Sensor Array for Material Characterization” (filed Mar. 7, 2006) (issued Oct. 9, 2007) describes representative measurement methods used for quality control in the semiconductor industry. Specifically, the '940 patent is “directed toward the nondestructive detection and characterization of insulating or semiconductor materials . . . ” '940 patent, col. 3 11. 31-33. According to the '940 patent, electrodes are placed in very close proximity with a material under test (“MUT”) to generate a two-dimensional grid used to estimate electrical properties of the MUT. Like the conventional measurement methods used by the semiconductor industry discussed above, the '940 patent teaches that the proximity, or “lift-off,” between the electrodes and the MUT is a very short range—on the order of a few millimeters to a few hundredths of a millimeter.
Given the foregoing, what is needed are methods, systems, and computer program products for remotely classifying materials based on complex permittivity features. The remote classification of materials could be used to identify contraband.
The present invention meets the above-described needs by providing methods, systems, and computer-program products for remotely classifying materials based on complex permittivity features. In accordance with embodiments of the present invention, the remotely classified materials are used to identify contraband.
For example, an embodiment of the present invention provides a system for identifying materials. The system includes a first electrode, a second electrode, and a computing module. The first electrode is configured to generate an electric field. The second electrode is configured to sense interaction of the electric field with a container and any materials in the container and to provide a signal corresponding thereto. The computing module is configured to (i) convert the signal into one or more electrical parameters, (ii) classify the materials in the container based on the one or more electrical parameters, and (iii) identify at least one of the materials in the container based on the classifications.
Another embodiment of the present invention provides a method for identifying materials. The method includes several steps. First, an electric field is generated. Second, interaction of the electric field with a container and any materials in the container is sensed to provide a signal. Third, the signal is converted into one or more electrical parameters. Fourth, the materials in the container are classified based on the one or more electrical parameters. Then, at least one of the materials in the container is identified based on the classifications.
A further embodiment of the present invention provides a tangible computer-readable medium having stored thereon computer-executable instructions that, if executed by a device, cause the device to perform a method for identifying materials. The method includes several steps. First, a signal, sensed by an electrode, is converted into one or more electrical parameters, wherein the electrode is configured to sense interaction of an electric field with a container and any materials in the container. Second, the materials in the container are classified based on the one or more electrical parameters. Then, at least one of the materials in the container is identified based on the classifications.
Further features and advantages of the invention, as well as the structure and operation of various embodiments of the invention, are described in detail below with reference to the accompanying drawings.
The accompanying drawings, which are incorporated herein and form part of the specification, illustrate the present invention and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the relevant art(s) to make and use the invention.
The features and advantages of the present invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings, in which like reference characters identify corresponding elements throughout. In the drawings, like reference numbers generally indicate identical, functionally similar, and/or structurally similar elements. The drawing in which an element first appears is indicated by the leftmost digit(s) in the corresponding reference number.
The present invention is directed to remotely classifying materials based on complex permittivity features of the materials. In this document, references to “one embodiment,” “an embodiment,” “an example embodiment,” etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
Embodiments of the present invention are directed to systems and methods for remotely detecting and classifying materials included in a container based on variations in electrical parameters (e.g., complex permittivity) of the materials. By remotely detecting and classifying materials, embodiments of the present invention may be used to detect contraband included in the container.
As used herein, the term “container” means a structure that holds or may be configured to hold goods, items, or materials. Example containers within the spirit and scope of the present invention may include, but are not limited to, an envelop, a jar, a box, a portable compartment (as may be used, for example, on a train, a ship, or a plane), a piece of luggage (such as, for example, a purse, a bag, a suitcase, a backpack, or the like), a vehicle (such as, for example, a train, a plane, or an automobile—including a car, a truck, a bus, and the like), or some other type of structure that holds or may be configured to hold goods, items, or materials.
As used herein, the term “contraband” means an illegal or prohibited good, item, or material. Examples of contraband may include, but are not limited to explosives, explosive precursors, narcotics, or some other type of illegal or prohibited good, item, or material.
The classification of materials and detection of contraband in accordance with embodiments of the present invention is based on dispersive properties of a material positioned relative to a driving electrode and one or more sensing electrodes. The driving electrode and the one or more sensing electrodes may be configured as opposing plate electrodes (as illustrated, for example, in
For example,
In operation, driving electrode 102 generates a fringing electric field that interacts with container 106 (and any materials therein) and is then sensed by sensing electrode 104. The distance between driving electrode 102 and sensing electrode 104 may be physically varied (e.g., increased) to vary (e.g., increase) the depth that the fringing electric field penetrates along the plane of container 106. Alternatively, when the system includes a plurality of driving electrodes and a plurality of sensing electrodes, the distance between the driving electrodes and the sensing electrodes may be effectively varied (e.g., increased) by varying the electrodes that are energized to generate the electric field and by varying the electrodes that are selected to sense the electric field. So, rather than mechanically moving electrodes, embodiments of the present invention electronically switch between electrodes to effectively adjust the distance between the electrodes used to generate and/or sense the electric field.
Like system 100 of
The electrical parameter measurements provided by the parallel-plate configuration of system 100 and/or the fringing-field configuration of system 150 are processed by computing module 110. Computing module 110 may implement any of a variety of classification algorithms. Multiple electrode combinations may be used to produce a map of dielectric properties and classification within different volume elements. The presence of sharp discontinuities in dielectric properties is a macro-indication that the test article may warrant further investigation, and classification based on known signatures for contraband substances may be conclusive.
In embodiments, for example, computing module 110 may implement linear discriminant analysis (LDA) to develop signatures for identifying contraband substances based on the electrical parameters. As explained in more detail below, LDA is a method for separating the electrical parameters into different clusters corresponding to the different types of materials that may be included in container 106.
As mentioned above, the degree to which a material in container 106 distorts or modifies an applied electric field is dependent on dispersive properties of the material. The dispersive properties of a material can be understood, for example, in terms of the complex permittivity, which comprises a dielectric constant (relating the applied electric field to a displacement field within the material) and a frequency-dependent conductivity (relating the applied electric field to a current density within the material). The complex permittivity of a material can be represented mathematically as follows:
∈*=∈′+i∈″
wherein ∈* is the complex permittivity, ∈′ is the dielectric constant or the real part of the complex permittivity, and ∈″ is the imaginary part of the complex permittivity. The imaginary part of the complex permittivity can be represented mathematically as follows:
wherein σ is the conductivity of the material and f is the frequency of the applied electric field.
For illustrative purposes, and not limitation, three embodiments are described below in which the container respectively comprises an envelop, a jar, and an automobile. It is to be appreciated, however, that other forms of containers may be used without deviating from the spirit and scope of the present invention.
Referring to
Referring to
In both system 300 and system 350, driving electrodes 302, 352 respectively generate an electric field that interacts with envelop 306 and any materials included therein. The interaction of the electric field with envelop 306 and any materials therein distorts the electric field. Sensing electrodes 304, 354 sense the distorted electric field to provide a signal. Computing module 310 receives the signal and derives electrical parameters of the materials included in envelop 306. For example, computing module 310 may derive data as illustrated in
Based on such data, computing module 310 classifies materials included in envelop 306. In embodiments, computing module 310 classifies the materials based on linear discriminant analysis (LDA), which is a mathematical technique for identifying a subspace in which data has the largest variance. In this way, the data of the electrical parameters of the materials can potentially be organized in clusters, wherein each cluster of data corresponds to a different material included in envelop 306. LDA is described in more detail below.
The computing module may implement one or more methods for classifying materials included in a sample positioned on platform 606. For example, the computing module may implement a Bayesian-classification method. The computing module may then compute, for example, the Bhattacharyya distance between materials included in the sample. In general, the Bhattacharyya distance measures the similarity of two discrete probability distributions. In this context, the Bhattacharyya distance may be used as a measure for assessing the performance of the Bayesian-classification method. Table 1 includes the Bhattacharyya distance for a classifying various materials included in a sample. Assuming equal prior probabilities for two probability distributions, the Bhattacharyya distance, B, bounds the Bayes error (i.e., error<exp(−B)). This means that B>10 gives an error rate lower than 2e-5, B>5 gives an error rate lower than 0.3%, and B>2 gives an error rate lower than 6.8%.
System 600 can be used to collect various data used to classify materials included in a container positioned on platform 606. In operation, driving electrode 652 generates an electric field. Sensing electrode 654 senses distortions in the electric field based on the interaction of the electric field with the container (and materials therein) positioned on platform 606. Data regarding the distortion of the electric field is collected by a computing module (not shown). Data may be collected for various frequencies of the electric field generated by driving electrode 652, for various distances between driving electrode 652 and sensing electrode 654, and/or for various distances between platform 606 and the first (e.g., transverse) arm of segment 630.
From the data of the distortion of the electric field, the computing module can derive electrical parameters of the materials included in the container. For example, the computing module may derive the complex permittivity of the materials as a function of frequency. In embodiments, the data of the electrical parameters is organized into multi-dimensional vectors. The multi-dimensional vectors are projected into a lower-dimensional subspace using LDA. Importantly, the data may be grouped into distinct clusters in the lower-dimensional subspace, wherein the distinct clusters represent distinct materials included in the container. In this way, each cluster may serve as a signature for classifying the materials included in the container.
To further illustrate how computing module may classify materials, example data collected from system 600 is presented below. It is to be appreciated, however, that this example data is presented for illustrative purposes only, and not limitation. In this example data, five classes of materials were tested: air, salt, sugar, starch, and flour. The data was taken from a fixed distance (i.e., the separation between the materials and the first (e.g., transverse) arm of segment 630 was fixed). Twenty samples of air, salt, and starch and seventy samples of sugar and flour were used. The computing module derived the complex impedance of the samples taken at six different frequencies, resulting in 12-dimensional sample vectors (6 real components and 6 imaginary components). The mean air signature was subtracted from all the data. The 12-dimensional sample vectors were projected into a two-dimensional subspace using Fisher LDA.
The Bhattacharyya distance for classifying various materials using system 600 of
System 800 may be used, for example, to detect contraband (e.g., explosives, explosive precursors, and/or narcotics) included in automobile 801. In operation, driving electrode 802 generates an electric field, and sensing electrode 804 senses distortions in the electric field after the electric field interacts with materials in the automobile 801, in a similar manner to the embodiments described above. And, like the embodiments discussed above, computing module 810 classifies the materials included in automobile 801 based on electrical parameters of the materials derived from the distortions of the electric field.
To further illustrate how system 800 may be used to detect the presence of contraband, example data collected from system 800 is presented below. It is to be appreciated, however, that this example data is presented for illustrative purposes only, and not limitation. In this example, several different types of explosive materials and several different types of relatively benign materials were tested. Data were taken over a fairly broad frequency range from approximately 10 Hz to 40 kHz. The higher frequencies were measured first. The spacing between driving electrode 802 and sensing electrode 804 was fixed. Each sample vector is 12 dimensional (including 6 real components and 6 imaginary components).
In addition to the pre-measurement signatures, system 800 may be used to obtain data used to derive electrical parameters of materials included in automobile 801. For example,
Computing module 810 may implement one or more methods to classify the materials in automobile 801. For example, according to a first example method, computing module 810 compares normalized blind measurements with the normalized pre-measured signatures illustrated in
According to a second example method, computing module 810 computes a Bayesian-classification method. The performance of the Bayesian-classification method can be assessed using the Bhattacharyya distance. As mentioned above, the Bhattacharyya distance measures the similarity of two discrete probability distributions and may be used to measure the separability of classes in a classification. The Bhattacharyya distances for the above-mentioned example materials are presented below in Table 4. Assuming equal prior probabilities for two probability distributions, the Bhattacharyya distance, B, bounds the Bayes error (i.e., error<exp(−B)). This means that B>10 gives an error rate lower than 2e-5, B>5 gives an error rate lower than 0.3%, and B>2 gives an error rate lower than 6.8%.
According to a third example method, computing module 810 implements LDA to find a linear combination of features that best separates the classes of materials included in automobile 801. For example,
According to a fourth example method, computing module 810 implements a partial least squares fit. Unlike a conventional least squares fit, a partial least squares fit is well-suited for blind tests, but requires extensive preliminary measurements prior to material identification. According to a partial least squares fit, prediction functions are extracted from cross-product matrices involving both a response variable, Y, and an independent variable, X. Compared to a conventional least squares fit, calibrations in a partial least squares fit are generally more robust, provided that the calibration set accurately reflects the range of variability expected in unknown samples.
Various aspects of the present invention—such as the computing modules described herein—can be implemented by software, firmware, hardware, or a combination thereof.
Computer system 1500 includes one or more processors, such as processor 1504. Processor 1504 can be a special purpose or a general purpose processor. Processor 1504 is connected to a communication infrastructure 1506 (for example, a bus or network). Computer system 1500 may also include a graphics processing system 1502 for rendering images to an associated display 1530.
Computer system 1500 also includes a main memory 1508, preferably random access memory (RAM), and may also include a secondary memory 1510. Secondary memory 1510 may include, for example, a hard disk drive 1512 and/or a removable storage drive 1514. Removable storage drive 1514 may comprise a floppy disk drive, a magnetic tape drive, an optical disk drive, a flash memory, or the like. The removable storage drive 1514 reads from and/or writes to a removable storage unit 1518 in a well known manner. Removable storage unit 1518 may comprise a floppy disk, magnetic tape, optical disk, etc. which is read by and written to by removable storage drive 1514. As will be appreciated by persons skilled in the relevant art(s), removable storage unit 1518 includes a computer usable storage medium having stored therein computer software and/or data.
In alternative implementations, secondary memory 1510 may include other similar means for allowing computer programs or other instructions to be loaded into computer system 1500. Such means may include, for example, a removable storage unit 1522 and an interface 1520. Examples of such means may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM, or PROM) and associated socket, and other removable storage units 1522 and interfaces 1520 which allow software and data to be transferred from the removable storage unit 1522 to computer system 1500.
Computer system 1500 may also include a communications interface 1524. Communications interface 1524 allows software and data to be transferred between computer system 1500 and external devices. Communications interface 1524 may include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA slot and card, or the like. Software and data transferred via communications interface 1524 are in the form of signals 1528 which may be electronic, electromagnetic, optical, or other signals capable of being received by communications interface 1524. These signals 1528 are provided to communications interface 1524 via a communications path 1526. Communications path 1526 carries signals 1528 and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link or other communications channels.
Computer programs (also called computer control logic) are stored in main memory 1508 and/or secondary memory 1510. Computer programs may also be received via communications interface 1524. Such computer programs, when executed, enable computer system 1500 to implement embodiments of the present invention as discussed herein, such as the computing modules. In particular, the computer programs, when executed, enable processor 1504 to implement the methods of embodiments of the present invention, including the methods implemented by the computing modules. Accordingly, such computer programs represent controllers of the computer system 1500. Where the invention is implemented using software, the software may be stored in a computer program product and loaded into computer system 1500 using removable storage drive 1514, interface 1520, hard drive 1512 or communications interface 1524.
Set forth above are example systems, methods, and computer-program products for remotely classifying materials based on complex permittivity features. While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be apparent to persons skilled in the relevant art that various changes in form and detail can be made therein without departing from the spirit and scope of the invention.
It is to be appreciated that the Detailed Description section, and not the Summary and Abstract sections, is intended to be used to interpret the claims. The Summary and Abstract sections may set forth one or more but not all exemplary embodiments of the present invention as contemplated by the inventor(s), and thus, are not intended to limit the present invention and the appended claims in any way. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
Statement under MPEP 310. The U.S. government has a paid-up license in this invention and the right in limited circumstances to require the patent owner to license others on reasonable terms as provided for by the terms of 0706D070-DI, 0707D070-DI, and 0708D070-DI, awarded by the Defense Advanced Research Projects Agency (DARPA).