Systems and methods consistent with the present invention are directed generally to systems and methods for x-ray inspection, and more particularly to systems and methods for multi-scanner x-ray inspection.
Various x-ray scanning systems can be used for baggage inspection, for example, at an airport or a train station, to detect the presence of explosives and other prohibited items in baggage or luggage. X-ray scanning systems are capable of measuring one or more parameters that can be used to characterize a scanned material, such as an absorption coefficient or an effective atomic number. For example, and without limitation, explosive materials can be detected based on the fact that their detected absorption coefficient and/or effective atomic number are differentiable from those of other items typically found in baggage.
A common step towards detecting explosive materials in an item is to expose the item to x-rays and to measure the amount of radiation absorbed by the item. An x-ray scanning system can contain a radiation source that is configured to emit x-ray radiation towards the item under inspection, and a detector on the opposite side of the item to detect the x-ray radiation that is not completely absorbed by the item. Based on different acquisition schemes, various sets of projection data can be acquired, from which one can derive one or more material-specific parameters.
For example, in a computed tomography (CT) system, the source and detector are conventionally arranged in a rotating manner and multiple sets of projection data can be collected at various projection angles. An absorption coefficient map of the item can be reconstructed based on the sets of projection data. Explosive materials can then be detected by comparing the absorption coefficients in the set of acquired data with known absorption coefficients of explosive materials.
As another example, in a multi-energy x-ray system, the source can emit x-ray radiation over a continuous spectrum of energies, and the detector can measure multiple sets of projection data at multiple energy ranges within that continuous spectrum, such as a first set of projection data at a first energy range within that continuous spectrum, a second set of projection data at a second energy range within that continuous spectrum, etc. Based on the collected projection data, an effective atomic number map (also known as a “Z image”) of the materials can be calculated. Explosives can be detected by determining if any region in the Z image has effective atomic numbers falling into one or more ranges associated with explosives. However, relying on a CT scanner or a multi-energy x-ray scanner alone, false alarms can occur at a high rate, especially when the scans are taken at a fast speed and/or the explosive material is under or inside some other materials.
The quality of conventional scanning systems, including multi-scanner systems, can be limited by the amount of unknown information about the item being scanned. A common unknown variable simply relates to the random nature by which material can be placed together in an item being scanned, especially when multiple objects overlap with each other along the travel path of the x-ray. By way of example only, an explosive material may exhibit a significantly lower effective atomic number than metals. If such an explosive object is behind a metal object along the projection path of a multi-energy single view scanner, the calculated effective atomic number of these two objects combined can mimic the effective atomic number of a non-explosive, or non-prohibited, item. As a result, the explosive can be missed by conventional inspection system.
In one aspect, the present disclosure is directed to a method of analyzing a target item utilizing multiple scanners. The method can include providing an item comprising a material. The method can further include acquiring a first set of scan data associated with the item using a first scanner, and acquiring a second set of scan data associated with the item using a second scanner. The method can further include generating a first set of transform data from the first set of scan data, analyzing the first set of transform data to identify a subset of the first set of transform data associated with a first region, and analyzing the second set of scan data to identify a subset of the second set of scan data associated with a second region. The method can also include generating a measure that at least a portion of scan data is consistent with a presence of a candidate material in the item, where the portion of scan data is selected from at least one of the set consisting of: the subset of the first set of transform data and the subset of the second set of scan data.
In another aspect, the present disclosure is directed to a system configured to analyze a target item utilizing multiple scanners. The system can include a conveyor configured to provide an item to a first scanner and a second scanner. The item can comprise a material. The first scanner can be configured to acquire a first set of scan data associated with the item, and the second scanner can be configured to acquire a second set of scan data associated with the item. The system can further include a transform calculator configured to generate a first set of transform data from the first set of scan data. The system can further include a region data classifier configured to identify a subset of the first set of transform data associated with a first region and to identify a subset of the second set of scan data associated with a second region. The system can also include a candidate material calculator configured to generate a measure that at least a portion of scan data is consistent with a presence of a candidate material in the item, where the portion of scan data is selected from at least one of the set consisting of: the subset of the first set of transform data and the subset of the second set of scan data.
In yet another aspect, the present disclosure is directed to a computer-readable medium comprising instructions stored thereon. The instructions can cause a computer to perform a method of analyzing a target item utilizing multiple scanners. The method can include receiving a first set of scan data associated with an item and receiving a second set of scan data associated with the item. The item can comprise a material. The first set of scan data can be acquired by a first scanner, and the second set of scan data can be acquired by a second scanner. The method can further include generating a first set of transform data from the first set of scan data, analyzing the first set of transform data to identify a subset of the first set of transform data associated with a first region, and analyzing the second set of scan data to identify a subset of the second set of scan data associated with a second region. The method can also include generating a measure that at least a portion of scan data is consistent with a presence of a candidate material in the item, where the portion of scan data is selected from at least one of the set consisting of the subset of the first set of transform data and the subset of the second set of scan data.
Inspection system 100 can include a conveyor 110, a CT scanner 120, a scanner 130, and a data processing system 140 coupled to scanners 120 and 130. Conveyor 110 can include belts for supporting item 10 and one or more motors that drive the belts. The belts can rotate intermittently or continuously to convey or provide item 10 from a loading area through a central aperture of CT scanner 120 and scanner 130. Conveyor 110 is illustrated as including a plurality of individual conveyor sections in
Any suitable CT scanner can be used. For example, the CT scanner 120 can include a cone beam, such as a three-dimensional cone beam. CT scanner 120 can include, among other things, an x-ray source 121 and an x-ray detector 122 secured to diametrically opposite sides of an annular-shaped platform or disk. The disk can be rotatably mounted within a gantry support so that in operation the disk continuously rotates about a rotation axis while x-rays pass from the source through item 10 positioned within the aperture of CT scanner 120. X-ray source 121 can generate a cone shaped beam (known as a “cone beam”) of x-rays that emanates from the focal spot, and passes through a volumetric imaging field. x-ray detector 122 can include a two-dimensional array of detectors disposed on a circular arc having a center of curvature at the focal spot of x-ray source 121. As conveyor 110 continuously transports item 10 through the aperture of CT scanner 120, the disk rotates about its rotation axis, thereby moving x-ray source 121 and x-ray detector 122 in circular trajectories about item 10. Accordingly, a plurality of projection views of item 10 at different projection angles can be generated and a corresponding plurality of sets of two-dimensional projection data can be acquired by x-ray detector 122. Since the x-rays are partially attenuated by all the mass in their path, the projection data acquired by x-ray detector 122 are representative of the absorption coefficients of all the objects disposed in the volumetric imaging field between x-ray source 121 and x-ray detector 122.
Consistent with other embodiments, the CT scanner 120 also can employ a stationary gantry, whose position remains fixed during data collection. The stationary gantry can have a plurality of x-ray sources and detectors mounted at various positions along the arc of the gantry. These x-ray sources can be electronically steered to generate substantially circular x-ray beams comparable to those generated by a rotating x-ray source. In some embodiments, each x-ray source on the stationary gantry can be activated in a sequential manner, so that one projection view of item 10 is generated each time. In some other embodiments, multiple x-ray sources can be active at the same time, generating multiple projection views of item 10.
Consistent with one embodiment, scanner 130 can be a multi-energy line scanner. Measuring x-ray absorptions at more than one energy value can provide additional information about a material's characteristics, beyond the absorption coefficient of the material. For example, when scanner 130 is a dual energy scanner, two sets of projection data can be collected, which can be used to determine an effective atomic number and/or an electron density of the material.
Scanner 130 can include, among other things, a point x-ray source 131 and a linear x-ray detector 132. Point x-ray source 131 and linear x-ray detector 132 can be mounted, stationary, on opposite sides of the aperture through which item 10 is conveyed. Although
Although
In one embodiment, both x-ray detector 122 and linear x-ray detector 132 can be coupled with data processing system 140 via, for example, one or more data transmission lines. The multi-angle projection data acquired by CT scanner 120 and the multi-energy projection data acquired by scanner 130 can be transferred to data processing system 140 via the data transmission lines. In another embodiment, the projection data also can be transferred wirelessly to data processing system 140.
Data processing system 140 can include one or more computer assemblies configured to detect an object of interest or a material, such as an explosive material, in item 10, based on scan data received from CT scanner 120 and scanner 130. Data processing system 140 can be associated with one or more software applications, including, for example, an image analysis and/or reconstruction tool and a material classification tool. These software applications can be stored on data processing system 140, and can be accessed by an authorized user, such as an operator at a customs, ports and borders control, or airport. The software applications also can be stored on a computer readable medium, such as a hard drive, computer disk, CD-ROM, or any other suitable medium.
Processor 241 can be a central processing unit (“CPU”) or a graphic processing unit (“GPU”). Processor 241 can execute sequences of computer program instructions to perform various processes that will be explained in greater detail below. Memory module 242 can include, among other things, a random access memory (“RAM”) and a read-only memory (“ROM”). The computer program instructions can be accessed and read from the ROM, or any other suitable memory location, and loaded into the RAM for execution by processor 241. Depending on the type of data processing system 140 being used, processor 241 can include one or more printed circuit boards, and/or a microprocessor chip.
Scanner control interface 243 can be configured for two way communication between scanners 120 and 130, and data processing system 140. Consistent with one embodiment, scanner control interface 243 can be configured to receive scan data from CT scanner 120 and scanner 130 and store the data into storage device 244. Consistent with another embodiment, scanner control interface 243 can be further configured to send scan control instructions to CT scanner 120 and scanner 130 to initiate and stop scan operations, or to configure the scanners. For example, the scan control instructions can include configuration parameters, such as, the rotation speed of the gantry of CT scanner 120 and the energy levels of scanner 130.
Storage device 244 can include any type of mass storage suitable for storing information. For example, storage device 244 can include one or more hard disk devices, optical disk devices, or any other storage devices that provide data storage space. In one embodiment of the present disclosure, storage device can store data related to the data processing process, such as the scan data received from CT scanner 120 and scanner 130, and any intermediate data created during the data processing process. Storage device 244 can also include analysis and organization tools for analyzing and organizing the information contained therein.
Data processing system 140 can be accessed and controlled by a user, such as a security officer, using input interface 245. User input interface 245 can be provided for the user to input information into data processing system 140, and can include, for example, a keyboard, a mouse, a touch screen, and/or optical or wireless computer input devices (not shown). The user can input control instructions via user input interface 245 to control the operation of conveyor 110, CT scanner 120 and/or scanner 130. For example, the user can push certain buttons on a keyboard to stop conveyor 110, let it go backward or resume going forward. The user can also input parameters to adjust the operation of data processing system 140.
One or more modules of data processing system 140 disclosed consistent with
A transform calculator can be configured to execute an image reconstruction algorithm. For example, the transform calculator can be configured to generate a three-dimensional CT image 410 of exemplary item 330 from the sets of projection data received from CT scanner 120, as shown in
The region data classifier, either alone or in cooperation with the candidate material calculator, can be configured to execute an image classification algorithm. For example, region data classifier can be configured to identify one or more volumetric regions, such as region 411 and region 412, in three-dimensional CT image 410 that correspond to the objects contained in exemplary item 330. For example, region 411 can correspond to object 331 and region 412 can correspond to object 332. In one embodiment, only those regions containing voxel values that are consistent with an absorption coefficient or a range of absorption coefficients associated with the presence of candidate materials in the item are identified. (As used herein, “candidate materials” refers to materials that are of interest and/or that are prohibited.) For example, voxel values of region 411, indicative of absorption coefficient of object 331, can be within the range of absorption coefficients associated with prohibited materials. However, voxel values of region 412, indicative of absorption coefficient of object 332, can be different from the absorption coefficients associated with that of prohibited materials. Accordingly, the region data classifier, either alone or in conjunction with the candidate material calculator, can identify region 411 for further analysis. Moreover, in one embodiment, the transform calculator can compare the mass and/or volume of an identified region with a candidate region threshold. For example, if the volume of an identified region is smaller than a volume threshold, the identified region can be disregarded as it is too small to be a candidate region, or it may not correspond to a real object of interest, but rather can correspond to merely a reconstruction artifact. Accordingly, identified regions smaller than a volume threshold can be discarded. As a result, this additional thresholding process can mitigate reconstruction errors and artifacts caused during reconstruction of three-dimensional CT image 410.
A candidate material calculator can be configured to execute a material identification algorithm. For example, the candidate material calculator can be configured to analyze all or a portion of the multi-energy projection data acquired by scanner 130. In one embodiment the entire image is analyzed and can be coextensive with a candidate region. In other embodiments, only a smaller, identified, portion of an image can be analyzed. Consistent with one embodiment, a portion of data to be analyzed is determined by mapping regions 411 and 412 to two-dimensional projection images consistent with the projection images of region 520 received from scanner 130, as shown in
Although
Going back to
Conveyor 110 can provide exemplary item 330 to scanner 130, where a multi-energy line scan can be conducted (Step 606). During the scan, multiple sets of two-dimensional projection data can be acquired by line x-ray detector 132—for example a set of data at a higher energy value and a lower energy value. Each set of two-dimensional projection data—or the combined set of two-dimensional projection data at both energies—can form a two-dimensional projection image 520 of exemplary item 330 (Step 607).
Probable material in each first region 411 and 412 can be identified by analyzing three-dimensional CT image 410 and two-dimensional projection image 520 obtained in step 605 and step 607 (Step 608). Step 608 can be carried out by a candidate material calculator implemented together with a region data classifier by data processing system 140. Consistent with one embodiment, for example, region data classifier can be configured to utilize at least a portion of the first set of transform data to identify subsets of the second set of scan data associated with second regions, such that first regions 411 and 412 and the identified second regions are approximately commensurate. Further, and consistent with one embodiment, step 608 can include generating the effective atomic number for each of the identified second regions. Additionally or alternatively, step 608 can also include calculating the electron density for each of the identified second regions.
The electron density can be calculated using the following formula:
ρc(r)=(Z1/A1×δ1(r)+Z2/A2×δ2(r))×Na
where Na is Avogadro's number (6.0225×1023), the variables Z1,2 correspond to the atomic numbers of base materials 1 and 2, the variable A1,2 corresponds to the atomic weight of materials 1 and 2 and variable δ1,2 correspond to the thicknesses of the materials 1 and 2 along the absorption path. Likewise, the effective atomic number can be calculated using the following formula:
Z
eff
={[Z
1
/A
1×δ1(r)×Z1X+Z2/A2×δ2(r)×Z2X]/[Z1/A1×δ1(r)+Z2/A2×δ1(r)]}1/X
Here, the exponent X can have a value between 2.8 and 3.4 depending on the scientific literature reference is cited. Common values are 3.0 and 3.1.
The candidate material calculator can further compare the generated effective atomic number and/or electron density value with those in a lookup table that specifies the effective atomic numbers and/or electron density of various materials, and determine which probable material is likely present in the second region. The lookup table can be stored in memory module 242 or in storage device 244. Table A shows an exemplary table that can be used in step 608.
For example, if the generated effective atomic number is consistent with ZF, the candidate material calculator can determine that the probable material in the second region is consistent with the presence of a candidate material (i.e., “Explosive F”) in the item being analyzed. The probable material identification process of step 608 will be described in greater detail in
The candidate material calculator further can generate a measure if any of the probable materials determined in step 608 in the second region is consistent with the presence of a candidate material in the item (Step 609). If data associated with one of the regions is consistent with the presence of a candidate material in the item (Step 609: Yes), the candidate material calculator can provide an indication of the candidate material (Step 610). For example, the candidate material calculator can determine that data associated with region 411 is consistent with the presence of an explosive material in the item, and can provide an indication to the user on display device 246 or otherwise provide some notation and/or sign. If none of data associated with the regions is consistent with the presence of a candidate material in the item (Step 609: No), step 610 will be skipped, and the process can conclude.
Consistent with one embodiment, step 708 can include calculating an effective atomic number map and/or an electron density map of exemplary item 330, based on two-dimensional projection images 520 corresponding (for example) to a higher energy value and a lower energy value, respectively. A region data classifier, either alone or in conjunction with a candidate material calculator, can then identify each region that has similar effective atomic number values and/or electron density values. Consistent with one embodiment, region data classifier, either alone or in conjunction with a candidate material calculator, can compare the calculated effective atomic numbers and/or electron densities with a set of effective atomic numbers and/or electron densities consistent with the presence of candidate materials in the item being analyzed, and flag only those regions for further analysis that have pixel values consistent with the presence of candidate materials. For example, region 521 corresponding to object 331 can be classified as R2.
Both R1 and R2 can be mapped onto a two-dimensional image (Step 709). The mapping of first regions R1 can be carried out using the same projection perspective of scanner 130 as that used to obtain two-dimensional projection images 520, so that the mapped R1 and R2 can be registered on the same two-dimensional image. For example, forward projection data of R1 can be calculated based on the geometry and projection angle of scanner 130. On the two-dimensional image, one or more areas covered by R1 and/or R2 can be determined (Step 710). Where R1 is determined solely based on the absorption coefficients represented by three-dimensional CT image 410 and R2 is determined solely based on the effective atomic numbers and/or electron density values derived from two-dimensional projection images 520, R1 and R2, when mapped onto the two-dimensional image, may not completely overlap with each other. Consistent with one embodiment, all the areas covered by the mapped R1 or R2 are analyzed to identify the probable materials in those areas, to enhance detection accuracy.
For areas A1 where the mapped R1 overlap with R2 (Step 711), the candidate material calculator can identify probable materials in areas A1 by analyzing both three-dimensional CT image 410 and two-dimensional projection images 520 (Step 712). The probable material identification process of step 712 can be carried out by candidate material calculator, similar to step 608 of
For example, if the generated absorption coefficient in A2 is consistent with μe, the candidate material calculator can determine that the probable material in the first region is an explosive material. Consistent with one embodiment, Table A and Table B can be combined into one look-up table with a listing of materials, absorption coefficients, effective atomic numbers, and/or electron density values.
Similarly, for areas A3 that are within R2 but outside of mapped R1 (Step 715), the candidate material calculator can identify probable materials in areas A3 by analyzing two-dimensional projection images 520 only (Step 716). For example, step 716 can include generating the effective atomic numbers for areas A3 based on two-dimensional projection images 520. The candidate material calculator can further compare the effective atomic numbers and/or electron density values with those stored in Table A, and determine a material that is consistent with the data associated with areas A3.
The candidate material calculator can generate a measure if any of the probable materials identified in steps 712, 714, and 716 is consistent with the presence of a candidate material (Step 717). Consistent with one embodiment, the measure can be generated based solely on areas A1. If data consistent with at least one candidate material is detected (Step 717: Yes), the candidate material calculator can provide an indication of the candidate material, for example, via display device 246 (Step 718). If no data consistent with the presence of candidate material is detected (Step 717: No), step 718 will be skipped, and the process can conclude.
For illustration purposes only, we can assume that the candidate material calculator selects nitroglycerin and iron as the first hypothetical combination of materials for first regions 411 and 412, and trinitrotoluene and copper as the second hypothetical combination of materials for the same regions. As shown in
The candidate material calculator can generate two-dimensional synthetic projection images 950 and 960 of the constructed three-dimensional synthetic images 910 and 920 (Step 803 and Step 804). Two-dimensional synthetic projection images 950 and 960 can be computed consistent with the projection perspective of scanner 130 that is used to obtain two-dimensional projection images 520, so that the mapped image can be registered with two-dimensional projection images 520. Accordingly, each of the sets of synthetic projection data associated with each of the respective hypothetical combinations can correspond to the hypothetical presence of each of the materials in second region 520. Consistent with one embodiment, two-dimensional synthetic projection images 950 and 960 can be calculated at either of the two energy levels used by scanner 130, and/or can be calculated to be consistent with combined set of two-dimensional projection data at multiple energies.
The candidate material calculator can further compute a distance between each generated two-dimensional synthetic projection image 950 or 960 and two-dimensional projection image 520 obtained from scanner 130 (Step 807 and Step 808). Consistent with one embodiment, the distance between two images can be computed as a L1 norm or a L2 norm of the difference image between the two images. As shown in
The candidate material calculator can select one of the hypothetical combinations of materials as the probable combination of materials in second regions 521 and 522 based on the computed distances (Step 809). For example, the hypothetical combination of materials 911 and 912 associated with a shorter distance can be selected, because two-dimension synthetic projection image 960 more closely resembles two-dimensional projection image 520 obtained from scanner 130. The process can conclude after step 809.
Although the exemplary process of
Consistent with the embodiments disclosed herein, at least two independent physical parameters associated with a material being inspected (such as Zeff and the absorption coefficient, or the electron density and the absorption coefficient), can be acquired. Utilizing at least two independent parameters provides additional information about the inspected material, and allows for a system that can exhibit an increased detection capability for some inspected materials. Especially for those materials that either have an absorption coefficient similar to the typical contents of bags or for those materials that cannot be sufficiently resolved by a conventional scanner and would result in the appearance of artifacts when inspected by such a conventional scanner.
The probable edges 1101 and 1102 can be mapped to two-dimensional projection images of second region 520 obtained from scanner 130 (Step 1002 and Step 1202). As shown in
For each segmented region, the candidate material calculator can determine an effective atomic number and/or an electron density value corresponding to that region (Step 1004 and Step 1204). Consistent with one embodiment, the effective atomic numbers can be determined using a “jump” method. Referring back to
The candidate material calculator can further look up the calculated effective atomic number and/or electron density value of each segmented region (such as in Table A for effective atomic number data), and determine the probable material contained in each region (Step 1005 and Step 1205). Process can conclude after steps 1005 and 1205.
It is contemplated that the steps associated with
The disclosed system and method can be applicable to detection of objects and materials of interest using an automated or semi-automated process. Although disclosed embodiments are described in association with container, crate or baggage inspection such as at an airport, train station, cargo inspection or other port- and border-applications, the disclosed inspection system and inspection method can be used in other applications, such as medical imaging in a hospital or imaging facility, product quality control in a factory, etc.
It will be apparent to those skilled in the art that various modifications and variations can be made in the disclosed system and method without departing from the scope of the disclosure. Additionally, other embodiments of the disclosed system and method will be apparent to those skilled in the art from consideration of the specification. It is intended that the specification and examples be considered as exemplary only, with a true scope of the disclosure being indicated by the following claims and their equivalents.
This application claims priority to U.S. Provisional Patent Application No. 61/444,541, filed Feb. 18, 2011, the contents of which are incorporated herein by reference.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB2012/000570 | 2/16/2012 | WO | 00 | 1/24/2014 |
Number | Date | Country | |
---|---|---|---|
61444541 | Feb 2011 | US |