The embodiments described herein relate generally to contraband imaging systems and, more particularly, to contraband imaging systems that track an object associated with the contraband.
At least some known radiation imaging systems detect contraband. As used herein, the term “contraband” refers to illegal substances, explosives, narcotics, weapons, special nuclear materials, dirty bombs, nuclear threat materials, a threat object, and/or any other material that a person is not allowed to possess in a restricted area, such as a border crossing. One known radiation imaging system can determine a direction from a detector to a radiation source when the radiation source is stationary. However, when the radiation source is moving, gamma rays from the source arrive at the detector from a plurality of angles that change over time. The motion of the source with respect to the detector leads to smearing of a radiation image generated from the detector data. Further, the generated radiation image is biased because more events are detected when the source is closer to the detector as compared to when the source is located farther from the detector. When a radiation image is distance-biased, it appears that the source is at an angle corresponding to a distance of closest approach to the detector, rather than at its true location.
At least another known system attempts to image moving radiation sources using coded-aperture gamma cameras. The coded-aperture cameras include a coded mask and a position sensitive detector. The coded mask includes a pattern of transparent material and opaque material, which attenuates X-rays in a target energy range. The position sensitive detector has a spatial pattern sufficiently matching a grid size of the coded mask pattern. Photons from a certain direction project the coded mask onto the position sensitive detector. The photon projection has the same coding pattern as the mask, but is shifted on a detector plane. The shift correlates with a direction of the incident X-rays. Because the detector can detect any X-rays within an observed space, a relatively large accumulation of X-rays is needed for the coded-aperture gamma camera to be effective.
In one aspect, an imaging detection system is provided. The imaging detection system includes at least one location detection device configured to determine coordinates of a target, at least one detector configured to detect events from a source associated with the target, and a processor coupled in communication with the at least one location detection device and the at least one detector. The processor is configured to receive the coordinates from the at least one location detection device and the events from the at least one detector, translate the events using the coordinates acquired from the at least one location detection device to compensate for a relative motion between the source and the at least one detector, and output a processed data set having the events translated based on the coordinates.
In another aspect, an imaging detection system is provided. The imaging detection system includes a tracking system having a location detection device. The tracking system is configured to determine coordinates of a target based on data acquired from the location detection device. The imaging system further includes a detection system having a detector. The detection system is configured to detect events from a source associated with the target based on data acquired from the detector. A processor is coupled in communication with the tracking system and the detection system. The processor is configured to receive the coordinates from the tracking system and the events from the detection system, translate the events using the coordinates from the tracking system to compensate for a relative motion between the source and the detector, and output a processed data set having the events translated based on the coordinates.
In still another aspect, a method for generating an image of a source moving with respect to a detector is provided. The method includes acquiring real-world coordinates of a target associated with the source using a location detection device, detecting events from the source using the detector, translating the events using the real-world coordinates to compensate for a relative motion between the source and the detector, and generating the image having the events translated to intersect generally at a center of a field of view of the image.
The target-linked radiation imaging (TLRI) system described herein combines radiation imaging with real-time target tracking to detect moving radiation sources with greater sensitivity as compared to known radiation imaging systems. More specifically, in the exemplary embodiment, the TLRI system uses sophisticated real-time tracking to simultaneously monitor locations of multiple targets and report the locations in three-dimensional (3D) world coordinates. A processor and/or a server synchronizes the locations of the sources with real-time gamma ray detection data from at least one cadmium zinc telluride (CZT) Compton imaging detector. By compensating for the motion of the sources, the TLRI system detects weaker sources in a shorter time while they are in continuous motion.
Although detection of gamma rays is described herein, it should be understood that the TLRI system can be used with any sensing technology that detects a direction from a source to the detector. In the exemplary embodiment, the TLRI system is used when signals accumulate over time to achieve a desired signal-to-noise ratio. Further, the herein-described TLRI system can be used to translate any suitable events generated by a moving source. As used herein, the term “event” refers to the detection of any suitable type of radiation, such as a gamma ray, light, microwave, and/or millimeter wave, from a source. An event can be recorded as a discrete signal or a continuously variable signal. When the event has a continuously variable signal, the continuously variable signal is divided into predetermined time intervals that are each considered to be an event. In a particular embodiment, the time interval is selected to be a duration during which a target does not move far, i.e. 1 millisecond (ms). Examples of events include, but are not limited to, a gamma ray producing a discrete energy deposition in the detector, and millimeter wave imaging producing an image from a short time interval as a continuously variable signal.
Referring to
where E1 is the energy of gamma ray 11 deposited in the scatter event, E2 is the remaining energy of the gamma ray, mc2 is the rest energy of an electron that absorbs the energy E1, and angle Θ is defined relative to an axis 16 connecting two interaction points 12 and 18. If scattered gamma ray 14 is subsequently absorbed in detector 10 there is sufficient information to reconstruct an incident direction of gamma ray 11.
As shown in
More specifically, as detected events accumulate, cones begin to overlap in an area 56 of radiation image 50, while cones remain spaced apart in a remainder 58 of radiation image 50. A location of a source corresponds with overlap area 56. As such, when the radiation source is stationary, an imaging algorithm accumulates multiple overlapping gamma events to determine a source location. However, with existing systems, when the source is moving, the incident angle changes continuously, and the gamma events no longer accumulate coherently, as illustrated in
In
In the exemplary embodiment, the reconstructed image is rotated or translated in a virtual sense in a computer's memory, while the detector remains stationary. MCRI can therefore be applied simultaneously to multiple targets, even if the targets are moving in different directions and/or at different speeds. More specifically, all of the detected events are rotated or translated for each target in the field of view. When a target includes an emitting radiation source, the backprojected detection events will accumulate coherently within the reconstructed image. When a target is a non-radiation emitting target, the events will not align with each other in a backprojection image and will blend into the background of the image. As such, the target having a radiation source can be distinguished from other, non-radiation-emitting targets in the field of view. In a particular embodiment, predetermined criteria are used to distinguish radiation-emitting targets from non-radiation-emitting targets in the field of view. For example, the predetermined criteria can be at least partially based on a level of coherency of the accumulation the events and/or alignment of the events with the center of a reconstructed image, as described in more detail below.
There are numerous ways that real-time locations of targets can be determined. The accuracy of the tracked location, response latency, and/or other factors will impact performance of the TLRI system under different scenarios. Although any suitable real-time location determination system can be used with the TLRI system described herein, in the exemplary embodiment, the TLRI system includes a multi-camera, real-time video tracking system to determine target locations, velocity, pose, orientation, shape, and/or any other suitable information relating to a target. In one embodiment, target locations are reported in real world coordinates by establishing an accurate mapping of the imaging plane of each camera into a 3D world model. Alternatively, 2D modeling can be used. In the exemplary embodiment, the model determines at least a location of the target with respect to time.
Tracking system 202 includes at least one location detection sensor or device 208, a location capture device 210, and a target tracking device 212. More specifically, in the exemplary embodiment, tracking system 202 includes a plurality of cameras 214, an image capture card 216, and target tracking device 212. Cameras 214 are considered to be location detection sensors or devices 208. Alternatively, any suitable location detection sensor or device, such as radar, lidar, millimeter wave imaging, and/or any other suitable imaging and/or tracking technology that enables TLRI system 200 to function as described herein, is used in tracking system 202. In the exemplary embodiment, detection system 204 includes at least one sensor or detector 218, such as a radiation detector, a second router 220, a processor 222, and a data storage device 224. In a particular embodiment, processor 222 is a TLRI server. When more than one radiation detector 218 is used, radiation detectors 218 can be networked together to combine the detected events. At least one display 226 is coupled to tracking system 202 and/or detection system 204.
Tracking system 202 is configured to determine real world coordinates of a target 228 having a radiation source 230 associated therewith. The coordinates of target 228 are transmitted from tracking system 202 to processor 222 via first router 206. Detection system 204 is configured to determine locations of events caused by radiation source 230, and to transmit the event locations to processor 222. Processor 222 uses the coordinates to compensate for relative motion between source 230 and radiation detector 218 to determine a real world location of source target 228 and/or source 230 and track target 228 and/or source 230 as it moves through a tracking field, such as an imaging field 232. In the exemplary embodiment, TLRI system 200 can track a plurality of targets with or without a radiation source associated therewith. In one embodiment, TLRI system 200 can track multiple targets each having a radiation source associated therewith. In a particular embodiment, processor 222 is configured to compensate for a change in pose of target 228 with respect to at least one detector 218. As used herein, the term “pose” refers to a position and orientation of one object with respect to another object.
As shown in
In the exemplary embodiment, the calibration is a semi-automatic calibration method that uses imagery from cameras 214 to define a geometry of tracking system 202. More specifically, images from cameras 214 are used to back-calculate positions and orientations of cameras 214. To do this, fixed points in the observed space are measured by multiple cameras 214 simultaneously. By determining correspondences between these points in different camera views and building up a sufficient number of such points, an accurate estimate can be made of the camera positions. Tracking system 202 uses a model, such as a wire shape model, and points within images from cameras 214 to track target 228 (shown in
The model in the exemplary embodiment includes information related to how vehicles move to track a target within the images. In one embodiment, tracking system 202 includes a VISIOWAVE® Intelligent Video Platform and/or ULTRAVIEW® Enterprise Video Platform manufactured by UTC Fire & Security of Farmington, Conn. Using the real world locations, velocities, and/or orientations, processor 222 can compensate for target's 228 motion in a radiation backprojection image, as described herein.
As shown in
In the exemplary embodiment, a vehicle-detection stage 238 detects vehicles by explaining the observed foreground regions by hypothesized vehicles of a typical size, shape, and orientation. In one embodiment, vehicle-detection stage 238 performs a greedy search by iteratively placing vehicle hypotheses into a scene of field of view 232 in a way that at every step a maximum amount of image data is explained. The iterative process ends once no vehicle can be placed in the scene. Tracking system 202 obtains 3D vehicle locations 240 in one of two ways. First, if the vehicle follows an image-based approach that does not rely on geometric information to be known, image-level detections are projected from an image plane into a groundplane, and a groundplane location from within the groundplane projection is selected as 3D location 240 of the vehicle. Second, if vehicle-detection stage 238 relies on 3D vehicle models to be used in conjunction with geometric information about cameras 214 to drive the scale and pose selection process, 3D vehicle locations 240 are given by the 3D model location that is used to drive the detection process. A motion tracker 242 uses the 3D vehicle locations 240 to perform track formation, data association between detections and existing tracks, and track maintenance. For data association, general nearest neighbor algorithms or more complex multi-hypothesis tracking (MHT) assignment strategies can be utilized. For tracking, Extended Kalman filters or particle filters are used to perform the tracking of vehicle observations.
Referring again to
Display 226 includes a graphic user interface (GUI) that displays information to a user. The information can be real-time and/or stored data. For example, an uncompensated radiation image, a compensated radiation image, a graph of an X-Y position of the target, a graph of an energy spectrum, and an overlaid video can be displayed to the user on the GUI. In the exemplary embodiment, the overlaid video includes a substantially real-time video showing target 228 being tracked by tracking system 202 with a substantially real-time compensated radiation image superimposed on the video. As such, the user can visually identify target 228 and track target's 228 movement in real-time. A still capture can be generated from the video. Further, in the exemplary embodiment, the GUI can provide information relating to each target being tracked with TLRI system 200 and allow the user to select which target's information to display. It should be understood that the GUI provides any suitable information to the user including, but not limited to, a list of available targets, a motion compensated backprojection image, an uncompensated backprojection image, a number of backprojected gamma rays, an X-Y position of a selected target, a graph of target position with respect to time, a spectrum of the selected target, an energy range used for back projection, a video of the selected target, a still capture of the selected target, an image of the target overlaid with a radiation image, and/or a recording/playback time stamp.
TLRI system 200 is configured to perform a method and/or algorithm to translate detected events to the coordinates of a moving target 228 to compensate for the movement of target 228 with respect to at least one detector 218. More specifically, radiation detector 218 detects Compton scatter to determine a cone for each detected event. The cones for each detected event are backprojected to generate a radiation image. As described above, the radiation image includes an array of points (θ, φ) representing the detected event, wherein an intensity of each point (θ, (φ) is determined based on a corresponding cone. Processor 222 transforms each pixel and/or point (θ, φ) of the radiation image into a movement-compensated pixel or point (θ′, φ′) for each event based on an instantaneous angle between target 228 and detector 218 at a time when the event occurred.
In the exemplary embodiment, the coordinates from tracking system 202 are used to compensate for the movement of radiation source 230 such that the cones are effectively translated to a center point in the radiation image. Any suitable algorithm can be used to calculate the compensation angles for the movement of the radiation source based on the coordinates from the tracking system. In the exemplary embodiment, a rotation matrix is applied to the points (θ, φ) to rotate each point (θ, φ) based on the coordinates of target 228 as determined by tracking system 202. The rotation matrix transforms each point (θ, φ) into a movement-compensated point (θ′, φ′) by rotating each point (θ, φ) about an X-axis, a Y-axis, and/or a Z-axis of the tracking system coordinate system. As such, the cones are mapped to a new set of points (θ′, φ′).
A signal associated with each movement-compensated point (θ′, φ′) is then weighted. More specifically, each cone associated with a point (θ′, φ′) has a finite thickness or intensity. The thickness or intensity of each cone is based on a certainty of each cone. For example, the more certain the cone is, the thinner the cone, and the less certain the cone is, the thicker the cone is. As such, the signal associated with each point (θ′, φ′) is weighted based on the certainty of the cone to produce cones of different thickness in the radiation image. Because the points (θ′, φ′) have been translated, the cones of varying thicknesses, or intensities, will accumulate coherently if the target is a radiation-emitting target.
In the exemplary embodiment, the above-described method is performed for each target 228 within a field of view 232 of TLRI system 200. More specifically, processor 222 assumes that all events within the field of view are emitted from each target and performs the translation and weighting for each target. When the method is performed for a non-radiation-emitting target, the cones will have a relatively low level of coherent accumulation and may generate an image similar to image 130 shown in
In the left column of radiation images 300, the cones are spaced along an X-axis of each radiation image and become more spaced apart as the radiation source moves a farther distance as shown in the bottom radiation image of the left column. As such, the radiation images 300 in the left column appear “smeared” along the X-axis. In contrast, the right column of images 302 shows that the cones are translated to a center of the image, thus compensating for the movement of the source. As can be seen in the lower right-column radiation image 302, the cones overlap and/or intersect near a center of the radiation image rather than being spaced apart along the X-axis. Accordingly, the TLRI system described herein can detect the presence of a radiation source and locate the radiation source. When multiple targets are within the field of view, non-radiation-emitting targets will produce an image similar to non-compensated image 300, and radiation-emitting targets will produce an image similar to compensated image 302.
Although the TLRI or imaging detection system described herein includes a tracking system and a detection system, it should be understood that other suitable sensors can additionally be included in the imaging detection system. In a particular embodiment, a plurality of different types of sensors are used in conjunction with the tracking system, and data from the different types of sensors is fused and integrated coherently. As such, different types sensors are integrated together using the imaging detection system such that many relatively smaller sensors can be added to the imaging detection system incrementally to improve coverage and/or sensitivity of the imaging detection system. The different types of sensors can include non-directional sensors that correlate data with the proximity of the target. Other sensors may be more sophisticated sensors that allow for directionality and further target discrimination. The different types of sensor can be configured to obtain gamma radiation data, neutron data, chemical data, biological data, active inspection data, weight data, and/or any other suitable type of data. For example, the imaging detection system additionally includes a scale that measures a weight of a vehicle as it tracked passed a gamma detector. Assuming a slightly elevated radiation level is detected by the detection system and the weight of the vehicle abnormally heavy indicating, for example, shielding, an operator could further confirm the presence of contraband using a neutron detector.
The above-described TLRI system detects moving radiation sources, such as special nuclear materials (SNM), dirty bombs, other nuclear threat materials, and/or other contraband at, for example, a border crossing and/or a public checkpoint, which has not been possible with known detection systems. Further, the above-described TLRI system can detect weak moving radiation sources by using multiple detectors and the 3D world coordinates from location and/or tracking information. More specifically, by compensating for the motion of the contraband, the detection system described herein produces an image having more overlapping and/or intersecting events as compared to known detection systems that do not compensate for movement of the contraband.
Further, the tracking system described herein enables the TLRI system to report a location of a target for subsequent intervention by law enforcement and/or automated actions such as lowering, or not raising, traffic barriers. The tracking system also enables multiple targets to be tracked and differentiated from each other. Although any suitable radiation imaging technique can be used by the above-described TLRI system, the detection of Compton scattering provides 4π sensitivity and spectral imaging at higher energies while not requiring a heavy collimator.
In one embodiment, a radiation imaging system is provided. The radiation imaging system includes at least one location detection device configured to determine coordinates of a target, at least one radiation detector configured to detect events from a radiation source associated with the target, and a processor coupled in communication with the at least one location detection device and the at least one radiation detector. The processor is configured to receive the coordinates from the at least one location detection device and the events from the at least one radiation detector, compensate for a relative motion between the radiation source and the at least one radiation detector using the coordinates from the at least one location detection device, and output a radiation image having the events translated based on the coordinates.
In another embodiment, a radiation imaging system is provided. The radiation imaging system includes a tracking system having at least one location detection device. The tracking system is configured to determine coordinates of a target based on data from the at least one location detection device. The radiation imaging system further includes a radiation detection system having at least one radiation detector. The radiation detection system is configured to detect events from a radiation source associated with the target based on data from the at least one radiation detector. A processor is coupled in communication with the tracking system and the radiation detection system. The processor is configured to receive the coordinates from the tracking system and the events from the radiation detection system, compensate for a relative motion between the radiation source and the at least one radiation detector using the coordinates from the tracking system, and output a radiation image having the events translated based on the coordinates.
In still another embodiment, a method for generating a radiation image is provided. The method includes acquiring real-world coordinates of a target using at least one location detection device, detecting events from a radiation source associated with the target using at least one radiation detector, and translating the events using the real-world coordinates to compensate for a relative motion between the radiation source and the at least one radiation detector. The radiation image having the events translated to intersect generally at a center of a field of view of the radiation image is generated.
Exemplary embodiments of a target-linked radiation imaging system are described above in detail. The methods and systems are not limited to the specific embodiments described herein, but rather, components of systems and/or steps of the methods may be utilized independently and separately from other components and/or steps described herein. For example, the methods may also be used in combination with other radiation imaging systems and methods, and are not limited to practice with only the Compton scatter systems and methods as described herein. Rather, the exemplary embodiment can be implemented and utilized in connection with many other radiation detection applications.
Although specific features of various embodiments of the invention may be shown in some drawings and not in others, this is for convenience only. In accordance with the principles of the invention, any feature of a drawing may be referenced and/or claimed in combination with any feature of any other drawing.
This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims.
This application claims the benefit of U.S. Provisional Application No. 61/323,574 filed Apr. 13, 2010, which is hereby incorporated by reference in its entirety.
This invention was made with United States government support under contract HSHQDC-08-C-00137, awarded by the Domestic Nuclear Detection Office (DNDO) Organization. The United States government may have certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
61323574 | Apr 2010 | US |