The present invention relates to the detection of objects, and more particularly, to techniques for remote detection and measurement of objects.
It is well known to use electromagnetic radiation to detect the presence of objects (e.g. handheld detectors used for detecting objects on or under the ground, and walk-through arches at airports).
However, the conventional detectors used at airports may be unable to determine the dimensions of objects to any significant degree, and thus may be unable to distinguish between objects of different types, i.e. harmless (belt buckles, cameras), and potentially dangerous (guns, knives).
The detection of concealed weapons, especially handguns, may be a very great problem for security applications that currently cannot be policed without a non-portable system, for example random checks in an urban environment. The use of microwaves (electromagnetic waves with wavelengths in the centimeter to millimeter range) may provide a means for the standoff detection and identification of concealed conducting items such as handguns and knives, Large metal objects, such as handguns, may give a significantly different and generally larger response when irradiated by low power microwaves than that from the human body, clothing and/or benign normally-carried objects. The larger response may be detected using a combination of antenna and sensitive receiver.
By actively illuminating, an object with wide-range swept and/or stepped frequency microwave and/or millimeter wave radiation, the frequency response of the return signal may give the range and/or information regarding dimensions of the object. This method may be substantially equivalent to using a fast microwave pulse and measuring the response as function of time, as used in conventional RADAR. Selecting a part of the return signal within a particular range may aid the positive identification of the suspect object and may also help to reject background signals. The analysis of the time response may give further information as to the dimensions of the target. This technique may also be applied to the detection of dielectric layers, such as, for example, an explosive vest strapped to a suicide bomber (see Active millimeter wave detection of concealed layers of dielectric material, Bowring N. J., Baker J, G., Rezgui M., Southgate M., Proceedings of the SPIE 6540-52 2007; and A sensor for the detection and measurement of thin dielectric layers using reflection of frequency scanned millimetric waves, Bowring N. J., Baker J. G., Rezgui R, Alder J. F. Meas. Sci. Technol. 19 024004 (7pp) 2008). However, such techniques have not been heretofore used for detecting and measuring metal objects.
A system based on swept frequency RADAR has been proposed (U.S. Pat. Nos. 6,359,582 and 6,856,271 and published application US2007/0052576), In the disclosed systems, the frequency may be swept by typically by 1 GHz around about 6 GHz. The depth resolution that is achievable is therefore only 15 cm, thus the system may not give details of the objects, The detection relies on comparing gross features of the signal as a whole with similar suspicious and benign signals to which the system had been previously exposed, Also the measurement of polarization properties of the scattered signal may be used.
In the aforementioned patent documents, the low frequency of operation makes the angular resolution of the antennae poor and the wide field of view makes it difficult to single out particular targets and/or to determine on which part of the target the threat is situated, This may be improved by changing to higher frequencies where microwave optics becomes effective. This may be particularly important for explosives detection where the contrast from the body signal is low, Systems working at higher frequencies but still with a limited bandwidth have been proposed by Gorman et al (U.S. Pat. No. 6,967,612) and by Millitech (U.S. Pat. No. 5,227,800). Many systems have been produced to enable images of the target to be obtained using either active microwave illumination or the passive thermal emission of the target (SPIE 2007). These systems use multi-detector arrays and some form of mechanical scanning. Passive systems, though giving more realistic images, tend to be slow and show poor contrast for dielectric targets. Active illumination systems can be acquired faster, but may suffer from strong reflections from benign objects such as the human body, which make it difficult to distinguish from metal threat objects, All scanning systems may require complex human or Artificial Intelligence interaction to interpret the image and/or to pick out the suspect features. This makes their deployment in many applications difficult.
It is apparent that systems which can identify threat objects at standoff distances may have many applications, where conventional metal detector booths are inappropriate. These may include covert surveillance and mobile operation in streets and buildings. Portable, compact and cost-effective systems are not presently available and this invention seeks to address this need.
According to some embodiments of the present invention there are provided systems for remote detection of one or more dimensions of a metallic or dielectric object. Some embodiments of such systems may include a transmission apparatus, including a transmission element, for directing microwave and/or mm wave radiation in a predetermined direction, a detection apparatus, for receiving radiation from an entity resulting from the transmitted radiation and generating one or more detection signals in the frequency domain, and a controller. In some embodiments, the controller may be operable to (i) cause the transmitted radiation to be swept over a predetermined range of frequencies, (ii) perform a transform operation on the detection signal(s) to generate one or more transformed signals in the time domain or optical depth domain, and (iii) determine, from one or more features of the transformed signal, one or more dimensions of a metallic or dielectric object upon which the transmitted radiation is incident.
In some embodiments, the transmission element is a directional element that may be pointed by a user.
In some embodiments, the controller is operable to initiate step (i) upon receiving an activation signal, the activation signal corresponding to a user input and/or to detection of the presence of the entity.
In some embodiments, step (i) comprises stepwise sweeping by predetermined steps in frequency and step (ii) comprises (iia) performing a transform operation-after each sweep to produce a time domain or optical depth domain trace, and (iib) storing each time domain trace in a respective sweep channel, said time domain or optical depth domain traces thereby comprising said transformed signals.
In some embodiments, step (iii) comprises normalising said according to range one or more transformed signals.
In some embodiments, step (iii) further comprises using a Complex Fourier Transform and/or Direct Fourier Transform to convert transformed signals to the x-dimension, and determining the x-positions of peaks on the transformed signals.
In some embodiments, step (iii) further comprises, from the x-positions, using
where L=optical depth
c=the speed of light
Δf=the periodicity in the frequency domain,
to determine corrected x-axis positions, and thereby optical depth.
In some embodiments, step (ii) includes the procedure of Appendix B.1, thereby producing first and second outputs (Output1, Output2) dependent upon the detection signals, wherein Output1 is the sum of all correlations between vectors in a first array, the vectors in the first array comprising, for each sweep channel, a stored signal above a threshold that are derived by Direct Fourier Transform from the detection signals, and Output2 is the sum of integrated signals above the threshold for each sweep channel.
In some embodiments, step (ii) includes the procedure of Appendix B.2, thereby producing a third output (Output3) dependent upon the detection signals, wherein Output3 is, for each sweep channel, the best (lowest) correlation value between the ideal response for a number of barrel lengths and for a number of weapon calibers stored in memory and the direct untransformed detection signals |ER|2.
In some embodiments, the detection apparatus includes a first detection element directed in a first direction, towards the entity, for generating non-polarized detection signals, and a second detection element, directed at 90 degrees to the first element, for generating cross-polarized detection signals, and wherein step (ii) includes the procedure of Appendix B.3, thereby producing fourth and fifth outputs (Output4, Output5) dependent upon the detection signals, wherein Output4 is, for each sweep channel, the sum of correlations between the transformed signals, the transformed signals comprising a Complex Fourier Transform of the non-polarized detection signals and of the cross-polarized detection signals, and Output5, for each sweep channel, the sum of the integrated non-polarized and cross-polarized signals after Complex Fourier Transform. In some embodiments, the integrated non-polarized and cross-polarized signals comprise integrations of transformed signals within one or more distance windows, the contents of each distance window being stored in a database in association with a respective response for a particular weapon.
In some embodiments, step (ii) includes the procedure of Appendix B.4, thereby producing sixth and seventh outputs (Output6, Output7) dependent upon the detection signals.
In some embodiments, the system further includes a neural network, the neural network having as inputs thereto any combination of (a) the first and second outputs (Output1, Output2), (b) the third output (Output3), (c) the fourth and fifth outputs (Output4, Outputs), and (d) the sixth and seventh outputs (Output6, Output7), wherein the output of the neural network is an indication of a confidence level of a metallic or dielectric object of a predetermined type being detected, for example, 1=gun detected, 0=no metallic or dielectric object detected.
According to some embodiments of the present invention there are provided methods for remote detection of one or more dimensions of a metallic or dielectric object. Such methods may include a transmission apparatus, including a transmission element, for directing microwave and/or mm wave radiation in a predetermined direction, a detection apparatus, for receiving radiation from an entity resulting from the transmitted radiation and generating one or more detection signals in the frequency domain, and a controller, Methods may include operating the controller to (i) cause the transmitted radiation to be swept over a predetermined range of frequencies, (ii) perform a transform operation on the detection signal(s) to generate one or more transformed signals in the time domain, and (iii) determine, from one or more features of the transformed signal, one or more dimensions of a metallic or dielectric object upon which the transmitted radiation is incident. In some embodiments, the transmission element is a directional element that may be pointed by a user.
In some embodiments, the controller is operable to initiate step (i) upon receiving an activation signal, the activation signal corresponding to a user input or to detection of the presence of the entity.
In some embodiments, step (i) comprises stepwise sweeping by predetermined steps in frequency and step (ii) comprises (iia) perform a transform operation after each sweep to produce a time domain or depth domain trace, and (iib) storing each time domain or depth domain trace in a respective sweep channel, said time domain or depth domain traces thereby comprising said transformed signals.
In some embodiments, step (iii) comprises normalising according to range one or more transformed signals.
In some embodiments, step (iii) further comprises using a Complex Fourier Transform and/or Direct Fourier Transform to convert transformed signals to the x-dimension, and determining the x-positions of peaks on the transformed signals.
In some embodiments, step (iii) further comprises, from the x-positions, using
where L=distance to entity
c=the speed of light
Δf=the periodicity in the frequency domain,
to determine corrected x-axis positions, and thereby optical depth.
In some embodiments, step (ii) includes the procedure of Appendix B.1, thereby producing first and second outputs (Output1, Output2) dependent upon the detection signals, wherein Output1 is the sum of all correlations between vectors in a first array, the vectors in the first array comprising, for each sweep channel, a stored signal above a threshold that are derived by Direct Fourier Transform from the detection signals, and Output2 is the sum of integrated signals above the threshold for each sweep channel.
In some embodiments, step (ii) includes the procedure of Appendix B.2, thereby producing a third output (Output3) dependent upon the detection signals, wherein Outputs is, for each sweep channel, the best (lowest) correlation value between the ideal response for a number of barrel lengths and for a number of weapon calibers stored in memory and the direct untransformed detection signals |ER|2.
In some embodiments, the detection apparatus includes a first detection element directed in a first direction, towards the entity, for generating non-polarized detection signals, and a second detection element, directed at 90 degrees to the first element, for generating cross-polarized detection signals, and wherein step (ii) includes the procedure of Appendix B.3, thereby producing fourth and fifth outputs (Output4, Outputs) dependent upon the detection signals, wherein Output4 is, for each sweep channel, the sum of correlations between the transformed signals, the transformed signals comprising a Complex Fourier Transform of the non-polarized detection signals and of the cross-polarized detection signals, and Output5 is, for each sweep channel, the sum of the integrated non-polarized and cross-polarized signals after Complex Fourier Transform, In some embodiments, the integrated non-polarized and cross-polarized signals comprise integrations of transformed signals within one or more distance windows, the contents of each distance window being stored in a database in association with a respective response for a particular weapon.
In some embodiments, step (ii) includes the procedure of Appendix B.4, thereby producing sixth and seventh outputs (Output6, Output7) dependent upon the detection signals.
In some embodiments, methods may further comprises providing a neural network, the neural network having as inputs thereto any combination of (a) the first and second outputs (Output1, Output2), (b) the third output (Output3), (c) the fourth and fifth outputs (Output4, Outputs), and (d) the sixth and seventh outputs (Output6, Output7), wherein the output of the neural network is an indication of a confidence level of a metallic or dielectric object of a predetermined type being detected, for example, 1=gun detected, 0=no metallic or dielectric object detected.
Some embodiments of the present invention may include a recorded or recordable medium having recorded or stored thereon digital data defining or transformable into instructions for execution by processing circuitry, the instructions corresponding the systems and methods herein.
Some embodiments of the present invention may include a server comprising processing circuitry, memory and a communications device, the server being programmed for communicating on demand or otherwise digital data defining or transformable into instructions for execution by processing circuitry, the instructions corresponding to the systems and methods herein.
Techniques according to some embodiments of the invention entail actively illuminating an object with wide range stepped microwave or millimeter wave radiation and inducing a local electromagnetic field on the surface of the object and within the barrel, comprised of a superposition of modes.
The coupling to these modes from the illuminating and scattered fields is, in general, frequency dependent and this forms the basis for the detection and identification of conducting items. The object may be fully illuminated if a full spectrum of modes and therefore a full frequency response are to be excited and collected.
The scattered EM power may be typically measured at “stand off” distance of several meters as the illuminating field is frequency swept over as wide a range as possible and patterns in frequency response characteristic to the target object being sought are looked for.
This system may rely on contributions from one or more of the following effects.
(1) Swept reflectrometry, in which the distances between comers, edges and cavities on the weapon independently from the distances to the source and the detector are ascertained in real-time.
(2) Barrel tone detection. The caliber and barrel length of the weapon can be ascertained when the barrel is oriented towards the general direction of a detector and source (±45n). This is determined by an aspect invariant method outlined in the appropriate section below.
(3) Cross-polarization effects. The use of two or more detectors, the first oriented in the same direction as the illuminating radiation and the second at 90° (the cross polarized detector) can yield important effects, The time dependent responses in the cross polarized detector are enhanced when a handgun is present. Furthermore, if the frequency is swept over a large range, the reflections from various comers of the object can be resolved in the time domain, These reflections are different or anti-correlated in the cross polarized detector. This differentiates the technique from previously known polarization-based detectors outlined above.
(4) Aspect Independent effects (Late Time Responses). A late time response or recurrence from the object is identified, to effectively give information related to the size and dimensions of the object. This enables dimensions to be determined in truly aspect independent manner. This phenomenon is the further set of scattered signals obtained after the main radiation has returned to the receiver, assuming the application of a pulse of radiation, It is caused by locally induced currents in the object re-radiating. The timing of the response can be directly linked to the size and natural resonances of the object, and this is illustrated herein by simple objects with one or more dimensions. It can, therefore, prove a useful tool in the identification of weapons, optionally when combined with the other techniques identified herein,
The concept of target identification by utilising re-radiation from a metal object illuminated by a radar pulse, after that pulse has passed the object, has been used and understood for decades, primarily in the field of radar for aircraft and missile identification purposes [e.g. Baum C. E “On the singularity expansion method for the solution of electromagnetic interaction problems”, Air Force Weapons Lab. Interaction Notes, Note 88, December, 1971] The present inventors demonstrate in this disclosure how techniques that build upon the basic principles can be used to confirm the presence or the absence of weapons, especially handguns and knives, concealed on or about the human body.
When a highly conductive object, such as a metal handgun or knife, is illuminated by a sudden pulse of microwave frequency electromagnetic radiation there are surface currents excited on that object. When the exciting pulse has passed the object, the excited surface currents oscillate in such a way as to give rise to re-radiation that carries an electromagnetic signature which is unique to that object. Of critical importance and underpinning the techniques according to some embodiments is the fact that the re radiated signature is independent of such vagaries as pulse shape and object (target) orientation. This re-radiated electromagnetic signal is known as the Late Time Response (LTR) and it is this signal that is excited, captured and processed to interrogate the human body for concealed weapons, according to some embodiments of the present invention,
The techniques identified in this application are suitable for a deployable gun and concealed weapons detection system and does not rely on imaging techniques for determining the presence of a gun. One or more of the techniques can be combined to reduce the false-positive events from the detector. Hereinafter, experimental sets of responses from typical metal or partially conducting objects such as keys, mobile phones and concealed handguns at a range of frequencies are presented, According to another aspect of the invention there is provided a system for remote detection and/or identification of a metallic threat object, comprising: a transmission apparatus, including a transmission element, configured to direct microwave and/or mm wave radiation in a predetermined direction, a detection apparatus configured to receive radiation from an entity resulting from the transmitted radiation and to generate one or more detection signals in the frequency domain, and control circuitry, the control circuitry being operable to (i) cause the transmitted radiation to be swept over a predetermined range of frequencies, (ii) perform a transform operation on the detection signal(s) to generate one or more transformed signals in the time domain, (iii) extract, from one or more features of the transformed signal, the late time response (LTR) signal of the metallic threat object upon which the transmitted radiation is incident, the metallic threat object being carried by or associated with the entity; and (iv) from the LTR signal, determine the presence and/or identity of the metallic threat object. According to another aspect of the invention there is provided a method for remote detection and/or identification of a metallic threat object, comprising: providing a transmission apparatus, including a transmission element, configured to direct microwave and/or mm wave radiation in a predetermined direction, providing a detection apparatus configured to receive radiation from an entity resulting from the transmitted radiation and to generate one or more detection signals in the frequency domain, and control circuitry, the method comprising (i) causing the transmitted radiation to be swept over a predetermined range of frequencies, (ii) performing a transform operation on the detection signal(s) to generate one or more transformed signals in the time domain, (iii) extracting, from one or more features of the transformed signal, the late time response (LTR) signal of the metallic threat object upon which the transmitted radiation is incident, the metallic threat object being carried by or associated with the entity; and (iv) from the LTR signal, determine the presence and/or identity of the metallic threat object, According to another aspect of the invention there is provided a threat object detection system, for remote detection and/or identification of a metallic threat object being carried by or associated with the entity, comprising: a plurality of detection systems, each detection system being in accordance with the appended claims, the detection systems being arranged spaced apart in relation to a closed path defined by walls and to be traversed by the entity, whereby, in use, transmitted radiation from at least one of the detection systems is incident upon the entity, According to another aspect of the invention there is provided a computer program product for remote detection of one or more dimensions of a metallic or dielectric object, the computer program product comprising a computer usable storage medium having computer readable program code embodied in the medium, the computer readable program code configured to carry out the methods of the appended claims.
An advantage of the invention is that effective detection of threat objects at stand-off distances maybe accomplished.
A further advantage of the invention is that detection of threat objects using a portable device may be achieved.
A further advantage is that the detection of smaller dimensions (e.g. gun barrel dimensions and/or caliber) is enabled.
Embodiments of the invention will now be described in detail, by way of example, with reference to the accompanying drawings, in which:
Embodiments of the present invention now will be described more fully hereinafter with reference to the accompanying drawings, in which embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like numbers refer to like elements throughout.
It will be understood that, although the terms first, second, etc. maybe used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present invention, As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
It will be understood that when an element such as a layer, region or substrate is referred to as being “on” or extending “onto” another element, it can be directly on or extend directly onto the other element or intervening elements may also be present. In contrast, when an element is referred to as being “directly on” or extending “directly onto” another element, there are no intervening elements present. It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is referred to as being “directly connected” or “directly coupled” to another element, there are no intervening elements present.
Relative terms such as “below” or “above” or “upper” or “lower” or “horizontal” or “vertical” may be used herein to describe a relationship of one element, layer or region to another element, layer or region as illustrated in the figures. It will be understood that these terms are intended to encompass different orientations of the device in addition to the orientation depicted in the figures.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” “comprising,” “includes” and/or “including” when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms used herein should be interpreted as having a meaning that is consistent with their meaning in the context of this specification and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, “threat object” is taken to mean a metallic or dielectric object, whether specifically designed or intended for offensive use or not, that have potential to be used in an offensive or violent manner.
The present invention is described below with reference to flowchart illustrations and/or block diagrams of methods, systems and computer program products according to embodiments of the invention. It will be understood that some blocks of the flowchart illustrations and/or block diagrams, and combinations of some blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be stored or implemented in a microcontroller, microprocessor, digital signal processor (DSP), field programmable gate array (FPGA), a state machine, programmable logic controller (PLC) or other processing circuit, general purpose computer, special purpose computer, or other programmable data processing apparatus such as to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. It is to be understood that the functions/acts noted in the blocks may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Although some of the diagrams include arrows on communication paths to show a primary direction of communication, it is to be understood that communication may occur in the opposite direction to the depicted arrows,
Embodiments of the invention may be used for remotely detecting the presence and/or size of metal and/or dielectric objects concealed underneath clothing. Embodiments herein may be used for remotely detecting metal and/or dielectric objects. A dielectric in this context is a non-conducting (i.e. insulating) substance such as ceramic that has a low enough permittivity to allow microwaves to pass through. A ceramic knife or gun, or a block of plastic explosive, are examples of this type of material.
Some embodiments of detection systems are disclosed herein,
The main procedure carried out by controller 104 in implementing a scan is set out in Appendix A at the end of this section of the Specification. The procedure “Perform transformation on received radiation signals to produce time domain or optical depth domain trace” in Appendix A, for each of the four techniques, is discussed later with reference to Appendix B.
In use and operation, the system may use electromagnetic radiation in the microwave or millimeter (mm) wave band, where the wavelength is comparable or shorter than the size of the object 116 to be detected. The object 116 may be on and/or in the body of a person, within containers and/or items of luggage, and/or concealed in and/or on some other entity (not shown). The suspect entity (e.g., a person; not shown) has radiation directed by transmitter 106 onto it, so that the (threat) object 116 is entirely illuminated by a continuous wave of this radiation (i.e., the radiation is not pulsed, but kept continuously on). The radiation intensity is well within safe operating limits, but may be in any case determined by the sensitivity of the detector 110, As an example, in the range 14-40 GHz, 0 dBm of power is used with a typical beam area 118 of 0.125 m2, which equates to a 20 cm diameter beam. However, in some embodiments, the hardware maybe designed so as generate a beam area 118 of greater or lesser size.
The frequency and consequently the wavelength of the radiation, is swept through a reasonable range and may be referred to as swept CW and/or continuous wave radiation. Limits maybe set by the devices used, but a 20 GHz or more sweep starting at 14, 50 or 75 GHz is typical. The data may be collected in a series of small steps and/or as a real-time continuous sweep. Typically 256 or more data points may be acquired. In some embodiments, data may be taken between 14 to 40 GHz, providing a sweep range of 26 GHz.
The illumination and detection may be undertaken remotely from the object 116 in question, for example, at a distance of a meter or more, although there is no lower or upper limit on this distance. The upper limit on detection distance may be set by the millimeter or microwave focusing optics, although, with this technique, a small beam at the diffraction limit is not necessary. In some embodiments, ranges for this device may include a few tens of centimeters (cm) to many tens of meters (m), In some embodiments, a device may be operated at a range of approximately 1 m to 10 m depending on the frequency chosen (some microwave frequencies are attenuated by the atmosphere, and atmospheric windows such as that found around 94 GHz are generally chosen to minimise these effects). In some embodiments, the source of electromagnetic radiation 102 and the detector 110 may be mounted next to each other and they may be focused onto some distant object 116 or entity (not shown).
A variety of techniques is disclosed herein and may include distinct system and/or method recitations. For example, swept reflectrometry and barrel tone detection, may provide that the return radiation is detected and its amplitude stored as a function of frequency. In this regard, embodiments of a system as illustrated in
Other techniques, including cross-polarization and LTR recurrences may use the phase of the returned radiation that may be acquired at each frequency point. When the phase of the returned signal is used—in order to replicate a Time Domain response via the use of a Fourier Transform—the synthesiser and detection system in
The frequencies of the first and second microwave sources 102 and 103 may be swept under control of the signal from the Ramp Generator 202 to remain approximately 100 MHz apart. The Microwave mixers 204, 206 generate signals corresponding to the difference frequency between the two inputs (˜100 MHz). After amplification by two RF amplifiers 208, 210, a RF Mixer 212 produces two outputs corresponding to the “in phase” (I) and “in quadrature” (Q) components of the detected signal. The signals may be amplified by amplifiers 112, 112′, and the data acquisition may be controlled by a controller 104 (PC). The entire system apart from the horns 106, 108 may be referred to as a Vector Network Analyser (VNA).
The return signal is collected by a horn and applied to port 2 of the VNA, which measures parameter S21, If cross-polarization measurements are used, a second receiver horn oriented (not shown) at 90° may be added to the VNA on, for example, port 3, The transmitted signal may be generated from port 1 and may be, for example, 1 mW. The real and imaginary parts may be recorded and can be corrected for the electrical behaviour of the horns. The signals are zero padded out to 4096 points and are processed by a Fast Fourier Transform routine to yield the effective time response. In this manner, the process allows the replication of the application of a pulse of radiation to the target (entity) and the subsequent acquisition of the time resolved response.
In some embodiments, hardware corresponding to the systems herein may form and/or be part of a portable device (i.e. small enough to be carried by one person, or transported in an automobile, so as to be operable therein),
Theoretical Basis.
To detect the range of signals described herein, several measurement techniques are available, For a transmitted signal the return signal ER. from a target (entity) distance L away may be written as follows:
ER=rE0e−jωte2jωL/c (1)
where co=2nf, f is the frequency, r the scattering coefficient and c the velocity of light.
A detector 110, which may respond to the microwave power, will only measure |ER|2, which for a single scattering center, does not explicitly depend on frequency. However, for two scattering segments at different ranges L, and L2, the power is proportional to:
This contains terms in cos (2w(L2)c) (i.e., oscillatory terms) that are dependent on the difference in range L1-L2. By performing a Fourier transform on the detected power measured as a function of transmitted frequency, peaks corresponding to the difference in range of various parts of the target are observed and these give an indication of the size of the object 116. However, for a complicated object 116, many pairs of distances would be involved and the analysis of the signal would be complex.
For a different group of detectors (i.e. Vector Network Analysers as illustrated in 2A (a)), it is possible to measure the complex return signal directly, These Vector Network Analysers effectively mix the return signal with a fraction of the transmitted wave to measure
r1e2jωL
in terms of its real and imaginary parts. In this case Fourier Transforming leads to a series of signal peaks at the range of each element of the target and arranged in the order of their distance. Thus, a much clearer indication of the dimensions of the object 116 may be obtained, though only in one dimension. Any Late Time Responses (i.e. those that cannot be attributed to direct scattering) can be measured in this way, although their strength may be many times less than directly reflected signals.
Further information about the target (entity) may be obtained using a second detector to collect return signals emitted at a different angle from the target. This effectively probes the target along a second direction and can in principle enable more dimensions of the object 116 to be ascertained.
A Fourier Transform (FT) or some other more advanced power spectrum analysis technique such as a Burg Transform may be applied. The Burg and related methods of power spectrum analysis may be better than the FT for this application as the individual peaks that relate directly to the dimensions of the object are more clearly identifiable, and as it is possible to choose the number of peaks to be displayed in the output (and hence reject weaker peaks), They may also allow two closely spaced peaks to be resolved.
The position L of peaks within the FFT or Burg spectrum directly relate to the size of the object using the following formula:
Where c is the speed of light, Δf the periodicity in the frequency domain. This axis represents optical depth for the purposes of this disclosure.
The minimum spatial resolution d is related to the sweep range or bandwidth BW:
As an example, if the source frequency were to be swept between 14 and 40 GHz, this constitutes a sweep range of 26 GHz, which translates to a resolution of 5.7 mm. A larger sweep range would lead to an improved resolution, which may result in, for example, a maximum optical depth or distance of 740 mm for 256 data points. In some embodiments, the number of data points may include more than 256 including, for example, 512, 1024 or any multiple thereof, among others, For Vector Network Analysers operating in Time Domain mode, in which the complex data is converted to the time domain, this calculation may be included in the software,
The four techniques mentioned above, each of which may be used in embodiments of the invention, will now be discussed in more detail.
Technique 1: Swept Reflectometry.
As briefly described above, swept reflectometry is the principle by which the distances between comers, edges and cavities on the threat object (weapon) 116 independently of the distances to the source (TX horn 106;
If the object 116 (e.g. a weapon strapped to the body as the latter rotates) is moved around in the beam and its angle and distance with respect to the source and detector is changed, those dimensions between edges and comers that actually belong to the object can be differentiated from those that do not. In this manner, the background clutter may be removed.
Some embodiments of a procedure carried out by controller 104 (
The software according to Technique 1 may differentiate the peaks that relate to the dimensions of the object 116 from those that do not by acquisition of the signal over a period of time and by storing these acquired signals independently, with the object moving within the beam. The signals that indirectly relate to the dimensions of the object remain and occur within certain bands denoted by the distances between the various corners of the object. Other signals that change (e.g., the air gaps between clothing and the skin) may be more chaotic and may be integrated out over a period of time.
If the strength of the signal is normalized relative to distance, the returns from a subject concealing a handgun will be larger in amplitude than those without.
Very large dimensions, such as, for example, metal doors, window frames and/or a multitude of other metal objects will not be observed as they are not entirely encompassed by the beam, as the microwave beam can be focused onto relevant parts of the person (entity) or object 116 in question.
The reflected return radiation is seen to contain patterns or frequencies that can be indirectly related to the dimensions of the metal object according to the technique identified in the section “Theoretical basis” above, including the presence and/or length of gun barrels. In this manner, embodiments herein may be used to discriminate between, say, handguns and keys, knives and keys, etc. In effect, the technique measures the distances between the various edges of the object at the orientation of the source and detector, and cavity lengths if present.
] The dimensions of guns and knives are different from most other objects carried about the person, so the appropriate dimensions may be stored on a database.
The technique (Technique 1) is also capable of measuring, particularly, the depth of a dielectric (i.e., of a material that does not conduct electricity), although the physics behind this may be significantly different, A dielectric object might typically be a lump of plastic explosives concealed on a suicide bomber.
Technique 2: Barrel Tone Detection by Direct Detection of Aspect-Independent Chirped Signals.
Threat objects that contain cavities and can be excited by an incoming microwave signal, can exhibit strong frequency dependence in the scattered signal. These signals may differ from those derived from the outside of the object by:
For example, consider a 10 cm long cylindrical metal barrel closed at one end, which has 19 mm outside diameter and 9 mm inside diameter, The HI 1 mode has the lowest threshold frequency/o for propagation for the inside bore at 19.5 GHz. For a cavity length L, the response for/greater than/o is proportional to the chirped sine wave signal:
where/is the microwave frequency and c is the velocity of light, with a minimal return at lower frequencies below this threshold.
A procedure according to some embodiments that may be carried out by controller 104 (
It should be noted that the signal is clearly seen at a range of impact angles 0 ranging from 0 to over 45° and the oscillation frequency is only a function of the cavity length L. This may be contrasted with the case of edge or corner detection where the oscillation frequency is proportional to L cos(f). The analysis provides a means of determining both the length and diameter of the cavity bore.
Technique 3: Identification of the target by cross-polarized detectors.
By measuring the return signal as a function of frequency scanned over a wide range, the dimensions may be recovered through Fourier Transform techniques. This duplicates the effect of responses of targets, to a very short excitation pulse without the need of high speed switches and ultra-fast detectors and digitization processes. The range resolution obtainable is of the order of 0.5-1.0 cm, as described by the principles above, at the sweep ranges available here (14-40 GHz, but this property is not restricted to this frequency range), and thus appropriate for characterizing objects such as hand guns.
Another useful aid to threat object identification is to measure the polarization of the return signal. Waveguide horns (see
Embodiments of a procedure carried out by controller 104 (
The responses of a range of objects using a system as illustrated in
In accordance with Technique 3, the very wide sweep range leads to detailed information about the dimensions of the object 116 and the fine structural distances between the source/detector 106/108 and corners/edges on the target/object 116. It can be seen in
Technique 4: Target Determination by Aspect Independent Effects (Late Time Responses).
The Late Time Response (LTR) and the closely associated Singularity Expansion method (SEM) arose from the observation that the time-resolved radar signature from conducting objects contains information after the radar pulse has passed the target.
The pulse sets up currents on the surface of the object 116 in the form of resonant modes, which subsequently re-radiate. An alternative interpretation is to consider the radar pulse stimulating travelling waves on the surface of the target, which move across and around the object 116 until they return back to their initial distribution, This recurrence can re-radiate back into the return beam, which appears an extra, time-delayed signal.
An important feature of the LTR is that the time taken for the travelling wave to circulate around the object does not depend on the orientation of the entity/object 116, and hence is aspect-independent, although its strength may depend on the efficiency of coupling into the modes. For objects 116 with symmetry the time-delay is approximately half the perimeter with respect to centre of the object 116. For more complicated objects, the LTR signal is more complex, but the structure can be interpreted in terms of the dimensions of the object 116, These include dimensions cross range as well as the usual along range values.
The return signal is collected by a second horn close to the transmitting horn and is measured and applied, for example, to port 2 of a VNA 1204. The S21 parameter is recorded over a range typical range 14-40 GHz. The signals were corrected for the performance of the microwave horns 106, 108.
If the plate 1202 of width L is rotated by angle 6 about its long direction, then scattering from its leading and trailing edge leads to a doublet response with separation L sin 0.
A procedure according to some embodiments may be carried out by controller 104 (
The training data may be formed of sets of data taken using the above-described techniques, in random order, The output 1506 from the neural network may be a single output that gives a confidence level (1=gun, 0=no object being concealed). However, it will be appreciated that other configurations or learning algorithms may be used. For example, multiple outputs from the neural network 1500 maybe employed, with sub-classifications (e.g., gun, mobile phone, keys, etc).
Tine millimeter wave reflected signals from the guns show a number of features which enable them to be distinguished from innocently carried objects such as keys and mobile phones. These include cavity mode oscillations from the barrel with characteristic frequency of onset that allows the caliber and length to be “determined. The interference of signals from different parts of the target leads to a frequency-dependent response, which can be used to deduce the size of the object. The response at different polarizations may give an indication of the complexity of the object from multiple reflections. The late time response gives an aspect-independent signal dependent on target dimensions. Taken together these features provide a means of detecting handguns, for example, under practical conditions at stand-off distances. The application of signal processing techniques enable relevant parameters to be extracted for use in automatic detection systems.
Embodiments of the system forming extensions and variants of Technique 4: Target Determination by aspect independent effects (Late Time Responses), will now be discussed in more detail.
The TX horn 106′ is coupled to detection electronics 1604 via (coax) cables 1606, and RX horn 108′ is coupled to detection electronics 1604 via (coax) cables 1608. The detection electronics 1604 may comprise the circuitry of
In certain embodiments, the apparatus includes a linear polarising element 1610, mounted for rotation about axis B. In this way, the entity or target 116 is illuminated by electromagnetic field with rotating polarisation. The spinning linear polarising element 1610 is used in conjunction with a dual polarised horn antenna to produce broadband microwaves with polarisation which rotates (either elliptically or circularly, depending on the relative amplitudes of the dual microwave feed) at a frequency equal to that of the frequency of rotation of the linear polarising element 1610. This allows optimum coupling between the exciting wave and the target 116, since coupling is strongly dependent upon polarisation for a given target aspect. The receiver RX horn 108′ is also a dual polarised antenna and data from both channels are used in processing, as discussed further hereinafter.
Theoretical Background.
When an object is illuminated by Electromagnetic (EM) waves the scattered waves in the time domain can be approximately represented by
R(t)=δ(t)h(t)
where R is the scattered signal, I is the incident signal, h is the “impulse response” of the target, and ® represents the mathematical convolution operation,
If the incident signal is a sharp pulse approximating the delta function then the scattered (detected) signal approaches
R(t)=δ(t)h(t)=h(t)
So the scattered signal approximates the impulse response of the object.
]This is useful because the impulse response “carries” unique and aspect independent information about the electromagnetic response of the target,
Rewriting the late time response in exponential form we obtain
where the argument of the exponential terms are the complex natural resonances of the target—these are aspect independent.
According to some embodiments of the invention, the Late Time Response (LTR) of the target 116 is recorded and Generalised Pencil Of Functions (GPOF) method is used to determine the complex natural resonances (poles)—
−am+i2πvm
These resonances or poles are used to identify the presence of a particular (threat) object by comparing the poles of with those of measured objects and looking for a correlation.
Requirements
Where the microwave frequency is scanned from a lowest frequency vL through to a highest frequency vH In currently preferred embodiments of the system, this is 1/(17.5 GHz), i.e. 0.06 ns.
Brief Outline of Technique:
Referring to
This is further illustrated in
As seen in
In step 1902, the Late Time Response of a metallic object 1602 (
The excitement of LTRs is achieved by illuminating the target 116 by a microwave source with frequency which is scanned from a lowest frequency vL through to a highest frequency vH to simulate illumination with a broadband (frequency content) and hence short time length, electromagnetic pulse. vL is typically (but is not restricted to) 0.5 GHz whereas vH is typically 18 GHz. The wavelength of the lowest frequency must exceed the size of the object 1602 in order to stimulate the fundamental mode (see further below).
The microwave output has variable (user determined) polarization state which is obtained via—
(1a) Rotating a linear polarising filter 1610 immediately in front of the dual polarised microwave horn 106′ used for target illumination (
(1b) Introducing a time delay between the two input ports of the dual polarised microwave horn 106′ used for target illumination in such a way as to give a time delay
¼v between the orthogonal polarised components, where v is the frequency of microwave output;
(2) Using a spiral free wave antenna (not shown) to give an elliptically polarised microwave output.
The polarised microwave source with frequency v is scanned from a lowest frequency vu through to a highest frequency vH. The frequency bounds of the system are selected so that the fundamental (lowest possible resonant frequency) and several higher order resonances of all threat objects 116 to be identified are encompassed within this range so that their excitation is possible. The natural resonant frequencies of objects 116 are related to the object's largest linear dimension in as much as the fundamental frequency is ˜c/21, where/is the object's largest linear dimension and c is the velocity of light in free space. The upper bound is determined only by the apparatus used and should be as high as is practicably achievable since it is the bandwidth of the system that determines the resolution of time data obtained.
The microwave receiving antennae 106′, 108′ (
Returning to
The target response data is then subjected (step s1906) to Inverse Fast Fourier Transform (IFFT) to give the time domain, scattered signal, with a time resolution Δt given by
The time domain signal so obtained is then time gated or “windowed” (step s1908) to divide the time signal into four distinct sections (see
This separation of the time response into sections is achieved by either of two techniques—Method A and Method B, as discussed further below.
Method A is illustrated in more detail in
First, at step s1930, a sliding time window is used to analyse (by FFT) spectral content of discrete windowed portions of time domain target response. The sliding windows have three user selected options—the segment size (time), the time shift applied to the window to “slide” it and whether the window is a step function or Gaussian in form, Typically both the window width and the time shift are <1 ns and exact values are empirically determined.
Next, at step s1932, both amplitude and frequency content of the spectral data (time domain target response) are analysed for each small time segment (window). This data is the used to determine where the Early Time Response starts and ends and where the Late Time Response starts and descends into noise (ends).
As seen in step s1934, for each window, thresholds (TA, Tv) are applied to both amplitude (A) change and frequency (v) change compared to previous window. The ETR has large amplitude at high frequency whereas the LTR has large amplitude at lower frequency. The time periods before the ETR and after the LTR have low amplitude at all frequencies. The threshold for amplitude change and the threshold for frequency change are determined empirically by the user beforehand.
Thus at step s1936, the position where Early Time Response starts is derived from (ampl. chge>TA and v chge>Tv).
Next, at step s1938, the position where Early Time Response ends/Late Time Response starts is derived from (ampl. chge<TA and v chge>Tv).
Finally, at step s1940, the position where Late Time Response descends into noise (ends) is derived from (ampl. chge>TA and v chge<Tv).
Method B is illustrated in more detail in
First (step s1942, the absolute maximum value in time domain target response is located, The absolute maximum value is used to determine the position of the ETR (s1944)
This Method, used two time delays (1 and 2)—these may for example be retrieved from a database (s1946). Time delay 1(t1,) is chosen so that ETR from a typical human body is removed. This is done by applying the formula t1=2D/c,
where D is the width of a typical human body. Time delay 2 (t1) is chosen so that a typical LTR response would have been attenuated into the noise level after this time, and is for example ˜5 ns.
Next, the time domain target response is sampled (step s1948), starting from time delay 1 after time position of absolute maximum value and continuing for a time length equal to time delay 2. Finally, the sampled data is used and/or store as the LTR.
Once the time gating (step s1908) has been performed, a pole extraction technique is applied to the derived LTR.
Referring briefly to
The LTR data S[n] is expected to be of the form
Where there exist M natural resonances Zm between the frequencies vL and vH and there is assumed to be inherent noise in the system N
The natural resonances or poles Zm=am+i2nvm are aspect independent and are to be extracted in step s1910 as precisely as is possible in order to confirm the presence or absence of a particular threat object 1602 whose natural resonances are known (either by measurement or numerical simulation) a-priori. The complex amplitudes Cm are highly aspect dependent and are not utilised explicitly in the determination of the presence or absence of a threat object.
Depending on the embodiment, the poles are extracted using either the Generalised Pencil Of Functions method (Matrix Pencil method) or a Genetic Algorithm is implemented for this purpose. The complex poles and their associated complex amplitudes (residues) are thus extracted. The Generalised Pencil Of Functions method is well known to persons skilled in the art, and will not be discussed in detail here, see “Generalized Pencil-of-Function Method for Extracting Poles of an EM System from Its Transient Response” Yingbo Hua and Tapa K. Sarkar, IEEE Transactions on Antennas and Propagation, Vol. 37, No, 2, February 1989.
In an alternative embodiment, pole extraction (step s1910 in
A genetic algorithm and/or differential evolutionary algorithm is a well established method of obtaining the parameters necessary to find the closest fit between the observed (experimental) Late Time Response (previously described as a sum of exponentially decaying sinusoidal functions or natural resonances) and the mathematical function that describes them, (given earlier) [In-Sik Choi et. al. “Natural Frequency Extraction Using Late-Time Evolutionary Programming-Based CLEAN”, IEEE Transactions on Antennas and Propagation, Vol. 51, No. 12, December 2003]. In [In-Sik Choi et. al.] the decaying natural resonances functions are fitted one at a time to the late time response and then subtracted from the original data. This makes the differential evolution algorithm task somewhat easier as it limits the number of parameters to four, amplitude, phase and the real and imaginary parts of each pole—am+i2nvm per iteration. In a preferred embodiment, the maximum number of waveforms is fitted simultaneously, which is a more difficult task computationally as there are more permutations of possible solutions to explore. In a algorithm according to a preferred embodiment the crossover/mutation operator from differential evolution referred to in [Price and Storn 1997] is used, followed by a tournament selection [Price and Storn 1997] to find the fittest chromosomes, although this does not preclude other least squares minimisation methods. It has been found that this approach is able to successfully fit the 20 parameters necessary to describe 5 damped sinusoidal functions typically used when analysing responses from concealed guns and other weapons.
In order to determine the presence of a weapon, two of the four parameters for each damped sinusoid (frequency find decay) are stored. Typically a handgun will require at least two damped sinusoids to classify it. If multiple data sets are acquired then a cluster of frequencies and damping factors can be used to identify the weapon (see
Returning to
Steps 1902 to 11912 are repeated, as shown by loop s1914 a set number of times—decided by user set parameter. The number of loops is determined by the likely time a person being interrogated would spends within the active area (e.g. see corridor of
Next, following pole filtering (step s1912), the poles are stored S1916).
Then, at step s1918, the pole data is compared with library (1920) of measured poles for targets of interest, stored in a database.
The comparison is carried out by finding the closest matching library poles to those measured and then computing a root mean square error where the damping space and frequency space are weighted by experimentally determined values. This weighting is necessary as the pole position in damping space is more spread than in frequency space. The RMSE value is then compared to empirically determined threshold values to give a threat level based on the closeness of pole match.
Finally, it a threat level decision (0-1) is obtained and a possible threat object/class determined (s1922).
Embodiments of the invention include the following novel aspects and consequent advantages,
Perform transformation on received radiation signals by all the steps below:
SNote:
Number | Date | Country | Kind |
---|---|---|---|
0804944.7 | Mar 2008 | GB | national |
The present application is a continuation of U.S. patent application Ser. No. 14/873,807, filed Oct. 2, 2015, which is a continuation of U.S. patent application Ser. No. 12/519,903, filed Feb. 10, 2011, U.S. Pat. No. 9,182,481, Issued Nov. 10, 2015, which is a U.S. National Application based on PCT/GB2009/000752, filed Mar. 18, 2009, which claims priority to U.S. Ser. No. 12/050,524, filed Mar. 18, 2008, U.S. Pat. No. 8,103,604, Issued Jan. 24, 2012 and claims priority to GB Patent Application 0804944.7, filed Mar. 18, 2008. Each of these applications is herein incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5073782 | Huguenin et al. | Dec 1991 | A |
5264856 | Thurlow | Nov 1993 | A |
5337058 | Cross | Aug 1994 | A |
5486833 | Barrett et al. | Jan 1996 | A |
5704355 | Bridges | Jan 1998 | A |
5807257 | Bridges | Sep 1998 | A |
6061589 | Bridges et al. | May 2000 | A |
6243036 | Chadwick et al. | Jun 2001 | B1 |
6421550 | Bridges et al. | Jul 2002 | B1 |
6777684 | Volkov et al. | Aug 2004 | B1 |
6856271 | Hausner | Feb 2005 | B1 |
6967612 | Gorman et al. | Nov 2005 | B1 |
7167123 | Hausner et al. | Jan 2007 | B2 |
7246522 | Diaz et al. | Jul 2007 | B1 |
7304603 | Reed et al. | Dec 2007 | B2 |
7492303 | Levitan et al. | Feb 2009 | B1 |
7800527 | Douglass et al. | Sep 2010 | B2 |
20020130804 | McMakin et al. | Sep 2002 | A1 |
20050230604 | Rowe et al. | Oct 2005 | A1 |
20060066469 | Foote et al. | Mar 2006 | A1 |
20070052576 | Hausner | Mar 2007 | A1 |
20070102629 | Richard et al. | May 2007 | A1 |
20070132630 | Beckner | Jun 2007 | A1 |
20080174476 | Detlefsen et al. | Jul 2008 | A1 |
20100265117 | Weiss | Oct 2010 | A1 |
Number | Date | Country |
---|---|---|
1203359 | May 2002 | EP |
1891459 | Feb 2008 | EP |
869770 | Jun 1961 | GB |
2299214 | Sep 1996 | GB |
2435509 | Aug 2007 | GB |
2008275382 | Nov 2008 | JP |
2187129 | Aug 2002 | RU |
9007130 | Jun 1990 | WO |
0075892 | Dec 2000 | WO |
200217231 | Feb 2002 | WO |
2006001821 | Jan 2006 | WO |
2006021799 | Mar 2006 | WO |
2006137883 | Dec 2006 | WO |
2007086916 | Aug 2007 | WO |
2007130288 | Nov 2007 | WO |
2007148327 | Dec 2007 | WO |
2009062946 | May 2009 | WO |
2009115818 | Sep 2009 | WO |
Entry |
---|
International Search Report of PCT/GB2009/000752, dated Nov. 24, 2001, 5 pages. |
United Kingdom Search Report of GB0904640.0, date of Search Report dated Jan. 5, 2010, 2 pages. |
United Kingdom Search Report of GB1020664.7, date of Search Report dated Feb. 23, 2011. |
United Kingdom Search and Examination Report of GB0804944.7, dated Jun. 27, 2008, 6 pages. |
United Kingdom Search and Examination Report of GB09046460.0 dated Jul. 9, 2009, 10 pages. |
Zhang et al., “Preliminary Investigation of Breast Tumor Detection Using Cross-Vivaldi Antenna,” Proceedings of the 2005 IEEE, Engineering in Medicine and Biology 27th Annual Conference, Shanghai,m China, pp. 6691-6694. |
Number | Date | Country | |
---|---|---|---|
20170315226 A1 | Nov 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14873807 | Oct 2015 | US |
Child | 15611277 | US | |
Parent | 12519903 | US | |
Child | 14873807 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12050524 | Mar 2008 | US |
Child | 12519903 | US |