Near-field microwave imaging is a non-ionizing and cost effective sensing modality for variety of applications, including Non-Destructive Evaluation (NDE), medical diagnostics, and detection of concealed weapons. In the latter application, a need exists for a practical system that can image subjects in high foot traffic environments, such as mass transit systems, stadiums, and large public events. In order to handle a potentially constant stream of subjects in motion, the system should measure a subject very quickly (on the order of tens of milliseconds), and reconstruct microwave images of a subject at video rate (e.g., 10 or more frames per second).
The desires to measure subject quickly and reconstruct microwave images at video rates present two major challenges. The first challenge is a cost-effective realization of an electrically large antenna array. Fast acquisition implies that the system should be fully electronic (e.g., it should sample the scene without moving sensors). Furthermore, for proper near-field illumination of a human subject, the array should be roughly the size of the subject (e.g., 1-2 m). For a high resolution system operating in the tens of GHz, this implies an aperture size in excess of 100λ.
A well-known paradigm that mitigates this challenge is multistatic sampling. Such array topologies use transmitters and receivers that are not co-located and are not separated by a fixed distance. This allows an array with NT transmit elements and NR receive elements to form NTNR spatially diverse samples. This is in contrast to a monostatic sampling scheme (wherein transmitters and receivers are co-located), which uses NTNR transmit-receive elements to achieve the same sampling.
The second challenge is video rate three-dimensional (3D) microwave image formation. The backprojection algorithm can be used with any multistatic configuration, but its computational demands are extreme. Fast Fourier Transform (FFT) imaging has long been used to efficiently construct images sampled with monostatic sampling schemes; however, this formulation cannot be used directly with multistatic sampled data. The modified FFT imaging formulation for multistatic arrays presented in Y. Alvarez et al., “Fourier-based imaging for multistatic radar systems,” IEEE Transactions on Microwave Theory and Techniques, vol. 62, no. 8, pp. 1798-1810, 2014, provides a tremendous improvement over backprojection, but is formulated for topologies where a single transmitter and multiple receivers are used. For topologies with multiple transmitters and receivers, the scheme can be run multiple times, at the expense of processing overhead.
The apparatus and methods presented herein include a sparse antenna array topology and a multistatic array sampling scheme that allows use of FFT-based imaging after the data undergoes a correction. The array topology allows multistatic sampling to be employed (reducing element count) in conjunction with FFT imaging (reducing processing load). This technology allows for high quality image reconstruction of a scene roughly the size of a human subject at video rate on cost-effective commercial off-the-shelf (COTS) hardware.
Embodiments of the present technology include systems and methods for near-field microwave imaging of an image plane. An example system includes a multistatic array, a transceiver operably coupled to the multistatic array, and a processor operably coupled to the transceiver. In operation, the multistatic array acquires multistatic array data, and the transceiver transduces the multistatic array data. The processor applies a multistatic-to-monostatic correction to the multistatic array data to form corrected multistatic array data, Fourier transforms the corrected multistatic array data to form Fourier-domain data, and applies a phase shift to the Fourier-domain data to form phase-shifted Fourier-domain data. The phase shift corresponds to a distance between the multistatic array and the image plane. (The multistatic image data may optionally be interpolated onto a uniform grid before being Fourier transformed.) Then the processor inverse Fourier transforms the phase-shifted Fourier-domain data to form a representation of the image plane. The system may perform these steps at a rate of 5 Hz, 10 Hz, or faster.
In some cases, the multistatic array comprises a plurality of tiled multistatic arrays. In these cases, each transmitter-receiver pair in each tiled multistatic array in the plurality of tiled multistatic arrays is sampled to yield the multistatic array data. Sampling each transmitter-receiver pair in each tiled multistatic array may comprises sampling only each transmitter-receiver pair in each tiled multistatic array in the plurality of tiled multistatic arrays. For instance, a tiled multistatic array may include a linear transmit array configured to communicate only with adjacent linear receive arrays. These tiled multistatic arrays may operate by emitting and receiving orthogonal waveforms (e.g., with a first tiled multistatic array emitting and receiving a first waveform, a second tiled multistatic array emitting and receiving a second waveform orthogonal to the first waveform, and so on).
The multistatic array data can be acquired by sampling a grid of phase centers defined by a plurality of transmitter-receiver pairs in the multistatic array. This grid of phase centers can be a nonredundant, regularly spaced grid of equivalent phase centers.
The multistatic-to-monostatic correction can be applied by estimating multistatic reflections of a point scatterer as sampled by the multistatic array, estimating monostatic reflections of the point scatterer as sampled in a plane of the multistatic array, and weighting the multistatic array data by a ratio of the monostatic reflections of the point scatterer to the multistatic reflections of the point scatterer. The point scatterer may be at an approximate center of the image plane.
It should be appreciated that all combinations of the foregoing concepts and additional concepts discussed in greater detail below (provided such concepts are not mutually inconsistent) are contemplated as being part of the inventive subject matter disclosed herein. In particular, all combinations of claimed subject matter appearing at the end of this disclosure are contemplated as being part of the inventive subject matter disclosed herein. It should also be appreciated that terminology explicitly employed herein that also may appear in any disclosure incorporated by reference should be accorded a meaning most consistent with the particular concepts disclosed herein.
The skilled artisan will understand that the drawings primarily are for illustrative purposes and are not intended to limit the scope of the inventive subject matter described herein. The drawings are not necessarily to scale; in some instances, various aspects of the inventive subject matter disclosed herein may be shown exaggerated or enlarged in the drawings to facilitate an understanding of different features. In the drawings, like reference characters generally refer to like features (e.g., functionally similar and/or structurally similar elements).
The antenna array topologies disclosed herein are (1) highly sparse, allowing for hardware efficient implementation, and (2) compatible with a computationally efficient image reconstruction process. While some existing imaging systems use sparse arrays, the sampling scheme presented here is unique in that it is readily compatible with FFT imaging. This translates to a lower computational cost for image formation, which makes it suitable for performing near field microwave/millimeter wave imaging at video rates for security, non-destructive testing, and medical applications.
An inventive antenna array can be sparse (e.g., with a small fraction of the number of elements in a conventional antenna array), so it can be large (e.g., with an aperture of >100κ) without being expensive. Such a system can capture image data in less than 50 ms at a maximum range of about 3 meters. The captured data is conditioned with a correction, which makes the data more closely approximate data captured by a monostatic aperture of equivalent size. While the correction has limited spatial domain, generally a human-sized domain can be imaged with a single correction of the data. The corrected data is then processed via monostatic Fast Fourier Transform (FFT) imaging, a technique with unparalleled computational efficiency. Thanks in part to this computational efficiency, the captured data can be used to generate microwave or millimeter-wave images at a rate of 10 Hz or greater, with cost-effective computing hardware.
The switched antenna array 110 includes a set of switched transmit elements 112 coupled to one or more transmit switches 114 and a corresponding set of switched receive elements 116 coupled to one or more receive switches 118. The switched transmit elements 112 and switched receive elements 116 may be arranged to form one or more sparse arrays, such as a set of tiled Boundary Arrays (BAs), that define a uniform grid of phase centers as described in greater detail below. For example, the array 110 may span an aperture of about 1.5 m×1.5 m (150λ×150λ at 30 GHz), with the switched transmit elements 112 including 1296 transmit elements coupled to a switching matrix and the switched receive elements 116 including 1296 receive elements. Together, the 1296 transmit elements and 1296 receive elements define 82,944 phase centers; other numbers of transmit elements, receive elements, and phase centers are also possible. At the same, the array 110 may have only nine transmit/receive channels, each of which serves 144 transmit elements 112 and 144 receive elements 116.
In one instance, the receive portion of the switched antenna array 110 is implemented with 11 SP4T switches 118, which are used to create a 24-way switch for the receive antenna elements 112. Buried striplines connect the switches 118 and the receive antenna elements 112, reducing the potential for crosstalk with transmit antenna elements 116. Additionally, the receive arrays can use low-noise amplifiers (LNAs) behind the first row of SP4T switches. The transmit arrays may use a similar layout, except that they use a single amplifier at the input of the entire 24-way switch instead of multiple amplifiers. Control of the switches 118 can be accomplished through the use of a suitable processor, such as a Complex Programmable Logic Device (CPLD). The CPLD stores switch biases for the array's 24 switch states, which can be toggled sequentially by sending a pulse to an “Element Step” connector. The state list is reset by pulsing a “Reset” input. This control scheme is simple and independent of acquisition speed.
The switched transmit elements 112 are coupled via the transmit switch(es) 114 to a radio-frequency (RF) synthesizer 122 in the transceiver 120. The RF synthesizer 122 generates a transmit waveform, such as a single tone from 24-30 GHz, which the switched transmit elements 112 emit towards the scene 10 as explained in greater detail below. The switched receive elements 116 receive RF radiation this reflected and/or scattered by objects in the scene. They couple the received RF radiation via the receive switch(es) 118 to a downconverter 124 in the transceiver 120. This downconverter 124 mixes the received RF radiation with a local oscillator (LO) to generate an intermediate frequency (IF) signal (e.g., at around 40 MHz) as well understood in the art of RF electronics. An analog-to-digital converter (ADC) 132 in the data acquisition system 130 digitizes the IF signal, which is converted from the time domain to a single complex-valued point by a field-programmable gate array (FPGA) 134 or other processor, then stored in a buffer 136.
In operation, the system 100 may probe the scene at a particular frequency, capture reflected or scattered returns, and down-convert and digitize the captured returns within a period of about 200 ns or less (i.e., at a rate of 5 MHz or faster). It repeats this acquisition process for each frequency step in the frequency range, possibly capturing an entire frame over all frequency steps. The frame capture time is equal to the product of the period (200 ns in this example), the number of transmit-receive pairs, and the number of frequency steps divided by the product of the number of active transmit antennas and the number of active receive antennas.
A computer 140 or other suitable processing system transforms the data stored in the buffer 136 into a rendering or image 14 of the objects or scene in the imaging domain 10. In some cases, the computer includes one or more graphics processing units (GPUs) 142 that apply a multistatic-to-monostatic correction to the data, then perform image reconstruction using a highly efficient FFT imaging technique described in greater detail below. The computer 140 displays the reconstructed image 14 to a user via a user interface 144, which may include a 2-dimensional (2D), such as a liquid crystal display, or a 3D display, such as a stereoscopic display.
The system 100 may also include one or more optional adjunct sensors 150, such as a visible or infrared camera 152 and a structured light sensor 154 (e.g., a Microsoft Kinect sensor). These adjunct sensors may acquire one or more depth maps of the imaging domain 10 while the system 100 acquires the microwave returns. The computer 140 may fuse data from the adjunct sensors 150 to create a more sophisticated rendering of the scene. It may also use data from the adjunct sensors 150 to create a depth map of the imaging domain 10 for use in constraining or restricting the image domain 10 for FFT-based image processing. Data from the adjunct sensors 150 can also be used by the computer 140 and/or a user to restrict size, shape, and/or position of the imaging domain, potentially reducing the computational load.
Compared to other multistatic microwave imaging systems, the imaging system 100 shown in
Supertiles for Multistatic FFT-Based Imaging
Together, the antenna array 210, transceiver 220, and data acquisition block 230 in each supertile 202 operate like the antenna array 110, transceiver 120, and data acquisition block 130 described above with respect to
The computer/digital interface 240 processes the digitized data by applying a multistatic-to-monostatic correction/compensation, then applying a Fourier-transform beam propagation technique as described above and below. The resulting microwave images are fused, possibly using a depth map generated from visible or infrared images acquired by the camera 250, to generate 3D microwave images. These images may be rendered in real-time at video or near-video rates.
Multistatic Array Topology
The array topology is notionally depicted in
Each BA 311 samples a scene with a regularly spaced grid of non-redundant phase centers 313. Each transmit element/receive element pair in the BA 311 defines a corresponding phase center 313 at the midpoint of the line segment connecting the transmit element with the receive element. Taken together, all of the transmit element/receive element pairs in a given BA 311 form phase centers 313 arrayed along a grid within the interior of the BA 311 as shown in
The tiled BA layout samples the scene with a regularly spaced grid of phase centers that covers the extent of the aperture. Phase center sampling takes place only within a tile. In other words, a linear transmit array communicates only with adjacent linear receive arrays. This restricts the distance between transmit-receive antenna pairs.
In the example shown in
Each tile 317 samples a scene with a regularly spaced grid of equivalent, non-redundant phase centers 320. Each transmit element/receive element pair in the tile 317 defines a corresponding phase center 320 at the midpoint of the line segment connecting the transmit element with the receive element. Taken together, the transmit element/receive element pairs in a given tile 317 form phase centers 320 arrayed along a grid within the interior of the tile 317 as shown in
It is noted that phase center sampling takes place only within a tile. In other words, a block of transmit antennas communicates only with adjacent blocks of receive antennas. This restricts the distance between transmit-receive antenna pairs.
In the example shown in
Each multistatic array is coupled to a transceiver 120 as shown in
Multistatic FFT-Based Imaging
As explained above, multistatic array topologies can be used to drastically reduce the number of antenna elements required in a large imaging aperture, mitigating hardware costs. However, with multistatic sampling schemes, efficient reconstruction remains a challenge. While the very computationally expensive backprojection method can be used for any multistatic scheme, the more efficient FFT method generally cannot be used directly. The imaging technique described in this section allows the FFT-based method to be used, after a data correction is applied. Because this process is relatively computationally inexpensive, it allows for video rate image formation on COTS computing hardware.
For each frequency point, reflection data is formatted into a 2D matrix, s(nx, ny), where indices nx and ny correspond to x- and y-positions of phase centers. Reflections for the missing phase centers in the middle row and column of each array tile are set to zero. Next, the sampled data set undergoes a multistatic-to-monostatic correction (404) using correction factor 405 A reference point is defined in the center of the imaging domain at a position given by {right arrow over (r)}ref. The corrected data set is given by:
Ru(nx,ny) is the calculated reflection set that the multistatic design would receive if it probed a scene that contained only a point scatterer placed at {right arrow over (r)}ref:
R
u(nx,ny)=e−jk|{right arrow over (r)}
It is noted that {right arrow over (rT)} is the position of transmit antennas, while {right arrow over (rR)} is the position of receive antennas. Ro(m, n) is the calculated reflection set that would be received by a monostatic aperture imaging the point scatterer scene, where sampling takes place on the multistatic aperture's phase center grid, {right arrow over (rC)}:
The corrected data is then zero padded and interpolated (406) to size 2N for FFT processing, where N is a power of 2. (The data may also be interpolated before the multistatic-to-monostatic correction is applied.) For instance, an aperture that supports 300×300 phase centers would be padded to size 512×512. The zero padded data undergoes an FFT (408), a phase shift to the image plane (410), and an inverse FFT (412) as part of the “monostatic” Fourier imaging process 420. This “monostatic” imaging process 420 is repeated for each measured frequency, and images are fused or summed (414) over frequency at each depth slice in a 3D imaging domain to produce an output image.
Deriving the Multistatic-to-Monostatic Corrections
The middle panel of
The multistatic to monostatic correction is valid over a finite imaging domain. However, as illustrated by experimental results given below, a single correction is sufficient for a human-sized domain. The correction may become less accurate as the size of the BA tiles is increased. Larger imaging domains could be realized by decomposition into subdomains.
Comparison with Backprojection Techniques
For real time imaging capability, image reconstruction should occur at or near video rates. Fortunately, the FFT-based techniques disclosed herein provide a reconstruction that can be performed orders of magnitude faster than backprojection using readily available, suitably programmed computer hardware (e.g., GPUs). In some cases, FFT-based construction can be performed at video rate using COTS computing hardware.
To compare the presented method with the prevailing backprojection technique, a simulation is considered where the array depicted in
It is noted that {right arrow over (rT)} is the position of transmit antennas, while {right arrow over (rR)} is the position of receive antennas.
The simulation assumed a stimulus ranging from 24-30 GHz (32 steps), and presented images have a dynamic range of 40 dB. As seen, the images are nearly identical. However, an analysis of the computational workloads required for each case shows that formation of the image with the FFT method requires 0.57 GFLOP (Giga-Floating Point Operations), while backprojection requires 512 GFLOP. The computational workload values used to calculate the computational loads are from M. Arakawa, “Computational Workloads for Commonly Used Signal Processing Kernels, ser.” Project Report, MIT Lincoln Laboratory, 2006, which is incorporated herein by reference in its entirety.
Experimental Validation of Multistatic FFT-Based Imaging
While various inventive embodiments have been described and illustrated herein, those of ordinary skill in the art will readily envision a variety of other means and/or structures for performing the function and/or obtaining the results and/or one or more of the advantages described herein, and each of such variations and/or modifications is deemed to be within the scope of the inventive embodiments described herein. More generally, those skilled in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are meant to be exemplary and that the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the inventive teachings is/are used. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific inventive embodiments described herein. It is, therefore, to be understood that the foregoing embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described and claimed. Inventive embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein. In addition, any combination of two or more such features, systems, articles, materials, kits, and/or methods, if such features, systems, articles, materials, kits, and/or methods are not mutually inconsistent, is included within the inventive scope of the present disclosure.
The above-described embodiments can be implemented in any of numerous ways. For example, embodiments of designing and making the technology disclosed herein may be implemented using hardware, software or a combination thereof. When implemented in software, the software code can be executed on any suitable processor or collection of processors, whether provided in a single computer or distributed among multiple computers.
Further, it should be appreciated that a computer may be embodied in any of a number of forms, such as a rack-mounted computer, a desktop computer, a laptop computer, or a tablet computer. Additionally, a computer may be embedded in a device not generally regarded as a computer but with suitable processing capabilities, including a Personal Digital Assistant (PDA), a smart phone or any other suitable portable or fixed electronic device.
Also, a computer may have one or more input and output devices. These devices can be used, among other things, to present a user interface. Examples of output devices that can be used to provide a user interface include printers or display screens for visual presentation of output and speakers or other sound generating devices for audible presentation of output. Examples of input devices that can be used for a user interface include keyboards, and pointing devices, such as mice, touch pads, and digitizing tablets. As another example, a computer may receive input information through speech recognition or in other audible format.
Such computers may be interconnected by one or more networks in any suitable form, including a local area network or a wide area network, such as an enterprise network, and intelligent network (IN) or the Internet. Such networks may be based on any suitable technology and may operate according to any suitable protocol and may include wireless networks, wired networks or fiber optic networks.
The various methods or processes (e.g., of designing and making the technology disclosed above) outlined herein may be coded as software that is executable on one or more processors that employ any one of a variety of operating systems or platforms. Additionally, such software may be written using any of a number of suitable programming languages and/or programming or scripting tools, and also may be compiled as executable machine language code or intermediate code that is executed on a framework or virtual machine.
In this respect, various inventive concepts may be embodied as a computer readable storage medium (or multiple computer readable storage media) (e.g., a computer memory, one or more floppy discs, compact discs, optical discs, magnetic tapes, flash memories, circuit configurations in Field Programmable Gate Arrays or other semiconductor devices, or other non-transitory medium or tangible computer storage medium) encoded with one or more programs that, when executed on one or more computers or other processors, perform methods that implement the various embodiments of the invention discussed above. The computer readable medium or media can be transportable, such that the program or programs stored thereon can be loaded onto one or more different computers or other processors to implement various aspects of the present invention as discussed above.
The terms “program” or “software” are used herein in a generic sense to refer to any type of computer code or set of computer-executable instructions that can be employed to program a computer or other processor to implement various aspects of embodiments as discussed above. Additionally, it should be appreciated that according to one aspect, one or more computer programs that when executed perform methods of the present invention need not reside on a single computer or processor, but may be distributed in a modular fashion amongst a number of different computers or processors to implement various aspects of the present invention.
Computer-executable instructions may be in many forms, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Typically the functionality of the program modules may be combined or distributed as desired in various embodiments.
Also, data structures may be stored in computer-readable media in any suitable form. For simplicity of illustration, data structures may be shown to have fields that are related through location in the data structure. Such relationships may likewise be achieved by assigning storage for the fields with locations in a computer-readable medium that convey relationship between the fields. However, any suitable mechanism may be used to establish a relationship between information in fields of a data structure, including through the use of pointers, tags or other mechanisms that establish relationship between data elements.
Also, various inventive concepts may be embodied as one or more methods, of which an example has been provided. The acts performed as part of the method may be ordered in any suitable way. Accordingly, embodiments may be constructed in which acts are performed in an order different than illustrated, which may include performing some acts simultaneously, even though shown as sequential acts in illustrative embodiments.
All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.
The indefinite articles “a” and “an,” as used herein in the specification and in the claims, unless clearly indicated to the contrary, should be understood to mean “at least one.”
The phrase “and/or,” as used herein in the specification and in the claims, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases. Multiple elements listed with “and/or” should be construed in the same fashion, i.e., “one or more” of the elements so conjoined. Other elements may optionally be present other than the elements specifically identified by the “and/or” clause, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, a reference to “A and/or B”, when used in conjunction with open-ended language such as “comprising” can refer, in one embodiment, to A only (optionally including elements other than B); in another embodiment, to B only (optionally including elements other than A); in yet another embodiment, to both A and B (optionally including other elements); etc.
As used herein in the specification and in the claims, “or” should be understood to have the same meaning as “and/or” as defined above. For example, when separating items in a list, “or” or “and/or” shall be interpreted as being inclusive, i.e., the inclusion of at least one, but also including more than one, of a number or list of elements, and, optionally, additional unlisted items. Only terms clearly indicated to the contrary, such as “only one of” or “exactly one of,” or, when used in the claims, “consisting of,” will refer to the inclusion of exactly one element of a number or list of elements. In general, the term “or” as used herein shall only be interpreted as indicating exclusive alternatives (i.e. “one or the other but not both”) when preceded by terms of exclusivity, such as “either,” “one of,” “only one of,” or “exactly one of” “Consisting essentially of,” when used in the claims, shall have its ordinary meaning as used in the field of patent law.
As used herein in the specification and in the claims, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, “at least one of A and B” (or, equivalently, “at least one of A or B,” or, equivalently “at least one of A and/or B”) can refer, in one embodiment, to at least one, optionally including more than one, A, with no B present (and optionally including elements other than B); in another embodiment, to at least one, optionally including more than one, B, with no A present (and optionally including elements other than A); in yet another embodiment, to at least one, optionally including more than one, A, and at least one, optionally including more than one, B (and optionally including other elements); etc.
In the claims, as well as in the specification above, all transitional phrases such as “comprising,” “including,” “carrying,” “having,” “containing,” “involving,” “holding,” “composed of,” and the like are to be understood to be open-ended, i.e., to mean including but not limited to. Only the transitional phrases “consisting of” and “consisting essentially of” shall be closed or semi-closed transitional phrases, respectively, as set forth in the United States Patent Office Manual of Patent Examining Procedures, Section 2111.03.
This application is a continuation application of U.S. application Ser. No. 15/262,687, filed Sep. 12, 2016, and entitled “Methods and Systems For Near-Field Microwave Imaging,” which claims priority, under 35 U.S.C. § 119(e), from U.S. Application No. 62/268,559, filed Dec. 17, 2015, and entitled “Multistatic Array Topology for FFT-Based Field Imaging.” Each of these applications is incorporated herein by reference in its entirety.
This invention was made with government support under Contract No. FA8721-05-C-0002 awarded by the U.S. Air Force. The government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
62268559 | Dec 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15262687 | Sep 2016 | US |
Child | 16433074 | US |