Embodiments of the present invention generally relate to unmanned aerial surveillance and, more particularly, to a small unmanned aerial system (sUAS) using a combination of radio, optical, thermal, and chemical detection for autonomously making a landing and performing surveillance.
There is often a need for remote surveillance using small unmanned aircraft so as not to put personnel in harm's way. Such needs often arise in situations where surveillance or security protection is desired such as for police work, military combat scenarios, or fire and rescue situations.
It may be desirable, for example, to be able to detect covert activity—such as smuggling or terrorist operations—or concealed dangers such as weapons or bombs hidden behind a wall of a building or buried underground. Solutions to such problems may be useful in situations where surveillance of an inhabitable area from behind a building wall may be desired, for example, for detecting illegal activities such as smuggling or illegal border crossings or, for example, detecting the presence of hostile individuals in a war zone or terrorist situation. Another important application is detection of unexploded ordnance (UXO) such as abandoned landmines or undetonated bombs that may, for example, be left over from past conflicts. In urban environments, unexploded ordnance often may lie concealed behind standing walls.
Many situations where surveillance is desired, however, can expose the operator of surveillance equipment to grave danger and unacceptably high risks. Using equipment for surveillance may also expose the equipment itself to destruction and loss.
Embodiments of the present disclosure and their advantages are best understood by referring to the detailed description that follows. It should be appreciated that like reference numerals are used to identify like elements illustrated in one or more of the figures, in which the showings therein are for purposes of illustrating the embodiments and not for purposes of limiting them.
Broadly speaking, methods and systems are provided in one or more embodiments for remotely and autonomously landing an unmanned surveillance aircraft while an operator of the surveillance aircraft, or other personnel, remain at a safe distance from the suspect area.
Many sonic based systems have been deployed to detect distance of objects to a moving unmanned vehicle, however, use of such systems typically are limited for landing small unmanned aerial vehicles due to the low signal to noise ratio as a result of lack of proper resolution, for example, as well as a number of other factors including multi-path echoes and propeller noise. Optical and thermal imaging has also been used to find a clear platform for landing; the image processing required for autonomous landing, however, is very complex in the presence of heat sources, fog, or smog, and especially during brownout effects on land or water spray when landing over sea based platforms. One or more embodiments solve these problems using an ultra wideband (impulse) radar system as an alternative to address the deficiencies of other systems.
In one or more embodiments, a remotely controlled small unmanned aerial system (sUAS)—with vertical take-off and landing (VTOL) capability and capability to hover at a near standstill and with the capability for autonomous landing and take-off—may provide additional surveillance and mission capabilities such as capability for IED or UXO detection and neutralization while being operated at an extended, e.g., greater than 100 meters (m), standoff (distance of a human operator from the detection apparatus and potential harm); endowment with a set of optical, thermal, and chemical detection modules for aerial surveillance. One or more embodiments may provide methods and systems for unmanned aerial surveillance using a combination of radio, optical, thermal, and chemical detection using a small unmanned aerial system (sUAS) and additionally provide for confirming the existence of explosives and accomplishing their detonation from a safe distance. For example, in one embodiment a system may include: an aircraft having a plurality of wing unit propellers for vertical takeoff and landing; a control system included in the aircraft for controlling flight of the aircraft from a remote location; an ultra-wideband (UWB) radar imaging system carried by the aircraft, for multiple types of surveillance including detection of motion and presence of animal or human life in a compound or container, detection of concealed objects; and a telemetry system carried by the aircraft for providing information from the UWB radar imaging system to the remote location.
Radar sensor 1300 may include a radar receiver 1304 that performs the required signal processing on a reflected response (e.g., reflected pulses 1303) to construct a digitized representation of the target 1305 (e.g., a buried IED). In the receiver 1304, amplitude and delay information may be extracted and digitally processed. As shown in
A general block diagram of transmit and receive functions are depicted in
Radar sensor 1300, as shown in
In another implementation strategy, shown in
As indicated in
As indicated in
Equation 1 describes the relationship between the transmitter power of sensor 1300, target distance, target cross section, and receiver sensitivity of sensor 1300. To calculate the reflected signal strength, it has been assumed that the effective reflective signal from ground is due to the effective cross section of the antenna beam at that elevation.
where:
The cross section is then derived from the beam width (β) using Equation (5).
Equation (5):
σ=π*(R*Tan(β/2))2 (5)
Equation 6 defines a modified SNR Radar Imaging Function of Equation (1) in each grid location (see
Aircraft 100 may include a VTOL capability as an sUAS with its radar sensor 1300 that may operate as an ultra-wideband (UWB) radio frequency (RF) radar that has the capability to perform autonomous take-off and landing. As a dual function radar that operates in the license free band of 3-6 GHz, the UWB RF sensor 1300 may also be used, for example, as a motion detector and tracking system for surveillance of live objects inside a compound. The UWB RF sensor 1300 may emit rapid wideband pulses (e.g., sub nano-second pulse width) that can penetrate glass, wood, concrete, dry wall and bricks. In the receiver (e.g., receiver 1370), a detector circuit may be employed to identify the reflections 1303 of transmitted pulses 1301 (e.g., pulses 1356, 1366). The received periodic pulses may be manipulated to enhance SNR while maintaining very low transmission power. Advanced signal processing algorithms may be employed to construct the activity detection of the target (e.g., target 1305). By using a laptop or game module (e.g., display 163, 165) the remotely guided mini-UAV (e.g., aircraft 100) can use the radar capability to land in a stationary position and scan the compound for detection of live objects, e.g., animals or people. While in motion or in stationary detection mode, aircraft 100 may process the data it collects and display the activity level in real-time. Aircraft 100 may have the capability of being configured to scan in the horizontal as well as in the vertical axis and may be capable of performing remote surveillance of premises at extended standoffs from a remote operator of sUAS aircraft 100. The system can be used, for example, to map inside walls of a compound for constructing a 2-D image of the building.
The autonomous landing of the VTOL sUAS aircraft 100 in a pre-defined waypoint employs the capabilities provided by a GPS unit 148 (see
Aircraft 100 may be remotely operated, for example, by a single specialist, such as Explosive Ordnance Disposal (EOD) personnel. Aircraft 100 may have a total diameter less than 30 inches (in.) and total flying weight, including batteries and UWB RF imager 1300 of less than 10.5 pounds (lb.). Aircraft 100 may have operational capability for vertical takeoff from any flat surface or surface sloped less than 45 degrees to a 100 ft. altitude in less than 10 seconds. Aircraft 100 may have operational capability for hover about 1.0 ft. above ground when locked to the GPS, e.g., using GPS unit 148. Aircraft 100 may have operational capability for sustained operation for at least 8.5 minutes, up to and possibly exceeding 30 minutes. Aircraft 100 may have operational capability for landing non-line-of-site (NLOS) using on-board radar capability.
As shown in
Imaging section 131 may include one or more UWB RF scanners (e.g., sensor array 132) such as, for example, the 5 GHz or 60 GHz systems referenced above. In addition, imaging section 131 includes an optical video camera 137. The UWB RF scanner (sensor array unit 132) and camera 137 may be connected to a digital signal processing (DSP) unit 134, which may access a memory unit 136 comprising, for example, a random access memory (RAM). The DSP unit 134 may communicate, as shown in
Flight control section 141 may include a micro-controller 140. Micro-controller 140 may integrate all sensory and control inputs from the components of flight control section 141 and may provide control and telemetry outputs for UAV 100. As shown in
Micro-controller 140 may provide control outputs and receive feedback inputs from wing propeller units 150. As shown in
Flight control section 141 may also include a power manager unit 147 for providing and regulating electrical power to any of the systems of UAV 100.
Multi-link wireless control system 160 may provide links, as shown, for a UWB radar RF sensor unit 168, gimbal video camera and stabilization unit 166, night vision camera 169, flight control unit 162, and line-of-sight (LOS) to non-line-of-sight (NLOS) router link 164. Each of these units may, for example, process telemetry data or interface control inputs to a corresponding unit on UAV 100. Interface display 163, for example, may provide first person view (FPV) control and direct visual flight control for UAV 100 as well as display telemetry data such as RF imaging from the UWB radar sensors on board the UAV 100. Interface display 165 may provide an LOS to NLOS router link for UAV 100.
In
An autonomous radar scan of the selected area, using a spiral pattern as shown in
The autonomous landing pattern of the VTOL aircraft 100 may begin at a pre-defined waypoint, which may be found using on-board GPS system 148 (see
Upon reaching the vicinity of the initial pre-defined waypoint, the VTOL UAV aircraft 100 may activates its UWB radar system 131 and hover at a constant altitude around a circular perimeter of pre-defined radius. Sensing, flight control, and telemetry system 130 of aircraft 100 may then calculate the least detected energy region as shown in
System 130 may repeat its assessment of the reflected energy and estimate the altitude of the single reflection. Comparing that to its preprogrammed altitude, system 130 may then decide to land in the center of the surveyed pattern that aircraft 100 has been circling (e.g., by hovering at a constant altitude around the circular perimeter of pre-defined radius).
X(β, θ)=A·Sin β·Cos·θ·e−θ cot α (7)
Y(β, θ)=A·Sin β·Sin Θ·e−θ cot α (8)
Z(β, θ)=−A·Cos β·e−θ cot α (9)
where:
α=equiangular angle of spiral H;
θ=hovering angle around Z-axis;
β=angle between Z-axis and line from aperture local origin to XYZ origin; and
A=size of the spiral aperture (distance from main origin of aperture at=0). A may be, for example, a constant value of Z0 with θ and β equal to zero. It may be the initial value of Z where the down spiral landing begins to be performed. In
Based on the above spiral pattern, a method 1400, illustrated by
The coordinates and timing of each incremental waypoint may already be programmed in the VTOL sUAS aircraft 100 prior to launch. Travelling at a pre-defined altitude through each waypoint (j), the UWB radar (e.g., radar sensor 1300, UWB RF scanner 132) may scan the reflected power (Pj) pattern at the radar's receiver (e.g., radar receiver 1304, 1370). The reflected power (Pj) pattern may be stored in what is referred to as a “bin” file.
While the content of the reflected power (Ψ(Pj)) is stored in a bin file, a mathematical filtering may be performed to identify spatial position (φ(Pj)) of the reflections. The filtering function φp(Pj) may identify a number of cluttering elements within the beam width range of the UWB's antenna system 1325. Based on that analysis and gathering more samples (S), the system 130 may decide that the points inside a platform are indicating a flat or sloped surface and may decide whether there is suitability to ensure a low risk landing. So, for example, as shown in
Based on the H(s), the processor inside the UWB radar (e.g., processor of system 130 such as micro-controller 140 shown in
At step 1402, various variables may be initialized, such as T, the time (e.g., universal time stamp) that waypoint(i) is scanned; X, Y, Z, x-y-z coordinates of waypoint(i); the variables from Equations 7-9; delta increment values indicating change from the previous aircraft position to the current aircraft 100 position; and Sf described above with reference to
At step 1403, J, the current value of the waypoint index i; and S (sample number) may be initialized. At step 1404, the angles for Equations 7-9 may be updated using the delta increment values reflected in aircraft 100 proceeding from its current position to its next position. At step 1405, system 130 may calculate the X, Y, Z, x-y-z coordinates of its next position so that at step 1406, aircraft 100 may move to and hover at the new X, Y, Z values of the x-y-z coordinates.
At step 1407, the UWB radar imaging system (e.g., imaging section 131) may identify spatial position (φ(Pj)) and measure reflected power (Ψ(Pj)) for Pj and may store (φ(Pj)), (Ψ(Pj)), Pj, Xj, Yj, Zj, and Tj in a bin file upon reaching step 1410.
At step 1408, system 130 may determine whether (Pj)=1, indicating that a flat or suitable platform may have been found. If yes, the method proceeds to step 1411, incrementing S, and then to 1412, checking if S=Sf (as described above with reference to
If at step 1408, or at step 1412, either check returns “No”, J, the current value of the waypoint index i; is incremented at step 1409, data is stored at step 1410 in a bin file as described above, and method 1400 proceeds again from step 1404.
If at step 1412, S=Sf, method 1400 proceeds to step 1413, comparing adjacent sample values of (Ψ(Pj)) as to whether they are closer together than a pre-determined amount ε, and if so proceeds to step 1420, where a waypoint is defined, data is stored at step 1410 and aircraft 100 may descend vertically until a landing is achieved at step 1421.
If instead, at step 1413, two adjacent sample values of (Ψ(Pj)) are not closer together than a pre-determined amount ε, method 1400 proceeds to step 1414, where J, the current value of the waypoint index i; is decremented, and at step 1415, aircraft 100 may move to and hover at the new X, Y, Z values of the x-y-z coordinates. If at step 1416, J is not equal to 1, method 1400 loops back to step 1414 until J becomes 1 at step 1416, proceeds to step 1417, checking for new coordinates. If there are new coordinates (step 1418) method 1400 returns to step 1402, and if not method 1400 proceeds to step 1419, at which aircraft 100 may abort its mission and may fly autonomously, for example, to a pre-programmed home waypoint or may fly under the direction of a remote operator using multi-link control system 160 home or on to the next mission.
After landing the UWB radar system 130 may be enabled for discriminating living individuals from inanimate objects and detecting whether an individual may be carrying an object of interest such as a concealed weapon or an improvised explosive device (IED). Such capability may be useful in situations where surveillance of an inhabitable area from the roof—such as a building and compounds—is desired. Some examples include detecting illegal activities such as smuggling or illegal border crossings under a warehouse, and detecting the presence of hostile individuals in a war zone or terrorist situation. In some situations, e.g., police work, military combat scenarios, fire and rescue situations, or border and immigration control, it may be desirable to be able to detect living individuals by deploying the UWB radar system 130 from outside any kind of structure occupied by the individuals, for example, a building or a temporary shelter. Such multi-purpose, multi-function radar carried by aircraft 100 can be landed autonomously and address the compound occupancy.
Embodiments described herein illustrate but do not limit the disclosure. It should also be understood that numerous modifications and variations are possible in accordance with the principles of the present disclosure. Accordingly, the scope of the disclosure is best defined only by the following claims.
This application claims the benefit of priority from U.S. Provisional Patent Application No. 61/561,623, filed Nov. 18, 2011, which is incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
4965582 | Hellsten | Oct 1990 | A |
5487172 | Hyatt | Jan 1996 | A |
5593114 | Ruhl | Jan 1997 | A |
6112141 | Briffe et al. | Aug 2000 | A |
6384766 | Ulander | May 2002 | B1 |
6567044 | Carroll | May 2003 | B2 |
6653970 | Mitra | Nov 2003 | B1 |
6727841 | Mitra | Apr 2004 | B1 |
6867727 | Mitra | Mar 2005 | B1 |
7312763 | Mohamadi | Dec 2007 | B2 |
7504984 | Mitra | Mar 2009 | B1 |
7511654 | Goldman et al. | Mar 2009 | B1 |
7548205 | Mohamadi | Jun 2009 | B2 |
7720630 | Miller et al. | May 2010 | B1 |
7741990 | Aprile | Jun 2010 | B2 |
7830989 | Mohamadi | Nov 2010 | B2 |
7884757 | Mohamadi et al. | Feb 2011 | B2 |
7965223 | McCusker | Jun 2011 | B1 |
8237604 | Mohamadi et al. | Aug 2012 | B2 |
8744760 | Mishmash et al. | Jun 2014 | B1 |
20040075018 | Yamane | Apr 2004 | A1 |
20070252748 | Rees et al. | Nov 2007 | A1 |
20080055149 | Rees et al. | Mar 2008 | A1 |
20080169962 | Rees et al. | Jul 2008 | A1 |
20080191924 | Duff et al. | Aug 2008 | A1 |
20090051581 | Hatono | Feb 2009 | A1 |
20090055038 | Garrec et al. | Feb 2009 | A1 |
20090243855 | Prokopuk | Oct 2009 | A1 |
20100193644 | Karem | Aug 2010 | A1 |
20100225541 | Hertzog et al. | Sep 2010 | A1 |
20110015810 | Lee | Jan 2011 | A1 |
20110169686 | Eusebi Borzelli et al. | Jul 2011 | A1 |
20110210883 | Mohamadi | Sep 2011 | A1 |
20110273324 | Petillon | Nov 2011 | A1 |
20110285981 | Justice et al. | Nov 2011 | A1 |
20120056040 | Brotherton-Ratcliffe et al. | Mar 2012 | A1 |
20120105274 | Andersson et al. | May 2012 | A1 |
20120112957 | Nguyen et al. | May 2012 | A1 |
20120177027 | Venkatraman et al. | Jul 2012 | A1 |
20120215388 | Pepitone et al. | Aug 2012 | A1 |
20120234968 | Smith | Sep 2012 | A1 |
20120261516 | Gilliland et al. | Oct 2012 | A1 |
20130248656 | Mohamadi | Sep 2013 | A1 |
20140032034 | Raptopoulos et al. | Jan 2014 | A1 |
20140062754 | Mohamadi | Mar 2014 | A1 |
20140062758 | Mohamadi | Mar 2014 | A1 |
20140125511 | Longstaff | May 2014 | A1 |
20140168010 | Mohamadi | Jun 2014 | A1 |
Entry |
---|
Douglas Murphy and James Cycon, “Applications for Mini VTOL UAV for Law Enforcement,” Space and Naval Warfare Systems Center San Diego, CA 92152-7383, Nov. 1998. |
Fred Mohamadi, “Wafer-scale integration brings low cost and a small footprint to active antenna arrays,” Microwave/Millimeter Wave Technology, www.rfdesign.com, Feb. 2005. |
Number | Date | Country | |
---|---|---|---|
20140222246 A1 | Aug 2014 | US |
Number | Date | Country | |
---|---|---|---|
61561623 | Nov 2011 | US |