The present invention relates to navigation. More specifically, the present invention relates to systems and methods for detecting a device's airspeed as an aid to navigation.
UAVs (Unmanned Aerial Vehicles) have developed from a seeming toy/plaything into devices with myriad uses. Nowadays, UAVs have developed as a mainstay of modern life. Not only is it used in the military context as reconnaissance platforms and weapons platforms but in civilian life UAVs have an ever expanding list of roles.
In the past decade, UAVs have developed from requiring human operators to becoming semi-autonomous and, in some cases, to becoming fully autonomous devices. Of course, both full autonomy and semi-autonomy are achieved through the use of a multitude of onboard sensors. For navigation, these onboard sensors are mainly composed of IMUs (inertial measurement units) operating in conjunction with GNSS (global navigation satellite systems). The IMUs can be used to reliably estimate the navigation states for short periods of time through INS (inertial navigation system) mechanization.
While such devices and systems have proven to be useful for the UAV field, such mechanization has its own issues. As is well-known, such mechanization will include mathematical integration (i.e. estimates of mathematical results) and such integration can necessarily lead to a massive accumulation of errors and inaccurate navigation states over long time periods. To achieve an accurate navigation solution that is useful over long periods of time, the GNSS system used is required to bound (i.e. impose limits on) the drift exhibited in the INS solution through GNSS/INS integration.
On a related note, current developments in UAV technology has allowed smaller UAVs to be operate in more challenging areas such as forests, caves, heavily urbanised areas, or even in physically hostile environments. In such areas, GNSS coverage can be either minimal or non-existent, with signals being either unable to reach the UAV or with signals being actively blocked. Such GNSS signal degradation will challenge the ability of UAVs to navigate autonomously.
To overcome the above noted absence of GNSS system as well as to limit the above noted issue with INS solution drift, different techniques have been proposed based on various sensors such as cameras, Light Detection and Ranging (LIDAR), and Radio Detection and Ranging (RADAR). Unfortunately, most of these alternative techniques have their drawbacks and issues.
Limiting the massive drift exhibited by the IMU during Dead-Reckoning (DR) can be achieved with the aid of different sensors. The information gained from these sensors can be fused as position, velocity, or attitudes update. Velocity update greatly enhances the navigation solution, as the horizontal velocity is coupled (Schuler effect) with roll and pitch angles. The velocity of the vehicle can be measured using various sensors such as cameras.
Visual odometry is the process of determining the location and orientation of a camera by analyzing a sequence of images. Monocular Visual Odometry (VO) uses a single camera and can be classified into two main approaches, Structure From Motion (SFM), and fundamental matrix with both of these approaches being mainly utilized to estimate the camera poses. The main issues with using a monocular camera are the scale ambiguity and the susceptibility to drift of the estimated position if the estimated position is not integrated with another aiding sensor.
The above problem of scale ambiguity can be solved when stereo or multiple cameras are used, with accuracy mainly depending on the baseline between cameras. Other approaches utilize Machine Learning (ML) approaches to estimate the velocity from monocular camera and to solve the scale ambiguity. Regardless of the number of cameras used or the configuration of these cameras, system performance is susceptible to environmental changes such as lighting conditions. As well, system performance can be severely degraded due to lack of features. In addition, when using multiple cameras, other drawbacks must be taken into consideration such as power consumption, weight, computations, and cost.
Radar can also be used as an aiding sensor to assist the navigation solution during GNSS signal blockage. Different approaches to this have been utilized such as Radar Odometry (RO). In one approach, a Synthetic Aperture Radar (SAR) is fixed on a Cessna aircraft, a compressed image is formed from the scatterers of stationary ground targets, and then the Hough transform is used to extract these targets to estimate range and range rate. These are then used in integration through EKF under an assumption of relatively constant heading. Another approach is based on range progression to estimate a vehicle's relative motion using recursive-RANSAC to separate outliers and to clearly identify targets. Other approaches use a two-dimensional odometer through multiple target tracking algorithm based on Global Nearest Neighbor (GNN). Regardless of the used radar approach, radar utilization faces limitations especially when applied to small and micro UAV. Considerations such as weight, size, cost, power consumption, and large computation requirements render radar utilization questionable for use with smaller UAVs.
Another common approach for aiding the navigation solution is Simultaneous Localization and Mapping (SLAM) with the aid of different sensors. For this approach, one commonly used sensor is LIDAR. Despite the impressive capabilities of LIDAR, it is not suitable for small and micro UAVs due to its weight, size, power consumption, and cost. In addition, LIDAR requires a large amount of computation as its measurements may reach half million points every second. LIDAR is therefore not as useful for real-time applications. As well, using LIDAR in outdoor environments with UAVs is challenging.
To summarize, regardless of the approach and the sensor used, due consideration must be given to the limited space, weight, size, power, cost, and computational power of the targeted small or micro UAV platform.
Based on the above, there is therefore a need for systems and methods that address the above issues while mitigating if not overcoming the shortcomings of the prior art.
The present invention provides systems and methods for use in determining a device's speed. The system uses a plate having a front side that is perpendicular to the device's direction of travel. The airflow caused by the device's motion causes the plate to deflect from a resting position and the amount of deflection of the plate is proportional to the speed of the device. The amount of deflection is measured by a rotary encoder coupled to the plate. By properly calibrating the system, the system can determine the device's velocity simply from the airflow caused by the device's motion.
In one aspect, the present invention provides a system for use in determining a speed of a moving device, the system comprising:
In another aspect, the present invention provides a speed determination system, the system comprising:
In yet a further aspect, the present invention provides a method for determining a speed of a moving device using a speed determination system mounted on said device, the method comprising:
a) providing a deflection-based subsystem as part of said speed determination system, said deflection based subsystem comprising a component exposed to an airflow;
b) determining an amount of a deflection of said component, said deflection of said component being caused by said airflow, said amount of deflection being measured relative to a predefined resting position;
c) using a data processing device, calculating said speed based on said amount of deflection;
wherein
The embodiments of the present invention will now be described by reference to the following figures, in which identical reference numerals in different figures indicate identical elements and in which:
In indoor or outdoor environments, there are several ways to aid the IMU during a GNSS outage or when GNSS signals are unavailable. As noted above, most of these methods suffer from various limitations such as high cost, heavy weight, high power consumption, need for high computational power, the inability to work in darkness, and the inability to work in areas with minimal features. Moreover, most of recently developed UAVs cannot use of the common pitot tubes as a velocity sensor. This sensor is very sensitive to air flow direction and requires high-velocity air flow as small changes in velocity profiles do not induce enough change in differential pressure that can be sensed by pitot tube. There is therefore a need for suitable devices and systems that can act as an odometer for UAVs while overcoming the above limitations.
It should be clear that, during a UAV's flight, there is relative airflow in a direction opposite to the UAV's direction of movement. The present invention seeks to take advantage of this relative airflow to estimate the device's velocity. Once the velocity has been estimated, this can then be used as an effective odometer to aid the INS during a GNSS outage.
Referring to
In one implementation, the encoder 80 uses a magnet that also rotates about the axis 55 as the plate rotates due to the airflow 60. The magnet operates in conjunction with a Hall effect sensor that detects and measures any changes to the position of magnetic field peaks in the magnetic field. The changes to the magnetic field peaks are proportional to the amount of deflection of the plate and the amount of deflection is proportional to the speed of the airflow 60. Thus, by properly calibrating the system 10, the speed of the airflow (which is proportional to the velocity of the device) can be determined and, accordingly, the velocity of the device can also be determined.
Referring to
For clarity, the Hall effect sensor is a transducer which is used to measure the magnetic field. This measured magnetic field can be utilized in many different ways according to the required task and application.
In one implementation, the Hall effect sensor used is contactless 360 degrees angle position sensor AS5048A board, which is a 14-bit magnetic rotary encoder having a 0.0219 degrees resolution. The sensor is used with a stationary and rotary part. The rotary part works with two opposite magnets while the integrated circuit (IC) in the subsystem detects the peaks of the opposite magnetic fields and determines the absolute angle. The change between these two peaks are measured and detected.
In order to change the rotation angle according to the relative airflow resulting from the device/UAV motion (which indicates the relative speed of the device), the structure used takes advantage of the lifting force applied on immersed bodies from airflow as seen in
L=½ρV2ACL (1)
In Equation (1), L is the lifting force, ρ is the air density, V is the velocity of flow, A is the area of the plate (i.e. the immersed body), and CL is the lifting coefficient.
The relation between the angle caused by the relative airflow and the velocity is given in the following equations. The schematic illustration of the various variables for these equations is shown in
F·cos(θ)=mg·cos(90−θ) (2)
F·cos(θ)=mg·sin(θ) (3)
In Equation (2), F is the force resulting from the relative airflow, m is the mass of the resisting plate.
g is the gravity constant, θ is the angle of the resisting plate (or component) from its zero or resting position.
Substituting Eqn. (1) in Eqn. (3),
Some of the variables in Eqn. (5) can be considered as constants for a specific design (ρ, A, CD, m, and g). This will lead to Eqns. (6) and (7):
The mathematical relationship between the velocity of the UAV and the deflection angle (using some arbitrary values) is shown in the graph of
It should be clear that, when the system in
Regarding the implementation of the system, the plate may be constructed from balsa wood to ensure low mass. In one implementation, the complete system weighed less than 50 grams while the plate weighed only 2 grams. In other implementations, other materials may be used for the plate and suitable calibrations may need to be performed to ensure that a proper measurement of the UAV's speed is executed. As can be imagined, depending on the choice of material for the plate, the calibration may be executed in various ways. In one method, the system can be calibrated by using a simple least squares method to properly map the measured angle deflection to the UAV velocity while there is GNSS availability. Once this mapping has been performed, the mathematical function derived from the calibration can be used to determine vehicle velocity when GNSS is not available.
The velocity from the system acts as a velocity update to enhance the navigation solution during GNSS outage through EKF.
Coordinate Frames
The navigation frame adopted while testing the system is the North, East, and Down (NED) coordinate frame. The device/UAV configuration for this implementation was the X-configuration, where the X-axis is between motor 1 and 2 arms, Y-axis is between motor 2 and 3 arms, and Z-axis completes the right-hand rotation rule and pointing upwards. (See
Extended Kalman Filter (EKF) and Framework
IMU (accelerometers and gyros) raw measurements pass through a mechanization process to obtain the UAV's navigation states (position, velocity, and attitudes). The error resulting from the difference between the INS and the GNSS solution is then fed to a Kalman filter to correct the navigation states by estimating the errors in these states.
The EKF is composed of 21 states.
In Equation (8), δPn, δVn, δ∈n are the position, velocity and attitudes errors respectively while ab and as are the accelerometers biases and scale factors, and gb and gs are the gyroscopes biases and scale factors.
To obtain the system model, the mechanization equations are linearized using first-order differential equations as in Equations (9) and (10). This is then discretized to represent the EKF prediction step.
{dot over (x)}=Fx+Gw (9)
{circumflex over (x)}k−=Φk,k-1{circumflex over (x)}k-1+Gk-1wk-1 (10)
In Equations (9) and (10), x is the error states vector, F and Φ are the dynamic and state transition matrices, G is the noise coefficient matrix, and w is the system noise. The Gauss-Markov (GM) process is used to describe the biases and scale factors stochastic errors of the accelerometers and gyroscopes.
The state covariance matrix P can be propagated (predicted) as follows. In Equation (11) below, Q is the system noise covariance matrix.
Pk−=Φk,k-1Pk-1Φk,k-1T+Gk-1Qk-1Gk-1T (11)
When GNSS is available or when there is available information from any other aiding sensor such as the system of the invention or a magnetometer, such new information is fused through the filter as an update step as follows.
Kk=Pk−HkT(HkPk−HkT+Rk)−1 (12)
{circumflex over (x)}k={circumflex over (x)}k−+Kk(Zk−Hk{circumflex over (x)}k−) (13)
Pk=(1−KkHk)Pk− (14)
In Equations (12), (13), and (14), Kk is the Kalman gain, Rk is the measurements covariance matrix, Hk is the design matrix, and Zk is the observation matrix.
The heading angle ψmag can be calculated by processing the raw magnetometer measurements from the three-perpendicular unit-vector readings [Mx My Mz].
In Equation (15), Φ is the roll angle, θ is the pitch angle and δmag is the magnetic declination, which represents the difference between true north and magnetic north.
The magnetometer heading and system's velocity measurement can be represented as follows:
{circumflex over (ψ)}mag=ψmag+Δψ
{circumflex over (V)}OdoFin=VOdoFin+ΔV
In Equations (16) and (17), Δψmag, ΔVOdoFin are the errors in the magnetometer heading and the OdoFin system measurements respectively. (It should be clear that the terms “OdoFin” and “Air-Odo” refer to implementations of the system of the present invention.)
The measurement model used for the EKF update is the difference between the heading and velocity measured from the INS and magnetometer and the OdoFin system.
zHeading={circumflex over (ψ)}INS−{circumflex over (ψ)}mag (18)
zVelocity={circumflex over (V)}INS−{circumflex over (V)}OdoFin (19)
During the deterioration of the GNSS signals, the EKF will be updated with the velocity and heading readings from the OdoFin system and the magnetometer.
To prove the derived relation between the rotation angle (or deflection angle) and velocity estimated, a real experiment in a wind tunnel was carried on with test setup as illustrated in
The velocity of the wind (induced by the wind tunnel) and the corresponding deflection angle measured from the Air-Odo system is shown in the graphs of
To achieve a better estimate of the constant in Eqn. (7), as there are several minor effects that might have not been modeled (e.g. friction), least square adjustment (LSA) is applied. After reaching a better estimate of this constant, it can be used to estimate the velocity using the following equation (Eqn. (20)).
By applying LSA, then utilizing the estimated constant value in Eqn. (20), this yields the velocity shown in the graph of
For each Air-Odo variant, there is a limitation regarding the least and maximum velocity that can be estimated. This limitation can be overcome if the mass of the resisting part or component is increased as this will give the Air-Odo system a higher dynamic range as will be shown in the second experiment.
In the second experiment, an additional mass (8 grams) was added to the resisting plate (as shown in
Referring to
Referring to
In order to verify the ability of the system to aid the navigation solution during a GNSS outage and to supply the EKF with the device's velocity, two real flights in two different days were conducted with a 3DR Solo quadcopter. During these flights, a prototype of the present invention was attached to the top of the quadcopter as seen in
For testing purposes, the system of the present invention was attached to the top of the quadcopter body, while a MY-RIO board was attached to the quadcopter belly to acquire the data from the system and store to store that data in a USB flash drive. It should be clear that MY-RIO is an embedded system board, equipped with Xilinx Zynq 7 series FPGA and a dual-core ARM Cortex-A9 processor. An FPGA program was developed for this task with the ability to monitor the data through WIFI on the ground station in addition to storing the data on a USB device.
To test the system, different GNSS outage scenarios were conducted ranging from 60 to 300 seconds. These were executed to evaluate the ability of the integration between OdoFin/INS/Mag systems to act as a replacement for GNSS during the outage.
In one test, simulating a 60 second GNSS outage, an INS solution was used as a dead-reckoning system. In another test, the present invention was used as an aiding sensor when the same 60 second GNSS outage was simulated. The results showed a 2D RMSE (root mean square error) of 144 m for the INS dead-reckoning and a 2D RMSE of 0.91 m for the system incorporating the present invention.
In another series of test flights, the present invention was integrated with INS and a magnetometer and differing periods of GNSS outages were simulated. As can be seen from Table I below, the RMSE for these various periods of time when GNSS was unavailable can be quite small.
Referring to
It should be clear that, although the embodiments explained above use the system of the present invention to determine the speed of an airborne device, the present invention may be used on any moving vehicle and/or device. Surface vehicles and surface moving devices may also use the present invention to determine their speed in much the same manner as explained above.
A person understanding this invention may now conceive of alternative structures and embodiments or variations of the above all of which are intended to fall within the scope of the invention as defined in the claims that follow.
This application is a non-provisional patent application that claims the benefit of U.S. Provisional Application No. 62/681,233 filed on Jun. 6, 2018.
Number | Name | Date | Kind |
---|---|---|---|
4625565 | Wada | Dec 1986 | A |
5438880 | Washburn | Aug 1995 | A |
8096507 | Cain | Jan 2012 | B2 |
20090152895 | Jeong | Jun 2009 | A1 |
20090165686 | Memory | Jul 2009 | A1 |
20130245980 | Forbes | Sep 2013 | A1 |
20180080775 | Loomis | Mar 2018 | A1 |
20200064438 | Swanson | Feb 2020 | A1 |
20200385115 | Piasecki | Dec 2020 | A1 |
Number | Date | Country |
---|---|---|
204797862 | Nov 2015 | CN |
108709677 | Oct 2018 | CN |
Entry |
---|
Noureldin, A., et al. “Accuracy Enhancement of Inertial Sensors Utilizing High Resolution Spectral Analysis” Aug. 27, 2012, Sensors ISSN 1424-8220. |
Weston, J. L., et al. “Modern inertial navigation technology and its application” Apr. 2000, Electronics & Communication Engineering Journal. |
Balamurugan, G., et al. “Survey on UAV Navigation in GPS Denied Environments” Oct. 2016, Interational conference on Signal Processing, Communication, Power and Embedded System (SCOPES). |
Taylor, C. N., et al. “Fusion of Inertial, Vision, and Air Pressure Sensors for MAV Navigation” Aug. 20-22, 2008, IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems. Seoul, Korea. |
Mohamed, H., et al. “A Novel Real-Time Reference Key Frame Scan Matching Method” May 7, 2017, Sensors, 17, 1060. |
Vadlamani, A. K., et al. “Flight Test Results of Loose Integration of Dual Airborne Laser Scanners (DALS)/INS” 2008, IEEE, Ohio University. |
Mohamed, H. A., et al. “Improved Real-Time Scan Matching Using Corner Features” Jul. 12-19, 2016, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLI-B5, 2016 XXIII ISPRS Congress, Prague, Czech Republic. |
Baucher, B., et al. “Experimental Radar-Enabled Navigaton with UWB System in Indoor Environments” Jun. 28-30, 2017, The 18th International Radar Symposium IRS 2017, Prague, Czech Republic. |
Jameson, B., et al. “Reconnaissance Using Adaptive Multi-Carrier Radar” 2013, 2013 IEEE Radar Conference. |
Li, Tao., “Use of Wheel Speed Sensors to Enchance a Reduced IMU Ultra-Tight GNSS Receiver” Dec. 2009, Department of Geomatics Engineering, Calgary, Alberta. |
Noureldin, A., et al. “Fundamentals of Inertial Navigation, Satellite-based Positioning and their Integration” 2013, Springer Heidelberg New York Dordrecht London. |
Pollefeys, M., et al. “Detailed Real-Time Urban 3D Reconstruction From Video” Int. J. Comput. Vis., vol. 78, No. 2-3, pp. 143-167, Jul. 2008. |
Nister, D., et al. “Visual Odometry” 2004, 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. |
Scaramuzza, D., et al. “Performance Evaluation of 1-Point-RANSAC Visual Odometry” Jul. 5, 2011, GRASP Lab, University of Pennsylvania, Philadelphia, Pennsylvania. |
Scaramuzza, D., et al. “Real-Time Monocular Visual Odometry for On-Road Vehicles with 1-Point RANSAC” Jul. 2009, Autonomous Systems Lab, Computer Vision and Geometry Group, ETH Zurich. |
Quist, E. B., et al. “Radar Odometry on Fixed-Wing Small Unmanned Aircraft” Feb. 2016, IEEE Transactions on Aerospace and Electronics Systems, vol. 52, No. 1. |
Quist, E. B., et al. “Radar Odometry with Recursive-RANSAC” Aug. 2016, IEEE Transactions on Aerospace and Electronic Systems vol. 52, No. 4. |
Durrant-Whyte, H., et al. “Simultaneous Localization and Mapping: Part I” Jun. 2006, IEEE Robotics & Automation Magazine. |
Bailey, T., et al. “Simultaneous Localization and Mapping (SLAM): Part II” Sep. 2006, IEEE Robotics & Automation Magazine. |
Mostafa, M.M., et al. “Optical Flow Based Approach for Vision Aided Inertial Navigation Using Regression Trees” Jan. 2017, pp. 856-865, 2017 International Technical Meeting, Monterey, California. |
Hemann, G., et al. “Long-range GPS-denied Aerial Inertial Navigation with LIDAR Localization” Oct. 9-14, 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Daejeon, Korea. |
Tang, J., et al. “LiDAR Scan Matching Aided Inertial Navigation System in GNSS-Denied Environments” Jul. 10, 2015, Sensors ISSN 1424-8220. |
Aqel, M., et al. “Review of visual odometry: types, approaches, challenges and applications” 2016, SpringerPlus. |
Applications, “Advantages and Limitations of Pitot Tubes”, 2019, Mechoholic. |
Buchnik, Y., et al. “Speed and Positon Estimation of Brushless DC Motor in Very Low Speeds” 2004, IEEE. |
Paul, S., et al. “A New Approach to Detect Mover Position in Linear Motors Using Magnetic Sensors” Oct. 2015, Sensors ISSN 1424-8220. vol. 15. |
Jezny, J., et al. “Position Measurement with Hall Effect Sensors” Nov. 2013, Science and Education Publishing, American Journal of Mechanical Engineering, vol. 1, No. 7, pp. 231-235. |
Ferrazzin, D., et al. “Hall Effect Sensor-Based Linear Transducer” Sep. 1999, IEEE International Workshop on Robot and Human Interaction, Pisa, Italy. |
Bienczyk, K., “Angle Measurement Using a Miniature Hall Effect Position Sensor” 2009, IEEE, Mechatronics. |
Marvelmind Robotics, https://marvelmind.com/. Accessed Aug. 18, 2018. |
Cadena, C., et al. “Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age” Dec. 2016, IEEE Transactions on Robotics, vol. 32, No. 6. |
Number | Date | Country | |
---|---|---|---|
20190376997 A1 | Dec 2019 | US |
Number | Date | Country | |
---|---|---|---|
62681233 | Jun 2018 | US |