The present disclosure relates generally to position tracking of mobile devices. More particularly, the present disclosure relates to a position tracking system and method using radio signals and inertial sensing.
In a Global Positioning System (GPS), satellites orbiting the earth transmit signals to passive receivers on the ground. The receivers only receive signals, but they do not transmit signals. One limitation of GPS receivers is that they require an unobstructed view of the sky. As a result, GPS receivers typically are better suited for outdoor use and in areas away from tall buildings or heavy tree cover. A further limitation of GPS location devices is their dependence on an accurate external time reference.
In a GPS system, each of many GPS satellite transmits a signal that includes data to indicate the satellite's location and current time. GPS systems use two carrier frequencies (L1 and L2) for transmitting information, including satellite location, ionospheric propagation delays, offsets between satellite clock time and true GPS time. Additionally, GPS measurements are determined from pseudoranges, which are range measurements biased by receiver and satellite clock errors. The GPS satellites are all synchronized to transmit repeating signals at the same time. Because each satellite is located at a different distance from a receiver on the ground, transmitted signals arrive at the GPS receiver at slightly different times. The receiver uses the different receipt times for various signals to calculate the receiver's location in three dimensions.
U.S. Pat. Nos. 5,953,683; 7,143,004; and 7,533,569 describe sourceless orientation sensors. For example, U.S. Pat. No. 7,533,569 discloses a method of measuring positional changes of an object by using multiple accelerometers. U.S. Pat. No. 7,236,091 describes a hybrid RF/inertial position tracking system having a “wide resolution” mode for general position tracking, and a “high-resolution” mode that employs kinematic models. In this system, the high-resolution position accuracy is considered to be within the order of meters. U.S. Pat. Nos. 7,409,290; 6,167,347; 6,292,750; 6,417,802; 6,496,778; 5,923,286; 6,630,904; 6,721,657; 7,193,559; and 6,697,736 describe GPS-aided positioning and navigation methods. For example, U.S. Pat. No. 7,409,290 altitude and heading information are used to aid the GPS positioning when satellite signals are not available.
Unlike GPS, where transmission time is measured from a satellite to a mobile device or receiver, high-accuracy systems that track mobile devices in three-dimensional space measure the time that a signal arrives from the mobile device to a system's connected (either wired or wireless) antennae. These systems do not have the bias errors that GPS has. These time-based, high-accuracy RF positioning systems that use networked antennae for comparing signal time of arrival or difference of arrival measurements consist of receiver hardware having multiple receiver antennae and transmitter hardware having one or more transmitter antennae. To track a single transmitter or transmitter antenna in three dimensions, at least four receiver antennae are required. Similarly, for tracking in two dimensions, at least three receiver antennae are required.
Also, unlike GPS, where the tracking calculation is performed in the mobile device, the RF system's receiver antennae provide the reference frame in which the mobile antennae are tracked. More receiver antennae provide better coverage and more accuracy but do so with increased complexity and cost. The receiver antennae must be distinct, fixed, and have a known location in space. More transmitter antennae attached to or embedded in a tracked object allow the object's orientation to be calculated based on geometric principles. For example, two transmitter antennae, separated by a distance D, yield a pointer, since the two transmitter antennae form a line with known direction. Three transmitter antennae provide enough information to calculate three-dimensional position and orientation. The system can be reversed, with the receiver antennae being tracked and the transmitter antennae providing the reference frame.
The major source of error in RF positioning systems is signal propagation errors, such as multi path. While many methods have attempted to mitigate this problem (antennae diversity, spread spectrum), signal propagation errors are very difficult to totally eliminate. A sourceless navigation system does not have these issues but does have its own set of problems. Sourceless navigation systems are typically based on inertial sensors, which can consist of accelerometers and gyroscopes, as well as magnetic sensors. The use of small inertial sensors, like gyroscopes and accelerometers, has become commonplace in position tracking. Inertial sensors overcome problems like line-of-sight restrictions that plague tracking systems. Unfortunately, commercial, low-cost devices have drift, bias and scale factor errors and orientation motion and positional motion need to be algorithmically separated.
A positioning solution is obtained by numerically solving Newton's equations of motion using measurements of forces and rotation rates obtained from the inertial sensors. The magnetic sensor helps to define azimuth based on the earth's magnetic field. The accelerometer, gyroscope, and magnetic sensor, and various combinations thereof, together with the associated hardware and electronics comprise the inertial/magnetic devices subsystem (IMDS).
Angular orientation may be determined by integrating the output from angular rate sensors. A relatively small offset error on the gyroscope signal will introduce large integration errors. Accelerometers measure the vector sum of acceleration of the sensor and the gravitational acceleration (g). In most situations, g is dominant, thus providing inclination information that can be used to correct the drifted orientation estimate from gyroscopes. The principles for measuring orientation of a moving body segment fusing gyroscopes and accelerometers in a Kalman filter have been described in H. J. Luinge, “Inertial Sensing of Human Movement” (Ph.D. Thesis, 2002), and is incorporated by reference herein in its entirety. The magnetic sensor is sensitive to the earth's magnetic field and it gives information about the heading direction in order to correct drift of the gyroscope about the vertical axis. Methods for integrating these devices are described in E. R. Bachman, “Inertial and Magnetic Tracking of Limb Segment Orientation for Inserting Humans into Synthetic Environments” (Ph.D. Thesis 2000), and E. Foxlin, Inertial Head-Tracker Sensor Fusion by a Complementary Separate-Bias Kalman Filter Proc. of VRAIS '96, 185-94 (1996), both incorporated in their entireties by reference herein.
These Kalman filter implementations use accelerometers and magnetic sensors for low frequency components of the orientation and use gyroscopes to measure faster changes in orientation. Finally, an accelerometer-only based position and orientation tracker is disclosed in “Design and Error Analysis of Accelerometer-Based Inertial Navigation Systems,” by Chin-Woo Tan Sungsu Park for the California Partners for Advanced Transit and Highways (PATH).
Methods for integrating similar IMDS components with GPS, acoustic, optical and magnetic tracking systems are known in the art. Some examples include “Robust Dynamic Orientation Sensing Using Accelerometers: Model-based Methods for Head Tracking in AR”, by Matthew Stuart Keir, “Accelerometer-based Orientation Sensing for Head Tracking in AR & Robotics,” by Matthew S. Keir, et al, “Using Gravity to Estimate Accelerometer Orientation,” by David Mizell, “Setting up the MMA 7660FC to do Orientation Detection,” Freescale Semiconductor AN3840, “3D Orientation Tracking Based on Unscented Kalman Filtering of Accelerometer and Magnetometer Data,” Benoit Huyghea et al., “Inertial and Magnetic Sensing of Human Movement near Ferromagnetic Materials,” Daniel Roetenberg et al., “An Extended Kalman Filter for Quaternion-Based Orientation Estimation Using MARG Sensors,” Joao Luis Marins et al., “An Improved Quaternion-Based Filtering Algorithm for Real-Time Tracking of Human Limb Segment Motions using Sourceless Sensors,” Eric Bachmann et al., and are incorporated by reference herein in their entireties. In addition to these patents, the general methods for incorporating GPS and sourceless sensors are described in “The Global Positioning System & Inertial Navigation,” by J. Farrell and M. Barth, (McGraw-Hill 1999); “Global Positioning Systems, Inertial Navigation and Integration,” by M. Grewal, L. Weill, and A. Andrew, (John Wiley and Sons 2001); and “Introduction to Random Signals and Applied Kalman Filtering,” by R. Brown and P. Hwang (John Wiley & Sons 1983). These references are also incorporated by reference in their entireties.
No examples exist of RF-based position tracking systems that use inertial devices in a tracked mobile device to increase stability of the mobile device's RF signals received at the system's antennae. Therefore, what is needed is an RF position tracking system that tracks the position of one or more wireless mobile devices in two or three dimensions, improves on the limitations of GPS systems, and effectively integrates inertial sensing information in a combined system that allows the user to obtain a more stabilized and accurate position solution.
It is an object of the invention to provide a position tracking system that avoids the satellite and receiver clock errors of GPS systems.
It is also an object of the invention to provide a position tracking system capable of tracking the location of a transmitter in two or three dimensions.
It is also an object of the invention to provide a system that reduces the signal propagation errors of RF position tracking systems.
It is also an object of the invention to provide a system that reduces the drift, bias, and scale factor errors of sourceless navigation systems.
It is also an object of the invention to integrate an inertial/magnetic subsystem (IMDS) in a mobile device to better perform tracking by increasing stability of the system's received RF signals.
It is also an object of the invention to integrate an RF positioning system with an inertial/magnetic devices subsystem (IMDS) to provide long-term position stability and accuracy, even when the RF positioning system experiences temporary loss of signal.
It is also an object of the invention to use Kalman filter implementations in a RF system having accelerometers, magnetic sensors, and/or gyroscopes to measure faster changes in orientation.
It is also an object of the invention to use inertial sensors to reduce battery consumption allowing the device to transmit its radio signal only when it is moving.
It is also an object of the invention to use inertial sensors for constant tracking between the device and the system to maintain absolute position monitoring.
The present invention relates to RF position tracking system that tracks, in two or three dimensions, one or more wireless mobile device(s). The disclosure features utilizing an inertial/magnetic subsystem (IMDS) integrated in the mobile device to better perform tracking by adding stability to the system's RF signals received at the system's receiver(s). As RF signals from the mobile device are received at the system receiver, inertial information is also received that helps the system screen interference and multipath by weighting the RF data to best match the inertial data provided by the IMDS. The combined system allows a user to obtain a more stabilized/accurate position solution.
One embodiment of the invention is a system for wirelessly tracking the physical position of an object. The system has at least one radio frequency (RF) device having an antenna and at least one inertial sensor. The RF device is configured to emit a radio signal. The system has at least three receiver antennae that are each configured to receive a radio signal emitted by the device and transmit that signal to a receiver. The system also has a receiver in communication with the three or more receiver antennae. The receiver is configured to receive the radio signal from each receiver antenna and is further configured to communicate data to a data processor. Another embodiment comprises a positioning and/or navigation method and system thereof, in which the acceleration and/or velocity and/or position and/or heading from an inertial/magnetic navigation subsystem is/are used to supplement the carrier phase tracking of the RF positioning system signals, so as to enhance the performance of the RF positioning system during signal corruption or loss.
In another embodiment, a positioning and navigation system receives the acceleration, velocity, position, and/or heading measurements from an inertial/magnetic navigation subsystem. The inertial sensor measurement(s) is/are fused in a Kalman filter to supplement the carrier phase tracking of the RF positioning system signals, so as to enhance the performance of the RF positioning system during signal corruption or loss.
In another embodiment, the present invention provides an automatic power up/power down method that relies on the inertial/magnetic devices subsystem (IMDS). When the IMDS has detected no motion for a period of time, the RF positioning system is powered to a low power state. When motion resumes, the RF positioning system is returned to a full power state. In this way extended battery life may be achieved.
A method of tracking an object having an inertial sensor and capable of transmitting an RF signal includes each one of at least three antennae receiving an RF signal transmitted from an object to be tracked. The antennae receive an inertial signal from an inertial sensor integrated into or fixed onto the object. The system processes the RF signal and the inertial signal to determine the position of the object.
Additional advantages and novel features will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the accompanying drawings or may be learned by production or operation of the examples. The advantages of the present teachings may be realized and attained by practice or use of various aspects of the methodologies, instrumentalities and combinations set forth in the detailed examples discussed below.
The drawing figures depict one or more implementations in accord with the present teachings, by way of example only, not by way of limitation. In the figures, like reference numerals refer to the same or similar elements.
In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant teachings. However, it should be apparent to those skilled in the art that the present teachings may be practiced without such details. In other instances, well known methods, procedures, components, and/or circuitry have been described at a relatively high-level, without detail, in order to avoid unnecessarily obscuring aspects of the present teachings.
The gyroscope 11 may be based on fiber optics, ring lasers, vibrating masses, micro-machined devices (MEMS technology), or other technology. A typical three-axis MEMS-based gyroscope 11 is the Analog Devices ADIS 16354, a high precision tri-axis inertial sensor. Multiple, single-axis gyroscopes could also be used.
The accelerometer 12 may be piezo-electric, capacitive, strain, optical, surface wave, micro-machined (MEMS technology) or one of the many other types of technologies used for measuring acceleration. A typical three-axis MEMS accelerometer 12 is the Analog Devices ADXL325, a three-axis analog accelerometer. The magnetic sensor (magnetometer) 13 can be a Hall effect, GMR, moving coil, magneto resistive, SQUID, spin dependent tunneling, proton precession, flux-gate, or other type of technology. An example of a three-axis magneto resistive magnetometer is the Honeywell HMC1 043 three-axis magnetic sensor.
Finally, IMDS subsystem 10 may also consist of a complete integrated solution, as exemplified by the Razor IMU for Sparkfun Electronics, a 9 degree-of-freedom system that incorporates three devices—an InvenSense ITG-3200 (triple-axis gyro), Analog Devices ADXL345 (triple-axis accelerometer), and a Honeywell HMC5883L (triple-axis magnetometer). The outputs of all sensors 11, 12, 13 are processed by an on-board Atmel ATmega328 RISC processor 14 and the navigation solution, which is represented by the corrected position and orientation block 40 is output over a serial interface.
The RF tracking system 20 includes a set of RF receiving antennae 21, a set of RF transmitting antennae 22, RF system hardware 23 and a tracking processor 24. The RF receiving antennae 21 and the transmitter antennae 22 can be a dipole, patch or other antennae appropriate for the particular wavelength. Various combinations of antennae may also be used. The RF system hardware 23 includes RF components that are explained more fully in the description of
As shown in
The transmitter section 50 consists of a sine wave 220 modulated with a pseudorandom noise sequence 215 by CDMA modulator 210. This type of modulation may be of the type found in cell phones and other communication devices. The signal is amplified (not shown) and sent to transmitter antenna 22.
In the receiver section 60, the signal is received by the receiver antennae 21 and receiver reference antenna 101. Receiver antenna 101 is the reference from which the time difference of arrival is measured. The receiver antennae receive the transmitted signal and forward these signals to the receiver circuitry 110 for demodulation using another pseudo-random noise (PN) sequence 115. PN sequence 115 may be identical to PN sequence 215, although not synchronized to it in time (in other words, the starting points are not the same). This means that both sequences contain the identical pseudo-random data, but that the data is read from different starting positions. CDMA demodulators 110 retrieve the transmitted sine wave from sine wave generator 220. Within the tracking processor 24, which may be a DSP (or microprocessor), the recovered reference sine wave is shifted by 90° so that when the other signals are multiplied by it and then integrated, the reference sine wave provides a measure of phase shift between the reference and the other received signals (i.e., differential phase). The differential phases are used by the position and orientation algorithm in the tracking processor 24 to determine position and orientation 121 of a tracked object.
Tracking a single transmitter device or transmitter antenna in three dimensions requires at least four receiver antennae 21; tracking in two dimensions requires at least three receiver antennae 21. The receiver antennae 21 provide the reference frame in which the transmitter antennae are tracked. More receiver antennae 21 provide better coverage and more accuracy but do so with increased complexity and cost. The receiver antennae 21 must be distinct and their respective locations known in space. More transmitter antennae 21 attached to or embedded in a tracked object allow the object's orientation to be calculated based on geometric principles.
For example, two transmitter antennae 22, separated by a distance D, yield a pointer, since the two transmitter antennae 22 form a line with known direction. Three transmitter antennae 22 provide enough information to calculate a three-dimensional orientation. The system 1 can be reversed, with the receiver antennae 21 being tracked and the transmitter antennae 22 providing the reference frame. Recent art can be found in “Communication Systems Engineering,” by Proakis and Salehi, and is incorporated by reference herein. Many variations possible to achieve the same functionality and many of the noted components can be part of an integrated DSP. For example, a DSP might generate sine wave 220 and PN sequence 215. Discrete multipliers and integrators might be implemented in hardware instead of firmware.
The inertial/magnetic devices subsystem 10 (IMDS) provides inertial and magnetic field measurements including body angular rates, specific forces, and information on the Earth's magnetic field direction which are sent to the fusion algorithm processor 30 for minimizing RF tracking system errors during loss or corruption of RF signal. In one embodiment, the position and orientation of the transmitter antennae 22 are calculated in RF algorithm block 24.
The position and orientation algorithm is based on solving the underlying range equations. In this phase-based system, the phase is used to measure range. The operating wavelengths of the RF tracking system provide ambiguous phase measurements because phase measurements are modulo 2π numbers. Without further information, only the fractional part of the phase can be determined, making the incorrect. Equations (1)-(3) illustrate the phase to range measurement relationship. ρn is the range, λ is the wavelength (for a fixed frequency), Φn is the measured phase and kn is the integer portion of the phase. Methods exist to determine the additional integer number of wavelengths corresponding to the actual range, but it should be noted that problems due to multipath, line-of-sight issues, and other problems can lead to loss of tracking.
One way to measure the phases is against a fixed reference phase. By measuring the transmitter signal's phase differences recorded at two receiver antennae the distance is calculated. In the following equations, values ρ1-ρ4 represent distances between the receiver antennae positions and the transmitter position and are determined by the phases. Receiver positions are denoted as rcvr_posreceivernumber,positioncoordinate, and are fixed, known quantities. Position coordinate x1,2,3 represent x,y,z, respectively.
Phase differences such as formed from manipulating equations (4)-(7) into differences ρ4-ρ1, ρ3-ρ1, and ρ2-ρ1 provide the same information for determining position while allowing one of the received signals to act as a common reference.
These four equations are used to solve for x1, x2 and x3, in the RF algorithm 24, which represents the x,y,z, position of the transmitter, respectively. This can be solved in a least squares algorithm, such as Levenberg-Marquardt or in a Kalman filter, as noted in the references.
There are many ways to combine the various data streams. According to Gautier in “GPS/INS Generalized Evaluation Tool (GIGET)for the Design and Testing of Integrated Navigation Systems,” a loosely-coupled system calculates position using the RF solution only. The IMDS computes position, velocity and attitude from the raw inertial sensor measurements and uses the RF solution to fix the IMDS errors. A benefit of a loosely coupled system is that the RF system can be treated as a “black box.” In tightly coupled systems, the Kalman filter receives phase measurements of range. Ultra-tightly coupled system utilize contain feedback to the RF system itself. However, in “The Global Positioning System and Inertial Navigation,” by Farrell and Barth, loosely coupled is defined in a more general manner (reference section 7.2.2 and accompanying figures) and allows for some feedback mechanisms to exist. The ultra-tightly coupled method of Gautier is equivalent to Farrell and Barth's version of tightly coupled. For this reason, and because it is more general, the definition of coupling will be based on Farrell and Barth's description in what follows.
Referring to
This x,y,z position solution from RF algorithm 24 is incorporated into the fusion algorithm processor 30, which preferably includes a linearized or extended Kalman filter. The Kalman filter 33 is a recursive filter that estimates the state of a dynamic system. It is commonly used in data fusion applications, among others. The Kalman filter 33 is used to combine, in an optimal manner, the RF tracking system 20 data with those of the IMDS subsystem 10. If the filter 33 detects short term divergence of the RF and IMDS subsystem, it weights the final solution towards the IMDS information and supplies a corrected position and orientation output 40.
In this second embodiment, the fusion of RF tracking and inertial tracking is performed in a loosely coupled manner. In loosely-coupled fusion, a link 36 sends the error signal from the Kalman filter 33 to the inertial sensing processor 14 to modify the IMDS 10 output. A feed-forward, complementary filter design, also known as a RF position aided IMDS design, is shown in
If link 36 is added, the INS algorithm 14 can be modified to take the error signal generated by Kalman filter 33 and modify the IMDS 10 output at the computation source. This can reduce offsets and biases that are common in inertial hardware 11, 12, and 13.
In a third embodiment shown in
In an alternate embodiment shown in
An additional use for the accelerometers 12 is as a power-saving device. In this mode of operation, the accelerometer is monitored for periods of no acceleration (hence no velocity or positional changes). During these periods, the RF positioning system, especially the RF transmitters, can be put into a low or no power state. When movement resumes, which would cause an instantaneous acceleration to be measured, the RF transmitters could be powered up to resume RF tracking. Since the fusion algorithm processor 30 mediates this process, it would be able to keep track of the last computed position and orientation 40, and once acceleration is detected, apply corrections to the position and orientation based on the IMDS subsystem 10 measurements until the RF tracking system 20 comes back on line.
Depending on total system tracking requirements, including accuracy, cost limitations, or other constraints, one or more components of the inertial/magnetic devices subsystem 10 (IMDS) may or may not be present. Multiple units of each device 11, 12, and/or 13 may be used to sense various directional components. In a minimal embodiment, only one accelerometer 12 may be used to provide positional corrections over short periods of time. Also, while the fusion algorithm processor 30 is expected to run a Kalman filter, other methods for integrating the disparate measurements may be used.
In another embodiment of the method, shown
Aspects of the position tracking system 1 and method 700 for using radio signals and inertial sensing can be executed on various computing platforms and/or using various programing languages. Program aspects of the technology may be thought of as “products” or “articles of manufacture” typically in the form of executable code and/or associated data that is carried on or embodied in a type of machine readable medium. “Storage” type media include any or all of the memory of the computers, processors or the like, or associated modules thereof, such as various semiconductor memories, tape drives, disk drives and the like, which may provide storage at any time for the software programming. All or portions of the software may at times be communicated through the Internet or various other telecommunication networks. Such communications, for example, may enable loading of the software from one computer or processor into another computer or processor. Thus, another type of media that may bear the software elements includes optical, electrical and electromagnetic waves, such as used across physical interfaces between local devices, through wired and optical landline networks and over various air-links. The physical elements that carry such waves, such as wired or wireless links, optical links or the like, also may be considered as media bearing the software. As used herein, unless restricted to tangible “storage” media, terms such as computer or machine “readable medium” refer to any medium that participates in providing instructions to a processor for execution.
Hence, a machine readable medium may take many forms, including but not limited to, a tangible storage medium, a carrier wave medium or physical transmission medium. Nonvolatile storage media include, for example, optical or magnetic disks, such as any of the storage devices in any computer(s) or the like, such as may be used to implement the data aggregator, the customer communication system, etc. shown in the drawings. Volatile storage media include dynamic memory, such as main memory of such a computer platform. Tangible transmission media include coaxial cables; copper wire and fiber optics, including the wires that comprise a bus within a computer system. Carrier-wave transmission media can take the form of electric or electromagnetic signals, or acoustic or light waves such as those generated during radio frequency (RF) and infrared (IR) data communications. Common forms of computer-readable media therefore include for example: a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD or DVD-ROM, any other optical medium, punch cards paper tape, any other physical storage medium with patterns of holes, a RAM, a PROM and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave transporting data or instructions, cables or links transporting such a carrier wave, or any other medium from which a computer can read programming code and/or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
Those skilled in the art will recognize that the present teachings are amenable to a variety of modifications and/or enhancements.
All the elements of all the Figures having the same reference numbers have the same or similar functions.
The object or wireless device being tracked is referred to as tracked object or as mobile device 3. Examples of mobile devices include, but are not limited to, unmanned or manned aerial or terrestrial vehicles, such as drones, automobiles, and trucks.
This embodiment also includes multiple (base) RF receiver antennae 21 that are spaced apart from each other at various locations but are not located on the tracked object 3. These may be all located to a common base 120-1 or be located on several different bases 120-1, 120-2, 120-3. These bases 120-1, 120-2, 120-3 may be located apart from each other.
The bases 120-1, 120-2, 12-3 are required to communicate among themselves. These may be connected by wired communications, such as between base 120-1 and 120-2. They may also be connected by wireless communications, such as bases 120-1 and 120-3.
The steps of processing of the signals from the RF receiver antennae 21 may be performed at one base, or any number of processing steps may be performed at any of the other bases.
The RF receiver antennae 21 is connected to the receiver section 60, which includes CDMA demodulators 110 and the PN Sequence device 115.
The CDMA demodulators 110 communicate with the tracking processor 24. The tracking processor 24 provides output to the position and orientation device 121.
In this embodiment, the receiver section 60, tracking processor 24 and position and orientation processor 121 are not on the tracked object 3. These may be located remote from the tracked object, at a fixed base 120. This embodiment is designed to receive a signal transmitted by the tracked object 3 at the base 120, and to calculate the position and orientation of tracked object 3 at the base 120. Therefore, the tracked object 3 will not know its position and orientation. This information in this embodiment is only at the base 120.
Referring now to
An alternative embodiment of the current invention is shown in
A transmitter section 50 is connected to each RF transmitter antenna 22-1, (and optionally 22-2, 22-3) and causes them to transmit an RF signal.
The tracked object 3 has at least one (mobile) RF receiver antenna 21 that receives the RF signals. It can differentiate between the signals received from different RF transmitting antennae. The received signals are passed to a receiver section 60 having CDMA demodulators 110. The CDMA demodulators 110 receive the output of the PN signal sequence device 115 to process the signals.
The output of the CDMA demodulators 110 is provided to the tracking processor 24 that runs an RF algorithm that determines distances between the mobile antenna 21 and each of the base antennae 22 based upon the received RF signals.
The output of the tracking processor 24 is then provided to the position and orientation device 121 that calculates the positions and orientations of the tracked object 3.
Turning now to
The tracked object 3 also includes an IMDS 10 (having the previously described inertial and magnetic sensors). The mobile device 3 determines its own position and orientation from information obtained by sensing inertia and/or magnetic field orientation. IMDS 10 monitors the inertia/magnetic field changes of the tracked wireless mobile device 3. The information from the IMDS 10 can create the location and orientation of the tracked wireless mobile device 3. However, the IMDS system 10 has inherent errors in its determinations of inertia. These errors accumulate for each determination. However, they are accurate for short periods of time.
The output of the RF tracking system 20 and the output of the IMDS 10 are fed to fusion algorithm processor 30. The fusion algorithm processor 30 uses the output from these devices to update the position and orientation of the tracked object 3. This embodiment employs a fusion algorithm processor 30 running a fusion algorithm that merges the position and orientation information determined by the IMDS with the position and orientation information determined from the RF signals, to produce a corrected position and orientation of the mobile device.
The fusion algorithm device 30 receives the location and orientation from both the IMDS 10 and the RF tracking system 20 and uses one or both the inputs to determine position and orientation.
Alternative embodiments of the fusion algorithm processor 30 are shown in
The system in which position and orientation calculations are made at the base 120, may also be modified into an alternative embodiment capable of transmitting the calculated position and orientation of tracked object 3 from the base 120 back to the tracked object 3, so the tracked object 3 may know of its position and orientation. This would allow it to have previous location and orientation to use in calculations when the RF signal is corrupted or lost. However, this embodiment would require an additional transmitter in the base 120 and a receiver in the tracked object 3 and add to the cost of producing the system.
While the foregoing has described what are considered to be the best mode and/or other examples, it is understood that various modifications may be made therein and that the subject matter disclosed herein may be implemented in various forms and examples, and that the teachings may be applied in numerous applications, only some of which have been described herein. It is intended by the following claims to claim any and all applications, modifications and variations that fall within the true scope of the present teachings.
This application is a continuation-in-part of U.S. application Ser. No. 15/685,493, filed Aug. 24, 2017, titled “Position Tracking System and Method Using Radio Signals and Inertial Sensing”, now U.S. Pat. No. 10,416,276, which is a continuation-in-part of U.S. application Ser. No. 14/600,025, filed Jan. 20, 2015, titled “Position Tracking System and Method Using Radio Signals and Inertial Sensing”, which is a continuation of U.S. application Ser. No. 13/293,639, filed Nov. 10, 2011, titled “Position Tracking System and Method Using Radio Signals and Inertial Sensing”, now U.S. Pat. No. 8,957,812, which claims the benefit of and priority to U.S. provisional application No. 61/413,026, filed on Nov. 12, 2010, titled “Position Tracking System and Method Using Radio Signals and Inertial Sensing,” the entireties of which applications are incorporated by reference herein.
Number | Name | Date | Kind |
---|---|---|---|
2408122 | Wirkler | Sep 1946 | A |
3824596 | Guion et al. | Jul 1974 | A |
3940700 | Fischer | Feb 1976 | A |
4328499 | Anderson et al. | May 1982 | A |
5010343 | Andersson | Apr 1991 | A |
5343212 | Rose et al. | Aug 1994 | A |
5426438 | Peavey et al. | Jun 1995 | A |
5510800 | McEwan | Apr 1996 | A |
5574468 | Rose | Nov 1996 | A |
5592180 | Yokev et al. | Jan 1997 | A |
5600330 | Blood | Feb 1997 | A |
5657026 | Culpepper et al. | Aug 1997 | A |
5923286 | Divakaruni | Jul 1999 | A |
5953683 | Hansen et al. | Sep 1999 | A |
6088653 | Sheikh et al. | Jul 2000 | A |
6101178 | Beal | Aug 2000 | A |
6167347 | Lin | Dec 2000 | A |
6255991 | Hedin | Jul 2001 | B1 |
6292750 | Lin | Sep 2001 | B1 |
6409687 | Foxlin | Jun 2002 | B1 |
6412748 | Girard | Jul 2002 | B1 |
6417802 | Diesel | Jul 2002 | B1 |
6496778 | Lin | Dec 2002 | B1 |
6512748 | Mizuki et al. | Jan 2003 | B1 |
6593885 | Wisherd et al. | Jul 2003 | B2 |
6630904 | Gustafson et al. | Oct 2003 | B2 |
6683568 | James et al. | Jan 2004 | B1 |
6697736 | Lin | Feb 2004 | B2 |
6720920 | Breed et al. | Apr 2004 | B2 |
6721657 | Ford et al. | Apr 2004 | B2 |
6744436 | Chirieleison, Jr. et al. | Jun 2004 | B1 |
6750816 | Kunysz | Jun 2004 | B1 |
6861982 | Forstrom et al. | Mar 2005 | B2 |
6867774 | Halmshaw et al. | Mar 2005 | B1 |
6989789 | Ferreol et al. | Jan 2006 | B2 |
7009561 | Menache et al. | Mar 2006 | B2 |
7143004 | Townsend et al. | Nov 2006 | B2 |
7168618 | Schwartz | Jan 2007 | B2 |
7190309 | Hill | Mar 2007 | B2 |
7193559 | Ford et al. | Mar 2007 | B2 |
7236091 | Kiang et al. | Jun 2007 | B2 |
7236092 | Joy | Jun 2007 | B1 |
7292189 | Off et al. | Nov 2007 | B2 |
7295925 | Breed et al. | Nov 2007 | B2 |
7315281 | Dejanovic et al. | Jan 2008 | B2 |
7336078 | Merewether et al. | Feb 2008 | B1 |
7409290 | Lin | Aug 2008 | B2 |
7443342 | Shirai et al. | Oct 2008 | B2 |
7499711 | Hoctor et al. | Mar 2009 | B2 |
7533569 | Sheynblat | May 2009 | B2 |
7538724 | Baillot | May 2009 | B1 |
7612715 | Macleod | Nov 2009 | B2 |
7646330 | Karr | Jan 2010 | B2 |
7868760 | Smith et al. | Jan 2011 | B2 |
7876268 | Jacobs | Jan 2011 | B2 |
7933730 | Li et al. | Apr 2011 | B2 |
8269624 | Chen et al. | Sep 2012 | B2 |
8269654 | Jones | Sep 2012 | B2 |
8406470 | Jones et al. | Mar 2013 | B2 |
8457655 | Zhang et al. | Jun 2013 | B2 |
8749433 | Hill | Jun 2014 | B2 |
8860611 | Anderson et al. | Oct 2014 | B1 |
8957812 | Hill et al. | Feb 2015 | B1 |
9063215 | Perthold et al. | Jun 2015 | B2 |
9092898 | Fraccaroli et al. | Jul 2015 | B1 |
9120621 | Curlander et al. | Sep 2015 | B1 |
9141194 | Keyes et al. | Sep 2015 | B1 |
9174746 | Bell et al. | Nov 2015 | B1 |
9482741 | Min et al. | Nov 2016 | B1 |
9497728 | Hill | Nov 2016 | B2 |
9519344 | Hill | Dec 2016 | B1 |
9544552 | Takahashi | Jan 2017 | B2 |
9782669 | Hill | Oct 2017 | B1 |
9872151 | Puzanov et al. | Jan 2018 | B1 |
9933509 | Hill et al. | Apr 2018 | B2 |
9961503 | Hill | May 2018 | B2 |
10001833 | Hill | Jun 2018 | B2 |
10163149 | Famularo et al. | Dec 2018 | B1 |
10180490 | Schneider et al. | Jan 2019 | B1 |
10257654 | Hill | Apr 2019 | B2 |
10416276 | Hill | Sep 2019 | B2 |
10444323 | Min et al. | Oct 2019 | B2 |
10455364 | Hill | Oct 2019 | B2 |
20020021277 | Kramer et al. | Feb 2002 | A1 |
20020140745 | Ellenby et al. | Oct 2002 | A1 |
20020177476 | Chou | Nov 2002 | A1 |
20030053492 | Matsunaga | Mar 2003 | A1 |
20030120425 | Stanley et al. | Jun 2003 | A1 |
20030176196 | Hall et al. | Sep 2003 | A1 |
20030195017 | Chen et al. | Oct 2003 | A1 |
20040095907 | Agee et al. | May 2004 | A1 |
20040107072 | Dietrich et al. | Jun 2004 | A1 |
20040176102 | Lawrence et al. | Sep 2004 | A1 |
20040203846 | Caronni et al. | Oct 2004 | A1 |
20050001712 | Yarbrough | Jan 2005 | A1 |
20050057647 | Nowak | Mar 2005 | A1 |
20050143916 | Kim et al. | Jun 2005 | A1 |
20050184907 | Hall | Aug 2005 | A1 |
20050275626 | Mueller et al. | Dec 2005 | A1 |
20060013070 | Holm et al. | Jan 2006 | A1 |
20060022800 | Krishna et al. | Feb 2006 | A1 |
20060061469 | Jaeger et al. | Mar 2006 | A1 |
20060066485 | Min | Mar 2006 | A1 |
20060101497 | Hirt et al. | May 2006 | A1 |
20060192709 | Schantz et al. | Aug 2006 | A1 |
20060279459 | Akiyama et al. | Dec 2006 | A1 |
20060290508 | Moutchkaev et al. | Dec 2006 | A1 |
20070060384 | Dohta | Mar 2007 | A1 |
20070138270 | Reblin | Jun 2007 | A1 |
20070205867 | Kennedy et al. | Sep 2007 | A1 |
20070210920 | Panotopoulos | Sep 2007 | A1 |
20070222560 | Posamentier | Sep 2007 | A1 |
20080007398 | DeRose et al. | Jan 2008 | A1 |
20080048913 | Macias et al. | Feb 2008 | A1 |
20080091350 | Smith | Apr 2008 | A1 |
20080143482 | Shoarinejad et al. | Jun 2008 | A1 |
20080150678 | Giobbi et al. | Jun 2008 | A1 |
20080154691 | Wellman et al. | Jun 2008 | A1 |
20080174485 | Carani et al. | Jul 2008 | A1 |
20080204322 | Oswald et al. | Aug 2008 | A1 |
20080266253 | Seeman et al. | Oct 2008 | A1 |
20080281618 | Mermet et al. | Nov 2008 | A1 |
20080316324 | Rofougaran et al. | Dec 2008 | A1 |
20090043504 | Bandyopadhyay et al. | Feb 2009 | A1 |
20090149202 | Hill et al. | Jun 2009 | A1 |
20090224040 | Kushida et al. | Sep 2009 | A1 |
20090243932 | Moshfeghi | Oct 2009 | A1 |
20090323586 | Hohl et al. | Dec 2009 | A1 |
20100090852 | Eitan et al. | Apr 2010 | A1 |
20100097208 | Rosing et al. | Apr 2010 | A1 |
20100103173 | Lee et al. | Apr 2010 | A1 |
20100103989 | Smith et al. | Apr 2010 | A1 |
20100123664 | Shin et al. | May 2010 | A1 |
20100159958 | Naguib et al. | Jun 2010 | A1 |
20110006774 | Baiden | Jan 2011 | A1 |
20110037573 | Choi | Feb 2011 | A1 |
20110187600 | Landt | Aug 2011 | A1 |
20110208481 | Slastion | Aug 2011 | A1 |
20110210843 | Kummetz | Sep 2011 | A1 |
20110241942 | Hill | Oct 2011 | A1 |
20110256882 | Markhovsky et al. | Oct 2011 | A1 |
20110264520 | Puhakka | Oct 2011 | A1 |
20120013509 | Wisherd et al. | Jan 2012 | A1 |
20120127088 | Pance et al. | May 2012 | A1 |
20120176227 | Nikitin | Jul 2012 | A1 |
20120184285 | Sampath et al. | Jul 2012 | A1 |
20120286933 | Hsiao | Nov 2012 | A1 |
20120319822 | Hansen | Dec 2012 | A1 |
20130018582 | Miller et al. | Jan 2013 | A1 |
20130021417 | Ota et al. | Jan 2013 | A1 |
20130029685 | Moshfeghi | Jan 2013 | A1 |
20130036043 | Faith | Feb 2013 | A1 |
20130113993 | Dagit, III | May 2013 | A1 |
20130281084 | Batada et al. | Oct 2013 | A1 |
20130314210 | Schoner et al. | Nov 2013 | A1 |
20140022058 | Striemer et al. | Jan 2014 | A1 |
20140253368 | Holder | Sep 2014 | A1 |
20140300516 | Min et al. | Oct 2014 | A1 |
20140361078 | Davidson | Dec 2014 | A1 |
20150009949 | Khoryaev et al. | Jan 2015 | A1 |
20150039458 | Reid | Feb 2015 | A1 |
20150091757 | Shaw et al. | Apr 2015 | A1 |
20150130664 | Hill et al. | May 2015 | A1 |
20150133162 | Meredith et al. | May 2015 | A1 |
20150134418 | Leow et al. | May 2015 | A1 |
20150169916 | Hill et al. | Jun 2015 | A1 |
20150221135 | Hill et al. | Aug 2015 | A1 |
20150323643 | Hill et al. | Nov 2015 | A1 |
20150362581 | Friedman et al. | Dec 2015 | A1 |
20150379366 | Nomura et al. | Dec 2015 | A1 |
20160035078 | Lin et al. | Feb 2016 | A1 |
20160142868 | Kulkarni et al. | May 2016 | A1 |
20160150196 | Horvath | May 2016 | A1 |
20160156409 | Chang | Jun 2016 | A1 |
20160178727 | Bottazzi | Jun 2016 | A1 |
20160238692 | Hill et al. | Aug 2016 | A1 |
20160256100 | Jacofsky et al. | Sep 2016 | A1 |
20160286508 | Khoryaev et al. | Sep 2016 | A1 |
20160366561 | Min et al. | Dec 2016 | A1 |
20160370453 | Boker et al. | Dec 2016 | A1 |
20160371574 | Nguyen et al. | Dec 2016 | A1 |
20170030997 | Hill et al. | Feb 2017 | A1 |
20170031432 | Hill | Feb 2017 | A1 |
20170123426 | Hill et al. | May 2017 | A1 |
20170234979 | Mathews et al. | Aug 2017 | A1 |
20170261592 | Min et al. | Sep 2017 | A1 |
20170280281 | Pandey et al. | Sep 2017 | A1 |
20170323174 | Joshi et al. | Nov 2017 | A1 |
20170350961 | Hill et al. | Dec 2017 | A1 |
20170372524 | Hill | Dec 2017 | A1 |
20180068266 | Kirmani et al. | Mar 2018 | A1 |
20180164103 | Hill | Jun 2018 | A1 |
20180197139 | Hill | Jul 2018 | A1 |
20180231649 | Min et al. | Aug 2018 | A1 |
20180242111 | Hill | Aug 2018 | A1 |
20190090744 | Mahfouz | Mar 2019 | A1 |
20190295290 | Schena et al. | Sep 2019 | A1 |
Number | Date | Country |
---|---|---|
2001006401 | Jan 2001 | WO |
2005010550 | Feb 2005 | WO |
Entry |
---|
Alban, Santago “Design and Performance of a Robust GPS/INS Attitude System for Automobile Applications”, Dissertation, Stanford University, Jun. 2004; 218 pages. |
Farrell and Barth, “The Global Positioning System & Interial Navigation”, 1999, McGraw-Hill; pp. 245-252. |
Farrell, et al. “Real-Time Differential Carver Phase GPS-Aided INS”, Jul. 2000, IEEE Transactions on Control Systems Technology, vol. 8, No. 4; 13 pages. |
Filho, et al. “Integrated GPS/INS Navigation System Based on a Gyroscope-Free IMU”, DINCON Brazilian Conference on Synamics, Control, and Their Applications, May 22-26, 2006; 6 pages. |
Gao, Jianchen “Development of a Precise GPS/INS/On-Board Vehicle Sensors Integrated Vehicular Positioning System”, Jun. 2007, UCGE Reports No. 20555; 245 pages. |
Gautier, Jennifer Denise “GPS/INS Generalized Evaluation Tool (GIGET) for the Design and Testing of Integrated Navigation Systems”, Dissertation, Stanford University, Jun. 2003; 160 pages. |
Goodall, Christopher L. , “Improving Usability of Low-Cost INS/GPS Navigation Systems using Intelligent Techniques”, Jan. 2009, UCGE Reports No. 20276; 234 pages. |
Grewal and Andrews “Global Positioning Systems, Inertial Navigation, and Integration” Section 8.6-8.6.3.1, 2001, John Weiley and Sons, pp. 252-256. |
Pourhomayoun, Mohammad and Mark Fowler “Improving WLAN-based Indoor Mobile Positioning Using Sparsity,” Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers, Nov. 4-7, 2012, pp. 1393-1396, Pacific Grove, California. |
Proakis, John G. and Masoud Salehi, “Communication Systems Engineering”, Second Edition, Prentice-Hall, Inc., Upper Saddle River, New Jersey, 2002; 815 pages. |
Schmidt and Phillips, “INS/GPS Integration Architectures”, NATO RTO Lecture Seriers, First Presented Oct. 20-21, 2003; 24 pages. |
Schumacher, Adrian “Integration of a GPS aided Strapdown Inertial Navigation System for Land Vehicles”, Master of Science Thesis, KTH Electrical Engineering, 2006; 67 pages. |
Sun, Debo “Ultra-Tight GPS/Reduced IMU for Land Vehicle Navigation”, Mar. 2010, UCGE Reports No. 20305; 254 pages. |
Sun, et al., “Analysis of the Kalman Filter With Different INS Error Models for GPS/INS Integration in Aerial Remote Sensing Applications”, Bejing, 2008, The International Archives of the Photogrammerty, Remote Sensing and Spatial Information Sciences vol. XXXVII, Part B5.; 8 pages. |
Vikas Numar N. “Integration of Inertial Navigation System and Global Positioning System Using Kalman Filtering”, M.Tech Dissertation, Indian Institute of Technology, Bombay, Mumbai, Jul. 2004; 69 pages. |
Welch, Greg and Gary Bishop “An Introduction to the Kalman Filter, TR95-041,” Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-3175, Updated: Monday, Jul. 24, 2006. |
Yang, Yong “Tightly Coupled MEMS INS/GPS Integration with INS Aided Receiver Tracking Loops”, Jun. 2008, UCGE Reports No. 20270; 205 pages. |
Wilde, Andreas, “Extended Tracking Range Delay-Locked Loop,” Proceedings IEEE International Conference on Communications, Jun. 1995, pp. 1051-1054. |
“ADXL202/ADXL210 Product Sheet”, Analog Devices, Inc., Analog.com, 1999. |
Morbella N50: 5-inch GPS Navigator User's Manual, Maka Technologies Group, May 2012. |
Bachmann, Eric Robert “Intertial and magnetic tracking of limb segment into orientation for inserting humans into synthetic enviomments,” Dissertation, Dec. 2000, Naval Postgraduate School, Montery, CA; http://www.nps.edu/library. |
Brown, Robert Grover and Patrick Y.C. Hwang, “Introduction to Random Signals and Applied Kalman Filtering,” Fourth Edition, 2012, John Wiley and Sons, Inc., Hoboken, NJ. |
Foxlin, Eric “Intertial Head-Tracker Sensor Fusion by a Complementary Separate-Bias Kalman Filter,” IEEE, 1996, Proceedings of VRAIS, pp. 185-195. |
Salhuana, Laura “Setting up the MMZ7660FC to do Orientation Detection,” 2009, Freescale Semiconductor, Inc. |
Luinge, H.J. “Inertial Sensing of Human Movement,” Thesis, 2002, Twente University, the Netherlands. |
Dictionary Definition for Peripheral Equipment. (2001). Hargrave's Communications Dictionary, Wiley. Hoboken, NJ: Wiley. Retrieved from Https://search.credorefernce.com/content/entry/hargravecomms/peripheral_equioment/0 (Year:2001). |
Huyghe, et al. “3D orientation tracking based on unscented Kalman filtering of accelerometer and magnetometer data,” Mar. 2009, IEEE Explore, Research Gate; 5 pages. |
Keir, et al, “Accelerometer-based Orientation Sensing for Head Tracking in AR & Robots,” 2007, UC Research Repository, Engineering: Conference Contributions, https://ir.canterbury.ac.nz/bitstream/handle/10092/1623/12606246_icst_2007%20-%20Head%20Tracking%20-%20FINAL.pdf?sequence=1&isAllowed=y. |
Keir, Matthew Stuart “Robust Dynamic Orientation Sensing Using Accelerometers: Model-based Methods for Head Tracking in AR,” Thesis, Sep. 24, 2008, University of Canterbury, New Zealand. |
Marins, et al. “An Extended Kalman Filter for Quaternion-Based Orientation Estimation Using MARG Sensors,” Proceedings of the 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems, Hawaii, Oct. 29-Nov. 3, 2001, pp. 2003-2011. |
Mizell, David “Using Gravity to Estimate Acceleromteter Orientation,” Proceedings of the Seventh IEEE International Symposium on Wearable Computers, 2003. |
Tan, Chin-Woo and Sungsu Park, “Design and Error Analysis of Accelerometer-Based Inertial Navigation Systems,” Jun. 2002, California PATH Program, Institute of Transportation Studies, University of California, Berkeley. |
Roetenberg, et al. “Inertial and magnetic sensing of human movement near ferromagnetic materials,” 2003, Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality. |
Restriction Requirement in U.S. Appl. No. 13/293,639 dated Jan. 28, 2014; 5 pages. |
Non-Final Office Action in U.S. Appl. No. 13/293,639 dated Jun. 18, 2014; 7 pages. |
Notice of Allowance in U.S. Appl. No. 13/293,639 dated Oct. 14, 2014; 5 pages. |
Non-Final Office Action in U.S. Appl. No. 14/600,025 dated Feb. 28, 2017; 21 pages. |
Notice of Allowance in U.S. Appl. No. 15/685,493 dated Jul. 3, 2019; 7 pages. |
Number | Date | Country | |
---|---|---|---|
20200011961 A1 | Jan 2020 | US |
Number | Date | Country | |
---|---|---|---|
61413026 | Nov 2010 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13293639 | Nov 2011 | US |
Child | 14600025 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15685493 | Aug 2017 | US |
Child | 16571622 | US | |
Parent | 14600025 | Jan 2015 | US |
Child | 15685493 | US |