Described herein are position detection (tracking) systems, and in particular ultrasonic position detection systems that utilize at least one stationary array-based ultrasonic receiver in combination with a portable ultrasonic transmitter to be tracked to provide a safe and robust position detection system.
This invention relates to a position tracking system. In an exemplary embodiment, the invention relates to an immersive simulation system which incorporates the position tracking system. More particularly, the invention relates to an immersive military simulation system which incorporates the position tracking system.
Most current ultrasonic tracking systems use “time-of-flight” from a series of stationary ultrasonic transmitters strategically placed around an area of interest and received by one or more portable devices in order to calculate the portable devices' positions. In a time of flight system, a portable device will receive an ultrasonic tone from multiple stationary transmitters and calculate the position of the portable device via triangulation of time-of-flight data from at least 2 ultrasonic transmitters.
Problems exist with ultrasonic time-of-flight tracking systems. For example, the ultrasonic transmitter side of the interface is usually incorporated into multiple stationary sensors. This requires that each stationary sensor be placed at strategic locations around the area of interest, and that these locations must be accurately measured and their location data inputted into tracking algorithms. This is a tedious task and not conducive to an immersive simulation system.
Another problem is that many time-of-flight portable entities are configured with microphones to detect the ultrasonic transmission. Microphones are susceptible to outside noise. They can overload or trigger false signals due to outside noise. Time-of-flight tracking systems are also susceptible to echoes from multiple ultrasonic signal paths. With multiple transmitters, determining an echo from a real transmission is difficult and sometimes impossible.
Many time-of-flight tracking systems use ultrasonic tones as a triggering mechanism to trigger the emittance of an ultrasonic tone from the stationary transmitters. Ultrasonic sound is subject to wind direction and speed, temperature, air density and air pressure across a sometimes large distance which could introduce a large amount of error.
The incorporation of tracking systems in immersive simulation systems is vital to creating a realistic virtual environment. If tracking systems were not incorporated into immersive simulation systems, for example the point-of-view for each portable device within the system would always be from the center of the area of interest in the system. If a portable device was moved off of center, the eye point offset of the image on the dome towards the orientation of the portable device would not match the portable device's simulated point of view.
Thus, it was the goal of the instantly described system to overcome the flaws noted above in “time of flight” ultrasonic tracking systems, while enabling a tracking system which could reasonably easily and effectively be integrated into a realistic virtual environment. The instantly disclosed tracking system was found to be able to overcome these problems with available “time of flight” tracking systems.
The instantly described system is an ultrasonic tracking system which utilizes a differential approach rather than a time of flight calculation to arrive at both the x-position and the y-position of the item being tracked. In another embodiment, the system also allows for tracking of z-position utilizing a time of flight calculation in combination with the calculated x-position and y-position. Finally, for example, this system may be incorporated into an immersive simulation system in order to track, for example, portable devices, such as simulated military devices in a simulated military environment. This system is described in more detail below, although the exemplary embodiments listed below are not intended to be limiting.
The instantly described system solves the problems of the previously used “time of flight” systems. For example, rather than requiring multiple stationary sensors which must be individually calibrated, the described system allows for performing of a one-time calibration routine at installation time. The calibration routine includes placing a portable device fitted with an ultrasonic emitter on the floor of the area of interest, directly under a sensor array installed in an immersive simulation system. To calibrate, the array would send a coded infrared burst to the portable device on the floor in which the portable device would respond with an ultrasonic tone. The information acquired from this exercise, is the distance to the floor in the Z axis as well as the X and Y offset readings at the center of the area of interest. To aid in finding the location directly under the present invention, a calibration laser is incorporated into the present invention to project a spot on the floor directly under the sensor array.
The instantly disclosed position tracking system uses a differential approach rather than time-of-flight triangulation. This allows, for example, placement of a single sensor array confined to a single point above the area of interest of an immersive simulation system. Portable devices, such as for example simulated military devices, include a transmitter which transmits an ultrasonic tone to the stationary sensor array. An ultrasonic tone can for example be a 40 KHz acoustic ultrasonic tone of a limited duration and a constant frequency. Each portable device's ultrasonic tone is captured by the sensors in the array and only using the difference in phase between the tone reaching each sensor to calculate a portable device's position.
The present invention may incorporate a resonant receiver which only detects a specific frequency of ultrasonic tone (for example 40 KHz). This creates a natural band pass filter, thus avoiding problems with more typical “time of flight” systems with overload or false signals due to extraneous noise.
The present invention allows situations in which only one portable device transmits a single ultrasonic tone at a time to one sensory array, thus avoiding problems present in “time of flight” systems due to interference making difficult the detection of an echo.
The present invention a signal produced from at least one emitter, for example a radio transmission or an infrared burst, as a triggering mechanism to reduce error due to wind direction and speed, temperature, air density and air pressure across a sometimes large distance. Also, the present invention's sensor array only measures phase differentials across the same cycle of a wave of an ultrasonic tone. This close proximity reduces the chance of atmospheric conditions affecting position detection.
In one exemplary embodiment, the system configures portable devices (for example hand-held simulated military equipment) with one ultrasonic transmitter and a stationary sensor array with at least three (3) ultrasonic sensors. The ultrasonic sensors are configured, for example, in a perpendicular “L” configuration (
The stationary sensor array may for example be placed above the center of an immersive simulation system (for example a dome), and no sensor array location measurements need to be taken or inputted into tracking algorithms. All required measurements can be automatically calculated during the simple calibration since the sensor array sensors are spaced at a known distance.
In an embodiment, a portable device fitted with an ultrasonic transmitter is polled via a signal, for example a numeric infrared signal, to emit an ultrasonic tone or tone. As the tone is detected in the first of the sensors (for example the Reference Sensor in the center of the “L”) in the sensor array, a processor starts a period counter. As the tone is detected in the next sensor in the array, the counter value is noted and the difference is stored, for example in the storage of a computer configured to store positioning data. Finally, as the tone is detected in the third sensor in the array, the counter value is noted and the difference stored again. The phase detection differentials and the order of sensors detecting the tone are used to calculate the X and Y position of the portable device. Multiple detections may occur for each tone and could be used to average out the measured phase differentials.
In an embodiment, the ultrasonic tone emitted from a portable device, is also used in a time-of-flight algorithm to calculate the Z axis position. When a portable device is polled to emit an ultrasonic tone via an infrared burst, the sensor array processor starts a counter and stops the counter when a number of samples per tone reaches a sensor in the array. The median counter value is used along with the X and Y offsets from center to calculate the height above the floor (Z-axis).
In an embodiment, the present invention requires that each portable device be assigned a unique identifier known as a Tracking ID. The sensor array processor will cause the emitter (for example an infrared emitter) to transmit a single code (burst), containing a command and a Tracking ID (based on a prioritized scheduler), to all portable devices registered in the system. If the command dictates to emit an ultrasonic tone, only the portable device with the matching Tracking ID will emit the tone.
In an embodiment, the code transmitted to all portable devices is implemented as an infrared burst originating from the sensor array.
In an embodiment, the present invention, as it is desired for the final application, implements an accelerometer/gyroscope/compass device in order to detect a portable device's orientation. This device provides the yaw, pitch and roll of the device (3 degrees of freedom [3DOF]) and the present invention provides the X, Y and Z axis offsets from center. Together, they provide 6DOF capabilities (6 degrees of freedom). The position offsets (X, Y and Z) are combined with the 3DOF data to produce an adjusted 3DOF used as input into an immersive simulation system's display functionality to generate a display image from the portable device's eye point offset.
Additional exemplary embodiments include:
In a first embodiment, a system for tracking the location of a portable device, comprising: —a portable device comprising an ultrasonic transmitter and a detector; —a stationary sensor array comprising at least three ultrasonic sensors in communication with a sensor array processor; and —at least one emitter; wherein the at least one emitter is configured to send a signal to the portable device; wherein the portable device is configured to emit an ultrasonic tone when the detector receives the infrared burst; wherein the at least three ultrasonic sensors are configured to receive the ultrasonic tone; and wherein the sensor array processor is configured to calculate differentials and the order in which the at least three ultrasonic sensors receive the ultrasonic tone to calculate the x-position and the y-position of the portable device.
In a second embodiment, the system according to the first embodiment, wherein the sensor array processor is further configured to start a counter when the sensor array emits the signal and stop the counter when a number of samples per tone reaches a sensor in the array to determine the z-position of the portable device.
In a third embodiment, the system according to the second embodiment, wherein the portable device further comprises an accelerometer/gyroscope/compass device.
In a fourth embodiment, the system according to the first embodiment, wherein the stationary sensor comprises three ultrasonic sensors, comprising an x-axis sensor, a y-axis sensor, and a reference sensor.
In a fifth embodiment, the system according to the first embodiment, wherein the at least one emitter is located on the stationary sensor array.
In a sixth embodiment, an immersive simulation environment comprising the system according to the first embodiment.
In a seventh embodiment, the immersive simulation environment according to the sixth embodiment, wherein the immersive simulation environment is in the shape of a dome.
In an eighth embodiment, the immersive simulation environment according to the seventh embodiment, wherein the stationary sensor array is located at the top center of the dome.
In a ninth embodiment, the immersive simulation environment according to the sixth embodiment, wherein the immersive simulation environment is a simulated military environment.
In a tenth embodiment, the immersive simulation environment according to the ninth embodiment, wherein the portable device is a simulated military device.
In an eleventh embodiment, an immersive simulation system comprising the system according to the first embodiment, a dome, at least two rear-mounted image projectors, and at least two projector image generators, at least two SMD image generators, wherein the portable devices receive images from the SMD image generators.
In a twelfth embodiment, a method for tracking the position of a portable device comprising an ultrasonic transmitter and a detector in an immersive simulation system comprising a stationary sensor array comprising at least three ultrasonic sensors in communication with a sensor array processor, and at least one emitter; the process comprising: —sending a signal from the emitter to the portable device; —emitting an ultrasonic tone from the portable when the detector receives the signal; —receiving at the at least three ultrasonic sensors the ultrasonic tone; and —calculating in the sensor array processor phase differentials and the order in which the at least three ultrasonic sensors receive the ultrasonic tone to determine the x-position and the y-position of the portable device.
In a thirteenth embodiment, the method according to the twelfth embodiment, further comprising: starting a counter at the sensor array processor when the sensor array emits the signal and stopping the counter when a number of samples per tone reaches a sensor in the array to determine the z-position of the portable device.
In a fourteenth embodiment, the method according to the twelfth embodiment, wherein the immersive simulation system is in a dome, wherein the stationary sensor array is mounted at the top center of the dome, and the portable device is located inside of the dome.
In a fifteenth embodiment, the method according to the fourteenth embodiment, wherein the at least one emitter is on the stationary sensor array.
In a sixteenth embodiment, the method according to the fifteenth embodiment, wherein the stationary sensor array comprises three sensors, an x-axis sensor, a y-axis sensor, and a reference sensor.
In a seventeenth embodiment, the method according to the sixteenth embodiment, wherein the processor is programmed to record a multitude of timer values when the ultrasonic tone is sensed for each of the three ultrasonic sensors; and wherein the x-position and y-position calculation comprises: subtracting the x axis sensor timer value from the reference sensor timer value to create an x axis differential; subtracting the y axis sensor timer value from the reference sensor timer value to create a y axis differential; and applying a configurable scaling factor to the x-axis differential and the y-axis differential to determine x-axis and y-axis offsets for the portable device.
In further embodiments, the emitter is either an infrared emitter or a radio transmitter and the detector is either an infrared sensor or a radio detector.
In additional embodiments, the emitter is an infrared emitter and the detector is an infrared sensor.
Other features of the invention, as well as the invention itself, will become more readily apparent from the following detailed description when taken together with the accompanying drawings, in which:
For both the X and the Y axis calculations, the phase differentials for example are phase angle calculations. In this case, the phase angle differential is calculated and used to determine the angle of arrival of the signal, thereby allowing for determination of X and Y positions. The phase angle is the change (horizontal shift) between the samplings of the X or Y axis sensors and the reference sensor or the phase angle differential.
The instant system is described in further detail with respect to the enclosed Figures. The following detailed description of the Figures enclosed herewith further illustrate the invention but should not be construed as in any way limiting its scope.
In
Described herein is an immersive simulation system which contains sensor array that is mounted, for example, at the top of a dome over a center of the area of interest (an area of interest is the cone-shaped field around the floor of the immersive simulation system) and one or more ultrasonic transmitters and infrared receivers (see
Each portable device (for example SMD) configured in an immersive simulation system (for example dome) is assigned a unique identifier (Tracking ID). A processor configured with the present invention will schedule each Tracking ID to be sampled in a priority-based scheduling algorithm. The processor configured with the present invention will create a message to contain the Tracking ID of the SMD to be sampled and a “Send Ultrasonic Tone” command. The present invention will transmit this message to all SMDs in the immersive simulation system (dome) as an 8-bit infrared code. At the same time, the sensor measurement timers in the present invention processor are reset to 0 and set to run. Upon receiving the infrared command, each SMD will compare the Tracking ID from the infrared command with their unique identifier. If they match, only that SMD will emit an ultrasonic tone.
The processor configured with the described system is programmed to record a multitude of timer values when the ultrasonic tone is sensed for each of the 3 ultrasonic sensors. The processor measurement timers are sampling at a rate of, for example, 80 MHz (or every 12.5 nsec). The X axis sensor (100) timer value is subtracted from the Reference sensor (101) timer value to create the X axis phase differential. The Y axis sensor (102) timer value is subtracted from the Reference sensor (101) timer value to create the Y axis phase differential. The timer value associated with the Reference sensor will be used for the Z axis calculation.
A configurable scaling factor is applied to X and Y axis differentials to scale the differential values to a centimeter (1 differential unit=1 centimeter). These X and Y axis offsets are then forwarded to the specific SMD processor for incorporation into the SMD's display eye-point view.
The Z axis position can be calculated as a time-of-flight value from the SMD to the sensor array. Initially, the Z time-of-flight value is subtracted from the number of timer units from the sensor to the floor of the dome (the floor distance is determined during a calibration phase). This calculation is the number of timer units from the floor of the dome to the SMD. A configurable scaling factor is applied to the Z axis offset to scale the offset from timer units to centimeters. The Z axis offset is then forwarded to the SMD for incorporation into the SMD's display eye-point view.
The Projector IGs (704) generate the scenery of a simulated topical location for displaying on the dome (700). The SMD IGs (705) generate an immersive simulation image of the dome from the perspective of the SMD. The SMD IGs create an eye-point image of the dome image based on the position and orientation of the SMD. The present invention adjusts the SMD eye-point image, at any location within the area of interest in the immersive simulation system, to match the dome image.
After the present invention has completed calculating the position offset (in the X, Y and Z axes) for a particular SMD, it will send the tracking data to the SMDs. The specific SMD processors will use the current display vector (using the yaw and pitch orientation of the SMD), and the new tracking offset to calculate new coordinates where the offset display vector intersects with the dome.
The Controller Systems (706) request the orientation data (yaw, pitch and roll), the tracking data (X, Y and Z axis offsets), and the newly calculated adjusted orientation (offset yaw, pitch and roll) from each SMD and forwards this information onto the SMD IG responsible for a particular SMD's display. The responsible SMD IG uses the adjusted orientation data to create an image of the dome from the perspective of the SMD's eye-point and transmits this image to the SMD's display via HDMI (707).
This process occurs multiple times a second for all SMDs registered in the immersive simulation system.
Although more specifically described above are immersive simulation systems, the described position tracking systems potentially have application outside of the simulation genre. Multiple sensor arrays can be configured to increase the size of the area of interest. Further, although a simulated military environment is discussed above, it would be understood that the described position tracking system could be used in differing simulation environments. Although the SMDs in the immersive simulation system may be tethered, wireless portable devices can be developed, drawing minimal power, to allow for a more free range of movement.
While the exemplary embodiments described above include specifically a dome, it would be understood that the system could potentially be adapted to any three dimensional immersive environment.
“Simulated Military Devices” as used throughout would be any portable device used in a simulated military environment, including but not limited to portable devices such as binoculars for observing distant locations, or other simulated devices which normally would be used by a soldier in a typical military environment.
“Portable devices” as used throughout would by any device which is moveable and for which it is desirable to track the position. While described in more detail above are simulated military devices, it is understood that the instantly described system could be used to track any portable device fitted with an ultrasonic transmitter.
“Immersive simulation system” is any system which allows for three dimensional immersion in a simulated environment. While immersive military simulation environments are described in more detail above, it is understood that the system may be used in other immersive systems. Further, while immersive simulation systems described in more detail above are in the shape of a dome, it is understood that the instantly described system could be configured for use in other three dimensional geometries.
“Ultrasonic transmitter” is a transmitter which is capable of emitting an ultrasonic tone. An ultrasonic tone is a tone which has a frequency above the human ear's adubility limit of 20,000 hertz, for example 40 kHz.
All references, including publications, patent applications, and patents, cited herein are hereby incorporated by reference to the same extent as if each reference were individually and specifically indicated to be incorporated by reference and were set forth in its entirety herein.
The use of the terms “a” and “an” and “the” and similar referents in the context of describing the invention (especially in the context of the following claims) are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. Recitation of ranges of values herein are merely intended to serve as a shorthand method of referring individually to each separate value falling within the range, unless otherwise indicated herein, and each separate value is incorporated into the specification as if it were individually recited herein. All methods described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The use of any and all examples, or exemplary language (e.g., “such as”) provided herein, is intended merely to better illuminate the invention and does not pose a limitation on the scope of the invention unless otherwise claimed. No language in the specification should be construed as indicating any non-claimed element as essential to the practice of the invention.
Preferred embodiments of this invention are described herein, including the best mode known to the inventors for carrying out the invention. It should be understood that the illustrated embodiments are exemplary only, and should not be taken as limiting the scope of the invention.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2017/028863 | 4/21/2017 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62326363 | Apr 2016 | US |