Accurately tracking the three-dimensional path of a high-speed radio controlled unmanned aircraft (i.e. drones) or other moving objects along a course is a complex task. As such radio controlled unmanned aircraft can move at high speed and make rapid changes in direction while traveling along a course, providing accurate path information in real time can be difficult. This task is complicated in applications, such as for racing drones, where it is important to keep the weight of the object down, so that the amount of tracking elements on the object to a minimum.
The following presents a system and techniques for automatically determining the three-dimensional path of an object. The primary examples discussed are high-speed radio controlled unmanned aircraft (i.e. drones), but the techniques can be applied more generally. The three-dimensional path is determined by a combination of signals. A first radio system monitors a communication signals transmitted by the object as it travels along the course. A second radio system transmits control signals to the object, which sends back an indication of the strength of the received signal. These two radio signals are combined with altitude data from sensors on the object that is transmitted by the object to determine its path.
For the drone example, the first radio system can be from a series of gates that the drone passes through as it travels along a course. The drone transmits a video signal and the first radio system monitors the received signal strength intensity of the video signal from the drone as it passes through the gate. The second radios system can use a set of transceivers that cover a region that includes the course and are used to transmit control signals to the drone. The drone can record the received signal strength intensity of the control signals and transmit these transceivers. The two sets can then be combined with data from an altitude sensor on the drone, such as an infrared or ping sensor or barometer, to determine the drone's three-dimensional path as it travels through the course.
The course can also include an end gate that includes a mesh net or other capture structure for when a drone completes a course. The end gate has an associated video or other control signal monitoring system and, based on the intensity of the received signal, the tracking system determines that a drone has been captured by the end gate structure and automatically transmits a disable signal for the drone, causing the drone to shut down and cease flying.
Although the following description is primarily given the context of drones moving along a three-dimensional path through a course, the concepts presented can be applied more generally. For example, the systems and techniques can be applied to non-drone aircraft or other objects that serve as a mobile source of the described signals as it moves along a three-dimensional path.
Considering the example of a drone tracking system, more specifically the example of racing drones, further, it useful to be able to track a drone's position during a race. Data from a drone tracking system can be useful for multiple applications such as displaying racer positions, lap-counting, crashed drones, drone out of bounds, safety precautions and much more. Data collectors can be used at various placements within a course to collect data from the drones, with the collected data stored, used live, or both, as an event proceeds. The tracking system can start when a race begins. Drones would fly throughout a course for a given amount of time, during which the pilots and observers can be aware of every drone's position, and placement in regard to the competitive standings, as well as a drone's physical location as it moves along a path on the course.
Embodiments for the tracking system can use multiple trackers, to be mounted on or near a timing gate. Multiple timing gates can be placed around the course to monitor checkpoints passed in a path along a course. Embodiments of the system can use a communication signal, such as video signal, specific to a drone (such as of a specific frequency) to identify a drone. Based on its frequency, the system can detect when a specific drone passes through a timing gate. Timing measurements can be recorded at each gate, similar to how a lap counter works. The timing gate data can be used in a number of ways. For example, the timing data can be used to determine the placement of each pilot (1st, 2nd, 3rd etc.) to show pilots and viewers who is in what place during a live race. Additionally, the path of the drones can be shown along a map or representation of a course to give viewers for a live feed of position within the course.
The drone also includes video camera 231 and altitude sensor 233 that supply data to the controller 211. An FM or other type video transmitter 225 transmits data from the video camera 231 to a video monitor receiver vRx 221 (external to the drone, such as on the ground) that monitors the video signals and passes on the video data to the pilot. Data can also be sent back to the control signal transceiver cTx 223 by the transmitter 227. Although the transmitter 227 and wireless receiver 215 are shown as separate elements in
Each drone can transmit a video data signal at a corresponding frequency, which a receiver monitors to determine the received intensity of these signals. The receiver can be designed in such a way that it can account for multiple transmit frequencies simultaneously. Such a receiver will be placed on each timing gate in order to track the overall positions of the active drones.
Although the start and finish of the course shown
Each gate (or, more generally, pylon or other communication signal monitor) in a course has a tracking or timing unit paired with it. Timing units can detect each of the different video transmitter frequencies. For these purposes, it is not needed to decode the signal, only to detect when and at what power level a drone passes through a gate and its timing unit. The six channels inside a unit can be the same in hardware, where a UART (universal asynchronous receiver/transmitter) programmable synthesizer acting as a local oscillator to tune each channel according to hardware, dropping the signal from the RF range down into the intermediate frequency range. Although
As the drones fly through the course, they are detected via the timing units, the RF signal from the video transmitter is received, downconverter to an intermediate frequency, filtered, and passed through an RF Power Detector where the RF value is converted to a DC value. In one embodiment, the power detector has a dynamic range from −60 dBm to +5 dBm which translates to a DC scale of 2.2 VDC to 0.4 VDC.
At left,
At step 507, the down converted and filtered signal for each channel then goes to the corresponding power detector 445 and ADC at 447. At right,
As a drone or other object acting as a signal source moves along a path, distance computations based on the communication signals and control signals can be used to establish the two-dimensional location of the object. To more accurately determine the three dimensional path, an altitude sensor can be used to provide altitude data. For the drone example, this is illustrated by the altitude sensor 223 in
Embodiments for the altitude sensor can include an infra-red (IR) sensor. IR sensors operate like a basic radar. There are two core components the, IR transmitter LED and the IR receiver (photo-sensor). The transmitter LED sends out IR light and the photo sensor receives the light reflected. The amount of light and the time it takes for this light to return determines the distance away an object is from the ground. When collecting data, the IR sensor can operate in a continuous mode, with pulses sent at regular intervals.
Other embodiments for the altitude sensor can include a ping sensor. Similar to the IR sensor, the ping sensor consists of a transmitted and received pulse, but now using sound waves. A chirp is sent, an echo received and the delay reflects the distance to the ground. As with the IR sensor, a ping sensor works best when the transmitter and receiver of the signal are at a relatively narrow angle relative to the reflecting surface and there is little interference with the signal.
Additional embodiments for an altitude sensor can use a barometer, such as a digital pressure sensor. Barometers are used to measure barometric pressure. Knowing that pressure changes with altitude, this measurement can be translated into altitude. By monitoring the pressure, the sensor can plot altitude versus time, data which be combined with two-dimensional grid this data to more easily plot the path in three-dimensional space.
As different altitude sensors have different relative advantages and disadvantages, the choice of sensor can be selected based on the type of object and the type of course through which a drone or other object moves. In many embodiments, it can be useful to use more than one of these or other sensors for improved accuracy across different conditions. The altitude can be transmitted out periodically to the base station to be combined with the other location data. The system can use a separate set of receivers for the altitude data, of use others of the systems receivers, such as the control signal transceivers cTx. The attitude data can be transmitter periodically, along a time stamp, for use with the other data, where the data can either be raw data from the altitude sensor or be processed to some degree before transmitting.
To illustrate these different components used to determine a path,
At a time t, the drone 601 is between gate G1611 and gate G2612 and at respective distances dv1 and dv2 from corresponding communication monitor receiver vRx1621 and vRx2622. As the drone 601 moves along its path through these gates, the timing units from these gates send the distance information to the base control machine 690. The drone 601 records the received signal strength intensity of the control signals from the control transceivers cTx1651 and cTx2652 and transmits to the control transceivers (either the same or different one from which the control signal is received), and then transferred on to the base control machine 690. In some embodiments, the strength of this return signal can also be used in the path determination. The drone 601 also determines the altitude data corresponding to the height h and transmits this to the base control machine 690.
At a time t′, the drone 601′ is between gate G2612 and gate G3613 and at respective distances d′v2 and d′v3 from corresponding communication monitor receiver vRx2622 and vRx3623. As the drone 601′ moves along its path through these gates the timing units from these gates send the distance information to the base control machine 690. The drone 601′ records the received signal strength intensity of the control signals from the control transceivers cTx2652 and cTx3653 and transmits to the control transceivers (either the same or different one from which the control signal is received), and then transferred on to the base control machine 690. In some embodiments, the strength of this return signal can also be used in the path determination. The drone 601′ also determines the altitude data corresponding to the height h′ and transmits this to the base control machine 690.
As the drone travels along its path, the distance from these different sources can be time stamped so that the base control machine 690 can combine the data from the different sources. The distance data from the communication monitor receivers (vRx) and control transceivers (cTx), combined with the altitude data, at the different times is used by processing circuits of the base control machine to establish the path. The processing circuitry of the base control machine can implement the determination of the path through software, hardware, firmware, or some combination of these, depending upon the embodiment. An embodiment for combining these signal is discussed below with respect to
There are several equations that incorporate sent/received signals, frequency, power, distance, and other factors that can be used by the system to calculate the distance a drone is from a gate. For example, a variation of the free space path loss equation can be modelled according to this system. Taking the drone as the transmitter and the antenna of the drone tracking unit as the receiver, a basic model for the distance calculation is as follows in equation (1):
Path LossdB=PRx−PTx=20 log(d)+20 log(f)+20 log(4π/c)−GTx−GRx, (1)
where:
For example, say a drone passes through the gate with peak power observed at −10 dBm, transmitting at +25 dBm. The gain of the drones transmitting antenna is 2 dBi at best, while the receiving antenna is direction with a gain of 14 dBi. Then:
Path LossdB=PRx−PTx=20 log(d)+20 log(f)+20 log(4π/c)−GTx−GRx,
or, putting in values,
−(−10 dBm−25 dBm)=20 log(d)+20 log(1995 MHz)+20 log(4π/c)−2 dBi−14 dBi.
This gives 12.56 dB=20 log(d), or d=4.24 meters. Consequently, in this example the drone flew within 4.24 meters of the antenna/gate. In an embodiment where gates are typically 3 meters×3 meters, adding a meter or two in for the antenna mounted near the gate and that value places the drone right in the gate.
Another method of distance calculation is the Friis Transmission Equation:
or
P
Rx
=P
Tx
−G
Tx
−G
Rx+20 log(λ/4πd).
Putting in the same values as above into equation 2 gives: −19 dB=20 log(0.0119d), or d=9.42 meters.
Both methods yield similar results, an average between the two yields a rounded result. Another approach could rely on comparing both results as a cross check. Of course, as this value tells how far the drone is from the antenna, it could be in front of or behind the gate. Incorporating additional data from the antennae of the control system will provide a finer resolution to a drone's location.
The region through which the course runs is covered by a system of control transceivers to transmit control signals to a drone as it travels on the course, as illustrated by the control transceivers cTx1-4151-154 in
The RSSI onboard computation by the drone is an interpretation of the power received. Typically, this value is the receiver's dynamic range, stretching from its sensitivity to maximum power input. Instead of looking at the raw values (e.g. −31.4 dBm) they can be integers from about −120 to 10 with a granularity of 1. In other words −120 dBm to 10 dBm with increments of 1 dBm.
Many commercial off the shelf receivers use basic RSSI equations like equation (3) below to determine distance from RSSI, which use similar parameters as the previous equations (1) and (2). In an embodiment of drone racing course, four control transceivers towers can be placed near the edges of the course, as illustrated by cTx1-4151-154 in
A drone racing course can range in size, but an example may span a volume that can be several hundred meters in each direction. In this example, the transmit power PTx is set at 30 dBm, typically resulting in an RSSI value is in a low range from −70 to −40. For this example, an RSSI of −60 is used. Fade margin Fm and path loss exponent are factors that dependent on the atmosphere. For example, rain and snow increase fade margin n as the signal is attenuated, while the path loss exponent sits around 2 in earth's atmosphere. These values will be around Fm=14 dB and n=2 given that DRL courses are indoors.
where:
d=distance (meters);
f=frequency (MHz);
n=path loss exponent, ˜2 for earth's atmosphere;
Fm=fade margin, an attenuation dependent on atmosphere and weather, ˜14 for normal day;
PTx=power transmitted (dBm); and
RSSI=power received (RSSI value in dBm).
Putting in some values gives:
or d=167.4 meters. The distance calculated from RSSI came out to be 167 meters, which may seem large relative to the gate distanced computed above with respect to equations (1) and (2), but a course can be quite large with control towers holding the control signal transceivers cTx on the outer edges, while the drones pass through the gates in close proximity to the communication signal monitors vRx.
When mapping locations there are several different methods to find an object's location based on known information. Triangulation and Trilateration are two methods to solve this problem. Triangulation utilizes angles in between observed locations of an object.
Applying basic trigonometry to
where:
Triangulation can pose challenges as the angles can change rapidly through a large range of values if the object is moving rapidly and passes close to one of the control signal transceivers or communication signal monitors, such as when a drone passes through a gate in in the drone racing course example. Additionally, the reference plane to determine the distance L is defined by the location of the two components (control signal transceivers or communication signal monitors) used to calculate the location. An advantage of triangulation is that it only requires two components to calculate the value of L, making it useful in regions of a course that have limited components for reporting distance measurements.
Triangulation uses measurements from 2 points for determining a location, while trilateration uses three. Trilateration utilizes distances which can be easily broken into a grid map for calculation. By making a course map into a grid, the location of the tracking components can be placed and recorded on the grid. These can be used as anchor points, from three different system components can be used to output a distance value to calculate an object's 2D position on the course.
r
1
=x
2
+x
2
+z
2;
r
2=(x−d)2+x2+z2; and
r
3=(x−i)2+(x−j)2+z2. (5)
As shown in
The equations of system (5) can also be solved for z and in some embodiments this data can be used in addition to the altitude sensor data from the object to determine a height value.
Consequently, the position of the object 801 in the coordinate system is (9.04 m, 4.84 m). Trilateration can be more accurate than the triangulation method, but needs three distance values reported from the system in order operate.
Considering the data acquisition for the example a drone racing course,
In this example, a set of four control signal transceiver cTx1-cTx4951-954 are located on the outskirts of the course and cover the region. Each of the gates G1-G5911-915 has an associated communication signal monitor vRx1-vRx 921-925, respectively. The course is split into six zones 1-6, as demarcated by the broken lines. A tracking log gives the correspondence between the zones and which of the control signal transceivers and communication signal monitors provide coverage in the zone:
Looking at step 1010 in more detail, the control transceivers (cTx) provide the area containing the course with control signals for the object at step 1011. In the drone example, the control signals transmitted by the radio signals from the transceivers include the signals by which the pilot controls the speed and direction when flying the aircraft. At step 1013, the object receives the control signals and determines an indication of their received signal strength intensity (RSSI), which the object then transmit back to the control transceivers (cTx) at step 1015. The RS SI values can be given time stamps for use when combining with the other data sets for establishing the object's path. At step 1017 the control transceivers (cTx) receive the RSSI values, where these can be received at the same transceiver that transmitted the measured signal or a different transceiver. In some embodiments, the strength of the received signal from the object can also be used for determining the object's path. The RSSI values for the control transceivers is provided to the base control at step 1019.
Looking now at step 1020 in more detail, at step 1021 the object is transmitting communication signals as it travels the course. For the drone example, these can be the video signals transmitted from the drone for pilots to use. The communication monitor receivers (vRx) determine a measure of the received signal strength intensity (RSSI) at step 1023, with the values being provided to the base control at step 1025. More detail on step 1025 is described above with respect to
For step 1030, at step 1031 the altitude sensor on the object measures the altitude as the object moves through the course. As discussed above, the altitude sensor can be an IR sensor, ping sensor, barometer, or other suitable sensor, where several different sensors can be used as these often have different relative advantages and disadvantages. At step 1033 the altitude data is provided to the base machine, where again this can be time stamped. The altitude data can be sent using the control transceivers (cTx) or other suitable receivers.
At step 1041, the data from steps 1010 and 1020 can be combined to determine a two dimensional projection of the object's path onto the x-y plane. The processing circuitry of the base control can combine these data using triangulation, trilateration, or a combination of these, such as described above with the tracking log for
Although presented mainly in the context of drones travelling through a closed or relatively compact course, the same or similar techniques can be applied to determining a three dimensional path of other objects. In addition to drones, these objects can include non-drone aircraft or even objects travelling on the ground in a non-flat region. For drones or other objects, the course need not be defined in terms of a set of gates that need to be passed through, but also less well defined course regions in which video or other communication signals from the object can be monitored for the intensity and which is covered by command transceivers in communication with the object.
Referring back to
Once a drone is in the capture structure, the drone remains “ON” until powered off. Relying on a technician or other person to manually turn off the drones can pose risks. Any time a drone is powered on it can still receive commands from pilots. Although pilots may be instructed, and not intending, to send commands, they can still have full control of the drone. For example, if someone accidentally knocked over a controller this could activate throttle and cause harm to someone handling the drone. Automatically powering down drones once they finish will maintain human safety.
The drones can also acquire damage from crashing into the end gate structure. When multiple drones crash into the end gate structure more or less simulataneously, not every pilot can be perfect when it comes to manually disarming the drone. This results in the propellers of the drones chewing each other up as well as physically damaging the end gate structure. Adding an automated power down sequence will also reduce physical damage to the drones and the end gate.
In the case of a drone passing through a gate along the course, the received signal strength indication seen by the gate's associated communication monitor receiver's antenna will increase as the drone approaches the gate, peak as it passes through the gate, then drop off as the drone moves away, as discussed above with respect to
As a drone crashes into the end gate it will remain (for the most part) stationary. If a drone sits in the same location near the end gate's communication monitor receiver vRx 1131 for some amount of time, the communication monitor receiver vRx 1131 will see a more or less consistant communication signal power transmitted from the drone above the threshold level of P0, as represented in the time versus power curve at lower left in
At step 1307 the end gate tracking unit 1121 and base control 1123 monitor the communication signals received signal strength intensity and determine whether it exceeds a trigger reference value and, if not, continues monitoring. For the embodiment of the end gate tracking unit in the embodiment represented in the left portion of
More generally, the automatic disabling techniques can be extended to more generally objects moving through a more general path. With or without an end gate having a capture structure, there may be circumstances when it is needed or convenient to disable an object when it reaches a certain point or region. By monitoring the received strength of video or other communication signals at the point or region similarly to the process described with respect to
One embodiment includes a system for controlling a moving object, the system including a communication signal receiver, a control signal transceiver, and one or more processing circuits connected to the communication signal receiver and the control signal transceiver. The communication signal receiver is configured to monitor a received signal strength intensity of a communication signal transmitted by the object. The control signal transceiver is configured to transmit control signals to the object while travelling through the course. The processing circuits are connected to the communication signal receiver and the control signal transceiver, the processing circuits configured to receive an indication of the received signal strength intensity of the communication signal and, in response to the indication of the received signal strength intensity of the communication signal exceeding a reference value for more than a specified time interval, transmitting a disable signal to the object.
Embodiments also include a system of one or more radio controlled unmanned aircraft, a communication signal receiver, a control signal transceiver and one or more processing circuits connected to the communication signal receiver and the control signal transceiver. The radio controlled unmanned aircraft are configured to receive control signals and each configured to transmit a corresponding communication signal. The communication signal receiver is configured to monitor received signal strength intensity of the communication signals transmitted by the radio controlled unmanned aircraft while travelling through a course. The control signal transceiver is configured to transmit control signals to the radio controlled unmanned aircraft while travelling through the course. The processing circuits are configured to receive an indication of the received signal strength intensity of the communication signals and in response to the indication of the received signal strength intensity of one of the communication signals exceeding a reference value for more than a specified time interval, transmitting a disable signal to the corresponding radio controlled unmanned aircraft.
One set of embodiments are for a method that includes receiving an indication of strength of one or more communication signals transmitted by a corresponding one or more moving objects. The method also includes determining whether the received indication of strength of any of the communication signals transmitted by the moving objects exceeds a reference value for more than a specified time interval; and in response to the received indication of strength of one of the communication signal exceeding the reference value for more than the specified time interval, transmitting a disable signal to the corresponding moving object.
For purposes of this document, it should be noted that the dimensions of the various features depicted in the figures may not necessarily be drawn to scale.
For purposes of this document, reference in the specification to “an embodiment,” “one embodiment,” “some embodiments,” or “another embodiment” may be used to describe different embodiments or the same embodiment.
For purposes of this document, a connection may be a direct connection or an indirect connection (e.g., via one or more other parts). In some cases, when an element is referred to as being connected or coupled to another element, the element may be directly connected to the other element or indirectly connected to the other element via intervening elements. When an element is referred to as being directly connected to another element, then there are no intervening elements between the element and the other element. Two devices are “in communication” if they are directly or indirectly connected so that they can communicate electronic signals between them.
For purposes of this document, the term “based on” may be read as “based at least in part on.”
For purposes of this document, without additional context, use of numerical terms such as a “first” object, a “second” object, and a “third” object may not imply an ordering of objects, but may instead be used for identification purposes to identify different objects.
For purposes of this document, the term “set” of objects may refer to a “set” of one or more of the objects.
The foregoing detailed description has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. The described embodiments were chosen in order to best explain the principles of the proposed technology and its practical application, to thereby enable others skilled in the art to best utilize it in various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope be defined by the claims appended hereto.