Robotic swarm localization using ranging radios

Information

  • Patent Grant
  • 11188100
  • Patent Number
    11,188,100
  • Date Filed
    Saturday, September 9, 2017
    7 years ago
  • Date Issued
    Tuesday, November 30, 2021
    2 years ago
Abstract
A system for localizing a swarm of robotic platforms utilizing ranging sensors. The swarm is localized by purposely leaving some of the platforms of the swarm stationary, providing localization to the moving ones. The platforms in the swarm can alternate between a stationary and moving state.
Description
FEDERALLY SPONSORED RESEARCH

Not Applicable


SEQUENCE LISTING OR PROGRAM

Not Applicable


TECHNICAL FIELD OF THE INVENTION

The present invention relates generally to the autonomous control of small robotic platforms. More specifically, the present invention relates to robotic localization.


BACKGROUND OF THE INVENTION

There are several challenges related to the autonomous control of small robotic platforms. The small payload and usually low cost restrict them from carrying accurate, inertial localization systems. Therefore, in GPS denied areas, automatic tasks—like mapping and searching—become a challenge.


Several technologies have been developed to overcome these challenges. Visual odometry and LADAR odometry are commonly used to complement the higher drift of the inertial components, aiding in localization. The problem with these techniques is that they are brittle in some environments; in particular, tunnels, caves, and man-made structures pose some challenges. Poor lighting conditions, low quality cameras, and dusty or smoky conditions further exacerbate the localization errors. For example, state-of-the-art quadrotors equipped with quality cameras, flying in a sufficiently-lit tunnel, while using visual odometry, may achieve 5% to 10% error as a function of distance travelled. This error becomes I 0% to 25% of distance travelled if the quad-rotor must carry its own illumination. If the tunnel is dusty or smoky, the error in localization is driven by the inertial components.


The inertial components of the navigation unit are composed of accelerometers and gyroscopes. The position is computed by double integrating the acceleration. Therefore, small bias errors in acceleration become exponential errors in position. If the visual or LADAR odometry is blocked by smoke or dust, and no longer seeing features, the position error will grow exponentially. This is due to the double integration errors, and the lack of other sensors contributing to the bias estimates.


The problems with localization become very evident on flying platforms, as they do not have wheel odometry to maintain the inertial biases. In small robotic platforms where the wheel slippage is large, the localization estimates also suffer accordingly.


SUMMARY OF THE INVENTION

The invention provides a mechanism for maintaining the localization of moving platforms, by utilizing stationary platforms, moving platforms, and ranging radios. The stationary platforms help provide localization to the moving platforms. The number of stationary platforms can be increased to provide higher accuracy, or to extend the localization workspace. By alternating stationary and moving platforms, the localization workspace can be accommodated to the task.


Ranging radios often provide a single measurement of range, without providing the direction of the other device. However, there are ranging radios that can provide both range and direction. If this type of ranging radios are used, then a single platform can be left stationary, while the others can move. The ranging radios can be implemented with a variety of technologies, including electromagnetic waves with active or passive responses (i.e. radar), utilizing LADAR, vision against known features in the moving platform, and even acoustic sensors. This localization system can be utilized with a variety of sensors that provide point-to-point measurement between the platforms.





BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate the present invention and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the pertinent art to make and use the invention.



FIGS. 1a, 1b, and 1c illustrate the localization swarm on the fly; and



FIG. 2 illustrates a group of quads is maintained stationary on the ground to provide a localization pathway for the fling quads.



FIG. 3 shows a logic/flow diagram of all of the features that are claimed in this invention.





DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description of the invention of exemplary embodiments of the invention, reference is made to the accompanying drawings (where like numbers represent like elements), which form a part hereof, and in which is shown by way of illustration specific exemplary embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention, but other embodiments may be utilized and logical, mechanical, electrical, and other changes may be made without departing from the scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.


In the following description, numerous specific details are set forth to provide a thorough understanding of the invention. However, it is understood that the invention may be practiced without these specific details. In other instances, well-known structures and techniques known to one of ordinary skill in the art have not been shown in detail in order not to obscure the invention. Referring to the figures, it is possible to see the various major elements constituting the apparatus of the present invention.


Ranging radios operating at ultra wide band (UWB) frequencies can provide accurate point-to-point measurements. The accuracy of the range measurements depends on the frequencies used and the radio's design. Commercial, off-the-shelf ranging radios are available utilizing UWB, but there are also ranging radios based on BLUETOOTH, WIFI, and other frequencies and encoding methods. State-of-the-art ranging radios are small in size and low in cost. This makes them prime candidates for installation in small robotic systems.


By installing ranging radios, we can directly measure the distance between the robotic platforms, but they do not provide localization by default. The invention provides a swarm movement methodology for maintaining relative and absolute localization of the group.


As presented earlier, the inertial components of navigation units drift with time as a platform is flying. However, when the navigation unit is not moving (i.e. the platform has landed), we are aware that the position is immobile; acceleration biases can then be computed (zero velocity update). Moreover, if a sufficient number of platforms are not moving, the position of the moving platforms can be computed by triangulating the position of the ones that are stationary.


Specifically, let's assume that the position of three quadrotors is known. The quads are on the ground 101, 102, and 103 in a triangular configuration shown in FIG. 1a, 104. There are three other quads 105, 106, and 107 that “leap frog” over the three landed quads 101, 102, and 103. Since the location of all the robots/quads on the ground 101, 102, and 103 is known, and the ranging radios provide ranges from each landed quad 101, 102, and 103 to each flying quad 105, 106, and 107, the location of the three flying quads 105, 106, and 107 is also known. As the flying quads land as shown in FIG. Ib, 108, the location of their landing will be known, releasing the originally landed quads 101, 102, and 103 to fly, starting the cycle once again as shown in FIG. 1e, 109.


Even though the example of FIGS. 1a-1e shows the quads “leap frogging,” the same algorithm can be used with at least three stationary robots, where the flying robots perform other tasks (like mapping the room), leaving the three stationary robots in place, acting as sources of localization.


In a similar fashion, more than three robots can be used in a stationary manner to create a localization “carpet” 207 that can provide both localization and communication relay. FIG. 2 shows one such example. In this case, a group of stationary quads 201, 202, 203, 204, and 205 which may be low on battery, are being used to provide localization for the incoming wave of flying quads 206 that are traversing a path 208.


Different vehicle topologies (stationary vehicles) will provide different error propagation for the swarm. In order to optimize the topology and therefore minimize the error in localization, the system can search for the most effective topology. The literature already presents a variety of optimization algorithms that can be used for this purpose. In particular, a lot of work in this area was conducted in the early 70s and 80s to find the best topology for GPS satellites. In the present incarnation the topology is generated by expanding a multi-vehicle search. Other search algorithms like visibility graph-based, DIJKSTRA, neural networks, or even simplex methods can be used.


Thus, it is appreciated that the optimum dimensional relationships for the parts of the invention, to include variation in size, materials, shape, form, function, and manner of operation, assembly and use, are deemed readily apparent and obvious to one of ordinary skill in the art, and all equivalent relationships to those illustrated in the drawings and described in the above description are intended to be encompassed by the present invention.


Furthermore, other areas of art may benefit from this method and adjustments to the design are anticipated. Thus, the scope of the invention should be determined by the appended claims and their legal equivalents, rather than by the examples given.



FIG. 3 shows a logic/flow diagram in which a marsupial robot makes ranging measurements on control systems with ranging modules as well as a moving platform with control systems and ranging modules.

Claims
  • 1. A method for robotic swarm localization using ranging sensors, comprising: operating a group of at least four robotic platforms, each robotic platform comprising a ranging radio;maintaining a stationary position by a first, second, and third robotic platform from the group of at least four robotic platforms, at a first time;localizing the group of at least four robotic platforms by: measuring, at the first time and utilizing the ranging radios, the distances between each of the first, second, and third robotic platforms and at least one fourth robotic platform that is in motion; andcalculating, based on the measured distances to the at least one fourth robotic platform that is in motion, a position of the at least one fourth robotic platform;transitioning the at least one fourth robotic platform from a moving state to a stationary state, at a second time;transitioning the first robotic platform to a mobile state, at the second time; andlocalizing the group of at least four robotic platforms by: measuring, at the second time and utilizing the ranging radios, the distances between each of the second, third, and fourth robotic platforms and the first robotic platform that is in motion; andcalculating, based on the measured distances to the first robotic platform that is in motion, a position of the at least one fourth robotic platform.
  • 2. The method for robotic swarm localization of claim 1, further comprising: mapping, by the at least one fourth robotic platform, a room.
  • 3. The method for robotic swarm localization of claim 1, wherein at least one of the at least four robotic platforms comprises at least one of a ground, underwater, surface, or flying platform.
  • 4. The method for robotic swarm localization of claim 3, wherein at least one of the at least four robotic platforms comprises an unmanned platform.
CROSS REFERENCE TO RELATED APPLICATIONS

This application claims priority from and is a continuation of U.S. patent application Ser. No. 14/874,078, entitled “Robotic Swarm Localization Using Ranging Radios”, filed on 2 Oct. 2015. The benefit under 35 USC § 119(e) of the United States provisional application is hereby claimed, and the aforementioned application is hereby incorporated herein by reference. U.S. patent application Ser. No. 14/874,078 claims priority from U.S. Patent Application Ser. 62/059,124, entitled “Robotic Swarm Localization Using Ranging Radios”, filed on 2 Oct. 2014. The benefit under 35 USC § 119(e) of the United States provisional application is hereby claimed, and the aforementioned application is hereby incorporated herein by reference.

US Referenced Citations (23)
Number Name Date Kind
6687571 Byrne Feb 2004 B1
9174733 Burgess Nov 2015 B1
9481475 Campillo Nov 2016 B2
20030028286 Glenn Feb 2003 A1
20030164794 Haynes Sep 2003 A1
20030212472 McKee Nov 2003 A1
20040024490 McLurkin Feb 2004 A1
20040068416 Solomon Apr 2004 A1
20040073337 McKee Apr 2004 A1
20050183569 Solomon Aug 2005 A1
20060161405 Munirajan Jul 2006 A1
20080137589 Barrett Jun 2008 A1
20120158176 Park Jun 2012 A1
20120326923 Oehler Dec 2012 A1
20130046420 Gottifredi Feb 2013 A1
20130123981 Lee May 2013 A1
20130226343 Baiden Aug 2013 A1
20140098990 Vian Apr 2014 A1
20150190925 Hoffman Jul 2015 A1
20160207637 Campillo Jul 2016 A1
20160243698 Hoffman Aug 2016 A1
20170057081 Krohne Mar 2017 A1
20190387374 Gherardi Dec 2019 A1
Non-Patent Literature Citations (12)
Entry
Notice of Allowance for U.S. Appl. No. 15/700,082 dated Apr. 29, 2021, pp. 7
Final Office Action for U.S. Appl. No. 16/403,890 dated Jun. 15, 2021, pp. 8.
Office Action for U.S. Appl. No. 14/874,078 dated Nov. 8, 2017, pp. 12.
Final Office Action for U.S. Appl. No. 14/874,078 dated Jun. 27, 2018, pp. 12.
Notice of Allowance for U.S. Appl. No. 14/874,078 dated Feb. 7, 2019, pp. 8.
Office Action for U.S. Appl. No. 15/700,082 dated Jun. 11, 2019, pp. 10.
Final Office Action for U.S. Appl. No. 15/700,082 dated Oct. 2, 2019, pp. 9.
Office Action for U.S. Appl. No. 15/700,082 dated Apr. 28, 2020, pp. 7.
Final Office Action for U.S. Appl. No. 15/700,082 dated Dec. 4, 2020, pp. 9.
Office Action for U.S. Appl. No. 16/403,890 dated Nov. 10, 2020, pp. 8.
Final Office Action for U.S. Appl. No. 16/403,890 dated Jun. 15, 2021; 9 pps.
Notice of Allowance for U.S. Appl. No. 15/700,082 dated Jul. 27, 2021; 5 pps.
Related Publications (1)
Number Date Country
20190023902 A1 Jan 2019 US
Provisional Applications (1)
Number Date Country
62059124 Oct 2014 US
Continuations (1)
Number Date Country
Parent 14874078 Oct 2015 US
Child 15700080 US