Patent Application
20230297105
A drone can be controlled via a radio-frequency communication channel between the drone and a ground-based controller, e.g., an RC controller. Examples of radio-frequency communication channels include 2.5 GHZ and 5.8 GHZ radio frequencies as well as Wi-Fi.
Drone control based on a radio-frequency communication channel can severely limit the range of drone operations. For example, if an airborne drone flies past the radio-frequency range of its ground-based controller or if there is excessive radio-frequency interference during operations, a drone can lose its contact with its controller and crash.
In general, in one aspect, the invention relates to a networked drone. The networked drone can include: a command processor that actuates at least one function of the networked drone in response to a drone command; and a network adapter that obtains the drone command by communicating with a user of the networked drone via a mobile communication network using internet protocols.
In general, in another aspect, the invention relates to a method for drone networking. The method can include: obtaining a drone command by communicating with a user of a networked drone via a mobile communication network using internet protocols; and actuating at least one function of the networked drone in response to the drone command.
Other aspects of the invention will be apparent from the following description and the appended claims.
Embodiments of the present invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements.
Reference will now be made in detail to the various embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. Like elements in the various figures are denoted by like reference numerals for consistency. While described in conjunction with these embodiments, it will be understood that they are not intended to limit the disclosure to these embodiments. On the contrary, the disclosure is intended to cover alternatives, modifications and equivalents, which may be included within the spirit and scope of the disclosure as defined by the appended claims. Furthermore, in the following detailed description of the present disclosure, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it will be understood that the present disclosure may be practiced without these specific details. In other instances, well-known methods, procedures, components, have not been described in detail so as not to unnecessarily obscure aspects of the present disclosure.
In one or more embodiments, the network adapter 104 obtains the drone command 130 by communicating with an internet-connected device 120 of the user of the networked drone 100 via the mobile communication network 110. In one or more embodiments, the internet-connected device 120 runs a drone app that enables a user to command the networked drone 100 by uploading the drone command 130 to the networked drone 100 via the mobile communication network 110 using internet protocols.
In one or more embodiments, the networked drone 100 and the internet-connected device 120 communicate by establishing one or more Websockets channels via the mobile communication network 110. In one or more other embodiments, the networked drone 100 and the internet-connected device 120 communicate via direct TCP and UDP ports, or other internet protocols.
In one or more alternative embodiments, the internet-connected device 120 communicates the drone command 130 up to the networked drone 100 via a drone server (not shown) that enables the internet-connected device 120 to post communications destined for the networked drone 100 and obtain communications posted by the networked drone 100. In one or more example embodiments, TCP connections, UDP connections, etc. transit through a server and communication between the networked drone 100 and the internet-connected device 120 switches between a server and direct peer to peer communication.
The mobile communication network 110 in one or more embodiments is a cellular network adapted for providing communication coverage for mobile devices such as smartphones, tablets, etc. Examples of cellular network implementations of the mobile communication network 110 include LTE and 5G networks.
The networked drone 100 and the internet-connected device 120 in one or more embodiments can communicate even if geographically located on opposite ends of the planet so long as the networked drone 100 is within range of communication infrastructure, e.g., a set of cell towers 140-1 through 140-3, of the mobile communication network 110.
The networked drone 100 in one or more embodiments includes a data acquisition mechanism 108 for performing one or more data acquisition functions of the networked drone 100. The data acquisition mechanism 108 can include any mechanism that can be carried by an airborne drone. Examples of the data acquisition mechanism 108 in various embodiments include cameras, e.g., still and video cameras, infrared imaging systems, radar, LIDAR, audio sensors, heat sensors, etc. In one or more embodiments, the data acquisition mechanism 108 is a video camera mounted on a gimbaled platform that enables aiming of the video camera and zoom functions for the video camera.
In one or more embodiments, the drone command 130 pertains to a navigation function of the networked drone 100. Examples of navigation functions include commands to steer the networked drone 100, commands to alter the speed or heading of the networked drone 100, commands to fly the networked drone 100 to a specified location, commands to change altitude of the networked drone 100, commands to return the networked drone 100 to a landing pad, etc.
In one or more embodiments, the drone command 130 pertains to a telemetry function of the networked drone 100. Examples of telemetry functions include downloading data acquired by the networked drone 100, downloading status information pertaining to the networked drone 100, etc. Examples of downloading data include streaming down a live video acquired by the networked drone 100. Examples of status information include location data, motion data, communication logs, activity logs, command logs, etc.
In one or more embodiments, the drone command 130 pertains to a data acquisition function of the networked drone 100. Examples include commands to control one or more operating parameters of the data acquisition mechanism 108, e.g., gimbal controls, zoom controls, sampling modes, etc.
In one or more embodiments, the internet-connected device 120 runs a drone app that depicts downloaded information to a user of the internet-connected device 120 via, e.g., images, graphs, tables, charts, summaries, audio, video, etc., rendered using the built-in user interface mechanisms of the internet-connected device 120.
There can be any number of internet-connected devices in the constellation 300 and any of the users in the constellation 300 can upload the drone command 330. The users in the constellation 300 can instigate any of the functions of the networked drone 100 by communicating with the networked drone 100 via the mobile communication network 110 using internet protocols. For example, one of the users in the constellation 300 can command the networked drone 100 to move to a particular geographic location and aim the data acquisition mechanism 108, etc., while another user or users in the constellation 300 commands the networked drone 100 to stream down a live video.
There can be any number of networked drones in the swarm 400. The swarm 400 can encompass any geographic disbursement. The user of the internet-connected device 120 can command any one or more of the networked drones in the swarm 400 by uploading drone commands via the mobile communication network 110 using internet protocols.
In one or more embodiments, the user of the internet-connected device 120 uploads drone commands to particular networked drones in the swarm 400 and those networked drones coordinate collective actions with other networked drones in the swarm 400 by communicating among the networked drones in the swarm 400 via the mobile communication network 110 using internet protocols. For example, a user can command the networked drone 410-1 to fly to a particular location and the networked drone 410-1 communicates with the networked drones 410-2 and 410-3 to coordinate flights to the particular location.
Examples of inter-drone communications include telemetry, e.g., location, speed, altitude, heading, etc., drone mission parameters, e.g., final destination location, takeoff location, relative urgency of mission, e.g., when drones are used as first-responders, e.g., as a car crash on a highway, versus a potential false burglar alarm in a commercial building, etc., battery level, video quality, flight mode, e.g., en-route, hovering on location, stationary on the ground, circling around a destination, conducting a search and rescue grid search operation, delivering an item, etc.
For example, if a drone command specifies an altitude of X, then the command processor 102 reads the current altitude from an altitude sensor 680 and actuates a set of flight control mechanisms 620 to move the networked drone 100 to the specified altitude of X. Similarly, if a drone command specifies a location at GPS coordinates Y then the command processor 102 reads a current location from a location sensor 690, e.g., a GPS system, and actuates the flight control mechanisms 620 to move the networked drone 100 to the specified location Y. Likewise, the command processor 102 actuates the flight control mechanisms 620 to move the networked drone 100 in response to drone commands that reflect control inputs by the user of the networked drone 100 to move left, right, up, down, etc., via, e.g., a user interface implemented on the internet connected device 120. The command processor 102 in one or more embodiments uses information from an accelerometer 610 and a compass 630 to control the flight of the networked drone 100.
If a drone command pertains to the data acquisition mechanism 108, e.g., gimbal settings for pointing a camera, the command processor 102 actuates the data acquisition mechanism 108 accordingly. Likewise, the command processor 102 actuates the data acquisition mechanism 108 in response to commands for zooming in or out or for changing camera mode, e.g., between optical and infrared modes.
In one or more embodiments, the command processor 102 is implemented using a combination of processor resources and code.
At step 710, a drone command is obtained by communicating with a user of a networked drone via a mobile communication network using internet protocols. In one or more embodiments, the drone command is obtained from an internet-connected device of a user of the networked drone.
At step 720, at least one function of the networked drone is actuated in response to the drone command. The function can pertain to any aspect of the networked drone, e.g., flight functions, navigation, data acquisition functions, telemetry functions, multiple networked drone coordination functions, etc.
While the foregoing disclosure sets forth various embodiments using specific diagrams, flowcharts, and examples, each diagram component, flowchart step, operation, and/or component described and/or illustrated herein may be implemented, individually and/or collectively, using a range of processes and components.
The process parameters and sequence of steps described and/or illustrated herein are given by way of example only. For example, while the steps illustrated and/or described herein may be shown or discussed in a particular order, these steps do not necessarily need to be performed in the order illustrated or discussed. The various example methods described and/or illustrated herein may also omit one or more of the steps described or illustrated herein or include additional steps in addition to those disclosed.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments may be devised which do not depart from the scope of the invention as disclosed herein.
