The field of the invention relates to unmanned aerial vehicle (UAV) systems, and more particularly to systems for operating a UAV autonomously.
Aerial geographic survey work for the agricultural and oil industries incur the logistics and costs of personnel to operate and maintain the air vehicle as well as collect and process the associated data. These costs are typically compounded by need for a substantial amount of this work to be performed at, or relatively near to, the location of the survey, which typically is well removed from any population centers. As a result it is advantageous to increase automation, reliability (reduce complexity), range, and capability of an air vehicle and support system for performing such data retrieval and processing tasks.
Exemplary method embodiments may include a method of migrating unmanned aerial vehicle (UAV) operations between geographic survey areas, including: uploading a first plurality of flight missions into a first UAV pod; deploying the UAV pod; autonomously launching the UAV from the UAV pod a plurality of times to perform the first plurality of flight missions; providing first survey data from the UAV to the UAV pod; autonomously migrating the UAV from the first UAV pod to a second UAV pod; receiving a second plurality of flight missions in a second UAV pod; providing the UAV with one of the second plurality of flight missions from the second UAV pod; autonomously launching the UAV from the second UAV pod a plurality of times to perform the second plurality of flight missions; and providing a second survey data from the UAV to the second UAV pod; where the autonomous migrating of the UAV to accomplish the first and second survey data happens autonomously and without active human intervention.
Additional exemplary method embodiments may include performing data analysis of the first and second survey data; and providing the data analysis to the customer. Additional exemplary method embodiments may include processing, by a first processor of the first UAV pod, the provided first survey data, where the processing may include at least one of: converting the provided first survey data into one or more viewable images with accompanying geospatial location and stitching the one or more images into an orthomosaic. Additional exemplary method embodiments may include charging a battery of the UAV in the first UAV pod; and charging the battery of the UAV in the second UAV pod. Additional exemplary method embodiments may include storing the provided first survey data in a UAV pod memory of the first UAV pod; and storing the provided second survey data in a UAV pod memory of the second UAV pod. Additional exemplary method embodiments may include determining, by a first weather sensor in communication with a first processor of the first UAV pod, a flight decision based on a measurement of the external environment prior to each autonomous launch of the UAV from the first UAV pod; and determining, by a second weather sensor in communication with a second processor of the second UAV pod, a flight decision based on a measurement of the external environment prior to each autonomous launch of the UAV from the second UAV pod.
Additional exemplary method embodiments may include autonomously landing the UAV in the first UAV pod a plurality of times after each of the performed first plurality of flight missions; and autonomously landing the UAV in the second UAV pod a plurality of times after each of the performed second plurality of flight missions. Additional exemplary method embodiments may include autonomously routing the UAV to a local area network (LAN) for wireless transmission of at least one of: the first survey data and the second survey data by a transceiver of the UAV. In additional exemplary method embodiments, at least one of the first plurality of flight missions may include dropping a payload by the UAV and/or loitering the UAV over an event of interest. Additional exemplary method embodiments may include determining a UAV battery power level during the first plurality of flight missions; and autonomously re-routing the UAV to the first UAV pod if the determined UAV battery power level drops below a predetermined voltage threshold.
Additional exemplary method embodiments may include uploading a third plurality of flight missions into the first UAV pod; autonomously launching a second UAV from the first UAV pod a plurality of times to perform the third plurality of flight missions; providing third survey data from the second UAV to the first UAV pod; autonomously migrating the second UAV from the first UAV pod to the second UAV pod; receiving a fourth plurality of flight missions in the second UAV pod; providing the second UAV with one of the fourth plurality of flight missions from the second UAV pod; autonomously launching the second UAV from the second UAV pod a plurality of times to perform the fourth plurality of flight missions; and providing a fourth survey data from the second UAV to the second UAV pod; where the autonomous migrating of the second UAV to accomplish the third and fourth survey data happens autonomously and without active human intervention.
Exemplary system embodiments may include an unmanned aerial vehicle (UAV) surveying system including: a first region having one or more UAV pods; a second region having one or more UAV pods; a UAV having a UAV processor, wherein the UAV processor can: receive one or more flight missions from a UAV pod in the first region; provide flight survey data from the received one or more flight missions to the UAV pod in the first region; migrate the UAV from the UAV pod in the first region to a UAV pod in the second region; receive one or more flight missions from the UAV pod in the second region; and provide flight survey data from the received one or more flight missions to the UAV pod in the second region. In additional exemplary system embodiments, the UAV may be a vertical takeoff and landing (VTOL) UAV. In additional exemplary system embodiments, the received one or more flight missions may include at least one of: waypoints, altitude, flight speed, sensor suite configuration data, launch time, launch day, and mission sensor go and no-go parameters.
Additional exemplary system embodiments may include a first transceiver of the UAV; and a second transceiver of the UAV pod in the first region; and a third transceiver of the UAV pod in the second region; where the provided flight survey data from the one or more flight missions in the first region may be sent by the first transceiver of the UAV and received by the second transceiver of the UAV pod in the first region; and where the provided flight survey data from the one or more flight missions in the second region may be sent by the first transceiver of the UAV and received by the third transceiver of the UAV pod in the second region. Additional exemplary system embodiments may include a weather sensor in communication with a processor of the UAV pod in the first region; where the processor of the UAV pod in the first region determines a UAV flight decision based on a measurement of the external environment by the weather sensor prior to each launch of the UAV from the UAV pod in the first region. In additional exemplary system embodiments, the migration of the UAV from the UAV pod in the first region to the UAV pod in the second region happens autonomously and without active human intervention.
Additional exemplary method embodiments may include a method of migrating unmanned aerial vehicle (UAV) operations between geographic survey areas, including: launching, from a first location, a UAV having a portable UAV pod, where the portable UAV pod is attached to the UAV at launch; flying the UAV having the portable UAV pod to a second location; landing the UAV having the portable UAV pod at the second location; and detaching the UAV from the UAV pod. Additional exemplary method embodiments may include the portable UAV pod folds up after launching and unfolds prior to landing. Additional exemplary method embodiments may include the portable UAV pod having one or more solar panels for charging the UAV. Additional exemplary method embodiments may include charging a battery of the UAV in the first UAV pod prior to launch. Additional exemplary method embodiments may include determining, by a weather sensor in communication with a processor of the UAV pod, a flight decision based on a measurement of the external environment by the weather sensor prior to launching the UAV from the first location. In additional exemplary method embodiments, flying the UAV having the portable UAV pod to the second location happens autonomously and without active human intervention.
The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principals of the invention. Like reference numerals designate corresponding parts throughout the different views. Embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which:
A vertical takeoff and landing (VTOL) unmanned aerial vehicle (UAV) system is disclosed that provides for improved remote geographic survey capabilities. Multiple autonomous mission launches and landings may be accomplished using a two-rotor VTOL UAV that is capable of efficient horizontal flight, and a UAV pod having a UAV pod processor, with the UAV selectively enclosed in the UAV pod for protection against the external environment when not in use, recharging and/or transferring data.
An operating method is disclosed for migrating UAV operations between geographic survey areas. The method may use multi-aircraft UAV pods to initiate UAV surveys across disparate geographic areas that have pre-positioned single-UAV pods for receipt and provisioning of the migrating survey UAVs. A UAV may be launched from a first UAV pod in a first geographic area to perform a first set of flight missions and return survey data to the first UAV pod. The UAV may then be autonomously migrated to a second UAV pod in a second geographic area. The UAV may then perform a second set of flight missions and return survey data from this second set of flight missions to the second UAV pod. The UAV may autonomously move to various geographic areas to perform various tasks that may then be analyzed and provided to a customer.
Exemplary UAV Pod and UAV Structure
A UAV pod memory 116 may also be housed within the UAV pod 108 for storing UAV flight mission information and geographic survey data. A battery 118 may be enclosed in the UAV pod for recharging the UAV 102 and for providing power to the UAV pod 108 such as for use by the processor 114 and cover motor (not shown). The battery 118 may be rechargeable such as through solar panels 119, or may be a permanent battery such as a 12-Volt deep cycle marine battery. In an alternative embodiment, the battery 118 may be a fuel cell. In some embodiments, the UAV pod 108 will use the solar panels 119 to charge the battery 118 to later charge the battery of the UAV 102. Typically, the UAV pod 108 will be charging the battery 118 while the UAV 102 is out of the pod 108 executing a mission and will recharge the UAV 102 upon its return to the UAV pod 108.
A weather sensor 120 in communication with the UAV pod processor 114 may extend from an exterior of the UAV pod 108 to enable accurate measurement of the external environment, such as wind speed, temperature and barometric pressure. A proximity sensor or sensors may also be provided (122, 124) and in communication with the UAV pod processor 114 to enable go and no-go flight decisions based on the proximity of any objects or other obstructions positioned over the UAV pod cover 110. The UAV pod 108 is preferably weather hardened to enable extended outdoor use regardless of weather variations.
The UAV 102 may also be provided with a rearward facing tang 216 extending off of a rear portion 218 of the fuselage 206 in lieu of or in addition to rear landing gear 212. Such rearward-facing tang 216 may be metallic or have metallic contacts for receipt of electrical signals (i.e., data) and/or power for charging the UAV's battery 209.
Business Methods of Operation
The next mission's flight data may be provided 412 to the UAV and the UAV may be launched to perform the next survey mission. Upon its return, the survey raw data may be provided 414 to the UAV pod for pre-processing and the pre-processed data may then be provided 416 to the customer support center for additional processing. With the UAV receiving the last mission flight data 418 and upon receipt by the UAV pod of the final survey raw data 420, the final pod-processed data may be provided 422 to the customer support center. After final processing of the collective missions pre-processed data, the survey results may be provided 424 by the customer support center to the customer.
Similarly, by suitably modifying GDS values, the UAV may have the coverage area and refresh rates listed in Table 2.
In other embodiments, rather than inputting the data request through a website portal, the customer may provide the data through a proprietary software interface or via a telephone interview mechanism, each in communication with a customer support center. A plurality of flight missions may then be planned that collectively accomplish the customer's (block 602) request such as by pre-planning how many flights and from what general areas they need to operate. The planned flight missions, such flight missions including flight mission data representing takeoff day/time, waypoints, flight altitudes, flight speeds, and such, are provided to the UAV pod (block 604) for future communication to a UAV seated in the UAV pod.
The UAV pod may then be deployed to a launch site that is either within or adjacent to the customer—desired geographic coverage area (block 606). Deployment may consist of loading the UAV into a UAV pod and transporting both to the launch site by means of truck or aircraft transport. By way of further example, the UAV pod and enclosed UAV may be transported by a commercial carrier (e.g., FedEX, UPS, etc.) to a farm for offloading into a field, or by an oil and gas utility company to a location adjacent a transmission or pipeline that may be the subject of a visual survey. The UAV may be provided with flight mission data representing one of the plurality of missions (block 608) such as by short range wireless or wired communication within the UAV pod. As used herein, “short range” may be defined as a range having sufficient distance to communicate with the UAV throughout the UAV's maximum range of flight. The UAV may then be launched out of the UAV pod to perform the provided flight mission (block 610). As described herein, a “mission” or “flight mission” preferably encompasses one launch, survey flight, and landing, but may encompass more than one launch/flight/landing. The flight mission data may also include dynamic flight instructions, such as altering its trajectory, attitude or such as by dropping a payload if certain conditions exist, such as would be valuable in a search and rescue mission if the plan locates the sought after object or person.
After completion of the flight mission, or in response to a rerouting request received by the UAV, the UAV is received in the UAV pod and the flight survey data is provided to UAV pod memory (block 612). In an alternative embodiment, rather than returning to the original UAV pod, the UAV flies to and is received by a second UAV pod (block 614) (see also
The flight survey data provided to UAV pod memory (perhaps detachable memory), provided wirelessly from the UAV pod, or even provided to a local LAN as described above, may be in raw or pre-processed form. For example, the flight survey data may simply be “zipped” and relayed to a remote processing station where all of the data is processed. Pre-processing the flight survey data prior to providing such from the UAV pod or directly from the UAV provides advantages. Data transmission bandwidth requirements may be reduced from what would otherwise be needed to transmit raw data for processing to an operational support center. A reduction in transmission bandwidth requirements may translate into reduced data transmission costs and time. In a preferred embodiment, either the UAV processor 208 (see
As shown in
As shown in
In a further alternative embodiment, the UAV pod may be deployed to a launch site prior to providing the UAV pod with flight missions data representing the planned flight missions. In such a scheme, the UAV pod may establish or join a local LAN connection for receipt of the planned flight missions on-site.
Local UAV Operation
Methods of General Survey Use—Contiguous Survey Areas
While embodiments of the system thus far are described within the context of a flight survey using only one UAV pod, it is contemplated that a customer of the system may request a geographic coverage area that extends beyond the capabilities of a single UAV and UAV pod combination.
In an alternative embodiment that recognizes the autonomous landing capability of the UAV, the UAV, rather than transitioning to the next individual geographic survey area 902 or to the next individual geographic survey areas 902, the UAV may fly to a predetermined data offloading waypoint, such as a customer's farm house or automobile, to establish or join a local LAN connection or to establish a wireless connection to provide a data dump of geographic survey data.
In a further alternative embodiment, more than one UAV may be provided within the extended geographic survey area 900, with each UAV having a different sensor suite to gather complementary data for the customer. In such a scheme, each UAV may survey the entire extended geographic survey area 900 by transitioning through the plurality of individual geographic survey areas 902 over time, or to only a subset of each area 900, to obtain a more complete understanding of the area 900 than would be possible with only a single UAV sensor suite.
Also, although the prior description describes one UAV for each UAV pod, in an alternative embodiment, each UAV pod may selectively encompass, provide power for, and distribute missions to two or more VTOL UAVs (see
Although
Methods of General Survey Use—Non-Contiguous Survey Areas
Methods of Agricultural Survey Use—Non-Contiguous Areas (“UAV Migration”)
In week 1, a first of five UAVs in each multi-aircraft UAV pod 1200, the first UAVs referred to for convenience as the “planting UAVs” because of provisioned sensors for detecting the success of the targeted crop's planting phase, may survey the first local geographic survey area to assess and/or record the success or failure of the survey area's planting (P) period. After the conclusion of the planting geographic survey, the planting UAVs may be flown (i.e., “migrated”) (indicated by arrows), preferably autonomously, to the adjacent second region single UAV pod 1202 survey site for subsequent provisioning, such as battery charging, in preparation for the next survey.
In week two, the planting UAVs may be again launched, this time from the second region UAV pod 1202 survey site, to conduct flight surveys to assess and/or record the area's planting (P) phase. In addition, a second of five UAVs in the multi-aircraft UAV pods 1200, referred to for convenience as the “emergence UAVs” because of provisioned sensors for detecting the success of the targeted crop's emergence phase, are launched for the first time to capture the emergence (E) phase of first geographic survey area that was previously surveyed during its planting phase. After the conclusion of the planting and emergence phase surveys by the planting and emergence UAVs, respectively, the UAVs may be flown (indicated by arrows), preferably autonomously, to the adjacent second and third regions UAV pods (1202, 1204) survey sites, respectively, for subsequent provisioning, such as battery charging, in preparation for the next survey.
In week three, the planting UAVs may again be launched, this time from the third region UAV pod 1204 survey sites, to conduct flight surveys to assess and/or record the area's planting (P) phase. The emergence UAVs may initiate their second survey, this time from the second region UAV pod 1202 survey sites, to conduct flight surveys to assess and/or record the area's emergence (E) phase. In addition, a third of five UAVs in the multi-aircraft UAV pods 1200, referred to for convenience as the “growth UAVs” because of provisioned sensors for detecting the success of the targeted crop's growth phase, are launched for the first time to capture the growth (G) phase of first geographic survey area that was previously surveyed during both their planting and emergence phases. After the conclusion of the planting, emergence, and growth phase surveys by the planting, emergence, and growth UAVs, respectively, the UAVs may be flown (indicated by arrows), preferably autonomously, to the adjacent second, third, and fourth region UAV pods (1202, 1204, 1206) survey sites, respectively, for subsequent provisioning, such as battery charging, in preparation for the next survey.
In week four, the planting UAVs may be launched to initiate their fourth survey, this time from the fourth region UAV pod 1206 survey sites, to conduct flight surveys to assess and/or record the local area's planting (P) phase. The emergence and growth UAVs may also be launched to initiate their surveys, this time from the third and second region UAV pod (1204, 1202) survey sites, respectively. In addition, a fourth of five UAVs in the multi-aircraft UAV pods 1200, referred to for convenience as the “harvest UAVs” because of provisioned sensors for detecting the success of the targeted crop's harvesting phase, are launched for the first time to capture the harvesting (H) phase of the first geographic survey area that was previously surveyed during their planting, emergence, and growth phases by the planting, emergence, and growth UAVs, respectively. After the conclusion of the planting, emergence, growth, and harvest phase surveys by the planting, emergence, growth, and harvesting UAVs, respectively, the UAVs (not shown) may be flown (indicated by arrows), preferably autonomously, to their next-scheduled survey sites.
In week five, the planting UAVs may be launched to initiate their fifth survey, this time from the fifth region multi-aircraft UAV pod 1208 survey sites, to conduct flight surveys to assess and/or record the local area's planting (P) phase. The emergence, growth, and harvest UAVs may also be launched to initiate their respective surveys, this time from the fourth, third, and second region UAV pods (1206, 1204, 1202) survey sites, respectively. Lastly, a fifth of five UAVs in the multi-aircraft UAV pods 1200, referred to for convenience as the “cleanup UAVs” because of provisioned sensors for detecting the success of the targeted fields' cleanup phase, are launched for the first time to capture the cleanup (X) phase of the first geographic survey area that was previously surveyed during their planting, emergence, growth, and harvesting phases.
Although not illustrated, in one embodiment, the remainder of weeks 6-9 would be used to accomplish the remaining emergence, growth, harvesting, and cleanup phase surveys of each of the geographic survey areas as the individual UAVs migrated from the northern-most multi-aircraft UAV pods 1200 down through the individual UAV pods (1202, 1204, 1206) and finally to the southern-most multi-aircraft UAV pods 1208 where the finally-enclosed UAVs would be made available for physical pick-up. In one embodiment, the northern-most and southern-most multi-aircraft UAV pods are the same pods, with launch and landing of the first and fifth UAVs coordinated to allow migration of the multi-aircraft pods 1200 to the southern-most pod position illustrated in
In alternative embodiments, the UAVs may be migrated in compass orientation other than generally North-South, or in migration paths that are not generally linear or in a manner that is not dependent on clearly defined crop phases.
As shown in
While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible that are within the scope of this invention.
This application claims priority to and the benefit of U.S. patent application Ser. No. 15/960,413, filed Apr. 23, 2018, which claims priority to and the benefit of U.S. patent application Ser. No. 15/040,985, filed Feb. 10, 2016, which issued as U.S. Pat. No. 9,977,435 on May 22, 2018, which claims priority to U.S. Provisional Patent Application No. 62/115,086, filed Feb. 11, 2015, the contents of which are hereby incorporated by reference herein for all purposes.
Number | Date | Country | |
---|---|---|---|
62115086 | Feb 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15960413 | Apr 2018 | US |
Child | 16867344 | US | |
Parent | 15040985 | Feb 2016 | US |
Child | 15960413 | US |