Vehicle system and method for providing services

Information

  • Patent Grant
  • 10185320
  • Patent Number
    10,185,320
  • Date Filed
    Thursday, July 27, 2017
    7 years ago
  • Date Issued
    Tuesday, January 22, 2019
    5 years ago
Abstract
A method for providing medical services to a patient, including: receiving a medical service request associated with a patient location; selecting an aircraft, located at an initial location, from a plurality of aircraft based on the patient location and the initial location; determining a flight plan for flying the aircraft to a region containing the patient location; at a sensor of the aircraft, sampling a first set of flight data; at a processor of the aircraft, autonomously controlling the aircraft to fly based on the flight plan and the set of flight data; selecting a landing location within the region; and landing the aircraft at the landing location, including: sampling a set of landing location data; determining a safety status of the landing location based on the set of landing location data; outputting a landing warning observable at the landing location; at the sensor, sampling a second set of flight data; and in response to determining the safety status and outputting the landing warning, autonomously controlling the aircraft to land at the landing location based on the second set of flight data.
Description
TECHNICAL FIELD

This invention relates generally to the field of vehicles, and more specifically to a new and useful vehicle system and method for providing vehicle-related services.


BACKGROUND

Typical vehicle-related services, and especially aircraft-related services, rely on a human to operate the vehicle, which can increase operation costs and/or vehicle requirements. Thus, there is a need in the vehicle field to create a new and useful vehicle system and method for providing vehicle-based services.





BRIEF DESCRIPTION OF THE FIGURES


FIG. 1 is a flowchart diagram of the method for providing services;



FIG. 2A is a schematic representation of a specific example of distributed control systems for performing the method;



FIG. 2B is a schematic representation of a specific example of the method;



FIG. 3 is a perspective view of a specific example of a landing location; and



FIGS. 4A-4B are schematic representations of a first and second specific example of landing the aircraft, respectively.





DESCRIPTION OF THE PREFERRED EMBODIMENTS

The following description of the preferred embodiments of the invention is not intended to limit the invention to these preferred embodiments, but rather to enable any person skilled in the art to make and use this invention.


1. Overview.


A method for providing services includes receiving a request for a service S110, determining mission parameters associated with the request S120, selecting aircraft S130 and/or other vehicle types, dispatching the selected aircraft S140 and/or other vehicle types, and controlling dispatched aircraft flight S150 and/or displaced vehicle travel, and can optionally include performing a service at a waypoint S160 and/or any other suitable elements. The method preferably functions to provide requested early response services using aircraft. However, the method can additionally or alternatively function to provide any suitable aircraft and/or vehicle-related services (e.g., emergency services, vehicle delivery services, personnel delivery services, product delivery services, etc.).


The method is preferably performed using an aerial vehicle system (e.g., the systems described in U.S. Provisional Application No. 62/452,051, titled “Systems and Methods for Providing Early Response Services”, which is herein incorporated in its entirety by this reference). Although elements of the method are described as performed using an aircraft, a person of skill in the art will understand that the method (and optionally, any or all such elements of the method) can additionally or alternatively be performed using any other suitable system. For instance, the method can additionally or alternatively be performed using terrestrial vehicles (e.g., cars, road-going ambulances, etc.), amphibious vehicles, aquatic vehicles, space vehicles, or a combination of vehicle types.


2. Benefits.


The system and/or method can confer several benefits. First, the system and/or method can enable autonomous operation of a vehicle or fleet of vehicles, which can reduce or eliminate the need for human presence on and/or operation of the vehicles. For example, a distribution of responsibilities (e.g., between humans and autonomous systems, between physical locations, etc.) can enable fewer human operators to efficiently perform necessary vehicle- and/or service-related tasks (e.g., for a fleet of vehicles) and/or increase safety, quality, and/or reliability by enabling human operators to concentrate on fewer tasks simultaneously (e.g., only one task at a time), while leveraging computer-based operation resources and/or autonomous control systems. For example, in some embodiments, a human operator can concentrate solely on selecting an appropriate landing site for an aircraft, while autonomous control systems handle safe, reliable, efficient control and navigation of the aircraft. This can facilitate providing fast, efficient, and/or safe vehicle-related services, such as air ambulance services, emergency response services, and/or transportation services.


Second, distribution of autonomous control systems can enable both sophisticated control requiring high-performance computing and communication, and safe control that is robust to issues such as communication failures and/or latency. For example, high-level control instructions can be generated and/or updated remotely (e.g., off-vehicle) and communicated to the vehicle, enabling high-level optimization of vehicle and fleet performance, while on-board systems can directly control the vehicle (e.g., based on the high-level control instructions and/or local sensor data), ensuring safe, consistent control throughout vehicle operation.


Third, providing the ability to accept and/or require inputs (e.g., confirmation inputs, abort inputs, etc.) from vehicle occupants (e.g., occupants not trained and/or licensed to operate the vehicle, passengers, etc.) can increase vehicle performance and/or help ensure safe vehicle operation. For example, the method can include requiring an occupant (e.g., non-pilot occupant) of a helicopter to confirm that a landing zone is clear before landing in the landing zone and/or allowing the occupant to indicate that flight conditions are too turbulent for safety and/or comfort. However, the system and/or method can additionally or alternatively confer any other suitable benefits.


3. Method.


3.1 Receiving a Request for an Early Response Service.


Receiving a request for an early response service Silo functions to receive information about a potential mission. The requested service can be an early response service (e.g., medical service, evacuation service, aerial firefighting service, survey and/or monitoring service, etc.), a non-emergent service (e.g., passenger and/or cargo transportation), and/or any other suitable service. The service request can be received from an emergency dispatch center (e.g., 911 call center), a user or potential user (e.g., user needing transportation, observer at an emergency scene, etc.), and/or from any other suitable requester. The request can be received by an aircraft, a ground-based control center (e.g., ground-based control center with human and/or non-human request processing entities), and/or any other suitable recipient.


The service request preferably includes waypoints (e.g., geographic locations, landmarks, other waypoints) associated with the service (e.g., pickup location, destination, etc.). The service request can additionally or alternatively include a priority classification (e.g., emergency, standard, low priority, etc.) and/or response time requirement (e.g., as soon as feasible; threshold time, such as 10 min, 20 min, 1 h, 4 h, etc.), a requested service type (e.g., medical emergency, such as heart attack, bleeding, burn, etc.; fire; crime; etc.) and/or requested service details (e.g., incident severity, patient medical history, etc.), additional information, such as areas to avoid (e.g., during aircraft flight, at a waypoint, etc.), other resources available (e.g., resources on scene and/or heading to the scene, etc.), other parties to coordinate with (e.g., other early responders, medical facilities, aircraft in the area, etc.), and/or any other suitable information. However, the request can be any suitable request received in any suitable manner.


3.2 Determining Mission Parameters Associated with the Request.


Determining mission parameters associated with the request S120 functions to assess the request and the associated mission required to satisfy the request. S120 is preferably performed in response to receiving the request S110, but can additionally or alternatively be performed in response to any other suitable triggers and/or at any other suitable time. The mission parameters can include feasibility parameters, risk parameters, resource availability parameters, financial parameters, and/or any other suitable perimeters. In one example, the mission parameters can be represented as a mission parameters vector (e.g., ordered list of mission parameter values). However, the mission parameters can have any suitable representation.


Feasibility parameters can include location-related parameters (e.g., terrain, weather, visibility, daylight, elevation, etc.). In specific examples, terrain feature-associated parameters can include or otherwise be used to determine glide range aspects (e.g., glide ratio, glide slope, etc.) required for vehicles over given terrain. Feasibility parameters can additionally or alternatively include route-related parameters (e.g., travel time, fuel and/or battery charge requirements, other aircraft performance factors, airspace-related parameters, traffic-related parameters, etc.), patient condition-related parameters (e.g.; required, estimated, and/or ideal response time to reach a patient; patient transport considerations such as mechanical shock thresholds and/or noise thresholds; treatment considerations such as necessary, desired, and/or potentially useful equipment; triage considerations such as patient treatment/transport prioritization and/or patient transport destination determination; etc.), load parameters (e.g., weight, balance, etc.), and/or any other parameters related to the feasibility of satisfying the request. Risk parameters can include the risk of damage and/or loss (e.g., to aircraft, personnel, other resources, users, bystanders, other people and/or property, etc.), and/or any other parameters related to mission risk. In specific examples, such parameters can include requirements for vehicle travel about hazards, persons on the ground (e.g., in relation to congested areas, non-congested areas), obstacles, and any other suitable hazards. Resource availability parameters can include aircraft availability, personnel availability (e.g., medical personnel, etc.), and can include prioritization and/or triage parameters (e.g., that can allow comparison of different service requests and/or missions). The mission parameters can be determined based on the requests, based on additional information received from the requesting party, based on information received from other parties (e.g., emergency dispatch services, air traffic control services, other resources, etc.), based on information received from aircraft and/or personnel, and/or information from any other suitable source.


In a first example, the mission parameters are determined based on a projected worst-case scenario, and an additional safety factor is introduced to determine a conservative estimate of mission requirements. In a second example, the mission parameters are determined based on a projected likely scenario (e.g., typical scenario; worst scenario expected to typically occur in a length of time, such as a day, a week, a month, or a year; etc.). In a third example, a first set of parameters (e.g., including risk-related parameters and/or feasibility parameters) are determined based on a projected worst-case scenario, and a second set of parameters (e.g., including financial parameters) are determined based on a projected likely scenario. However, the mission parameters can include any suitable parameters, and can be determined in any suitable manner.


In other variations, mission parameters can be determined based on mission type. For instance, with missions involving an on-board medical professional (e.g., doctor, nurse, paramedic, emergency medical technician, etc.), the mission can include sequential flying to multiple waypoints rather than flights directly to a home base after each waypoint is reached. Alternatively (e.g., with missions not involving an on-board medical professional), the mission can include flights to a home base between each waypoint. However, mission parameters can additionally or alternatively be determined in any other suitable manner.


Furthermore, mission parameters can be determined based upon learnings from historical data acquired during previous missions. For instance, Block S120 can include retrieving actual responses/factors associated with environmental conditions, vehicle conditions, terrain conditions, and/or any other suitable conditions from previous vehicle operations (e.g., aircraft flights, terrestrial operations, etc.), in order to guide identification of mission parameters having similar aspects to previously conducted missions. In an example, a previous mission involving high terrain may have resulted in preparation of a flight path over the terrain at a specific altitude, but in practice, flight over the terrain at the altitude was unfavorable. Thus, identification of subsequent missions over high terrain may result in preparation of flight paths around the terrain to provide more favorable mission results.


Algorithms for processing historical data to guide future missions can be based on machine learning approaches. In variations, the machine learning algorithm(s) can be characterized by a learning style including any one or more of: supervised learning (e.g., using logistic regression, using back propagation neural networks), unsupervised learning (e.g., using an Apriori algorithm, using K-means clustering), semi-supervised learning, reinforcement learning (e.g., using a Q-learning algorithm, using temporal difference learning), and any other suitable learning style. Furthermore, the machine learning algorithm(s) can implement any one or more of: a regression algorithm (e.g., ordinary least squares, logistic regression, stepwise regression, multivariate adaptive regression splines, locally estimated scatterplot smoothing, etc.), an instance-based method (e.g., k-nearest neighbor, learning vector quantization, self-organizing map, etc.), a regularization method (e.g., ridge regression, least absolute shrinkage and selection operator, elastic net, etc.), a decision tree learning method (e.g., classification and regression tree, iterative dichotomiser 3,C4.5, chi-squared automatic interaction detection, decision stump, random forest, multivariate adaptive regression splines, gradient boosting machines, etc.), a Bayesian method (e.g., naive Bayes, averaged one-dependence estimators, Bayesian belief network, etc.), a kernel method (e.g., a support vector machine, a radial basis function, a linear discriminant analysis, etc.), a clustering method (e.g., k-means clustering, expectation maximization, etc.), an associated rule learning algorithm (e.g., an Apriori algorithm, an Eclat algorithm, etc.), an artificial neural network model (e.g., a Perceptron method, a back-propagation method, a Hopfield network method, a self-organizing map method, a learning vector quantization method, etc.), a deep learning algorithm (e.g., a restricted Boltzmann machine, a deep belief network method, a convolutional network method, a stacked auto-encoder method, etc.), a dimensionality reduction method (e.g., principal component analysis, partial least squares regression, Sammon mapping, multidimensional scaling, projection pursuit, etc.), an ensemble method (e.g., boosting, bootstrapped aggregation, AdaBoost, stacked generalization, gradient boosting machine method, random forest method, etc.), and any suitable form of machine learning algorithm.


3.3 Selecting Aircraft and/or other Vehicle Types.


Selecting aircraft S130 and/or other vehicle types functions to accept or decline the received request and to allocate resources to the associated mission. S130 preferably includes selecting aircraft to perform the mission, and can additionally or alternatively include selecting aircraft to support the mission, to compensate for coverage gaps (e.g., gaps created due to mission performance, etc.), and/or to select aircraft for any other suitable purpose. S130 can alternatively include selecting no aircraft and declining the service request (preferably communicating the decision to decline the service request to the requesting party and/or other parties associated with the request). Block S130 can include selecting a single aircraft for a single mission or multiple missions. Block S130 can additionally or alternatively include selecting multiple aircraft for a single mission or multiple missions. In multiple vehicle scenarios, the selected vehicles can include aircraft, terrestrial vehicles, and/or any other suitable vehicle type.


Aircraft and/or other vehicles are preferably selected S130 based on mission parameters, such as the parameters determined in S120, wherein aircraft/vehicles are preferably selected S130 concurrent with and/or after (e.g., in response to) determining the mission parameters S120. The aircraft can be selected based on location, aircraft and/or associated personnel capabilities, other service needs (e.g., concurrent missions, projected future needs, etc.), and/or any other suitable factors.


For example, aircraft (and/or other vehicles) can be selected based on a function of the mission parameters vector. In a specific example, a function of the mission parameters vector and of an aircraft parameters vector (e.g., representing information about an aircraft, about the aircraft fleet, etc.) can be used to select in the aircraft. In this specific example, each aircraft is associated with an aircraft parameters vector, and the aircraft whose aircraft parameters vector maximizes the function (for the given mission parameters vector) is selected (e.g., always selected based on maximizing the function; selected only if the function value exceeds a minimum threshold, wherein the service request can be declined if the function value does not exceed the threshold; etc.).


In a first variation, the closest aircraft (e.g., of the set of aircraft with appropriate resources to perform the mission) is selected. In this variation, aircraft distance can be determined based on geographical distance to the first waypoint (e.g., pickup location), estimated response time (e.g., response time to the first waypoint, response time to a subsequent time-sensitive waypoint, etc.), and/or any other suitable metric.


In a second variation, aircraft are selected to minimize the overall loss of coverage ability for the early response network. In this variation, aircraft can be selected from the set of all aircraft that can satisfy the mission requirements (e.g., estimated response time below a threshold value, having appropriate resources to perform the mission, etc.). In a specific example of this variation, in which a 20 minute response time is required for a mission, a first aircraft, located to the east of the pickup location, has a 10 minute projected response time, and a second and third aircraft, collocated to the west of the pickup location, each have a 15 minute projected response time. In this specific example, one of the two western aircraft is selected (despite their slower response time) in order to avoid creating a coverage gap in the eastern region.


In a third variation, aircraft can be selected to perform multiple concurrent (and/or consecutive) missions. The concurrent missions can include transporting multiple patients on departure and/or return routes. In a first example of this variation, after stabilizing an emergent patient, the aircraft can proceed to a second pickup location associated with a non-emergent mission (e.g., to pick up a stable patient, courier, passenger, cargo, etc.). In this example, the aircraft can then proceed to one or more drop-off locations (e.g., hospital, requested destination, etc.). In a second example, an aircraft that is currently performing a first mission (e.g., non-emergent mission, low-priority emergency mission, etc.) can be selected for an emergency mission (e.g., wherein the first mission is delayed in order to minimize response time for the emergency mission). In a third example, in which an aircraft is performing a first emergency mission, the aircraft can be selected (e.g., tentatively selected) for a second emergency mission (e.g., to be performed after completion of the first emergency mission, after time-sensitive steps of the first emergency mission, etc.). In this third example, the second emergency mission can optionally be reallocated to an alternative aircraft (e.g., in response to the first aircraft being delayed, the alternative aircraft becoming available earlier than anticipated, receipt of additional information such as changing weather and/or mission requirements, etc.).


In a fourth variation, an aircraft may be dispatched for a portion of a mission to deliver products to a terrestrial vehicle that completes the remainder of the mission. In a fifth variation, a terrestrial vehicle is selected rather than an aircraft (e.g., if the terrestrial vehicle is capable of completing the mission and would be more economical to use than an aircraft, if the terrestrial vehicle is expected to perform the mission more safely and/or effectively than an aircraft, etc.). However, the aircraft (and/or other vehicle) can be selected S130 in any other suitable way, based on any other suitable information, at any other suitable time.


3.4 Dispatching the Selected Aircraft and/or other Vehicle Types.


Dispatching the selected aircraft S140 and/or other vehicle types functions to initiate the mission. The aircraft are preferably dispatched S140 in response to selecting the aircraft S130 and/or other vehicle types, but can additionally or alternatively be dispatched at a predetermined time after the selection (e.g., for a non-emergent mission) and/or any other suitable time. Dispatching the aircraft S140 preferably includes performing preflight checks (e.g., safety checks of the selected aircraft) and sending a mission profile to the selected aircraft, and can additionally or alternatively include any other suitable elements.


Performing preflight checks functions to ensure that the aircraft is safe for flight and ready to carry out the mission. The preflight checks can be performed using sensors onboard the aircraft (e.g., aerial vehicle diagnostic systems), external sensors near the aircraft (e.g., at a landing and/or storage location occupied by the aircraft), and/or sensors of any suitable system in any suitable location. The sensors can include optical sensors (e.g., cameras), sonar, heat sensors, and/or any other suitable sensors. Performing preflight checks can additionally or alternatively be implemented with a human examiner or other entity according to a checklist.


Sending the mission profile to the aircraft functions to communicate information associated with the mission to the aircraft. The mission profile can include one or more waypoints (e.g., first waypoint, all waypoints, etc.), locations, desired paths (e.g., for path following), and/or desired velocities (e.g., with direct velocity commands). The mission profile can additionally or alternatively include additional information from the service request, mission parameters (e.g., determined in S120), other selected and/or available aircraft (e.g., along with information about these additional aircraft, such as capabilities, locations, intended roles, etc.), and/or supplemental information. The supplemental information can include maps (e.g., terrain, radar, visual flight rules maps, instrument flight rules maps, other airspace factors, etc.), weather conditions and/or forecasts (e.g., visibility, winds, moisture, density, altitude, etc.), air traffic information (e.g., notices to airmen, temporary flight restrictions, alerts, information related to special use areas, global and/or local obstacle information, right-of-way rules, traffic advisories, etc.), noise abatement and/or ground congestion information (e.g., population density, noise burden, public gatherings, etc.), resource information (e.g., location and/or availability of mission-critical and/or potentially useful resources such as medicine, equipment, etc.), and/or any other suitable information. However, the selected aircraft can be dispatched in any other suitable manner.


3.5 Controlling Dispatched Aircraft Flight and/or Vehicle Operation.


Controlling aircraft flight S150 and/or other vehicle operation functions to control the vehicle(s) to perform the mission. Aircraft flight is preferably controlled S150 in response to aircraft dispatching S140 (e.g., wherein the aircraft is controlled to take off and perform the mission upon being dispatched), but can additionally or alternatively be controlled at any other suitable time.


The aircraft is preferably autonomously controlled, but can additionally or alternatively be manually controlled. Autonomous aircraft flight can be completely autonomous (e.g., without human entity involvement; performed entirely by on-board systems, performed in part or all by remote systems such as automated air traffic control systems, etc.), or can allow and/or require human and/or other external inputs (e.g., from ground station personnel, on-board personnel, requesting users, etc.). For example, human and/or external inputs can be used to modify the mission (e.g., flight path, landing location, etc.), trigger evasive maneuvers (e.g., to avoid collision with incoming air traffic and/or other obstacles), trigger contingency maneuvers (e.g., due to off-nominal flight conditions, such as motor failure, chassis damage, low fuel, extreme weather, etc.), directly control the aircraft, and/or modify aircraft flight in any other suitable way. Contingency maneuvers can include course alterations, speed alterations, expedited landing (e.g., land at nearest ground station, land at nearest known helipad, runway, and/or other regular landing location, land at an emergency site, immediately begin landing, etc.), safety system deployment, and/or any other suitable maneuvers. Direct aircraft control can be limited and/or unlimited (e.g., determined based on mission stage, aircraft status, controller qualifications, etc.). In a specific example, personnel on-board the aircraft can directly control aircraft horizontal alignment and descent rate during a landing procedure (e.g., in a standard operation mode, or in an override mode).


The aircraft is preferably controlled based on the mission parameters (e.g., determined as described above regarding S120). The mission parameters on which aircraft control is based can be determined prior to aircraft selection, determined during mission performance (e.g., based on information received from observers, inputs received from aircraft personnel such as medical professionals, sensor measurements such as patient condition sensors and/or aircraft sensors, communications from ATC and/or other aircraft, etc.). In one variation, the aircraft is controlled based on patient condition-related parameters, such as patient transport considerations. In a first example of this variation, a patient on the aircraft urgently needs advanced medical treatment (e.g., available at a hospital but not onboard the aircraft). In this example, the aircraft can be controlled to fly to and land at a hospital (e.g., the closest acceptable hospital) quickly (e.g., as quickly as possible, practical, and/or safe).


In a second example of this variation, a patient on the aircraft is in a stable condition (e.g., not deteriorating, not in urgent need of medical care beyond that provided in the aircraft) but has potentially suffered a spinal injury (e.g., shows signs of a spinal injury, has injuries and/or symptoms consistent with a spinal injury, was observed to undergo a trauma that could cause a spinal injury, etc.). In this example, the aircraft can be controlled to attempt to minimize the mechanical shock exerted on the patient (e.g., to reduce the likelihood of spinal injury exacerbation). For example, the aircraft can be flown at a reduced velocity; can be navigated around regions of atmospheric turbulence; and/or can be routed toward a destination selected based on a number of factors (e.g., not based solely or primarily on minimizing transport time to the destination), such as distance, intervening weather conditions, care availability at the destinations, transport costs, patient preferences, and/or any other suitable factors.


In a third example of this variation, the aircraft has not yet reached the patient location. In a first specific example, in which the patient is possibly in urgent need of medical treatment (e.g., is bleeding rapidly, is unconscious, etc.), the aircraft can be controlled to fly toward and land near the patient quickly (e.g., as quickly as possible, practical, and/or safe). In a second specific example, in which the patient is not in urgent need of medical treatment (e.g., has broken a bone, necessitating helicopter evacuation, but is in a stable condition), the aircraft can be controlled to fly based on economic (e.g., minimizing fuel consumption) and/or safety considerations. This example can additionally or alternatively include determining the aircraft landing location based on the patient condition-related parameters. For example, if the patient condition precludes significant patient movement on the ground, a landing location can be selected to reduce (e.g., minimize) the distance between the patient and the aircraft, whereas if the patient can be safely and easily moved, a landing location farther from the patient can be selected if it is preferable based on other considerations (e.g., increased safety of landing at the location, lesser incline angle of the landing location, etc.). However, the aircraft can additionally or alternatively be controlled based on any other suitable parameters.


3.5.1 Distributed Aircraft Control.


Controlling aircraft flight S150 preferably includes aviating, navigating, and communicating. Aircraft flight control responsibilities (e.g., aviation, navigation, communication, etc.) can be performed exclusively by on-board aircraft systems, can be distributed between systems in multiple locations (e.g., on-board aircraft systems, ground station systems, other aircraft, etc.), and/or can be performed by any other suitable system(s).


Aviating functions to control the aircraft to maintain safe flight conditions, and preferably functions to follow the mission plan. Aviating preferably includes generating state data and/or controlling aircraft systems.


Navigating can function to determine the aircraft route and/or plans (e.g., heuristics) for updating the route based on new information. Navigating can include determining (and/or updating) a mission plan based on currently-available information (e.g., from aircraft sensors, external data, etc.). In a first variation, the mission plan is generated by a human operator. In a second variation, the mission plan is generated by machine learning processes (e.g., reinforcement learning, Markov and/or partially observable Markov decision processes, etc.), and can optionally be reviewed by a human operator after generation. The mission plan can be represented as a neural network, a sequence of maneuvers, a Markov control policy, and/or can have any other suitable representation.


Communicating can function to disseminate updated information to the aircraft and/or network, facilitate coordination with other parties, and/or satisfy regulatory requirements (e.g., air traffic control requirements). Communication is preferably performed via radio (e.g., audio transmission, transponder, LTE, satellite, etc.), but can additionally or alternatively be performed using any other suitable communication modules. The aircraft is preferably controlled to communicate with air traffic control and/or other aircraft (e.g., via voice communication, using ADS-B systems to observe locations and tracks of other aircraft, etc.), and can additionally or alternatively be controlled to communicate with emergency responders and/or other resources, users, ground stations (e.g., ground stations manned by human entities, by non-human entities, etc.), auxiliary data sources (e.g., weather information sources, etc.), medical treatment centers (e.g., hospitals, etc.) and/or other potential aircraft destinations (e.g., pickup and/or dropoff locations, etc.), and/or any other suitable endpoints. The aircraft can send and/or receive telemetry, mission plans (e.g., updated based on new information and/or analysis), auxiliary data, control commands, mission-related information (e.g., patient health condition), and/or any other suitable information. Aircraft communications can be performed directly between the aircraft and the communication endpoints, and/or can be relayed (e.g., through ground stations, other aircraft, etc.). In a first variation, the communications are directly relayed. In a second variation, the communications are translated and/or augmented by a relayer. For example, ground station personnel can perform voice communication with the communication endpoints (e.g., air traffic control, first responders, etc.), and can communicate with the aircraft via a computerized data transmission to transmit and receive substantive information (e.g., information related to the voice communications, such as encodings of the information communicated, data needed to respond to queries from the communication endpoints, etc.).


State data is preferably generated based on aircraft sensors (e.g., optical cameras, ultrasonic sensors, radar, lidar, temperature sensors, altimeters, accelerometers, gyroscopes, magnetometers, barometers, GPS receivers, etc.), but can additionally or alternatively be generated based on external sensors (e.g., ground station sensors, sensors of other aircraft, etc.), information received from other parties, and/or any other suitable information. State data can include aircraft position and/or orientation (and/or rates of change thereof), external observables, and/or any other suitable data types. State data can be determined based on raw sensor data, filtered and/or analyzed sensor data (e.g., using Kalman filter, classification, heuristics, etc.).


The aircraft systems are preferably controlled (e.g., by a control system) based on the state data. Aircraft systems to be controlled can include power systems (e.g., motors), control surfaces, safety systems, and/or any other suitable systems. In one example, in which the aircraft is a helicopter, the controls can include cyclic control, collective pitch control, tail rotor blade pitch control, and throttle. In a second example, in which the aircraft is an airplane, the controls can include one or more of: aileron control, elevator control, rudder control, throttle control, propeller pitch control, flap control, landing gear control, and any other suitable airplane control. In a third example, in which the method is performed using a wheeled terrestrial vehicle, the controls can include one or more of: wheel steering angle control, brake control, gas vs. electric engine operation control, throttle control, and any other suitable wheeled terrestrial vehicle control. The systems can be controlled using one or more different methods in combination or isolation, such as rule-based systems, methods from control theory such as Proportional-Integral-Derivative and Linear Quadratic Register, control policies for Markov Decision Processes or Partially Observable Markov Decision Processes, and/or any other suitable methods. The control methods can be employed using predefined parameters and/or using dynamically modified parameters (e.g., modified based on the mission profile, modified by machine learning methods, etc.). The control system may communicate with the actuators and other like devices using analog and digital methods such as Pulse Width Modulation, Serial Commands, Voltage Control, and Current Control. The aircraft systems can additionally or alternatively by controlled based on human control inputs (e.g., overriding automated control, informing motorized control of aircraft systems, directly controlling aircraft systems such as through mechanical linkages, etc.). However, the aircraft systems can be controlled in any other suitable manner.


In a specific example (e.g., as shown in FIGS. 2A-2B), aircraft flight control is distributed between a ground station network and several systems on-board the aircraft, including an aircraft flight management system, navigation system, guidance layer, and control system. In this specific example, the ground station network generates an initial mission profile and relays communications to the aircraft, and can optionally perform computations related to aircraft control (e.g., determining flight trajectories, landing locations, etc.). The navigation system consumes raw sensor data and processes them to resolve the state of the aircraft and the world, generating aircraft state data which is made available to the Aircraft Flight Management, Guidance, and Control systems. The aircraft flight management system receives the initial mission profile and relayed communications from the ground station network, receives aircraft state data from the navigation system, and determines updated mission plans based on the new information it receives. The guidance layer receives updated mission plans from the aircraft flight management system and receives aircraft state data from the navigation system, determines a series of maneuvers (e.g., high level directives such as takeoff, fly to waypoint, land, etc., which can be associated with locations and/or any other suitable information; control policy for a Markov Decision Process or Partially Observable Markov Decision Process; etc.) based on the received information, and emits commands to the control system to accomplish these maneuvers, based on the current state values. The control system generates control signals based on the commands received from the guidance layer and state data received from the navigation system, and transmits the control signals to the actuators in order to actuate the aircraft control systems.


3.5.2 Landing the Aircraft.


Controlling aircraft flight S150 preferably includes controlling the aircraft to land (e.g., as shown in FIGS. 4A-4B). The aircraft can be controlled to land in response to reaching a landing waypoint (e.g., pickup and/or drop-off location, ground station, etc.), in response to off-nominal flight conditions, in response to receipt of a directive to land, in response to any other suitable trigger, and/or at any other suitable time. Controlling the aircraft to land can include determining that a landing is safe, outputting a landing warning, and performing the landing.


A landing is preferably determined to be safe in an autonomous manner. A human (e.g., on-board personnel, ground station personnel, observer near a landing location, etc.) can additionally or alternatively authorize and/or abort the landing (e.g., determine the landing is safe or not safe). Landing safety can be determined based on sensor measurements (e.g., on-board aircraft sensors, landing site sensors, etc.), visual inspection, and/or any other suitable information. Landing safety can be determined based on landing location status (e.g., terrain, damage, obstructions, etc.), aircraft status, environmental status (e.g., visibility, air density, etc.), and/or any other suitable factors. In some variations, a threshold for landing safety determination (e.g., safety threshold value to be exceeded in order to determine that a landing is safe) can be dynamically adjusted based on other factors (e.g., mission urgency, landing urgency, alternative landing options, aircraft status, etc.). For example, a safety threshold for an urgent mission landing can be lower than for a non-emergent mission, but higher than for an emergency landing during aircraft system failure. If the landing is determined to not be safe, the aircraft can wait for the landing to become safe (e.g., hover near the landing location until obstacles on the platform are cleared) and/or proceed to an alternative landing location (e.g., based on instructions from the ground station network).


A landing warning is preferably output throughout the landing process (e.g., during landing safety determination and/or landing performance), but can additionally or alternatively be output at any other suitable time. The landing warning can include visual warnings (e.g., flashing lights, projection onto ground indicating the landing location, etc.), audible warnings (e.g., spoken warnings, klaxons, etc.), and/or any other suitable warnings. The warnings can be output by output modules of the aircraft, output modules of the landing location, and/or any other suitable output modules.


The landing is preferably performed in response to determining the landing is safe and concurrent with outputting the landing warning, but can additionally or alternatively be performed at any other suitable time. The landing can be performed by controlling aircraft flight autonomously (e.g., as described above) and/or in any other suitable manner.


In a first variation, in which the aircraft lands at a dedicated landing location (e.g., ground station; example shown in FIG. 3), sensors of both the aircraft and the landing location can be used to determine landing safety, and output modules of both the aircraft and the landing location can be used to output the landing warning. In a second variation, the aircraft lands at a location that is not dedicated to autonomous aircraft landing (e.g., standard helipad, medical evacuation site, emergency landing site, etc.). In this variation, the aircraft can act alone to determine landing safety and output landing warnings. However, controlling the aircraft to land can include any other suitable elements, and aircraft flight can be controlled in any other suitable manner.


3.6 Performing a Service at a Waypoint.


Performing a service at a waypoint S160 can function to satisfy mission requirements. The service is preferably performed in response to aircraft arrival at the waypoint (e.g., upon landing at the waypoint, upon establishing a hovering position above the waypoint, etc.), but can additionally or alternatively be performed at any other suitable time. Performing the service can include cargo and/or passenger loading and/or unloading (e.g., allowing passengers to embark/disembark, loading and securing a patient for transport to a hospital, etc.), performing medical treatment (e.g., stabilizing a patient, etc.), performing surveillance, releasing a fire extinguishing agent, and/or performing any other suitable services.


In a first variation, the aircraft lands before performing the service (e.g., and subsequently takes off after performing the service), which can enable easy ingress and/or egress. In a second variation, the aircraft does not land (e.g., hovers above the waypoint). In a first example of this variation, on-board personnel (e.g., medical personnel) can exit the aircraft while it hovers (e.g., using a rope, hoist, parachute, etc.). In this example, after exiting the aircraft, the personnel can perform the service on the ground (e.g., perform medical treatment) and/or can retrieve an injured person on the ground (e.g., wherein the injured person and/or medical personnel are subsequently hoisted into the aircraft). However, the service can be performed in any other suitable manner.


After performing the service, the aircraft can continue to perform the mission (e.g., continue to the next waypoint), can be dispatched for a new mission, can return to a ground station (e.g., its original the ground station), can remain at its current location, can repeat any or all elements of the method, and/or can perform any other suitable actions.


3.7 Specific Example.


In a specific example of the method, the ground station network (GSN) learns of an incident from an emergency dispatcher (e.g., emergency medical dispatcher, 911 dispatcher) and/or through direct contact with a bystander. The GSN chooses the appropriate vehicle, given parameters such as the distance from the incident, equipment on site, current weather conditions, obstacles on the way and other safety considerations. A formal risk assessment is conducted as well, ensuring that the proposed mission complies with laws, regulations, and policies of Federal, State, and Local government and other relevant entities. The mission is then generated and uploaded to the dispatched vehicle, and the first responders at the dispatch site are informed of their mission.


The motor starts spinning as soon as the mission is uploaded, to allow it to heat up. Before takeoff, final visual inspection is conducted (e.g., via cameras and/or other sensors on site, by personnel on site, etc.), and additional pre-flight checks can additionally or alternatively be performed (e.g., via sensors of the aircraft, external sensors, personnel on site, etc.). The GSN informs air traffic control of the critical rescue mission and continues sending updates. The vehicle takes off and starts to perform the mission. Warning signals (e.g., blinking lights, sirens, landing zone projection, etc.) can be activated at the dedicated landing location in order to warn people in the vicinity and clear the landing area.


While the vehicle is in the air, the GSN is informed by 911 dispatch about updates on the patient condition. This information is communicated to the first responder on board of the vehicle. Upon vehicle arrival near the landing location, the GSN, Aircraft Flight Management System, and the first responder on board the vehicle observe the landing location via appropriate sensors. In case of any unexpected disturbances, the landing can be halted or aborted and an alternative landing spot chosen.


Once the vehicle has landed, the first responder exits the aircraft and begins treating the patient. After the patient has been treated, the first responder returns to the vehicle, a return-to-base mission is created, similarly to the mission explained above. If the return mission is not considered critical (e.g., if the vehicle is not performing an EMS mission), more communication between GSN and air traffic control can be necessary (e.g., in order to re-route the vehicle as instructed). Communications from air traffic control (e.g., instructions, advisories, requests, etc.) are consumed by the GSN, which can modify and update the mission accordingly, preferably transmitting the updates to the vehicle. Additionally or alternatively, communications from air traffic control can be consumed by the vehicle itself (e.g., should the need arise, such as due to a communication failure between the vehicle and the GSN).


The vehicle reaches home and lands. Required and/or desired reports and/or logs (e.g., Patient Care Reports, etc.) are automatically generated (e.g., based on the mission plan and/or vehicle status during the mission), and are preferably verified by the first responder and/or the GSN (e.g., before submission). Critical data (e.g., location, time of arrival, etc.) can be automatically obtained using various sensors (e.g., vehicle sensors, such as sensors on top of the vehicle). The vehicle can be refueled and restocked (e.g., to be readied for a subsequent mission) autonomously and/or manually. Post-flight inspections can optionally be performed (e.g., as described above regarding pre-flight visual inspection and/or other checks). However, the method can be performed in any suitable manner.


Although omitted for conciseness, the preferred embodiments include every combination and permutation of the various system components and the various method processes. Furthermore, various processes of the preferred method can be embodied and/or implemented at least in part as a machine configured to receive a computer-readable medium storing computer-readable instructions. The instructions are preferably executed by computer-executable components preferably integrated with the system. The computer-readable medium can be stored on any suitable computer readable media such as RAMs, ROMs, flash memory, EEPROMs, optical devices (CD or DVD), hard drives, floppy drives, or any suitable device. The computer-executable component is preferably a general or application specific processing subsystem, but any suitable dedicated hardware device or hardware/firmware combination device can additionally or alternatively execute the instructions.


The FIGURES illustrate the architecture, functionality and operation of possible implementations of systems, methods and computer program products according to preferred embodiments, example configurations, and variations thereof. In this regard, each block in the flowchart or block diagrams may represent a module, segment, step, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block can occur out of the order noted in the FIGURES. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.


As a person skilled in the art will recognize from the previous detailed description and from the figures and claims, modifications and changes can be made to the preferred embodiments of the invention without departing from the scope of this invention defined in the following claims.

Claims
  • 1. A method for providing services to a user, comprising: receiving a service request associated with a user location;selecting a vehicle, located at an initial location, from a plurality of vehicles based on the user location and the initial location;determining a first operation plan for controlling the vehicle to move to a region containing the user location;controlling the vehicle to move to the region, comprising: at a sensor of the vehicle, sampling a first set of operation data; andat a processor of the vehicle, autonomously controlling the vehicle to move to the region based on the first operation plan and the first set of operation data;selecting a waypoint stopping location within the region;stopping the vehicle at the waypoint stopping location, comprising: sampling a set of waypoint stopping location data;determining a safety status of the waypoint stopping location based on the set of waypoint stopping location data;in response to determining the safety status, at the processor, at least one of autonomously controlling the vehicle and receiving control inputs that direct the vehicle to stop at the waypoint stopping location;at the vehicle, receiving the user;determining a second operation plan for controlling the vehicle to move from the region to a destination; andat the vehicle, transporting the user to the destination, comprising: at the sensor, sampling a second set of operation data; andat the processor, autonomously controlling the vehicle to move to the destination based on the second operation plan and the second set of operation data, wherein the vehicle contains the user during movement.
  • 2. The method of claim 1, wherein selecting the vehicle comprises: sampling a set of vehicle inspection data by a set of inspection sensors of the initial location; andbased on the set of vehicle inspection data, determining that the vehicle is safe for operation.
  • 3. The method of claim 2, wherein: the set of inspection sensors comprises: a camera, an active sonar system, and a thermal sensor;sampling the set of vehicle inspection data comprises: at the camera, capturing a photograph of the vehicle;at the active sonar system, sampling a set of sonar data indicative of a mechanical state of the vehicle; andat the thermal sensor, sampling a set of thermal data indicative of a thermal state of the vehicle; anddetermining that the vehicle is safe for operation comprises: determining that the mechanical state is safe based on the photograph and the sonar data; anddetermining that the thermal state is safe based on the thermal data.
  • 4. The method of claim 2, further comprising: before selecting the vehicle, receiving a second service request;based on the set of vehicle inspection data, determining that the vehicle is fit to provide services associated with the service request and unfit to provide services associated with the second service request; andbased on the determination that the vehicle is unfit to provide services associated with the second service request, selecting a second vehicle from the plurality to provide services associated with the second service request; wherein the vehicle is selected based further on the determination that the vehicle is unfit to provide services associated with the second service request.
  • 5. The method of claim 1, further comprising, before selecting the waypoint stopping location within the region: selecting a candidate stopping location within the region, the candidate stopping location different from the waypoint stopping location;sampling a set of candidate stopping location data; anddetermining, based on the set of candidate stopping location data, that the candidate stopping location is not acceptable for stopping; wherein the waypoint stopping location is selected in response to determining that the candidate stopping location is not acceptable for stopping.
  • 6. The method of claim 1, further comprising automatically inspecting systems of the vehicle after completion of at least one of: the first operation plan and the second operation plan.
  • 7. The method of claim 1, further comprising transmitting vehicle operation data and personnel data from the vehicle during execution of at least one of: the first operation plan and the second operation plan.
  • 8. The method of claim 1, wherein: the vehicle comprises an aircraft;controlling the vehicle to move comprises controlling the aircraft to fly; andautonomously controlling the vehicle to stop at the waypoint stopping location comprises autonomously controlling the aircraft to land at the waypoint stopping location.
  • 9. The method of claim 1, wherein the service request is associated with at least one of a search and rescue operation, surveillance, a fire response service, a rescue operation, and an emergency first responder service.
  • 10. The method of claim 1, further comprising automatically generating a declaration of a status report associated with operation of the vehicle.
  • 11. The method of claim 10, further comprising automatically submitting the status report to a controlling agency.
  • 12. A method for providing services to a user, comprising: receiving a service request associated with a user location;selecting a vehicle, located at an initial location, from a plurality of vehicles based on the user location and the initial location;determining an operation plan for controlling the vehicle to move to a region containing the user location;at the vehicle, transporting a service provider to the region, comprising: at a sensor of the vehicle, sampling a first set of operation data; andat a processor of the vehicle, controlling the vehicle to move based on the operation plan and the first set of operation data, wherein the vehicle contains the service provider during movement;selecting a stopping location within the region; andstopping the vehicle at the stopping location, comprising: sampling a set of stopping location data;determining a safety status of the stopping location based on the set of stopping location data;at the sensor, sampling a second set of operation data; andin response to determining the safety status, at least one of autonomously controlling the vehicle and receiving control inputs that direct the vehicle to stop at the stopping location based on the second set of operation data.
  • 13. The method of claim 12, wherein determining the safety status of the stopping location is further based on a stopping approval input received from the service provider.
  • 14. The method of claim 12, wherein the service request comprises an emergency service request received from an emergency dispatcher.
  • 15. The method of claim 14, wherein the service request comprises a response deadline, wherein selecting the vehicle comprises determining that the vehicle is capable of stopping within the region before the response deadline.
  • 16. The method of claim 12, wherein transporting the service provider to the region further comprises: while controlling the vehicle to move, receiving weather information via a wireless communication module of the vehicle, the weather information indicative of an unfavorable weather condition in an area, wherein a planned route of the operation plan intersects the area;based on the weather information and the operation plan, determining a modified operation plan comprising a modified route, wherein the modified route does not intersect the area;at the sensor, sampling a third set of operation data; andat the processor, controlling the vehicle to move based on the modified operation plan and the third set of operation data, wherein the vehicle contains the service provider during movement.
  • 17. The method of claim 12, wherein: the vehicle comprises an aircraft;controlling the vehicle to move comprises controlling the aircraft to fly; andautonomously controlling the vehicle to stop at the stopping location comprises autonomously controlling the aircraft to land at the stopping location.
  • 18. The method of claim 17, wherein the aircraft does not contain a licensed pilot during flight and does not receive direct inputs from a licensed pilot during flight.
  • 19. The method of claim 17, wherein stopping the vehicle at the stopping location further comprises outputting a landing warning observable at the stopping location.
  • 20. The method of claim 19, wherein the landing warning comprises a visual warning projected onto the stopping location and an auditory warning emitted by the vehicle.
  • 21. The method of claim 17, further comprising, after stopping the vehicle at the stopping location: based on the service request, automatically performing a service for the user with onboard equipment;determining a second operation plan for flying the aircraft from the stopping location to an aircraft base; andautonomously controlling the aircraft to fly based on the second operation plan.
  • 22. The method of claim 21, further comprising: sampling a set of aircraft base data by a base sensor of the aircraft base;determining a base safety status of the aircraft base based on the set of aircraft base data;at the sensor, sampling a third set of operation data; andin response to determining the base safety status, autonomously controlling the aircraft to land at the aircraft base based on the third set of operation data.
  • 23. The method of claim 21, wherein the aircraft base comprises the initial location.
  • 24. The method of claim 12, wherein the service request is associated with at least one of a search and rescue operation, surveillance, a fire response service, a rescue operation, and an emergency first responder service.
  • 25. The method of claim 12, further comprising automatically generating a declaration of a status report associated with operation of the vehicle.
  • 26. The method of claim 25, further comprising automatically submitting the status report to a controlling agency.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 15/643,205, filed on 6 Jul. 2017, which claims the benefit of U.S. Provisional Application Ser. No. 62/452,051, filed on 30 Jan. 2017, and U.S. Provisional Application Ser. No. 62/469,419, filed on 9 Mar. 2017, all of which are incorporated in their entirety by this reference.

US Referenced Citations (65)
Number Name Date Kind
3455182 Kelley Jul 1969 A
3747877 Drew Jul 1973 A
3995793 Wing Dec 1976 A
4500966 Zagranski et al. Feb 1985 A
4676457 Allen Jun 1987 A
4709881 Rafikian et al. Dec 1987 A
4957121 Icenogle et al. Sep 1990 A
5493309 Bjornholt Feb 1996 A
6739556 Langston May 2004 B1
6776373 Talmage, Jr. Aug 2004 B1
7032860 Kirk et al. Apr 2006 B1
7059570 Strong Jun 2006 B2
7143973 Ballew Dec 2006 B2
7377468 Saggio, III et al. May 2008 B2
7458544 Sarigul-Klijn et al. Dec 2008 B1
7487939 Christof Feb 2009 B1
7523892 Cook Apr 2009 B2
8018079 Kelly Sep 2011 B2
8033507 Fox, Jr. Oct 2011 B2
8399816 Glasson Mar 2013 B2
8453962 Shaw Jun 2013 B2
8521340 Coulmeau Aug 2013 B2
8868258 Papadopoulos et al. Oct 2014 B2
8948935 Peeters et al. Feb 2015 B1
8979031 Fox, Jr. Mar 2015 B2
8979032 Hester, Jr. et al. Mar 2015 B1
9158304 Fleck Oct 2015 B2
9199742 Giannakopoulos Dec 2015 B2
9257048 Offer et al. Feb 2016 B1
9308970 Gefken et al. Apr 2016 B1
9319913 Raleigh Apr 2016 B2
9645582 Shue May 2017 B2
9786187 Bar-Zeev et al. Oct 2017 B1
9849044 Groden Dec 2017 B1
9868526 Yates Jan 2018 B2
20030094537 Austen-Brown May 2003 A1
20050087652 Holmboe Apr 2005 A1
20050139363 Thomas Jun 2005 A1
20050230529 Towne Oct 2005 A1
20060032984 Preston Feb 2006 A1
20060106506 Nichols et al. May 2006 A1
20070055434 Kohlmann Mar 2007 A1
20070164167 Bachelder et al. Jul 2007 A1
20080167763 Duranti et al. Jul 2008 A1
20110009053 Anglin, Jr. et al. Jan 2011 A1
20110264312 Spinelli et al. Oct 2011 A1
20130221153 Worsham et al. Aug 2013 A1
20140129951 Amin et al. May 2014 A1
20140140871 Grieser May 2014 A1
20140343765 Suiter et al. Nov 2014 A1
20150203200 Bye et al. Jul 2015 A1
20150323931 Downey et al. Nov 2015 A1
20160052626 Vander Mey Feb 2016 A1
20160055754 Ling et al. Feb 2016 A1
20160240091 Thiele et al. Aug 2016 A1
20160274577 Heinonen Sep 2016 A1
20160318615 Pick Nov 2016 A1
20160357192 McGrew et al. Dec 2016 A1
20160378121 Shue Dec 2016 A1
20170003681 Ross et al. Jan 2017 A1
20170274994 Eller et al. Sep 2017 A1
20170369160 White et al. Dec 2017 A1
20180065738 Lappos et al. Mar 2018 A1
20180129226 Rogers et al. May 2018 A1
20180214324 Groden et al. Aug 2018 A1
Foreign Referenced Citations (2)
Number Date Country
3003844 Oct 2014 FR
2017064717 Apr 2017 WO
Non-Patent Literature Citations (2)
Entry
International Search Report and Written Opinion for PCT Application No. PCT/US18/20149 dated May 16, 2018.
International Search Report and Written Opinion for International Application No. PCT/US18/19547 dated Jul. 20, 2018.
Related Publications (1)
Number Date Country
20180217596 A1 Aug 2018 US
Provisional Applications (2)
Number Date Country
62452051 Jan 2017 US
62469419 Mar 2017 US
Continuations (1)
Number Date Country
Parent 15643205 Jul 2017 US
Child 15661763 US