Patent Grant
12078495
The present application generally relates to augmenting the operation of autonomous vehicles, and more particularly relates to systems and methods for remotely monitoring and controlling a fleet of autonomous vehicles in a transportation network.
Auto companies are developing autonomous vehicles for commercial and personal use on existing roadways for a variety of applications, including but not limited to personal taxi services, delivery services, etc. In the context of the present application, autonomous vehicle refers to a vehicle equipped with an automated driving system capable of performing all aspects of dynamic driving that can be managed by a human driver. It is envisioned that networks of autonomous vehicles will be available, similar to a network of taxis, buses or delivery vans, whereby a user can request an autonomous vehicle to pick-up, transport and drop off passengers, or pick-up, transport, and deliver packages, or the like. With different companies developing autonomous vehicles, existing autonomous vehicles have certain functional limitations at this early developmental stage of the technology because of a lack of standardization. It is desirable to provide a universal/generic solution to allow a transportation network company to remotely monitor and dynamically control different autonomous vehicles in its fleet to provide optimized consistent operation, functionality, safety and quality.
The present application is directed to an Autonomous Vehicle Enhancement System (AVES) and method for autonomously monitoring and managing a fleet of registered autonomous vehicles in a transportation network and dispatching the autonomous vehicles in the fleet to registered users of the transportation network. The AVES includes an AVES Central Operations Center (COC) that is in operative communication with AVES vehicle equipment installed in each of the autonomous vehicles in the fleet and AVES applications installed on computing devices accessible by the users of the transportation network. The AVES maximizes and optimizes the overall efficiency of the operations of a transportation network by monitoring the condition of autonomous vehicles in the fleet, dynamically optimizing the preliminary distribution of the fleet of autonomous vehicles throughout the transportation network's geographic area and optimizing assignment of the autonomous vehicles in the fleet to users requesting transportation services. The AVES COC monitors and controls the autonomous vehicles in the fleet via the AVES vehicle equipment. The AVES COC communicates with the users of the transportation network via the AVES applications installed on the computing devices to provide transportation network services to the users. The AVES vehicle equipment and the AVES applications installed on the computing devices communicate with each other to fulfill user request for transportation services.
In one embodiment, an Autonomous Vehicle Enhancement System (AVES) Central Operations Center (COC) and method of operating the AVES COC for managing a fleet of registered autonomous vehicles in a transportation network and dispatching the autonomous vehicles in the fleet to registered users of the transportation network, includes a computer server in communication with AVES vehicle equipment installed on each autonomous vehicle in the fleet and with AVES applications installed on computing devices accessible by the users, the computer server comprising an Artificial Intelligence System including a knowledge base. The computer server monitors the fleet of autonomous vehicles via the AVES vehicle equipment installed on each autonomous vehicle to determine real-time vehicle location, real-time vehicle availability, real-time vehicle operational state, real-time vehicle condition and real-time vehicle fuel/power-charge level of each autonomous vehicle in the fleet. The computer server assigns autonomous vehicles in the fleet to an active pool if the autonomous vehicles are available, are in acceptable operational state, are in acceptable condition and have acceptable fuel/power-charge level (e.g., pre-defined criteria), and meet the existing assignment criteria (e.g., allowable service area), for each vehicle. The computer server receives trip requests from hailing users and the Artificial Intelligence System executes a Matchmaking Algorithm that uses the knowledge base to select autonomous vehicles from the active pool that are qualified and optimally suited to respond to the trip requests. The computer server guides the selected autonomous vehicles to the hailing users. The computer server guides autonomous vehicles in the fleet, which are not in acceptable operational state or condition, to service locations for maintenance service. The computer server guides autonomous vehicles in the fleet, which do not have acceptable fuel/power-charge level, to fueling/power-charging stations for fueling/power-charging. The computer server guides autonomous vehicles in the active pool, which are not assigned to respond to trip requests from hailing users, to dynamically allocated standby locations throughout the transportation network's geographic area.
In some embodiments of the above AVES COC and method of operating the AVES COC, the Artificial Intelligence System executes a Vehicle Distribution Optimization Algorithm that uses the knowledge base to determine the standby locations for the autonomous vehicles in the transportation network's geographic area to dynamically achieve a vehicle distribution that is optimally suited for fulfilling potential trip requests.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server receives a trip request from a hailing user via a selected AVES application on a selected computing device, the trip request including a unique user ID associated with the hailing user and trip information including pickup location, pickup date/time, destination location, and any intermediate stop location(s).
In some embodiments of the above AVES COC and method of operating the AVES COC, the Artificial Intelligence System executes a Route Determining Algorithm by using the trip information for the trip request and knowledge base to determine a trip route that is optimally suited for fulfilling the trip request, and the Artificial Intelligence System executes a Matchmaking Algorithm that uses the trip route and knowledge base to select an autonomous vehicle from the active pool that is optimally suited to fulfill the trip request.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server generates a unique trip ID for the trip request, and associates the user ID for the hailing user and the vehicle ID for the selected autonomous vehicle with the unique trip ID.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server sends the trip information and/or trip route to the AVES vehicle equipment of the selected autonomous vehicle to guide the selected autonomous vehicle to the pickup location at the pickup time.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server stores a vehicle profile for each registered autonomous vehicle in the fleet, the vehicle profile including a unique vehicle ID, vehicle owner specified restriction(s), vehicle description information and billing or payment account.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server stores a user profile for each registered user of the transportation network, the user profile including a unique user ID, user preference(s), and billing or payment account.
In some embodiments of the above AVES COC and method of operating the AVES COC, the knowledge base includes: user preference(s) for each registered user of the transportation network; historical information regarding trip requests, real-time information regarding trip requests, and information regarding scheduled events in the transportation network's geographic area; and real-time vehicle location data, real-time vehicle availability data, real-time vehicle operational state data, real-time vehicle condition data, real-time vehicle fuel/power-charge level indication, vehicle owner specified restriction(s) and vehicle description for each of the autonomous vehicles in the fleet.
In some embodiments of the above AVES COC and method of operating the AVES COC, the Vehicle Distribution Optimization Algorithm uses from the knowledge base, at least one of real-time vehicle location data for the autonomous vehicles in the active pool, historical information regarding trip requests, real-time information regarding trip requests and information regarding scheduled events in the transportation network's geographic area, to determine the standby locations for the autonomous vehicles in the transportation network's geographic area.
In some embodiments of the above AVES COC and method of operating the AVES COC, the Route Determining Algorithm uses from the knowledge base, at least one of historical traffic conditions, real-time traffic conditions, scheduled road closures, scheduled events and scheduled construction, to determine the trip route that is optimally suited for fulfilling the trip request.
In some embodiments of the above AVES COC and method of operating the AVES COC, the Matchmaking Algorithm uses from the knowledge base, at least one of real-time vehicle location, real-time vehicle availability, real-time vehicle operational state, real-time vehicle condition, real-time vehicle fuel/power-charge level, vehicle owner specified restriction(s), vehicle description and user preference(s), to select the autonomous vehicle from the active pool that is optimally suited to fulfill the trip request.
In some embodiments of the above AVES COC and method of operating the AVES COC, the real-time information regarding trip requests and information regarding scheduled events in the transportation network's geographic area are received by the computer server from public messaging systems and/or the AVES vehicle equipment installed on the autonomous vehicles in the fleet.
In some embodiments of the above AVES COC and method of operating the AVES COC, the real-time vehicle availability of each autonomous vehicle in the fleet includes information regarding whether the autonomous vehicle is in the active pool, has been assigned to respond a trip request from a hailing user, is waiting or en route to pickup a hailing user for an assigned trip request, has picked up a hailing user for an assigned trip request or has dropped of a hailing user after completion of an assigned trip request.
In some embodiments of the above AVES COC and method of operating the AVES COC, the real-time vehicle operational state of each autonomous vehicle in the fleet includes information regarding the operational state of the mechanical and electrical systems of the autonomous vehicle, and the real-time vehicle condition of each autonomous vehicle in the fleet includes information regarding state of cleanliness of the autonomous vehicle.
In some embodiments of the above AVES COC and method of operating the AVES COC, the real-time vehicle fuel/power-charge level of each autonomous vehicle in the fleet includes information regarding at least one of a vehicle travel distance range, a percentage of fuel tank or electrical battery capacity available and units of available power or energy.
In some embodiments of the above AVES COC and method of operating the AVES COC, if, before a scheduled pickup date/time for the trip request is completed, the Matchmaking Algorithm determines that a newly available autonomous vehicle is better suited for fulfilling the trip request than the previously selected autonomous vehicle, the Artificial Intelligence System selects the newly available autonomous vehicle to fulfill the trip request in lieu of the previously selected vehicle, and changes the availability status of the substituted vehicle to “available”.
In some embodiments of the above AVES COC and method of operating the AVES COC, if the trip request exceeds an operational range of any available autonomous vehicle in the fleet, the computer server implements multi-hop routing to select and coordinate two or more autonomous vehicles to fulfill the trip request.
In some embodiments of the above AVES COC and method of operating the AVES COC, if the trip request exceeds a passenger capacity of any available autonomous vehicle in the fleet, the computer server implements simultaneous multi-vehicle routing to select and coordinate two or more autonomous vehicles to fulfill the entirety or full capacity of the trip request.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server selects and unilaterally and automatically assigns the autonomous vehicle to fulfill the trip request.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server generates a trip PIN corresponding to the unique trip ID for the trip request, and the computer server sends the unique trip ID and corresponding trip PIN to the AVES vehicle equipment of the selected autonomous vehicle and to the selected AVES application on the selected computing device of the hailing user.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server stores a picture and/or vehicle description for each autonomous vehicle in the fleet, and the computer server sends the vehicle description for the selected autonomous vehicle to the selected AVES application on the selected computing device of the hailing user.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server receives a modification request from the hailing user, via the AVES vehicle equipment installed on the selected autonomous vehicle and/or the selected AVES application on a selected computing device, to alter the trip information; the computer server determines whether the selected autonomous vehicle is capable of fulfilling the modification request and determines an altered trip route; if the selected autonomous vehicle is capable of fulfilling the modification request, the computer sever confirms that the user accepts the altered trip route via the AVES vehicle equipment installed on the selected autonomous vehicle and guides the selected autonomous vehicle according to the altered trip route; and if the selected autonomous vehicle is not capable of fulfilling the modification request, the computer server selects an alternative autonomous vehicle for fulfilling the modification request, confirms that the user accepts the alternative autonomous vehicle via the AVES vehicle equipment installed on the selected autonomous vehicle and implements multi-hop routing to coordinate the selected autonomous vehicle and the alternative autonomous vehicle to fulfill the trip request according to the altered trip route.
In some embodiments of the above AVES COC and method of operating the AVES COC, the computer server receives a user emergency alert via the AVES vehicle equipment installed on the selected autonomous vehicle and/or the selected AVES application on a selected computing device, and the computer server reroutes the autonomous vehicle to a hospital, police station or fire station, and/or calls for emergency response service.
The foregoing summary, as well as the following detailed description, is better understood when read in conjunction with the appended drawings. For the purpose of illustrating the invention, exemplary embodiments are shown in the drawings, it being understood, however, that the present application is not limited to the specific embodiments disclosed. In the drawings:
Before the various exemplary embodiments are described in further detail, it is to be understood that the present invention is not limited to the particular embodiments described. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only, and is not intended to limit the scope of the claims of the present invention.
In the drawings, like reference numerals refer to like features of the systems and methods of the present invention. Accordingly, although certain descriptions may refer only to certain figures and reference numerals, it should be understood that such descriptions might be equally applicable to like reference numerals in other figures.
The present invention is directed to Autonomous Vehicle Enhancement System (AVES) 10 for monitoring and controlling a fleet of autonomous vehicles 20 throughout a geographic area of a transportation network and providing transportation services to users in the transportation network. AVES 10 allows autonomous vehicles 20 in the transportation network to be remotely monitored and controlled so that the autonomous vehicles 20 can be efficiently managed to provide transportation services to users in the transportation network without the need for human operational involvement. In accordance with particular embodiments of the present invention, the fleet of autonomous vehicles 20 can comprise a commonly-owned fleet of vehicles, or may also include individually-owned vehicles that are part of the available fleet at the owner's discretion, much like current taxi services and fleets.
As shown in
AVES COC 100 communicates with AVES vehicle equipment 200 installed on each autonomous vehicle 20 to monitor and control autonomous vehicles 20 in the fleet. AVES COC 100 communicates with AVES vehicle equipment 200 via communication links that are established by means of suitable communication protocols (e.g., BLUETOOTH®, WI-FI®, ZIGBEE®, Ethernet, SAP®, SAS®, ATP, GSM, TCP/IP, etc.) and are, at least in part, established wirelessly. AVES COC 100 receives vehicle information from AVES vehicle equipment 200 installed on each autonomous vehicle, including a unique vehicle ID 402, real-time vehicle location 404 (e.g., GPS coordinates), real-time vehicle availability 406, real-time vehicle operational state 408, real-time vehicle condition 410 and real-time vehicle fuel/power-charge level 412. Real-time vehicle availability 406 may include information regarding whether the autonomous vehicle 20 has picked up a hailing user for an assigned trip request or has dropped of a hailing user after completion of an assigned trip request. Alternatively, an autonomous vehicle 20 may be “off duty” and therefore not available for trip requests until back on-line, for example, if a particular vehicle 20 is an individually-owned vehicle that is temporarily added to the fleet at the owner's discretion. Real-time vehicle operational state 408 may include information regarding the operational state of the mechanical and electrical systems of the autonomous vehicle 20. Real-time vehicle condition 410 may include information regarding state of cleanliness of the autonomous vehicle 20. Real-time vehicle fuel/power-charge level 412 may include information regarding at least one of a vehicle travel distance range, a percentage of fuel tank or electrical battery capacity available and units of available power or energy. AVES COC 100 uses the vehicle information received from AVES vehicle equipment 200 to monitor the fleet of autonomous vehicles 20 via the AVES vehicle equipment 200 installed on each autonomous vehicle 20 to determine the availability of autonomous vehicles 20 in the fleet and to assign available autonomous vehicles 20 in the fleet to an active pool of autonomous vehicles 20 that are ready for dispatch.
AVES COC 100 communicates with AVES applications 300 installed on computing devices 30 to receive service requests (e.g., trip requests) from users. AVES COC 100 communicates with AVES application 300 via communication links that are established by means of suitable communication protocols (e.g., BLUETOOTH®, WI-FI®, ZIGBEE®, Ethernet, SAP®, SAS®, ATP, GSM, TCP/IP, etc.) and are, at least in part, established wirelessly. AVES COC 100 receives trip requests from hailing users via AVES applications 300 installed on computing devices 30. AVES COC 100 receives from AVES applications 300 installed on computing devices 30 a unique user ID 502 associated with each user trip request 504 and trip information 506 associated with each user trip request 504. Trip information 506 may include pickup location, pickup date/time, destination location and intermediate stop location(s).
In response to a user trip request 504, AVES COC 100 selects an autonomous vehicle 20 from the active pool to respond to the trip request 504. For each user trip request 504, AVES COC 100 generates a unique trip ID 602 and corresponding unique trip PIN 604, and determines a trip route 606 based on trip information 506. Trip route 606 includes information about the expected mileage and duration of the trip. AVES COC 100 selects an autonomous vehicle 20 from the active pool that is optimally capable of fulfilling the trip request according to determined trip route 606. Once AVES COC 100 selects an autonomous vehicle 20 to fulfill trip request 504, AVES COC 100 sends vehicle assignment information to the hailing user via AVES application 300, including trip ID 602, trip PIN 604, trip route 606, and vehicle ID 402 and vehicle description 414 for the autonomous vehicle 20 assigned to fulfill trip request 504.
AVES COC 100 communicates with AVES vehicle equipment 200 installed on a selected autonomous vehicle 20 to guide said selected autonomous vehicle 20 to the hailing user. AVES COC 100 sends trip assignment information to AVES vehicle equipment 200 installed on the selected autonomous vehicle 20, including trip ID 602, trip PIN 604, trip route 606 and/or trip information 506, for the selected autonomous vehicle 20 to fulfill trip request 504. Also, AVES COC 100 communicates with AVES vehicle equipment 200 on autonomous vehicles 20 in the active pool, which are not assigned to respond to trip requests from hailing users, to guide autonomous vehicle 20 to standby locations throughout the transportation network's geographic area.
As shown in
The functions of computer server 120 described herein may be implemented using computer applications comprising computer program code stored in a non-transitory computer-readable medium that is executed by a computer processor. The functions of computer server 120 described herein may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like. Further, functions of computer server 120 described herein may be implemented using some combination of computer program(s) executed by a computer processor and programmable hardware devices. Thus, computer server 120 of the present application comprises suitable computer hardware and software for performing the desired functions and are not limited to any specific combination of hardware and software.
The executable computer program code may comprise one or more physical or logical blocks of computer instructions, which may be organized as an object, procedure, process or function. For example, the executable computer program code may be distributed over several different code partitions or segments, among different programs, and across several devices. Accordingly, the executable computer program need not be physically located together, but may comprise separate instructions stored in different locations which, when joined logically together, comprise the computer application and achieve the stated purpose for the computer application.
As shown in
The functions of AVES vehicle control system 210 described herein may be implemented using computer applications comprising computer program code stored in a non-transitory computer-readable medium that is executed by a computer processor. The functions of AVES vehicle control system 210 described herein may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like. Further, functions of AVES vehicle control system 210 described herein may be implemented using some combination of computer program(s) executed by a computer processor and programmable hardware devices. Thus, AVES vehicle control system 210 of the present application comprises suitable computer hardware and software for performing the desired functions and are not limited to any specific combination of hardware and software.
AVES vehicle control system 210 on each autonomous vehicle 20 communicates with computer server 120 to send the necessary data for AVES COC 100 to monitor the fleet of autonomous vehicles 20. AVES vehicle control system 210 installed on each autonomous vehicle 20 sends computer server 120 vehicle information, including unique vehicle ID 402, real-time vehicle location 404 (e.g., GPS coordinates), real-time vehicle availability 406, real-time vehicle operational state 408, real-time vehicle condition 410 and real-time vehicle fuel/power-charge level 412. Real-time vehicle availability 406 may include information regarding whether the autonomous vehicle 20 has picked up a hailing user for an assigned trip request or has dropped off a hailing user after completion of an assigned trip request. Real-time vehicle availability 406 may be established using at least one of user input to IVR System 220, user input to interactive touchscreen 230, images from cameras 260 and signals from sensors 270 to determine whether a user has entered or exited autonomous vehicle 20. Real-time vehicle operational state 408 may include information regarding the operational state of the mechanical and electrical systems of the autonomous vehicle. Real-time vehicle operational state 408 may be established using the connection of AVES vehicle control system 210 to the autonomous driving system (e.g., CAN bus) of the autonomous vehicle 20. Real-time vehicle condition 410 may include information regarding state of cleanliness of the autonomous vehicle 20. Real-time vehicle condition 410 may be established using at least one of user input to IVR System 220, user input to interactive touchscreen 230, images from cameras 260 and signals from sensors 270 to determine whether the autonomous vehicle 20 is soiled, littered, or in disrepair. Real-time vehicle fuel/power-charge level 412 may include information regarding at least one of a vehicle travel distance range, a percentage of fuel tank or electrical battery capacity available and units of available power or energy. Real-time vehicle fuel/power-charge level 412 may be established using the connection of AVES vehicle control system 210 to the autonomous driving system (e.g., CAN bus) of the autonomous vehicle 20.
Also, AVES vehicle control system 210 installed on selected autonomous vehicle 20 communicates with computer server 120 to receive the necessary data for guiding selected autonomous vehicle 20 to the hailing user. AVES vehicle control system 210 installed on selected autonomous vehicle 20 receives trip assignment information from computer server 120, including trip ID 602, trip PIN 604, trip route 606 and/or trip information 506, for the selected autonomous vehicle 20 to fulfill trip request 504. Further, AVES vehicle control system 210 installed on autonomous vehicles 20 in the active pool, which are not assigned to respond to trip requests from hailing users, communicate with computer server 120 to receive the necessary data for guiding autonomous vehicle 20 to standby locations throughout the transportation network's geographic area.
A user may access the transportation network services via an AVES application 300 installed on a computing device 30 that is in communication with AVES COC 100. AVES application 300 communicates with AVES COC 100 via communication links that are established by means of suitable communication protocols (e.g., BLUETOOTH®, WI-FI®, ZIGBEE®, Ethernet, SAP®, SAS®, ATP, GSM, TCP/IP, etc.) and are, at least in part, established wirelessly. AVES application 300 is embodied in a set of computer executable instructions stored in a non-transitory computer-readable medium, which are executed by a processor of the computing device 30 to provide the user access to AVES COC 100 to request transportation network services. Computing device 30 may be any suitable device (e.g., PC, laptop, tablet, smartphone, etc.) for executing AVES application 300 to perform the functions described hereafter, and is preferably, a mobile computing device (e.g., tablet, smartphone, etc.). Alternatively, a trip may be requested via other methods, such as via telephone or Application Programming Interface (API), or even in person at a kiosk with an API. For instance, AVES COC may be configured to dynamically select and assign autonomous vehicle(s) 20 to fulfill trip request(s) 504 generated by an API or other system that has been previously registered and approved to authorize such trip request(s) 504.
AVES application 300 installed on computing device 30 communicates with computer server 120 to send trip request 504 and receive vehicle assignment information for trip request 504. AVES application 300 installed on a computing device 30 sends computer server 120 a unique user ID 502 associated with user trip request 504 and trip information 506 associated with user trip request 504. Trip information 506 may include pickup location, pickup date/time, destination location and intermediate stop location(s). Once computer server 120 selects an autonomous vehicle 20 to fulfill trip request 504, AVES application 300 installed on computing device 30 receives vehicle assignment information from computer server 120, including trip ID 602, trip PIN 604, trip route 606, and vehicle ID 402 and vehicle description 414 for the autonomous vehicle 20 assigned to fulfill trip request 504.
Computer server 120 of AVES COC 100 maintains the necessary data monitoring and managing a fleet of autonomous vehicles 20 in the transportation network and dispatching autonomous vehicles 20 to users of the transportation network. Computer server 120 stores and maintains vehicle records 400 for each of the autonomous vehicles 20 registered in the transportation network, user records 500 for each of the users 30 registered in the transportation network and trip records 600 for each trip performed by the transportation network.
Each autonomous vehicle 20 has a corresponding vehicle record 400 maintained in computer server 120, which may include a unique vehicle ID 402, real-time vehicle location 404 (e.g., GPS coordinates), real-time vehicle availability 406, real-time vehicle operational state 408, real-time vehicle condition 410, real-time vehicle fuel/power-charge level 412, vehicle description 414, vehicle owner specified restriction(s) 416 and vehicle billing or payment account 418. Real-time vehicle availability 406 may include information regarding whether the autonomous vehicle 20 is in the active pool, has been assigned to respond a trip request from a hailing user, is waiting or en route to pickup a hailing user for an assigned trip request, has picked up a hailing user for an assigned trip request or has dropped of a hailing user after completion of an assigned trip request. Real-time vehicle operational state 408 may include information regarding the operational state of the mechanical and electrical systems of the autonomous vehicle 20. Real-time vehicle condition 410 may include information regarding state of cleanliness of the autonomous vehicle 20. Real-time vehicle fuel/power-charge level 412 may include information regarding at least one of a vehicle travel distance range, a percentage of fuel tank or electrical battery capacity available and units of available power or energy. Vehicle description 414 may include a general vehicle description (e.g., type, make, model, year, etc.), vehicle photograph, passenger capacity, vehicle travel range, state DMV vehicle registration information, insurance information, and repair and maintenance history. At the time of registration (which may be updated as necessary), vehicle owner/operator may specify restriction(s) 416, which may include an allowable operational trip area that the autonomous vehicle 20 may travel (e.g., defined by a radius around a latitude/longitude reference point, or City, County, State or other geographic boundaries), allowable days and times when the autonomous vehicle 20 may be assigned to a trip, and minimum revenue rate for a trip to which the autonomous vehicle may be assigned.
Each user has a corresponding user record 500 maintained in computer server 120, which may include a unique user ID 502, trip request(s) 504 associated with user ID 502, trip information 506 corresponding to each trip request 504, user preference(s) 508, real-time user location 510 and user billing or payment account 512. Trip information 506 may include pickup location, pickup date/time, destination location and intermediate stop location(s). User preference(s) 508 may include pricing, priority, speed of trip, vehicle capacity, cabin temperature, etc. User preference(s) 508 may be provided at the time of user registration with the transportation network or at the time of making a specific trip request. Real-time user location 510 may be established using the GPS function of the computing device on which AVES application 300 is installed.
Each trip request 504 has a corresponding trip record 600 maintained in computer server 120, which may include unique user ID 502 associated with user trip request 504, trip information 506 associated with trip request 504, vehicle ID 402 assigned to trip request 504, trip ID 602 and trip PIN 604 associated with trip request 504, trip route 606 determined for trip request 504, trip modification 608 requested by user for trip request 504 and altered trip route 610 provided for trip request 504.
As shown in
Computer server 120 guides autonomous vehicles 20 in the fleet, which do not have acceptable fuel/power-charge level, to fueling/power-charging stations for fueling/power-charging. Electric autonomous vehicles 20 may be guided to power-charging stations and charged using systems and methods as described in U.S. patent application Ser. No. 15/956,998, U.S. patent application Ser. No. 15/957,022, U.S. patent application Ser. No. 15/957,041, and U.S. patent application Ser. No. 15/957,057, which are hereby incorporated by reference in their entireties.
Computer server 120 receives a trip request 504 from a hailing user via a selected AVES application 300 on a selected computing device 30, the trip request 504 including a unique user ID 502 associated with the hailing user and trip information 506 including pickup location, pickup date/time, destination location, and any intermediate stop location(s). Computing device 30 may be any suitable device (e.g., PC, laptop, tablet, smartphone, etc.) for executing AVES application 300 to perform the functions described hereafter, and is preferably, a mobile computing device (e.g., tablet, smartphone, etc.). Alternatively, a trip may be requested via other methods, such as telephone or Application Programming Interface (API), as discussed above. For instance, AVES COC may be configured to dynamically select and assign autonomous vehicle(s) 20 to fulfill trip request(s) 504 generated by an API or other system that has been previously registered and approved to authorize such trip request(s) 504. For example, in the event of an unexpected school closing due to an adverse situation, an API may receive a broadcast notification from the school's alert system and automatically generate trip request(s) 504. Parents would no longer have to unexpectedly leave work for such events to pick up their children. At the time of registration for this service, a parent would receive a unique emergency ride identifier, which may be displayed by a selected autonomous vehicle 20 assigned to fulfill the trip request 504 so that the child would know which autonomous vehicle 20 is assigned to the child.
Computer server 120 determines a trip route 606 based on the trip information 506 for the trip request 504. For example, Artificial Intelligence System 130 executes a Route Determining Algorithm to determine the trip route 606 (including estimated trip duration) for fulfilling the trip request 504 based on the trip information 506 and information in knowledge base 140. Knowledge base 140 includes historical traffic conditions 700, real-time traffic conditions 702, scheduled road closures 704, scheduled events 706 and scheduled construction 708. Route Determining Algorithm uses trip information 506 (e.g., pickup location, pickup date/time, destination location and any intermediate stop location) and information from knowledge base 140 (e.g., the historical traffic conditions 700, real-time traffic conditions 702, scheduled road closures 704, scheduled events 706 and scheduled construction 708) to determine the trip route that is optimally suited for fulfilling the trip request 504. Historical data can identify popular pick-up and drop-off locations based upon analysis of existing trip requests. The AVES COC can also recognize “popular” pick-up and drop-off locations based on an ongoing record of trip requests, and coordinated based on patterns related to the time of day (e.g., morning and evening rush-hour; the day (e.g., weekday or weekend); time of year (e.g., summer versus winter); or varying time durations (e.g., daily patterns, weekly patterns, or longer time frames).
Computer server 120 selects an autonomous vehicle 20 to fulfill the trip request 504. For example, Artificial Intelligence System 130 executes a Matchmaking Algorithm to select the autonomous vehicle 20 to fulfill the trip request 504 based on the determined trip route 606 and information in knowledge base 140. Knowledge base 140 includes user preference(s) 508, and for each autonomous vehicle 20 in the fleet, real-time vehicle location data 404, real-time vehicle availability data 406, real-time vehicle operational state 408, real-time vehicle condition data 410, real-time vehicle fuel/power-charge level indication 412, vehicle description 414, vehicle owner specified restriction(s) 416, historical traffic conditions 700, real-time traffic conditions 702, scheduled road closures 704, scheduled events 706 and scheduled construction 708. Matchmaking Algorithm uses the determined trip route 606 and information from knowledge base 140 (e.g., user preference(s) 508, real-time vehicle location data 404, real-time vehicle availability data 406, real-time vehicle operational state 408, real-time vehicle condition data 410, real-time vehicle fuel/power-charge level indication 412, vehicle description 414, vehicle owner specified restriction(s) 416, historical traffic conditions 700, real-time traffic conditions 702, scheduled road closures 704, scheduled events 706 and scheduled construction 708) to select the autonomous vehicle from the active pool that is optimally suited to travel the determined route 606 to fulfill the trip request 504.
If the trip request 504 exceeds an operational range of any available autonomous vehicle 20 in active pool, computer server 120 selects two or more autonomous vehicles 20 to sequentially fulfill the trip request 504. For example, Artificial Intelligence System 130 executes the Matchmaking Algorithm to implement multi-hop routing to select two or more autonomous vehicles that are optimally suited to travel the determined route in sequential segments to fulfill the trip request. The multi-hop routing executed by Artificial Intelligence System 130 is similar to how airlines sometimes utilize multi-segment trips for travelling long distances. Computer server 120 automatically offers a multi-segment trip route 606 to the user in response to trip request 504. Artificial Intelligence System 130 may implement multi-hop routing to provide a convenient location and staggered drop-off and pickup times for the vehicle change to allow for a rest stop (e.g., restroom stop, food stop, etc.) and to avoid unnecessary waiting charges. Computer server 120 coordinates the vehicle change by guiding the two or more selected autonomous vehicles 20 to a vehicle change location at a specified drop-off time and pickup time.
If the trip request 504 exceeds a passenger capacity or load capacity of any available autonomous vehicle 20 in the active pool, computer server 120 selects two or more autonomous vehicles 20 to simultaneously fulfill the trip request 504. For example, Artificial Intelligence System 130 executes the Matchmaking Algorithm to implement multi-vehicle routing to select two or more autonomous vehicles that are optimally suited to simultaneously travel the determined trip route 606 to fulfill the trip request. Computer server 120 automatically offers two or more autonomous vehicles 20 to the user in response to trip request 504. Multi-vehicle routing is implemented by automatically coordinating the driving patterns of the two or more autonomous vehicles 20 to stay in an ad-hoc caravan formation. By maintaining an ad-hoc caravan formation, passengers (e.g., members of a large family, etc.) can be kept relatively close together. To this end, the selected autonomous vehicles 20 can be in communication with each other, as well as with AVES COC 100, during the trip, so that if one vehicle deviates from the trip route 606 (e.g., breaks down or gets stuck in traffic), the other vehicle will be aware of such deviation and can make accommodations as deemed necessary with assistance form AVES COC 100.
Computer server 120 selects autonomous vehicle(s) 20 to fulfill the trip request 504 and unilaterally and automatically assigns the selected autonomous vehicle(s) 20 to fulfill the trip request 504. This approach differs from conventional approaches implemented by existing “ride-sharing” companies or transportation network companies. Typically, a transportation network company offers a trip opportunity to vehicles located near the hailing user and then the transportation network company waits for acceptance of the trip opportunity by a vehicle. By contrast, AVES COC 100 of the present application unilaterally, unequivocally and automatically assigns the selected autonomous vehicle(s) 20 that is optimally suited to fulfill the trip request 504 without rejection, uncertainty or delay. This approach ensures that AVES COC 100 is able to assign the most suitable autonomous vehicle 20 for a trip request 504, and not just offer the trip request 504 to autonomous vehicle(s) 20 merely located near the hailing party but which may be insufficient for successful and efficient completion of the trip request for other reasons. By removing the human factor, AVES 10 is able to operate quickly, efficiently and cost effectively. Other than the hailing user that initiates a trip request 504, there is no human intervention in the “instant” and automatic selection and assignment process, which allows for dispatch of autonomous vehicles 20 to hailing users without delay. Additionally, with familiarity with AVES 10, a user can be confident that AVES 10 will deliver an autonomous vehicle 20 that is capable of fulfilling a trip request 504.
If, before the completion of a scheduled pickup date/time for a trip request 504, the Matchmaking Algorithm determines that a newly available autonomous vehicle 20 in the active pool is better suited for fulfilling the trip request 504 than the previously selected autonomous vehicle 504, the Artificial Intelligence System 130 unilaterally and automatically selects and substitutes the newly available autonomous vehicle 20 to fulfill the trip request in lieu of the previously selected vehicle 20. This reassignment process is automatic and invisible to the hailing user, who may only see the end-result of the reassignment of autonomous vehicles 20 as a reduced wait time for an autonomous vehicle 20. AVES COC 100 suspends the reassignment process at a specified period of time before the scheduled pickup time for a trip request 504 and before vehicle description 414 of the selected autonomous vehicle 20 is sent to AVES application 300. Unlike a transportation network that uses human drivers, AVES 10 can improve yield management and operational efficiency because AVES COC 100 can automatically and unilaterally assign and reassign autonomous vehicles 20 to fulfill trip requests 504 without negatively affecting a working relationship between a transportation network company and its drivers. For example, when a driver accepts a trip request through a transportation network company, the driver proceeds toward a requested location with the expectation of revenue from the accepted trip request, but if a transportation network company were to unexpectedly reassign that trip request to another driver, it would have a negative effect working relationship between the transportation network company and the displaced driver.
For each trip request 504 received by AVES COC 100, computer server 120 generates a unique trip ID 602 and corresponding unique trip PIN 604 corresponding to the trip request 504. Further, computer server 120 associates trip request 504 and corresponding trip information 506, user ID 502 for the hailing user, vehicle ID 402 for the selected autonomous vehicle 20, trip ID 602 and corresponding trip PIN 604 for the trip request 504 and determined trip route 606 for the trip request 504 in a trip record 600 that is stored in computer server 120. Once AVES COC 100 selects an autonomous vehicle 20 to fulfill trip request 504, AVES COC 100 communicates with AVES vehicle equipment 200 installed on selected autonomous vehicle 20 to guide selected autonomous vehicle 20 to the to the pickup location at the pickup time. Computer server 120 sends trip assignment information to AVES vehicle control system 210 installed on selected autonomous vehicle 20, including trip ID 602, trip PIN 604, trip route 606 and/or trip information 506, for the selected autonomous vehicle 20 to fulfill trip request 504. AVES vehicle control system 210 transmits the trip information 506 and/or trip route 606 for the trip request 504 to the vehicle computer system (e.g., CAN bus) for guiding the autonomous vehicle 20 to the pickup location at the pickup time. Alternatively, AVES vehicle control system 210 transmits driving commands to the vehicle computer system (e.g., CAN bus) of autonomous vehicle 20 based on the trip information 506 and/or trip route 606 for guiding the autonomous vehicle 20 to the pickup location at the pickup time. If a trip request 504 is reassigned to a newly selected autonomous vehicle 20, computer server 120 sends trip assignment information to the AVES vehicle control system 210 of the newly selected autonomous vehicle 20 to guide the newly selected autonomous vehicle 20 to the to the pickup location at the pickup time. Also, computer server 120 diverts the previously selected autonomous vehicle to another pickup location or a standby location. Further, computer server 120 updates trip record 600 to replace the previously selected autonomous vehicle with the newly selected autonomous.
Computer server 120 guides autonomous vehicles 20 in the active pool, which are not assigned to respond to trip requests from hailing users, to standby locations throughout the transportation network's geographic area. For example, Artificial Intelligence System 130, which includes knowledge base 140, executes a Vehicle Distribution Optimization Algorithm to determine standby locations for the autonomous vehicles 20 in the fleet. Knowledge base 140 includes real-time vehicle location data 404 for the autonomous vehicles 20 in the active pool, historical information regarding previous trip requests 504, real-time information regarding current trip requests 504 and information regarding scheduled events in the transportation network's geographic area. Vehicle Distribution Optimization Algorithm uses current information (e.g., current time of day, date, day of week and weather) and information from knowledge base 140 (e.g., real-time vehicle location data 404 for the autonomous vehicles 20 in the active pool, historical information regarding previous trip requests 504, real-time information regarding current trip requests 504 and information regarding scheduled events in the transportation network's geographic area) to select standby locations for autonomous vehicles 20 throughout the transportation network's geographic area to achieve a vehicle distribution that is optimally suited for fulfilling expected demand for trip requests. Standby locations may include fueling/power-charging stations, street parking spaces, parking garages, airports and bus stations, schools, and taxi queues. The real-time information regarding trip requests 504 and information regarding scheduled events in the transportation network's geographic area are received by the AVES COC from public messaging systems, the AVES applications installed on computing devices accessible by the users or the AVES vehicle equipment installed on the autonomous vehicles 20 in the fleet.
AVES COC 100 may direct autonomous vehicles 20 in the active pool, which are not assigned to respond to trip requests from hailing users, to taxi queues at locations that traditionally depend on the timeliness and efficiency of taxi queues (e.g., airports, public events, hotels, etc.). In response to a trip request 504 made via AVES application 300 as described above, computer server 120 provides a trip ID 602 for the trip request 504 and offers the user the ability to go to a taxi queue and pick the first available autonomous vehicle 20 if appropriate for the trip request 504. Once the hailing party enters an autonomous vehicle 20 in the taxi queue, the user provides the trip ID 602 via IVR System 220 or interactive touchscreen 230. AVES vehicle control system 210 transmits the trip ID 602 entered by the user to AVES COC 100, and computer server 120 sends trip assignment information to AVES vehicle control system 210 of the selected autonomous vehicle 20, including trip ID 602, trip route 606 and/or trip information 506, for the selected autonomous vehicle 20 to fulfill trip request 504. AVES COC 100 monitors the number of trip requests 504 fulfilled by autonomous vehicles in taxi queues, and directs additional autonomous vehicles as necessary to match demand.
AVES COC 100 may direct autonomous vehicles 20 in the active pool, which are not assigned to respond to trip requests from hailing users, fueling/power-charging stations for fueling/power-charging while waiting for assignment to a trip request 504 in order to maintain fuel/power charge levels of the autonomous vehicles 20 in the active pool as full as possible and optimize the utilization rate of the autonomous vehicles in the active pool. Electric autonomous vehicles 20 may be guided to power-charging stations and charged using systems and methods as described in U.S. patent application Ser. No. 15/956,998, U.S. patent application Ser. No. 15/957,022, U.S. patent application Ser. No. 15/957,041, and U.S. patent application Ser. No. 15/957,057, which are hereby incorporated by reference in their entireties.
AVES COC 100 removes autonomous vehicles 20, which are not in acceptable vehicle operational state 408 or vehicle condition 410, from the active pool and guides those autonomous vehicles 20 to service locations for maintenance service. Real-time vehicle operational state 408 may include information regarding the operational state of the mechanical and electrical systems of the autonomous vehicle 20 (e.g., low tire pressure, loss of heating or air conditioning, mechanical problem, etc.). Real-time vehicle operational state 408 may be established using the connection of AVES vehicle control system 210 to the autonomous driving system (e.g., CAN bus) of the autonomous vehicle 20. Real-time vehicle condition 410 may include information regarding state of cleanliness of the autonomous vehicle 20. Real-time vehicle condition 410 may be established using at least one of user input to IVR System 220, user input to interactive touchscreen 230, images from cameras 260 and signals from sensors 270 to determine whether the autonomous vehicle 20 is soiled, littered, or in disrepair. After a trip is complete, cameras 260 may without intervention detect anomalies such as, a passenger still in the car, extra items in the autonomous vehicle 20 since the start of the trip, stains, discarded food or drink containers or anything else that detracts from a clean environment in the autonomous vehicle 20. In the case of a forgotten valuable item, AVES COC directs the autonomous vehicle 20 to a service location for item retrieval and notifies the prior passenger of the forgotten item. Also, AVES COC 100 periodically (e.g., once a day) removes an autonomous vehicle 20 from the active pool and guides the autonomous vehicle to a service location for inspection, cleaning, maintenance and/or service. In the event that an autonomous vehicle 20 picks up a user for a trip request 504 in an unacceptable condition, the user may indicate the unacceptable condition and reject the autonomous vehicle 20 via the autonomous vehicle's IVR System 220 and/or interactive touchscreen 230. Upon receiving an indication of an unacceptable vehicle condition from AVES vehicle control system 210 of the autonomous vehicle 20, AVES COC automatically assigns a replacement autonomous vehicle 20 at highest priority, and takes the autonomous vehicle 20 in unacceptable condition out of the active pool and directs said autonomous vehicle 20 to a service location.
AVES COC 100 sends vehicle assignment information to the hailing user via AVES application 300, including unique trip ID 602, trip PIN 604, trip route 606, and vehicle ID 402 and vehicle description 414 for the autonomous vehicle 20 assigned to fulfill trip request 504. Also, AVES COC 100 sends the hailing user via AVES application 300 real-time vehicle location progress updates, including estimated time until arrival.
Once the assigned autonomous vehicle 20 and user's device 30 with AVES application 300 are within a specified distance, AVES 10 initiates a vehicle/user finding protocol. During the vehicle/user finding protocol, AVES application 300 transmits a signal 302 encoded with the unique trip ID 602 via the selected computing device 30 and AVES vehicle control system 210 activates antenna 240 to scan for the AVES application's signal 302 encoded with the unique trip ID 602. For example, during the vehicle/user finding protocol, AVES application 300 automatically activates a BLUETOOTH® transmitter in the computing device 30 to transmit signal 302 encoded with the unique trip ID 602. A 2.4 GHz frequency band for BLUETOOTH® transmission and reception is disclosed, but any other suitable communication protocol may be used. Antenna 240 may be a phased array antenna that is electronically steerable to scan 360° for the signal transmission encoded with the trip ID 602 (e.g., Bluetooth) from the selected computing device of the hailing user. Alternatively, antenna 240 may be a conventional directional antenna that is motorized to scan 360° for the signal transmission encoded with the trip ID 602 (e.g., Bluetooth) from the selected computing device of the hailing user. Also, during the vehicle/user finding protocol, AVES vehicle control system 210 activates signal emitter 250 to transmit a signal 252 encoded with the unique trip ID 602 and AVES application 300 activates a video camera on computing device 30 to sense the signal emitter's signal 252 encoded with the unique trip ID 602. For example, signal emitter 250 may be an omni-directional infrared emitter that transmits a continuously modulated signal 252 encoded with the unique trip ID 602. AVES application 300 activates a video camera on computing device 30 to sense the uniquely modulated infrared signal emitted by signal emitter 250.
AVES vehicle control system 210 uses the signal transmission encoded with the unique trip ID 602 that is detected by antenna 240 to guide the autonomous vehicle 20 toward the hailing user. AVES vehicle control system 210 determines the location of the selected computing device transmitting the signal 302 encoded with the unique trip ID 602 based on the direction of greatest received signal strength, which is indicative of the direction the autonomous vehicle 20 should move toward in order to intercept the selected computing device transmitting the signal 302 encoded with the trip ID 602. Additionally, as shown in
Once autonomous vehicle 20 is within a specified distance to the hailing user, which may be determined based on the strength of the signal received from the user's computing device or other data, along with an analysis of local conditions, AVES vehicle control system 210 determines that it has made a terminal intercept of the user and stops the autonomous vehicle 20. After AVES vehicle control system 210 stops autonomous vehicle 20, AVES vehicle control system 210 activates the hazard flashers, unlocks the doors and trunk and waits for the hailing user to enter the autonomous vehicle 20. The interconnection between AVES vehicle control system 210 and the computer system (e.g., CAN bus) of the autonomous vehicle 20, allows AVES vehicle control system 210 to activate the hazard flashers, unlock the doors and trunk and detect when the hailing user has entered the autonomous vehicle 20 (e.g., detect when a vehicle door has opened and closed). Also, AVES vehicle control system 210 may determine whether items have been placed in the trunk by detecting whether the trunk has been opened and closed. Additionally, AVES vehicle equipment 200 may include camera(s) 260 and/or sensor(s) 270 in the trunk space of the autonomous vehicle, which are connected to AVES vehicle control system 210, for determining whether items have been left behind in the trunk.
Once AVES vehicle control system 210 detects that a passenger has entered the autonomous vehicle 20, AVES vehicle control system 210 activates IVR System 220 to announce a welcome message and the unique trip ID 602 for the trip request 504. Also, AVES vehicle control system 210 activates interactive touchscreen 230 to display the unique trip ID 602 for the trip request 504. Further, AVES vehicle control system 210 activates IVR System 220 and interactive touchscreen 230 to prompt the user for the trip PIN 604 corresponding to the unique trip ID 602. Once AVES vehicle control system 210 receives trip PIN 604 from the user, AVES vehicle control system 210 compares trip PIN 604 received from the user to trip PIN 604 corresponding to unique trip ID 602. If trip PIN 604 received from the user matches trip PIN 604 corresponding to unique trip ID 602, the user is verified. Additionally, AVES vehicle control system 210 activates IVR System 220 and interactive touchscreen 230 to prompt the user to confirm the destination. The verification process helps ensure that users do not get into the wrong autonomous vehicle 20 and end up at the wrong destination. AVES vehicle control system 210 will also check to make sure that any occupied seating position has secured their seat-belts. If all the passengers are not belted in, AVES vehicle control system 210 activates IVR System 220 and interactive touchscreen 230 to prompt the passengers to fasten their seatbelts. After the user is verified, the destination is confirmed and passengers have fastened their seatbelts, AVES vehicle control system 210 commands autonomous vehicle 20 to begin the trip. AVES vehicle equipment 200 of an autonomous vehicle 20 may be set to a sight-impaired mode by the user via AVES application 300. In sight-impaired mode, AVES vehicle control system 210 communicates with the user via IVR System 220.
In the event that an autonomous vehicle 20 picks up a user for a trip request 504 in an unacceptable condition, the user may indicate the unacceptable condition and reject the autonomous vehicle 20 via the autonomous vehicle's IVR System 220 and/or interactive touchscreen 230. Upon receiving an indication of an unacceptable vehicle condition from AVES vehicle control system 210 of the autonomous vehicle 20, AVES COC automatically assigns a replacement autonomous vehicle 20 at highest priority, and takes the autonomous vehicle 20 in unacceptable condition out of the active pool and directs said autonomous vehicle 20 to a service location.
As a trip progresses, interactive touchscreen 230 displays real-time trip information, including trip route and real-time location on a map, estimated time of arrival, etc. Also, interactive touchscreen 230 may provide a soft key to temporarily halt the trip for a bathroom break, illness, etc., and IVR System 220 may programmed to recognize voice commands to temporarily halt the trip for a bathroom break, illness, etc.
The user may make a trip modification request 505 with altered trip information 507 (e.g., changed intermediate stop location(s) and/or destination location) while in transit by using IVR System 220, interactive touchscreen 230 or AVES application 300. AVES vehicle control system 210 sends the trip modification request 505 with altered trip information 507 to AVES COC 100. Artificial Intelligence System 130 executes the Route Determining Algorithm to determine an altered trip route 608 (including newly estimated trip duration and cost) for fulfilling the modification request 505 based on the altered trip information 507 and information in knowledge base 140, as described above with respect to ride request 504. Computer server 120 determines whether the present autonomous vehicle is capable of fulfilling the trip modification request 505 according to the altered trip route 608, as well as if there is sufficient payment capacity by the requesting user for the altered trip. If the present autonomous vehicle 20 is capable of fulfilling the modification request 505 according to the altered trip route 608, computer server 120 confirms that the user accepts the altered trip route 608 via the IVR system 220, the interactive touchscreen 230 or the AVES application 300, and guides the present autonomous vehicle 20 according to the altered trip route 608. If the present autonomous vehicle 20 is not capable of fulfilling the trip modification request 505 according to the altered trip route 608, computer server 120 selects an alternative autonomous vehicle 20 for fulfilling the trip modification request 505, confirms that the user accepts the alternative autonomous vehicle 20 via the IVR system 220, the interactive touchscreen 230 or the AVES application 30 and implements multi-hop routing to coordinate the present autonomous vehicle 20 and the alternative autonomous vehicle 20 to fulfill the trip modification request 505 according to the altered trip route 608. Artificial Intelligence System 130 executes the Matchmaking Algorithm to select the alternative autonomous vehicle 20 to fulfill the trip modification request 505 based on the altered trip route 608 and information in knowledge base 140, as described above with respect to ride request 504.
The user may trigger an emergency alert 514 by using IVR System 220 or interactive touchscreen 230. For example, IVR System 220 may be programmed to recognize certain keywords to initiate the emergency protocol. IVR system 220 may remain active during the duration of a trip to detect pre-programmed words to initiate the emergency protocol. AVES vehicle control system 210 sends the emergency alert 514 to AVES COC 100 and AVES COC 100 initiates an emergency protocol. AVES COC 100 confirms that there is an emergency via IVR System 220 or interactive touchscreen 230. If AVES COC 100 confirms that there is an emergency or receives no response at all, AVES COC 100 proceeds with the emergency protocol. AVES COC 100 places an emergency 911 call and links the IVR System 220 in the autonomous vehicle to the emergency 911 call. An AVES COC 100 attendant may also be linked to the emergency 911 call if needed to give location information, etc. Also, AVES vehicle control system 210 activates IVR System's 220 microphone and speaker, interior and exterior cameras 260 and the autonomous vehicle's interior lights to facilitate video monitoring. The interior video camera 260 and the IVR System 220 are activated so that an AVES COC 100 attendant can assess the user emergency and so that video and audio data may be stored in the autonomous vehicle's on-board memory. Interactive touchscreen 230 may provide “Go to Police Station” and “Go to Hospital” soft button choices. IVR System 220 may be programmed to recognize certain keywords to confirm an emergency and the type of emergency (e.g., medical emergency). AVES vehicle control system 210 may interrupt the autonomous vehicle's trip and guide the autonomous vehicle 20 to a police station or hospital depending on the user input. An AVES COC 100 attendant will be able to remotely halt or reroute the autonomous vehicle and give the autonomous vehicle's location if the hospital wishes to dispatch an ambulance to meet the autonomous vehicle 20. AVES 10 will also have the ability to directly forward the location information to a future 911 system that can accept such information.
If an autonomous vehicle 20 is suddenly disabled during a trip, AVES vehicle control system 210 initiates a disabled vehicle protocol. AVES vehicle control system 210 will first attempt to guide the autonomous vehicle to a safe location (e.g., at the side of a road), activate the hazard flashers and notify AVES COC 100. AVES COC 100 automatically priority dispatches a substitute autonomous vehicle 20 and establishes a communications link to the autonomous vehicle's passenger(s) via IVR System 220 and interior video camera 260 so that an AVES COC 100 attendant can monitor the situation. This disabled vehicle protocol differs from present automatic vehicle notification systems in that a substitute autonomous vehicle 20 is automatically dispatched, rather than simply notify the transportation network company of the disabled condition of the autonomous vehicle 20.
In the event that AVES COC 100 fails or loses the communication link to AVES vehicle equipment 200, AVES vehicle control system 210 will initiate a disabled system protocol. AVES vehicle control system 210 directs autonomous vehicle 20 to complete the trip in progress, and store the trip billing information in the autonomous vehicle's 20 local AVES memory until the communication link and/or AVES COC 100 is restored to normal operation. Once the communication link and/or AVES COC 100 is restored, AVES vehicle control system 210 sends the trip data to AVES COC 100. AVES vehicle control system 210 directs autonomous vehicle 20 to drive to the nearest fail-safe location or rest location, which are stored in the local AVES memory files. A failure in the GPS system will also cause disabled system protocol to be initiated, with “dead reckoning” (e.g., compass and distance information) used to complete a trip in progress, or a move to a fail-safe location or rest location.
If an autonomous vehicle 20 reaches a desired intermediate stop location or destination location and it is unable to stop (e.g., another vehicle occupying that area, etc.), AVES vehicle control system 210 directs autonomous vehicle 20 to drive slightly past the desired intermediate stop location or destination location for a specified distance before automatically looping back to attempt another stop at the desired intermediate stop location or destination location. AVES vehicle control system 210 activates IVR System 220 to ask the passenger whether they would like to stop before the destination, circle around, stop past the destination, or have an alternative stop location. Once the autonomous vehicle 20 has come to a stop at the desired intermediate stop location or destination location, AVES vehicle control system 210 automatically unlocks the doors, announces the location via IVR System 220 and displays the location via interactive touchscreen 230.
AVES vehicle control system 210 activates IVR System 220 and interactive touchscreen 230 prompts the user to confirm whether the user wishes to terminate the trip, wishes for the autonomous vehicle 20 to wait for the user to return to the autonomous vehicle 20, or wishes to go to a new destination. If the hailing user wishes for the autonomous vehicle 20 to wait for the user to return to the autonomous vehicle 20, AVES application 300 stays active during this period to allow a re-summoning of the autonomous vehicle 20. If, at the conclusion of a trip, AVES vehicle control system 210 does not receive a response to the request for confirmation of the trip's conclusion within a specified time frame, AVES vehicle control system 210 repeats the confirmation attempt at progressively louder volume levels and with flashing of the interior lights. If AVES vehicle control system 210 does not receive a response to the request for confirmation of the trip's conclusion and there is no indication that the doors have been opened, AVES vehicle control system 210 activates an interior video camera and the IVR so that AVES COC 100 can assess whether the user is still present in the autonomous vehicle 20. The interconnection between AVES vehicle control system 210 and the computer system (e.g., CAN bus) of the autonomous vehicle 20, allows AVES vehicle control system 210 to determine when the hailing user has exited the autonomous vehicle 20 (e.g., detect when a vehicle door has opened and closed). If AVES COC 100 detects an incapacitated passenger who is still in the autonomous vehicle 20 and unable to respond, AVES COC 100 initiates the emergency protocol.
The interconnection between AVES vehicle control system 210 and the computer system (e.g., CAN bus) of the autonomous vehicle 20, allows AVES vehicle control system 210 to determine when items have been placed in the trunk of the autonomous vehicle 20 (e.g., detect when a trunk has opened and closed). At the conclusion of a trip, if AVES vehicle control system 210 determines that the trunk has been opened during the trip, AVES vehicle control system 210 activates IVR System 220 and interactive touchscreen 230 to prompt the passenger(s) to make sure that any personal items have been removed from the trunk and to confirm that they have checked. If AVES vehicle control system 210 determines that the trunk has been opened only once during the trip (thus precluding the possibility that an item could have been placed in the trunk and then subsequently removed), AVES vehicle control system 210 will direct autonomous vehicle 20 remain at the destination location and continue to prompt the passenger(s) to make sure that any personal items have been removed from the trunk. Also, AVES vehicle control system 210 may determine whether items have been placed in the trunk by detecting whether the trunk has been opened and closed. Additionally, AVES vehicle equipment 200 may include camera(s) 260 and/or sensor(s) 270 in the trunk space of the autonomous vehicle, which are connected to AVES vehicle control system 210, for determining whether items have been left behind in the trunk. If, after a specified period of time, AVES vehicle control system 210 does not receive confirmation that the passenger(s) checked the trunk, AVES vehicle control system 210 activates a video camera and lights in the trunk so that AVES COC 100 can assess whether any items are in the trunk. If an item is left behind in the trunk, the passenger is notified. Also, sensor(s) 270 (e.g., infrared sensors) in the trunk may be used to detect the presence of items in the trunk space.
AVES 10 takes into consideration the security dangers of autonomous vehicles 20 being requested to drive into “restricted” areas. Just as the F.A.A. designates “no-fly” zones around arenas, special events, etc., AVES 10 can also refuse to accept trip requests 504 to enter certain known restricted areas as a matter of course. Areas that are declared temporarily restricted by governing authorities (e.g., parades, marathons, etc.) are also accommodated by AVES COC 100.
Trip requests 504 to and from locations that have access controls (e.g., gate operators, garage doors, guard stations, etc.) will require additional capabilities that AVES vehicle equipment 200 can be configured to provide. For remote-controlled access systems, AVES vehicle equipment 200 includes 300-400 MHz band transmitters that can operate the controls using direct radio transmission of Security+ 2.0 (rolling code), Intellicode, or other gate or garage door remote opener radio protocols to provide a seamless interface. AVES COC 100 may store access codes to be stored as part of user record 500. Alternatively, a user may provide access codes via IVR System 220 and interactive touchscreen 230. For those locations that have live security personnel, AVES vehicle equipment 200 include external loudspeakers and external microphones to allow a user to communicate with security personnel via IVR System 220 without having to open a window. Additionally, if an autonomous vehicle 20 is blocked by a gate (or similar impediment) at the pickup location, AVES COC 100 may communicate with the user via AVES application 300 to inform the user that the autonomous vehicle is waiting at the gate to be admitted.
AVES COC 100 may be integrated into a transportation network company's central facility or may operate as a “stand alone” facility that creates a “fleet of fleets” virtually combining existing independent fleets into a single virtual fleet. AVES COC 100 may manage transportation services (e.g., dispatch, billing, etc.) for multiple transportation companies in a geographical area. AVES COC 100 may limit transportation services (e.g., dispatch, billing, etc.) for a particular transportation company only to those autonomous vehicles 20 in that particular transportation company's fleet. The sharing of fleet resources may be invisible to the user in a similar way that airline “code-sharing” arrangements allow a user to book a trip through a particular airline, but the actual trip is fulfilled by another airline. Alternatively, the entire virtual fleet may consist of individually owned single vehicles, or individually owned fleets of vehicles.
The foregoing description of embodiments of the present invention has been presented for the purpose of illustration and description. It is not intended to be exhaustive or to limit the invention to the form disclosed. Obvious modifications and variations are possible in light of the above disclosure. The embodiments described were chosen to best illustrate the principles of the invention and practical applications thereof to enable one of ordinary skill in the art to utilize the invention in various embodiments and with various modifications as suited to the particular use contemplated.
This application is a continuation of U.S. patent application Ser. No. 15/974,021, filed on May 8, 2018, which claims the benefit of U.S. Provisional Application No. 62/502,817, filed on May 8, 2017, each of which is hereby incorporated by reference in its entirety. The U.S. Patent Applications titled “Autonomous Vehicle Enhancement System,” “Vehicle Equipment for Autonomous Vehicle Enhancement System,” and “Mobile Device for Autonomous Vehicle Enhancement System,” all filed on May 8, 2018, which also claim the benefit of U.S. Provisional Application No. 62/502,817, are herein incorporated by reference in their entireties.
| Number | Name | Date | Kind |
|---|---|---|---|
| 9606539 | Kentley | Mar 2017 | B1 |
| 20140222298 | Gurin | Aug 2014 | A1 |
| 20160303969 | Akula | Oct 2016 | A1 |
| 20160321566 | Liu | Nov 2016 | A1 |
| 20170166147 | Hiroki | Jun 2017 | A1 |
| 20170337437 | Kanagaraj | Nov 2017 | A1 |
| 20180150772 | Ryan | May 2018 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20220381568 A1 | Dec 2022 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62502817 | May 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15974021 | May 2018 | US |
| Child | 17876648 | US |
