Patent Application
20190384276
The present disclosure relates to autonomous vehicles, and more particularly, to an intent communication system for an autonomous vehicle.
A system according to one, non-limiting, embodiment of the present disclosure includes a vehicle and a drone. The vehicle includes one or more sensor systems, one or more navigation systems, one or more maps, and a receiver. The one or more sensor systems provide vehicle location data to the one or more navigation systems locating the vehicle on a roadway represented by the one or more maps. The one or more sensor systems include one or more of a computer vision system, a radar system, and a LIDAR system. The drone includes a transmitter and at least one position-tracking device configured to determine drone location data. Use of the drone is initiated from the vehicle in accordance with a determination by the one or more processors that the vehicle location data provided by the one or more sensor systems is insufficient for the one or more navigation systems to navigate the vehicle. The transmitter is configured to transmit the drone location data to the receiver.
A vehicle system according to another, non-limiting, embodiment includes one or more navigation systems, one or more sensor systems, and one or more processors. The one or more navigation systems are configured to effect vehicle maneuvers. The one or more sensor systems are configured to generate vehicle location data, and include at least one or more of a computer-vision system, a radar system, and a LIDAR system. The one or more processors are configured to receive the vehicle location data, determine if the vehicle location data is insufficient for the one or more navigation systems to effect the vehicle maneuvers, and if insufficient, to utilize drone location data to effect the vehicle maneuvers.
A method of operating the system according to another, non-limiting, embodiment includes the step of receiving vehicle location data from one or more sensor systems of a vehicle. One or more processors then determine that the vehicle location data is insufficient to locate the vehicle on a roadway. As a result, a drone may be deployed. After drone deployment, the one or more processors may then receive drone location data from the drone. The drone location data is then processed by the one or more processors. Via the processing of the drone location data, the one or more processors may then determine a location of the vehicle on the roadway.
These and other advantages and features will become more apparent from the following description taken in conjunction with the drawings.
The subject matter which is regarded as the invention is particularly pointed out and distinctly claimed in the claims at the conclusion of the specification. The foregoing and other features, and advantages of the invention are apparent from the following detailed description taken in conjunction with the accompanying drawings in which:
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described embodiments. However, it will be apparent to one of ordinary skill in the art that the various described embodiments may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
Referring to
Referring to
The controller-circuit(s) 34 of the vehicle 22 include one or more processors 40 and one or more electronic storage mediums 42. The processor 40 is any combination of one or more of a central processing unit (CPU), multiprocessor, microcontroller unit (MCU), digital signal processor (DSP), application specific integrated circuit, and others capable of executing software instructions or otherwise controllable to behave according to predetermined logic. The storage medium 42 is, optionally, any combination of read and write memory (RAM) and read only memory (ROM). The storage medium 42 may also include persistent storage, which can be any single one or combination of solid state memory, magnetic memory, or optical memory storing a computer program (i.e., application) with software instructions.
In one embodiment, the vehicle 22 is an autonomous vehicle, and the controller-circuit 34 of the vehicle 22 is configured to output an array of operating commands (see arrows 44) based in-part on the navigation system 32. The operating commands 44 are received by one or more actuation devices 46 (e.g., vehicle maneuver devices) adapted to control various maneuvers of the vehicle 22. Examples of the actuation devices 46 include one or more of a steering actuator, a brake actuator, an acceleration actuator, and others generally known in the art of autonomous vehicles.
The sensor system 30 is configured to provide location data (see arrow 48 in
The map 36 is preprogrammed into the storage medium 42 for use by the navigation system 32. The navigation system 32 is configured to determine routes that the vehicle 22 will travel. The available routes are constrained by roadways represented by the preprogrammed map 36. During normal operation, the navigation system 32 receives the location data 48 from the sensor system 30 to determine and track the present location of the vehicle. To determine an upcoming vehicle route, the navigation system 32 then applies the current location to the preprogrammed map 36. In the example of an autonomous vehicle, the controller-circuit 34 of the vehicle 22 then sends the appropriate command signals 44 to the actuation device(s) 46 to effect vehicle maneuvers that follow the determined vehicle route. In a scenario where the controller-circuit 34 of the vehicle 22 determines that the location data 48 is insufficient for the navigation system 32 to navigate the vehicle 22, the system 20 may then invoke use of the drone 24.
In one embodiment, the navigation system 32 is configured to determine that the location data 48 is insufficient by comparing the localization information contained as part of the location data 48 to a predetermined threshold 49. The threshold 49 is preprogrammed into, and stored by, the storage medium 42 of the controller-circuit 34. In one embodiment, this localization is associated with a distance that is greater than the predetermined threshold 49 of an expected localization. Examples of the expected localization include an expected localization based on a previous localization and a known path, and an expected localization based on a previous localization and a known speed of the vehicle 22, or an expected localization based on a previous localization and both of a known path and a known speed. In one embodiment, the predetermined threshold 49 may be a matrix of values dependent upon (i.e., a function of) a previous localization value and a known path and/or a present speed of the vehicle 22. As will be appreciated, the accuracy of a localization, and by extension, the threshold of expected accuracy can be dependent on the previous path and speed of the vehicle, (e.g., if the vehicle is passing into an urban canyon or is moving slowly).
In one embodiment, the drone 24 of the system 20 includes a communication device 50, at least one controller-circuit 52, an actuator device 54 (i e , maneuver device), at least one position-tracking device 56 configured to generate drone location data (see arrow 58 in
The controller-circuit(s) 52 of the drone 24 include one or more processors 60 and one or more electronic storage mediums 62. The processor 60 is any combination of one or more of a central processing unit (CPU), multiprocessor, microcontroller unit (MCU), digital signal processor (DSP), application specific integrated circuit, and others capable of executing software instructions or otherwise controllable to behave according to predetermined logic. The storage medium 62 is, optionally, any combination of read and write memory (RAM) and read only memory (ROM). The storage medium 62 may also include persistent storage, which can be any single one or combination of solid state memory, magnetic memory, or optical memory storing a computer program (i.e., application) with software instructions.
In one embodiment, the controller-circuit 52 of the drone 24 is configured to output at least one operating command signal (see arrow 64) based at least in-part on a command signal (see arrow 66) from the controller-circuit 34 of the vehicle 22. Moe specifically, the processor 40 of the vehicle controller-circuitry 34 generates the command signal 66. The vehicle communication device 38 then wirelessly send the signal 66 to the drone communication device 50 for receipt by the drone controller-circuitry 52 for generation of the operating command signal(s) 64. The operating command signal(s) 64 are then received by at least one of the actuator devices 54 adapted to maneuver the drone 24.
In one embodiment, the drone location data 58 generated by the position-tracking device 56 of the drone 24 includes tracking data established with respect to the vehicle 22 (i.e., three-dimensional orientation between the vehicle 22 and the drone 24), and geographic position data associated with the geographic position of the drone itself. For example, the tracking device 56 may include the LIDAR system to generate the tracking data of the drone location data 58, and the GPS to generate the geographic position data of the drone location data 58. When the vehicle location data 48 is deemed insufficient by the controller-circuit 34 of the vehicle 22, the navigation system 32 uses both the tracking data and the geographic position data of the drone location data 58 to navigate the vehicle 22. In another embodiment, the controller-circuit 52 of the drone 24 is configured to process the tracking data and the geographic position data of the drone location data 58 for the vehicle 22, and thereby provide the vehicle with a vehicle geographic position (i.e., a substitute for the vehicle location data 48). This embodiment is particularly advantageous where the drone 24 is a communal drone that services a plurality of the vehicles.
In furtherance of this embodiment, and in one example, the controller-circuit 52 of the drone 24 may also utilize, at least in-part, the tracking data of the drone location data 58 to generate the drone operating command signals 64, and thereby control flight patterns of the drone 24 with respect to the vehicle 22. This example is particularly advantageous where the drone 24 is specific to the vehicle 22.
In another example, a sensor system 30B of the vehicle sensor systems 30 may be utilized to track the drone 24 (i.e., instead of the drone tracking the vehicle). For instance, and in one scenario, if a GPS 30A of the vehicle sensor systems 30 loses reliable communication with various satellites, another sensor system 30B (e.g., LIDAR system) of the sensor systems 30 is utilized to track the drone 24 by generating tracking data (see arrow 68 in
Referring to
At block 106, the vehicle controller-circuitry 34 receives drone location data 58 from the deployed drone. The drone location data includes a relative drone positioning data associated with a position of the drone 24 relative to the vehicle 22, and geographic position data of the drone 24, both generated by one or more position-tracking devices 56 disposed in the drone 24. At block 108, the processor 40 processes the drone location data 58. At block 110, the processor 40 (i.e., via the navigation system 32) determines the location of the vehicle 22 on the roadway 26.
The various functions described above may be implemented or supported by a computer program that is formed from computer readable program codes, and that is embodied in a non-transitory computer readable medium. Computer readable program codes may include source codes, object codes, executable codes, and others. Computer readable mediums may be any type of media capable of being accessed by a computer, and may include Read Only Memory (ROM), Random Access Memory (RAM), a hard disk drive, a compact disc (CD), a digital video disc (DVD), or other non-transitory forms.
The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, die term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.
Terms used herein such as component, application, module, system, and the like are intended to refer to a computer-related entity, either hardware, a combination of hardware and software, or software execution. By way of example, an application may be, but is not limited to, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. An application running on a server and the server, may be a component. One or more applications may reside within a process and/or thread of execution and an application may be localized on one computer and/or distributed between two or more computers.
While the invention has been described in detail in connection with only a limited number of embodiments, it should be readily understood that the invention is not limited to such disclosed embodiments. Rather, the invention can be modified to incorporate any number of variations, alterations, substitutions or equivalent arrangements not heretofore described, but which are commensurate with the spirit and scope of the invention. Additionally, while various embodiments of the invention have been described, it is to be understood that aspects of the invention may include only some of the described embodiments. Accordingly, the invention is not to be seen as limited by the foregoing description.
