Patent Application
20220289195
The technical field generally relates to vehicles and, more specifically, to methods and systems for controlling a vehicle in avoiding and mitigating events with a target vehicle.
Certain vehicles today include systems for avoiding and mitigating vehicle events, such as when a host vehicle would contact a target vehicle. However, such existing vehicle systems may not always provide optimal avoidance and mitigation in certain situations.
Accordingly, it is desirable to provide improved methods and systems for controlling vehicles in avoiding and mitigating vehicle events with a target vehicle.
In accordance with an exemplary embodiment, a system is provided that includes one or more first sensors, one or more second sensors, and a processor. The one or more first sensors are disposed onboard a host vehicle, and are configured to at least facilitate obtaining first sensor data with respect to the host vehicle. The one or more second sensors are disposed onboard the host vehicle and configured to at least facilitate obtaining second sensor data with respect to a target vehicle that is in proximity to the host vehicle. The processor is coupled to the one or more first sensors and the one or more second sensors, and is configured to at least facilitate: creating an adaptive prediction horizon that includes a probabilistic time-to-event horizon with respect to possible vehicle events between the host vehicle and the target vehicle; and controlling the host vehicle based on the probabilistic time-to-event horizon.
Also in an exemplary embodiment, the processor is further configured to at least facilitate simultaneously controlling lateral and longitudinal movement of the host vehicle based on the probabilistic time-to-event horizon.
Also in an exemplary embodiment, the processor is further configured to at least facilitate: estimating prediction uncertainties for the adaptive predictive risk horizon, using respective uncertainties associated with one or more of the first sensors, second sensors, or both; generating a corrected probabilistic time-to-event horizon using the prediction uncertainties; and controlling the host vehicle based on the corrected probabilistic time-to-event horizon.
Also in an exemplary embodiment, the processor is further configured to at least facilitate: generating a probabilistic risk horizon for the adaptive prediction horizon; and controlling the host vehicle based on both the probabilistic time-to-event horizon and the probabilistic risk horizon.
Also in an exemplary embodiment, the processor is further configured to at least facilitate: generating a predictive potential event zone using the first sensor data and the second sensor data; and calculating a risk of specific events associated with the potential event zone.
Also in an exemplary embodiment, the processor is further configured to at least facilitate: generating a category for control based on both the probabilistic time-to-event horizon and the probabilistic risk horizon; and controlling the host vehicle based on both the probabilistic time-to-event horizon and the probabilistic risk horizon, based on the category for control.
Also in an exemplary embodiment, the processor is further configured to at least facilitate generating the category for control from a plurality of different category groupings, including: a first category grouping representing a first level of urgency, and calling for a notification to be provided to a driver or other user of the host vehicle; a second category grouping representing a second level of urgency, greater than the first level of urgency, and calling for mission planning control to be provided for the host vehicle in accordance with instructions provided by the processor; and a third category grouping representing a third level of urgency, greater than both the first level of urgency and the second level of urgency, and calling for reactive planning control to be provided for the host vehicle in accordance with instructions provided by the processor.
Also in an exemplary embodiment, the processor is further configured to at least facilitate controlling steering for the host vehicle based on the probabilistic time-to-event horizon.
Also in an exemplary embodiment, the processor is further configured to at least facilitate controlling lateral and longitudinal movement of the host vehicle based on the probabilistic time-to-event horizon.
In another exemplary embodiment, a method is provided that includes: obtaining first sensor data with respect to a host vehicle, from one or more first sensors onboard the host vehicle; obtaining second sensor data with respect to a target vehicle that is in proximity to the host vehicle, form one or more second sensors onboard the host vehicle; creating, via a processor onboard the host vehicle, an adaptive prediction horizon that includes a probabilistic time-to-event horizon with respect to possible vehicle events between the host vehicle and the target vehicle; and controlling the host vehicle based on the probabilistic time-to-event horizon via instructions provided by the processor.
Also in an exemplary embodiment, the step of controlling the host vehicle includes providing a notification to a user of the host vehicle, in accordance with instructions provided by the processor, based on the probabilistic time-to-event horizon.
Also in an exemplary embodiment, the step of controlling the host vehicle includes simultaneously controlling lateral and longitudinal movement of the host vehicle, in accordance with instructions provided by the processor, based on the probabilistic time-to-event horizon.
Also in an exemplary embodiment, the method further includes: estimating, via the processor, prediction uncertainties for the adaptive predictive risk horizon, using respective uncertainties associated with one or more of the first sensors, second sensors, or both; and generating, via the processor, a corrected probabilistic time-to-event horizon using the prediction uncertainties; wherein the step of controlling the host vehicle includes controlling the host vehicle based on the corrected probabilistic time-to-event horizon.
Also in an exemplary embodiment, the method further includes: generating, via the processor, a probabilistic risk horizon for the adaptive prediction horizon; wherein the step of controlling the host vehicle includes controlling the host vehicle based on both the probabilistic time-to-event horizon and the probabilistic risk horizon, via instructions provided by the processor.
Also in an exemplary embodiment, the generating of the problematic risk horizon includes: generating a predictive potential event zone using the first sensor data and the second sensor data; and calculating a risk of specific events associated with the potential event zone.
Also in an exemplary embodiment, the method further includes: generating, via the processor, a category for control based on both the probabilistic time-to-event horizon and the probabilistic risk horizon; wherein the step of controlling the host vehicle includes controlling the host vehicle based on both the probabilistic time-to-event horizon and the probabilistic risk horizon, via instructions provided by the processor, with the instructions based on the category for control.
Also in an exemplary embodiment, the category for control is generated from a plurality of different category groupings, including: a first category grouping representing a first level of urgency, and calling for a notification to be provided to a driver or other user of the host vehicle; a second category grouping representing a second level of urgency, greater than the first level of urgency, and calling for mission planning control to be provided for the host vehicle in accordance with instructions provided by the processor; and a third category grouping representing a third level of urgency, greater than both the first level of urgency and the second level of urgency, and calling for reactive planning control to be provided for the host vehicle in accordance with instructions provided by the processor.
In another exemplary embodiment, a vehicle is provided that includes: a body, a propulsion system, one or more first sensors, one or more second sensors, and a processor. The propulsion system is configured to generate movement of the body. The one or more first sensors is disposed onboard a host vehicle, and is configured to at least facilitate obtaining first sensor data with respect to the host vehicle. The one or more second sensors are disposed onboard the host vehicle, and are configured to at least facilitate obtaining second sensor data with respect to a target vehicle that is in proximity to the host vehicle. The processor is coupled to the one or more first sensors and the one or more second sensors, and is configured to at least facilitate: creating an adaptive prediction horizon that includes a probabilistic time-to-event horizon with respect to possible vehicle events between the host vehicle and the target vehicle; and controlling the host vehicle based on the probabilistic time-to-event horizon.
Also in an exemplary embodiment, the processor is further configured to at least facilitate: estimating prediction uncertainties for the adaptive predictive risk horizon, using respective uncertainties associated with one or more of the first sensors, second sensors, or both; generating a corrected probabilistic time-to-event horizon using the prediction uncertainties; and controlling the host vehicle based on the corrected probabilistic time-to-event horizon.
Also in an exemplary embodiment, the processor is further configured to at least facilitate: generating a probabilistic risk horizon for the adaptive prediction horizon; and controlling the host vehicle based on both the probabilistic time-to-event horizon and the probabilistic risk horizon.
The present disclosure will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and wherein:
The following detailed description is merely exemplary in nature and is not intended to limit the disclosure or the application and uses thereof. Furthermore, there is no intention to be bound by any theory presented in the preceding background or the following detailed description.
In various embodiments, the vehicle 100 comprises an automobile. The vehicle 100 may be any one of a number of different types of automobiles, such as, for example, a sedan, a wagon, a truck, or a sport utility vehicle (SUV), and may be two-wheel drive (2WD) (i.e., rear-wheel drive or front-wheel drive), four-wheel drive (4WD) or all-wheel drive (AWD), and/or various other types of vehicles in certain embodiments. In certain embodiments, the vehicle 100 may also comprise a motorcycle or other vehicle, such as aircraft, spacecraft, watercraft, and so on, and/or one or more other types of mobile platforms (e.g., a robot and/or other mobile platform).
The vehicle 100 includes a body 104 that is arranged on a chassis 116. The body 104 substantially encloses other components of the vehicle 100. The body 104 and the chassis 116 may jointly form a frame. The vehicle 100 also includes a plurality of wheels 112. The wheels 112 are each rotationally coupled to the chassis 116 near a respective corner of the body 104 to facilitate movement of the vehicle 100. In one embodiment, the vehicle 100 includes four wheels 112, although this may vary in other embodiments (for example for trucks and certain other vehicles).
A drive system 110 is mounted on the chassis 116, and drives the wheels 112, for example via axles 114. The drive system 110 preferably comprises a propulsion system. In certain exemplary embodiments, the drive system 110 comprises an internal combustion engine and/or an electric motor/generator, coupled with a transmission thereof. In certain embodiments, the drive system 110 may vary, and/or two or more drive systems 112 may be used. By way of example, the vehicle 100 may also incorporate any one of, or combination of, a number of different types of propulsion systems, such as, for example, a gasoline or diesel fueled combustion engine, a “flex fuel vehicle” (FFV) engine (i.e., using a mixture of gasoline and alcohol), a gaseous compound (e.g., hydrogen and/or natural gas) fueled engine, a combustion/electric motor hybrid engine, and an electric motor.
As depicted in
In the embodiment depicted in
In various embodiments, the sensor array 120 includes various sensors that obtain sensor data for use in tracking road elevation and controlling the vehicle 10 based on the road elevation. In the depicted embodiment, the sensor array 120 includes inertial measurement sensors 121, input sensors 122 (e.g., brake pedal sensors measuring brake inputs provided by a driver and/or touch screen sensors and/or other input sensors configured to received inputs from a driver or other user of the vehicle 10); steering sensors 123 (e.g., coupled to a steering wheel and/or wheels of the vehicle 10 and configured to measure a steering angle thereof), tire sensors 124 (e.g., to measure pressure of one or more tires of the vehicle 100), speed sensors 125 (e.g., wheel speed sensors and/or other sensors configured to measure a speed and/or velocity of the vehicle and/or data used to calculate such speed and/or velocity), mass sensors 129 (e.g., to measure a mass of the vehicle 100 and/or one or more components thereof), cameras 126 (e.g., configured to obtain camera images, for example with respect to other vehicles on the roadway), lidar sensors 127 (e.g., configured to obtain lidar data, for example with respect to other vehicles on the roadway), radar sensors 128 (e.g., configured to obtain radar data, for example with respect to other vehicles on the roadway), and/or one or more other sensors 131 (e.g. including one or more other ultrasonic sensors configured to obtain data, for example with respect to other vehicles on the roadway).
Also in various embodiments, the location system 130 is configured to obtain and/or generate data as to a position and/or location in which the vehicle is located and/or is travelling. In certain embodiments, the location system 130 comprises and/or or is coupled to a satellite-based network and/or system, such as a global positioning system (GPS) and/or other satellite-based system.
In various embodiments, the display system 135 provides notifications to a driver or other user of the vehicle 100. In various embodiments, the display system 135 provides audio, visual, haptic, and/or other notifications when a potential event between the vehicle 100 and one or more target vehicles is determined, such that the driver or user may take appropriate corrective action.
In various embodiments, the controller 140 is coupled to the sensor array 120, the location system 130, and the display system 135. Also in various embodiments, the controller 140 comprises a computer system (also referred to herein as computer system 14), and includes a processor 142, a memory 144, an interface 146, a storage device 148, and a computer bus 150. In various embodiments, the controller (or computer system) 140 controls vehicle operation, including avoidance and mitigation of vehicle events, based on the data from the sensor array 120. In various embodiments, the controller 140 provides these and other functions in accordance with the steps of the process of
In various embodiments, the controller 140 (and, in certain embodiments, the control system 102 itself) is disposed within the body 104 of the vehicle 100. In one embodiment, the control system 102 is mounted on the chassis 116. In certain embodiments, the controller 104 and/or control system 102 and/or one or more components thereof may be disposed outside the body 104, for example on a remote server, in the cloud, or other device where image processing is performed remotely.
It will be appreciated that the controller 140 may otherwise differ from the embodiment depicted in
In the depicted embodiment, the computer system of the controller 140 includes a processor 142, a memory 144, an interface 146, a storage device 148, and a bus 150. The processor 142 performs the computation and control functions of the controller 140, and may comprise any type of processor or multiple processors, single integrated circuits such as a microprocessor, or any suitable number of integrated circuit devices and/or circuit boards working in cooperation to accomplish the functions of a processing unit. During operation, the processor 142 executes one or more programs 152 contained within the memory 144 and, as such, controls the general operation of the controller 140 and the computer system of the controller 140, generally in executing the processes described herein, such as the process 200 discussed further below in connection with
The memory 144 can be any type of suitable memory. For example, the memory 144 may include various types of dynamic random access memory (DRAM) such as SDRAM, the various types of static RAM (SRAM), and the various types of non-volatile memory (PROM, EPROM, and flash). In certain examples, the memory 144 is located on and/or co-located on the same computer chip as the processor 142. In the depicted embodiment, the memory 144 stores the above-referenced program 152 along with map data 154 (e.g., from and/or used in connection with the location system 130) and one or more stored values 156 (e.g., including, in various embodiments, threshold values of time and/or distance with respect to a possible event between the vehicle 100 and one or more target vehicles on the roadway).
The bus 150 serves to transmit programs, data, status and other information or signals between the various components of the computer system of the controller 140. The interface 146 allows communication to the computer system of the controller 140, for example from a system driver and/or another computer system, and can be implemented using any suitable method and apparatus. In one embodiment, the interface 146 obtains the various data from the sensor array 120 and/or the location system 130. The interface 146 can include one or more network interfaces to communicate with other systems or components. The interface 146 may also include one or more network interfaces to communicate with technicians, and/or one or more storage interfaces to connect to storage apparatuses, such as the storage device 148.
The storage device 148 can be any suitable type of storage apparatus, including various different types of direct access storage and/or other memory devices. In one exemplary embodiment, the storage device 148 comprises a program product from which memory 144 can receive a program 152 that executes one or more embodiments of one or more processes of the present disclosure, such as the steps of the process 200 discussed further below in connection with
The bus 150 can be any suitable physical or logical means of connecting computer systems and components. This includes, but is not limited to, direct hard-wired connections, fiber optics, infrared and wireless bus technologies. During operation, the program 152 is stored in the memory 144 and executed by the processor 142.
It will be appreciated that while this exemplary embodiment is described in the context of a fully functioning computer system, those skilled in the art will recognize that the mechanisms of the present disclosure are capable of being distributed as a program product with one or more types of non-transitory computer-readable signal bearing media used to store the program and the instructions thereof and carry out the distribution thereof, such as a non- transitory computer readable medium bearing the program and containing computer instructions stored therein for causing a computer processor (such as the processor 142) to perform and execute the program. Such a program product may take a variety of forms, and the present disclosure applies equally regardless of the particular type of computer-readable signal bearing media used to carry out the distribution. Examples of signal bearing media include: recordable media such as floppy disks, hard drives, memory cards and optical disks, and transmission media such as digital and analog communication links. It will be appreciated that cloud-based storage and/or other techniques may also be utilized in certain embodiments. It will similarly be appreciated that the computer system of the controller 140 may also otherwise differ from the embodiment depicted in
As depicted in
In various embodiments, sensor data is obtained with respect to both: (i) target vehicles and/or other objects on the roadway in which the vehicle 100 is travelling (step 204) and (ii) states of the vehicle 100 itself (step 206).
In various embodiments, during step 204, data is obtained with respect to one or more other vehicles on or near the roadway on which the vehicle 100 is travelling (referred to herein as “target vehicles”). While the term “target vehicles” is used herein, it will be appreciated that in various embodiments this may also refer to one or more other objects that may not be vehicles (such as, by way of example, trees, rocks, pedestrians, traffic lights, infrastructure, and the like). In various embodiments, during step 204 data is obtained by one or more cameras 126, lidar sensors 127, radar sensors 128, and/or other sensors 131 of
In various embodiments, during step 206, data is obtained with respect to one or more states of the host vehicle 100 itself. In various embodiments, during step 206 sensor data is obtained by one or more inertial measurement unit (IMU) sensors 121 (e.g., IMU data), input sensors 122 (e.g., including a destination of travel for the vehicle 100 for the current vehicle drive, engagement of the braking steering system 108, and/or drive system 110 by a driver or other user, a driver or user's override of one or more automated features of the vehicle 100, and so on), tire sensors 124 (e.g., including tire pressure), speed sensors 125 (e.g., a speed of the vehicle 100 and/or wheels 112 thereof), mass sensors 129 (e.g., a mass or weight of the vehicle 100 and/or one or more components thereof), and so on.
In various embodiments, the sensor data as to both the target vehicle (i.e., of step 204) and the host vehicle 100 itself (i.e., of step 206) are utilized together to generate a probabilistic time-to-event horizon 208 via steps 210-216, described below.
Specifically, in various embodiments, an adaptive prediction horizon is generated for the vehicle 100 (step 210). In various embodiments, the processor 142 of
In various embodiments, during step 210, a motion model is utilized for both the host vehicle 100 (Xhost,k) and the target vehicle (Xtarget,k)in accordance with the following equation:
{circumflex over (X)}
k
=A
k
X
k−1
+B
k
u
k+εk, εk˜N(0,Rk) (Equation 1).
Also during step 210 in various embodiments, a measurement model is also utilized in accordance with the following equation:
Ŷ
k
=C
k
X
k+Δk, Δk˜N(0,Qk) (Equation 2).
Also in various inputs, probabilistic future states of the vehicles {circumflex over (X)}k+f can be calculated by assuming piecewise constant Ak and Bk and update for Ak+f and Bk+f.
With reference to
With reference back to
In various embodiments, during step 212, a probabilistic relative distance {circumflex over (D)}k between the host vehicle 100 and the target vehicle is first calculated in accordance with the following equation:
{circumflex over (D)}
k
={circumflex over (X)}
host,k
−{circumflex over (X)}
target,k (Equation 3).
where {circumflex over (X)}host,k, {circumflex over (X)}target,k are the host vehicle's and target vehicle's probabilistic positions, respectively.
Also in various embodiments, as part of step 212, a change in velocity in the direction of the relative distance vector (e.g., a component that may result in a vehicle event) {dot over ({circumflex over (D)})}k is calculated in accordance with the following equation:
where Δ{circumflex over (v)}(h,t),k is defined as
Δ{circumflex over (υ)}(h,t),k={dot over ({circumflex over (X)})}host,k−{dot over ({circumflex over (X)})}target,k (Equation 4).
where {dot over ({circumflex over (X)})}host,k, {dot over ({circumflex over (X)})}target,k are the host vehicle's and target vehicle's probabilistic velocity vectors, respectively.
Thus, in accordance with various embodiments, a probabilistic time-to-event at time “k” can be calculated in accordance with the following equation:
Also in various embodiments, the time-to-event at time “k+f” can similarly be determined by predicting the states {circumflex over (X)}host,k+f, {circumflex over (X)}target,k+f and by calculating {circumflex over (D)}k+f, Δ{circumflex over (υ)}(h,t),k+f accordingly.
Also in various embodiments, estimates are provided as to prediction uncertainties (step 214). In various embodiments, the processor 142 of
In various embodiments, during step 216, the prediction uncertainties ascertained in step 214 are used to correct the calculation of the probabilistic time-to-event of step 212 over the adaptive prediction horizon of step 210. In various embodiments, the processor 142 corrects the probabilistic time-to-event of step 212 based on the historic data in the previous steps and comparing with what states that was predicted, as determined in step 214.
In various embodiments, the corrected calculation of the probabilistic time-to-event over the adaptive prediction horizon, as determined during step 216, comprises the probabilistic time-to-event horizon 208, as depicted in k+f−1.
With continued reference to
In various embodiments, during step 220, a predictive potential event zone is generated. In various embodiments, the predictive potential event is generated by the processor 142 of
With reference to
With reference back to
In various categorizations of the potential events for the adaptive prediction horizon are determined in step 226. In various embodiments, the values of the time-to-event horizon 208 and the probabilistic risk horizon 218 are combined by the processor 142 of
With respect to
For example, in the depicted embodiment of
By way of additional example, also in the depicted embodiment of
By way of further example, also in the depicted embodiment of
With reference now to
With reference back to
Accordingly, in various embodiments, for categorizations with a relatively lower level of urgency (e.g., considering the time-to-event, the confidence of the prediction, and the potential severity or risk associated with the event, all taken together), such as in the first grouping 512 of
Likewise, also in various embodiments, for categorizations with a relatively medium level of urgency (e.g., considering the time-to-event, the confidence of the prediction, and the potential severity or risk associated with the event, all taken together), such as in the second grouping 510 of
Also in various embodiments, for categorizations with a relatively higher level of urgency (e.g., considering the time-to-event, the confidence of the prediction, and the potential severity or risk associated with the event, all taken together), such as in the third grouping 514 of
Furthermore, in various embodiments, when automatic control is called for (e.g., with respect to the second grouping 510 and the third grouping 514 of
In certain embodiments, the vehicle control is provided based on a desired wheel angle δt to avoid a vehicle event, that is found based on the following equation:
subject to:
ė=M
1
e+M
2δt+M3ρ+M4(θ)+{tilde over (e)} (Equation 9) and
α1e+α2δt≤c,∀{tilde over (e)} (Equation 10),
where M1, . . . , M5 are vehicle parameters for vehicle lateral error dynamics, δt is the desired road wheel angle, which is the control command, ρ is desired curvature, θis the road's bank angle, and {tilde over (e)} is the uncertainty in the error dynamics.
However, in various embodiments, the specific manner of vehicle control may vary, for example based on the categorization of step 226, described above.
In various embodiments, the method then terminates at step 230.
Accordingly, methods, systems, and vehicles are provided for controlling vehicles while avoiding or mitigating vehicle events with target vehicles. In various embodiments, an adaptive prediction horizon is predicted in front of the vehicle, and a probabilistic time-to-event is calculated at various control points along a receding prediction horizon in front of the vehicle. Also in various embodiments, the time-to-event along the prediction horsing is adjusted based on a level of confidence in the predictions and the potential risk of such a vehicle event, in order to provide appropriate vehicle control to avoid or mitigate the vehicle event. In various embodiments, the techniques described herein provide for a reactive approach to avoid or mitigate potential vehicle events with greater lead time as compared with other techniques, for example using the advanced and updated probabilistic approach.
It will be appreciated that the systems, vehicles, and methods may vary from those depicted in the Figures and described herein. For example, the vehicle 100 of
While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the disclosure in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the exemplary embodiment or exemplary embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope of the disclosure as set forth in the appended claims and the legal equivalents thereof.
