This relates generally to automatically detecting distracted driver patterns for safe vehicle navigation.
Distracted driving has significantly increased, particularly in light of the wide scale use of smartphones and other mobile devices without proper vehicle integration. Moreover, drunk driving, drowsy driving, speeding, and driving inexperience continue to contribute to vehicle collisions. According to the National Highway Traffic Safety Administration, in 2014, distracted driving was a factor in 10% of crash fatalities, drunk driving was a factor in 31% of crash fatalities, drowsy driving was a factor in 2.6% of crash fatalities, and speeding was a factor in 28% of crash fatalities. (See http://www-nrd.nhtsa.dot.gov/Pubs/812219.pdf.) Therefore, a solution to automatically detect distracted, or otherwise unsafe, drivers for safe vehicle navigation is desirable.
Examples of the disclosure are directed to using pattern recognition or other algorithms to automatically recognize distracted (e.g., unsafe) driving behavior for safe vehicle navigation. The vehicle can use unsafe driving patterns to classify another vehicle as being driven by a distracted driver. In this way, the vehicle can automatically warn the driver and/or avoid the other vehicle driven by the distracted, or otherwise unsafe, driver for safe vehicle navigation.
In the following description of examples, references are made to the accompanying drawings that form a part hereof, and in which it is shown by way of illustration specific examples that can be practiced. It is to be understood that other examples can be used and structural changes can be made without departing from the scope of the disclosed examples.
Some vehicles, such as automobiles, may include various sensors for detecting and gathering information about the vehicles' surroundings, such as information about other vehicles and the other vehicles' drivers. Examples of the disclosure are directed to recognizing distracted driver patterns based on various considerations such as characteristics about other vehicles, characteristics about the drivers of the other vehicles, and characteristics about the vehicle itself, among other considerations. The vehicle can use distracted driving patterns or any other irregular driving patterns to automatically classify another vehicle as being driven by a distracted driver. It is understood that while the examples of the disclosure describe classifying distracted drivers, the teachings of the disclosure analogously extend to classifying any form of irregular driving for safe vehicle navigation. In this way, the vehicle can automatically warn the driver and/or avoid an unsafe vehicle. This can help the vehicle avoid distracted drivers, drunk drivers, drowsy drivers, inexperienced drivers, reckless drivers, or any other form unsafe drivers.
In some examples, vehicle 100 can automatically take precautionary actions after determining that vehicle 104 is being driven by a distracted or unsafe driver. In some examples, vehicle 100 can be driving autonomously and can automatically take steps to avoid getting near vehicle 104 (e.g., without driver input). For example, vehicle 100 can automatically move into lane 110, slow down to create further distance with the other vehicle, safely drive past vehicle 104, stay out of vehicle 104's blind spots, notify the driver or any third party, or allow the driver to take over driving operations. In some examples, vehicle 100 can provide a visual representation of the distracted driver vehicle (during automated and non-automated driving operations). For example, vehicle 100 can be equipped with a windshield heads up display and can project an overlay over vehicle 104 on the windshield (e.g., highlight the vehicle in red or any other color). In some examples, vehicle 100 can provide a visual representation of vehicle 104 in vehicle 100's infotainment system, a smart phone, or any other electronic device with a display. In some examples, vehicle 100 can activate a sound and/or audio indicator signifying that a distracted driver classification has been made.
At 202, the activity of other vehicles can be monitored to recognize distracted, or otherwise dangerous, driver patterns (e.g., as described with reference to
In some examples, the vehicle can monitor the activity of other vehicles using optical cameras. For example, the vehicle can analyze images of other vehicles around it. In some examples, the vehicle can determine whether another vehicle is not staying within the center of its lane. For example, the vehicle can analyze image data (or video data) of another vehicle to determine the distance between the wheels of the other vehicle and the lane dividers on one or both sides of the other vehicle. The vehicle can use this information to monitor the other vehicle's position within the other vehicle's lane over time. This can allow the vehicle to determine, without driver input, whether the driver of the other vehicle allows his or her vehicle to go outside of its driving lane (e.g., drive over or past driving lane dividers). This can also allow the vehicle to automatically determine how frequently the other vehicle is correcting its steering toward the center of its driving lane (e.g., correcting its steering every few seconds, every 10 seconds, etc.). Allowing a vehicle to partially enter an adjacent lane or failing to routinely steer a vehicle toward the center of its driving lane (e.g., not correcting the steering every few seconds, every 10 seconds, etc.) can be indicative of a distracted driver. In some examples, the vehicle can determine if a driver is delayed in moving forward at an intersection after a traffic light changes from red to green. For example, the vehicle can compare image data (or video data) of the other vehicles from when the traffic light is red to image data (or video data) of when the traffic light is green. Using this data, the vehicle can determine, without driver input, how long after an intersection light turns green a particular vehicle's brake lights turn off (indicating a forward motion) and/or compare, without driver input, the position of the other vehicles over time. In some examples, the vehicle can automatically identify when another vehicle turns on its hazard lights. Again, the vehicle can keep track of these distracted driver indications, or any other indications that a driver is distracted or otherwise dangerous for each vehicle in the vicinity at 202 (e.g., by counting the indications, measuring the duration of the indications, measuring the frequency of the indications, etc.). In some examples, the vehicle can automatically determine that vehicle activity is not an indication of a distracted driver. For example, the vehicle can determine that another vehicle changing lanes with its turn signal on is not an indication of a distracted driver even though the other vehicle entered into an adjacent lane. As another example, the vehicle can determine that another vehicle pulling over to allow an emergency vehicle to pass is not an indication of a distracted driver. In some examples, the driver can provide feedback at 202 regarding the vehicle's automated distracted driver determinations during driving operations to enhance the system's accuracy in identifying distracted driver indications (e.g., through machine learning as described with reference to
At 204, the activity of the drivers of other vehicles can be monitored (e.g., as described with reference to
At 206, the time of day (or night) can be monitored. In some examples, the time of day can be determined by an internal clock in the vehicle, an external clock, or any other device that can determine the time.
At 208, the speed of the vehicle itself can be monitored (e.g., as described with reference to
At 210, additional external information about the vehicles and/or drivers of the vehicles can be monitored. In some examples, the additional external information can include information obtained from other vehicles on the road. For example, a third-party vehicle can monitor, using its own sensors, the activity of itself, the vehicle and its driver, and/or other vehicles and their drivers (as described above), and can communicate that data to other vehicles in the vicinity. For example, the third party vehicle can determine that another vehicle is tailgating it and can communicate that information to other vehicles in the vicinity. In some examples, the third-party vehicle can communicate its distracted driver classifications to other vehicles. For example, the third party vehicle can determine that another vehicle, or even the third party vehicle itself, is being driven in an unsafe manner (as described above) and can communicate that information to other vehicles in the vicinity. In this way, the vehicle can use the data from other vehicles' sensors and the classifications from other vehicles as input to make its own distracted driver classifications. In some examples, the additional external information can include information from stationary sensors along roads or at intersections. These stationary sensors can include ultrasonic sensors, laser sensors, radar sensors, cameras, LIDAR sensors, or any other sensors that can be used to detect one or more characteristics about vehicles and/or drivers. These stationary sensors can be configured as on-site or remote systems for detecting distracted, or otherwise dangerous, drivers. These on-site or remote systems can be configured to communicate information about distracted, or otherwise dangerous, drivers to vehicles and/or drivers within the vicinity of the stationary sensors. These on-site or remote systems can also be configured to communicate information about distracted, or otherwise dangerous, drivers to the police, medical personnel, or any third party.
At 212, the vehicle can autonomously make a distracted driver classification without driver input based on the results of one or more steps 202, 204, 206, 208, and 210 (e.g., as described with reference to
At 214, a precautionary action can automatically be taken based on the distracted driver classification at 212 (e.g., as described with reference to
Vehicle control system 300 can include an on-board computer 310 that is coupled to the cameras 306, sensors 307, GPS receiver 308, clock 305, and external information interface 304, and that is capable of receiving the image data from the cameras and/or outputs from the sensors 307, the GPS receiver 308, clock 305, and external information interface 304. The on-board computer 310 can be capable of determining whether the driver of another vehicle is distracted, or otherwise dangerous, as described in this disclosure. On-board computer 310 can include storage 312, memory 316, communications interface 318, and processor 314. Processor 314 can perform any of the methods described with reference to
In some examples, the vehicle control system 300 can be connected to (e.g., via controller 320) one or more actuator systems 330 in the vehicle and one or more indicator systems 340 in the vehicle. The one or more actuator systems 330 can include, but are not limited to, a motor 331 or engine 332, battery system 333, transmission gearing 334, suspension setup 335, brakes 336, steering system 337, and door system 338. The vehicle control system 300 can control, via controller 320, one or more of these actuator systems 330 during vehicle operation; for example, to control the vehicle during autonomous driving operations, which can utilize the distracted driver classifications by the on-board computer 310, using the motor 331 or engine 332, battery system 333, transmission gearing 334, suspension setup 335, brakes 336, and/or steering system 337, etc. Actuator systems 330 can also include sensors that send dead reckoning information (e.g., steering information, speed information, etc.) to on-board computer 310 (e.g., via controller 320). The one or more indicator systems 340 can include, but are not limited to, one or more speakers 341 in the vehicle (e.g., as part of an entertainment system in the vehicle), one or more lights 342 in the vehicle, one or more displays 343 in the vehicle (e.g., as part of a control, entertainment, heads up display system(s) in the vehicle), and one or more tactile actuators 344 in the vehicle (e.g., as part of a steering wheel or seat in the vehicle). The vehicle control system 300 can control, via controller 320, one or more of these indicator systems 340 to provide visual and/or audio indications that a distracted, or otherwise dangerous, driver was classified.
Thus, the examples of the disclosure provide various ways to utilize a vehicle's automated distracted (e.g., unsafe) driver classifications to safely navigate the vehicle autonomously or manually.
Therefore, according to the above, some examples of the disclosure are directed to a system comprising: one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: determining one or more characteristics about an area surrounding a vehicle using the one or more sensors; determining whether the one or more characteristics about the area surrounding the vehicle is indicative of a distracted driver; wherein: the one or more characteristics about the area surrounding the vehicle comprises one or more of: one or more characteristics about one or more other vehicles; one or more characteristics about one or more other drivers; and in response to determining whether the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver: in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver, performing a precautionary action; and in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is not indicative of the distracted driver, foregoing performing the precautionary action. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles partially entering into an adjacent driving lane without a turn signal; and partially entering into the adjacent driving lane without the turn signal is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about one or more other vehicles comprises the one or more other vehicles failing to routinely steer the one or more other vehicles toward the center of its driving lane; and failing to routinely steer the one or more other vehicles toward the center of its driving lane is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles failing to keep up with the flow of traffic; and failing to keep up with the flow of traffic is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles accelerating or braking suddenly; and accelerating or braking suddenly is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles having hazard lights on; and having hazard lights on is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles traveling at a speed equal to or above a first threshold speed; and traveling at the speed equal to or above the first threshold speed is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles traveling at a speed equal to or below a second threshold speed; and traveling equal to or below the second threshold speed is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles traveling at a speed between the first threshold speed and the second threshold speed; and traveling at the speed between the first threshold speed and the second threshold speed is not indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other vehicles comprises the one or more other vehicles tailgating the vehicle or another vehicle; and tailgating the vehicle or another vehicle is indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the one or more other drivers comprises one or more of opening a door, using a cell phone, reading a book, reading a newspaper, putting on makeup, eating, shaving, and looking away; and opening a door, using a cell phone, reading a book, reading a newspaper, putting on makeup, eating, shaving, and looking away are each indicative of the distracted driver. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the precautionary action comprises one or more of slowing the vehicle down, driving past the one or more other vehicles, navigating the vehicle to a different driving lane, staying out of the one or more other vehicles' blind spots, and notifying a third party. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the precautionary action further comprises providing a visual representation of the one or more other vehicles. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the precautionary action further comprises activating an indicator in the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the indicator is one or more of a headlight, a hazard light, a smog light, a horn, a speaker, and an alarm system in the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the area surrounding the vehicle is received from an external source. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the external source comprises one or more of: the one or more other vehicles; and one or more stationary sensors. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the area surrounding the vehicle further comprises a time. Additionally or alternatively to one or more of the examples disclosed above, in some examples, determining the one or more characteristics about the area surrounding the vehicle using the one or more sensors occurs while operating the vehicle in a mode of vehicle operation, wherein the mode of vehicle operation comprises one of: an automated driving mode; an assisted driving mode; and a manual driving mode. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the precautionary action further comprises changing the mode of vehicle operation. Additionally or alternatively to one or more of the examples disclosed above, in some examples, determining whether the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver comprises: maintaining a count of the one or more characteristics about the area surrounding the vehicle that are indicative of another vehicle being driven by an unsafe driver; determining whether the count of the one or more characteristics about the area surrounding the vehicle that are indicative of another vehicle being driven by the unsafe driver is equal to or above a threshold; and in response to determining whether the count of the one or more characteristics about the area surrounding the vehicle that are indicative of another vehicle being driven by the unsafe driver is equal to or above the threshold: in accordance with a determination that the count of the one or more characteristics about the area surrounding the vehicle that are indicative of another vehicle being driven the unsafe driver is equal to or above the threshold, performing the precautionary action; and in accordance with a determination that the count of the one or more characteristics about the area surrounding the vehicle that are indicative of another vehicle being driven the unsafe driver is not equal to or above the threshold, foregoing performing the precautionary action. Additionally or alternatively to one or more of the examples disclosed above, in some examples, determining whether the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver comprises: determining an average one or more characteristics about one or more other vehicles; and comparing the one or more characteristics about one or more other vehicles to the average one or more characteristics about one or more other vehicles.
Some examples of the disclosure are directed to a non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising: determining one or more characteristics about an area surrounding a vehicle using one or more sensors; determining whether the one or more characteristics about the area surrounding the vehicle is indicative of a distracted driver; wherein: the one or more characteristics about the area surrounding the vehicle comprises one or more of: one or more characteristics about one or more other vehicles; one or more characteristics about one or more other drivers; and in response to determining whether the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver: in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver, performing a precautionary action; and in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is not indicative of the distracted driver, foregoing performing the precautionary action.
Some examples of the disclosure are directed to a vehicle comprising: one or more sensors; one or more processors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: determining one or more characteristics about an area surrounding the vehicle using one or more sensors; determining whether the one or more characteristics about the area surrounding the vehicle is indicative of a distracted driver; wherein: the one or more characteristics about the area surrounding the vehicle comprises one or more of: one or more characteristics about one or more other vehicles; one or more characteristics about one or more other drivers; and in response to determining whether the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver: in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver, performing a precautionary action; and in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is not indicative of the distracted driver, foregoing performing the precautionary action.
Some examples of the disclosure are directed to a method comprising: determining one or more characteristics about an area surrounding a vehicle using one or more sensors; determining whether the one or more characteristics about the area surrounding the vehicle is indicative of a distracted driver; wherein: the one or more characteristics about the area surrounding the vehicle comprises one or more of: one or more characteristics about one or more other vehicles; one or more characteristics about one or more other drivers; and in response to determining whether the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver: in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is indicative of the distracted driver, performing a precautionary action; and in accordance with a determination that the one or more characteristics about the area surrounding the vehicle is not indicative of the distracted driver, foregoing performing the precautionary action.
Although examples have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of examples of this disclosure as defined by the appended claims.
This application claims the benefit of U.S. Provisional Application No. 62/357,299, filed Jun. 30, 2016, the entirety of which is hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
62357299 | Jun 2016 | US |