Driver behavior, which has a huge impact on the potential for vehicle accidents and other accidents due to driver behavior, has long been a concern. In addition to increasing the risks of a potential accident, driver behavior may have other important cost and environmental impacts as well. For example, rapid or frequent acceleration of a vehicle may result in less efficient fuel consumption or higher concentrations of pollutants. In addition, hard braking or excessive speed may result in increased maintenance costs, unexpected repair costs, or require premature vehicle replacement.
Various driver performance monitoring systems can be used to assess a driver's operation of a vehicle, such as an automobile, or the like. These performance monitoring systems analyze the movement of the vehicle, movement such as speed, braking, acceleration, and swerving, as measured by various sensors on-board the vehicle. The performance monitoring systems may assess the behavior of the driver operating the vehicle and gather data information pertaining to how that person is operating the vehicle. These assessments can be done in both real time and non-real time manners.
Generally, the present disclosure provides systems and methods for remotely monitoring a driver's behavior, in essentially real time, and providing a notification to the driver when the behavior deviates from previously-observed driver actions and/or regulatory limits. If the systems detect at least two aberrational driver events within a time window for the driver, the notification is sent.
One particular implementation described herein is a method that includes receiving sensor data from a plurality of sensors within a vehicle, analyzing that sensor data to detect at least two aberrational driver events, and, responsive to the detection of the at least two aberrational driver events, generating a notification to alert that individual driver of the vehicle. The aberrational driver events are determined from observed driver actions for that individual driver within a time window, the aberrational driver events time-separated and occurring when the observed driver actions for the individual driver satisfy anomaly criteria.
Another particular implementation described herein is a method that includes receiving sensor data regarding observed driver action from a plurality of sensors within a vehicle, comparing that sensor data to anomaly criteria to identify at least two aberrational driver events, and, responsive to the detection of at least two, time-separated aberrational driver events, generating a notification to alert that individual driver of the vehicle.
Yet another particular implementation described herein is a system for remotely monitoring behavior of a driver. The system includes a discrepancy calculation module stored in memory and executable by a processor, and a notification module stored in memory and executable by the processor. The discrepancy calculation module is configured to receive sensor data for an individual driver and to analyze the sensor data to detect at least two aberrational driver events from the data within a time window, the aberrational driver events time-separated and occurring when the data satisfy anomaly criteria. The notification module is configured to notify the driver upon detection of the at least two aberrational driver events.
The disclosure also generally provides one or more computer-readable storage media of a tangible article of manufacture encoding computer-executable instructions for executing on a computer system a computer process. The computer process includes receiving sensor data for an individual driver; analyzing the sensor data to detect at least two aberrational driver events from the data within a time window, the aberrational driver events time-separated and occurring when the data satisfy anomaly criteria; and notifying the driver upon detection of the at least two aberrational driver events.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. These and various other features and advantages will be apparent from a reading of the following detailed description.
The described technology is best understood from the following Detailed Description describing various implementations read in connection with the accompanying drawings.
Provided herein are various systems, modules and methods for remotely monitoring a driver. In general, a driver's actions are monitored by various sensors located in or on the vehicle being driven, and data from those sensors is analyzed to detect if and when the driver performs actions that deviate from predetermined norms. A method described herein includes sending a notification to the driver responsive to detection of at least two driver events that satisfy anomaly criteria defining behavior that is “aberrational” as compared to pre-determined driving norms. In some implementations, the pre-determined driving norms are driver-specific (e.g., based on the driver's own previous driving patterns or behavior). In other implementations, the pre-determined driving norms may be adjusted to take into account the current driving environment and conditions.
In one implementation, anomaly criteria are driver-specific and are, for a particular driver, based on that driver's own driving habits and tendencies, rather than a generic or hypothetical person's driving habits and tendencies. In another implementation, current driving environment is also used to set the anomaly criteria to determine whether the driver's driving habits are aberrational. For example, if the current flow of traffic on the road being driven is, e.g., 10 mph over the posted regulatory limit, the anomaly criteria will be adjusted accordingly, so that a speeding notification is not sent, due to the driver merely ‘keeping up with traffic’ or ‘going with the flow.’
Unlike other monitoring and notification systems, the systems described here are configured to send a notification after two or more of these aberrational driver events have been detected. Sending the notification after two or more of these aberrational driver events have been detected allows leeway for a driving action that is not typical for that driver, but a rare occurrence, such as, e.g., accelerating to get around another vehicle, sharply swerving to avoid a collision with a deer, sharply braking to avoid a ball misplayed into the road, and sliding around a sharp corner in icy conditions. The systems and methods described here do not discipline a driver for a single occurrence of a bad driving event, but advise the driver when the bad driving events are more frequent, e.g., constitute a pattern.
Any notification that is sent, when at least two or more aberrational driver events have been detected, can be a non-accusatory, non-confrontational message, e.g., stating the detected aberrational event as a mere observance, rather than accusing the driver or bad behavior. It is human nature for a driver to become obstinate when confronted, particularly over a single event that may have been unavoidable. The systems and methods described herein are technical improvements over known monitoring systems because the systems and methods take into account human tendencies and human nature, while also accounting for the occasional abnormal driving event, which allows for a more accurate determination of a trend of abnormal driving behavior (e.g., road rage). The systems and methods take into account the normal tendencies of that driver for the situation, allowing for the occasional deviation from normal.
Included in this disclosure are implementations of various methods, systems, modules, computer processes, computer-executable instructions, and computer-readable storage media encoding computer-executable instructions for executing the methods and/or processes.
In the following description, reference is made to the accompanying drawing that forms a part hereof and in which are shown by way of illustration at least one specific implementation. The following description provides additional specific implementations. It is to be understood that other implementations are contemplated and may be made without departing from the scope or spirit of the present disclosure. The following detailed description, therefore, is not to be taken in a limiting sense. While the present disclosure is not so limited, an appreciation of various aspects of the disclosure will be gained through a discussion of the examples provided below.
The vehicle 102 is equipped with a sound-emitting speaker 104, which may be installed in the vehicle 102, either as a factory-installed feature or an after-market feature. In the illustrated implementation, also present within the vehicle 102 is a cellular phone 106. In some implementations, the speaker 104 may be part of the phone 106.
The driving monitoring system 100 includes a plurality of sensors 110, an aberration detector module 120, a notification module 130, a processor 140, memory 150, and a communication system 160.
The plurality of sensors 110 monitor the movement and motion of the vehicle 102. Examples of suitable sensors 110 include any one or more of an accelerometer, a gyroscope, a gravimeter, a pressure sensor, and/or a temperature sensor. With these sensors 110, driving events or actions such as acceleration, speeding, braking or deceleration, erratic braking, swerving or lateral acceleration or G-force, are sensed. In some implementations, a Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), or other location or positioning sensor may be one of the sensors 110.
The sensors 110 may be part of (e.g., in or on) a physical device that is the driving monitoring system 100, or one or more of the sensors 110 may be located in or on the vehicle 102. For example,
The aberration detector module 120 collects and analyzes sensor data from the sensors 110 to identify a sequence of observed driver actions for a driving activity. An observed driver action may be identified based on data from a single sensor or a plurality of sensors 110. Different driving activities may be classified as different “types” of activities, including without limitation speeding, acceleration (e.g., rapid acceleration), deceleration (e.g., rapid deceleration) or hard braking, erratic braking, and swearing or lateral acceleration. Once a series of observed driver actions are identified, the aberration detector module 120 compares the observed driver actions to anomaly criteria to determine whether any of the observed driver actions are “aberrational” with respect to pre-determined driving norms and/or limits. p Anomaly criteria may be derived differently in different implementations. The anomaly criteria can be based on guidelines (e.g., regulatory limits) or predefined behavioral norms. Additionally or alternately, anomaly criteria can be established based on historical behavior (e.g., from the previous week, previous day) of a driver. Still further, anomaly criteria can be based on historical behavior for the same driver that the anomaly criteria is used to evaluate. For example, the aberration detector module 120 may compare real-time observed driver actions with other actions of the same driver observed 10 minutes prior. In some implementations, anomaly criteria is route-specific. For example, a route along an interstate will have a wider range of speeds than a route through a suburban neighborhood.
Additional details regarding the methodology for comparing the data from the sensors 110 and observed driver actions to anomaly criteria to determine an aberrational event are discussed in respect to
Returning to
The notification module 130 may deliver the notification, for example, through the speaker 104 in the vehicle 102, or through a speaker in the cell phone 106. In other implementations, the notification module 130 may send a notification to the cell phone 106 as a text message.
In some implementations, the notification is a non-confrontational message, e.g., stating the detected aberrational events as a mere observance, or posing a question rather than accusing the driver. The notification may or may directly address the observed detected aberrational events. In some implementations, the notification requests a response or acknowledgement from the driver. Examples of possible notifications include: “We noticed that you have changed lanes without signaling and your speed has dropped well below the speed limit. Are you feeling tired or distracted?” and “The temperature has dropped below freezing and you are driving faster than usual. You might want to slow down a bit.” Not tied to any detected aberrational events, the driver may receive a congratulatory notification when no aberrational driver events are detected, or when the driving monitoring system 100 detects that the driving has improved.
Concurrently or subsequently, a notification may be sent to a device remote from the vehicle 102 to inform a third party that a sequence (e.g., at least two) aberrational driver events have been detected. For example, if the vehicle 102 is a fleet vehicle, the owner or manager of the fleet may receive a notification that aberrational driver events were detected. Such a remote notification may be sent to a cell phone, a tablet, a computer, etc. as an audible notification or as a visual notification, e.g., a textual message, a light, an audible tone, or any combination thereof.
The driving monitoring system 100 also includes an appropriate processor 140 and memory 150 storing one or more applications executable by the processor, such as, the aberration detector module 120 and the notification module 130. The processor 140 executes the aberration detector module 120 to perform various operations, e.g., initiating sensor data collection, initiating location determination (if a GPS or other location sensor is present), measuring time for the time period or window, comparing collected data to predetermined observed driver actions, detecting aberrational driver events, etc. Information such as predetermined observed driver actions, detected aberrational driver events, as well as any instructional modules, are stored in memory 150.
The device 100 also includes a communication system 160 to transmit any indication of detected aberrational driver events to the notification module 130 and/or any speaker, e.g., the speaker 104; this transmission may be across a network 170. In some implementations, the communication system 160 transmits from the notification module 130 to the speaker 104 when two aberrational driver events have been detected within the prescribed time period or window.
The communication system 160 can include a short-range communication system for communicating across a local area network (LAN) (e.g., a Wi-Fi, a Bluetooth™ network, BLE (Bluetooth Low Energy) network) from the notification module 130 to a device such as the vehicle speaker 104 or the driver's cellphone 106, which then provides a notification to the driver. Additionally or alternately, the communication system 160 can include a long-range communication system for communicating across a wide-area network (WAN) (e.g., via a radio frequency (RF), cellular-based, or satellite-based system), that can be used to transmit from the notification module 130 via the network 170 to a remote location, such as a fleet manager, via a, e.g., long range network.
A system for monitoring driver or driving performance and issuing a notification responsive to the performance is generically shown in
The methodology 300 includes comparing anomaly criteria 320 for a particular driving activity 310 to observed driver actions 330 for that driving activity 310. The anomaly criteria 320, which determines an aberrational driver event for that driving activity 310, can be based on predetermined limits or based on observed driving behavior for the associated type of driver activity within a time interval. The observed driver actions (e.g., the driver actions 330) are shown in
Each driving activity 310 has associated anomaly criteria 320 defining an acceptable associated upper criteria limit and a lower criteria limit for that driving activity 310; particularly, speed 312 has an anomaly criteria 322 having an upper criteria limit 322a and a lower criteria limit 322b, acceleration 314 has an anomaly criteria 324 having an upper criteria limit 324a and a lower criteria limit 324b, and deceleration 316 has an anomaly criteria 326 having an upper criteria limit 326a and a lower criteria limit 326b. The anomaly criteria 320, and the upper and lower criteria limits, may be one or a combination of a regulatory limit, a predetermined limit or threshold, or based on previously observed driver actions or a behavior pattern or trend.
The anomaly criteria 320 and the upper and lower criteria limits for any driving activity (e.g., anomaly criteria 322, including limits 322a and 322b, for speed 312) may be based on an observed behavior pattern or observed trend of previous behavior. For example, the anomaly criteria 320 may be based on a trend observed by analyzing historical data or information, e.g., from the previous day, from the previous week, the previous time the particular route was driven, etc. The historical data or information may be from that particular driver being monitored or from a fleet of drivers. Additionally or alternately, the anomaly criteria 320 may be based on a more recently observed trend, such as the particular driver's own driving behavior during that trip, for example, in the previous 15 minutes. The observed pattern or trend may be dynamic, shifting over time; for example, the anomaly criteria 320 may be based on the observed driver action 330 ten (10) minutes prior to the current observed driver action 330. For example, the upper criteria limit 322a for speed 312 can be a combination of a posted speed limit for the road that is being traveled and the previously observed driver actions for that route, by that driver, on the previous day.
Any anomaly criteria 320, e.g., the upper criteria limit and/or the lower criteria limit, can further be based considering the current driving environment or conditions, e.g., expected speeds for interstate rush hour, expected or known traffic congestion, bad weather or other environmental conditions, road condition, etc. As another example, the upper criteria limit 322a for speed 312 can be a combination of a posted speed limit for the road that is being traveled, the previously observed driver actions for that route, by that driver, on the previous day, adjusted to take into consideration that it is raining.
Although the anomaly criteria 320 shown in
A method of monitoring driving performance includes analyzing the observed driver actions 330 for at least one driving activity 310 and detecting at least two aberrational driver events, which are observed driver actions 330 outside of the anomaly criteria 320 for that driving activity 310. If the at least two aberrational driver events are observed within a time window, a notification is sent.
Each driving activity 310 has associated observed driver actions 330, which are obtained from sensors (e.g., sensors 110 of
The example methodology 300 of
Exemplary observed driver actions 330 are provided in
In the example provided in
A notification is sent to the driver when two aberrational driver events 350, time-separated from each other within a time window, satisfy anomaly criteria, or in other words, are outside of (either above or below) a criteria limit. In order to trigger a notification, the two aberrational driver events 350 are not simultaneous, but one is subsequent to the other, for example, by 10 seconds, 1 minute, etc., being either sequential data samplings or non-sequential. In some implementations, the notification is sent when the two aberrational driver events 350 are in the same driving activities 310 (e.g., both in speed 312, both in acceleration 314, etc.) in the same time window, whereas in other implementations, the notification is sent when the two aberrational driver events 350 are in different driving activities 310 (e.g., one in speed 312 and one acceleration 314, etc.) non-coincidental but separated by time in the same time window.
The methodology 400 includes comparing a first anomaly criteria 420 and a second anomaly criteria 425 to observed driver actions 430 for a particular type of driving activity 410. The anomaly criteria 420, 425, which are used to determine an aberrational driver event for the driving activity 410, in this example, is based on both previously observed driving behavior for the associated type of driving activity within an immediately preceding time interval (first anomaly criteria 420) and on a regulatory limit (second anomaly criteria 425). The observed driver actions 430 are shown in
Three sequential time windows, t1, t2 and t3 are illustrated in
In this particular example, each time window t1, t2, t3 is 10 minutes, with time window t2 immediately following time window t1 and time window t3 delayed from time window t2. The limits for the first criteria 420 for each time window t1, t2, and t3 are based on the observed driver actions, for this particular example, in the previous 10 minutes. Thus, the limits for the anomaly criteria 420 for time window t1 are based on time window T1, the limits for the anomaly criteria 420 for time window t2 are based on time window T2, and the limits for the anomaly criteria 420 for time window t3 are based on time window T3 In this example, time window T2 overlaps with time window t1. The limit for the second anomaly criteria 425 is continuous and constant, at the posted speed limit.
As with methodology 300 in
Obtained individual observed driver actions 430 for the driver's speed 412 are shown in relation to the anomaly criteria 420 and 425. In the illustrated implementation, after the driver starts driving, time window T1 begins, tracking the observed driver actions 430 to establish a driver pattern and the anomaly criteria 420 for time window t1. In time window T1, the observed driver actions 430 have a slightly increasing trend, thus providing a slightly increasing anomaly criteria 420 for time window t1. As additional observed driver actions 430 are collected and analyzed in time window t1, those same observed driver actions 430 are used to establish the anomaly criteria 420 for time window t2. In time window T2 (which is also time window t1), the observed driver actions 430 have an even more increasing trend, thus further increasing the anomaly criteria 420 for time window t2.
In time window t1, the observed driver actions 430 are within the bounds of the anomaly criteria 420 and the anomaly criteria 425. In time window t2, the individual observed driver actions 430 have an increasing trend yet remain within the anomaly criteria 420, due to anomaly criteria 420 increasing because of the increasing observed driver actions 430 in time window T2. However, two individual observed driver actions 430 are above the regulatory speed limit criteria 425, thus qualifying as aberrational driver events 450. It is seen that a third aberrational driver event 450 is detected after time window t2. Upon detection of the two aberrational driver events 450 in time window t2, the driver of the vehicle is notified of the speeding infraction; this notification may occur immediately after the second aberrational driver event 450 is detected, or there may be a delay.
In this example methodology 400, there is no anomaly criteria 420 in place after detection of the two aberrational driver events 450 and after the notification, to allow the driver to adjust the driving style and resume acceptable driving habits. The delay T0 in having the anomaly criteria 420 may be a set period (e.g., 3 minutes, 5 minutes) or may be based on the individual observed driver actions 430 returning to a steady-state.
After the delay T0, time window T3 begins, tracking the observed driver actions 430 to establish a driver pattern and the anomaly criteria 420 for time window t3. In time window T3, the observed driver actions 430 are fairly level, resulting in a level anomaly criteria 420 for time window t1. In time window t3, one aberrational driver event 450 is detected above the anomaly criteria 420. Because this is a single detected aberrational driver event in that time window t3, no notification is sent.
In operation 704, with the knowledge of the current driving environment, a base criteria is adjusted to obtain the anomaly criteria used to eventually determine aberrational driver events. The base criteria can be a regulatory limit (e.g., speed limit) or be based on previously observed driver behavior or driver actions.
Data and program files may be input to the computer system 800, which reads the files and executes the programs using one or more processors. Some of the elements of the computer system 800 are shown in
The computing system 800 may be a conventional computer, a distributed computer (including a distributed computer such as “the Cloud”), or any other type of computer. The described technology is optionally implemented in software (modules) loaded in memory 808, a storage unit 812, and/or communicated via a wired or wireless network link 814 on a carrier signal (e.g., Ethernet, 3G wireless, 6G wireless, LTE (Long Term Evolution)) thereby transforming the computing system 800 in
The I/O section 804 may be connected to one or more user-interface devices (e.g., a keyboard, a touch-screen display unit 818, etc.) or a storage unit 812. Computer program products containing mechanisms to effectuate the systems and methods in accordance with the described technology may reside in the memory section 808 or on the storage unit 812 of such a computer system 800.
A communication interface 820 is capable of connecting the computer system 800 to a network via the network link 814, through which the computer system can receive instructions and data embodied in a carrier wave. When used in local area networking (LAN) environment, the computing system 800 is connected (by wired connection or wirelessly) to a local network through the communication interface 820, which is one type of communications device. When used in a wide-area-networking (WAN) environment, the computing system 800 typically includes a modem, a network adapter, or any other type of communications device for establishing communications over the wide area network. In a networked environment, program modules depicted relative to the computing system 800 or portions thereof, may be stored in a remote memory storage device. It is appreciated that the network connections shown are examples of communications devices for and other means of establishing a communications link between the computers may be used.
In an example implementation, any or all of the modules from any discrepancy notification system, such as a volume calculating module and/or a notifying module, are embodied by instructions stored in memory 808 and/or the storage unit 812 and executed by the processor 802.
One or more databases storing data used in comparing different measurements may be stored in the disc storage unit 812 or other storage locations accessible by the computer system 800. In addition, the computer system 800 may utilize a variety of online analytical processing tools to mine and process data from the databases. Further, local computing systems, remote data sources and/or services, and other associated logic represent firmware, hardware, and/or software, which may be configured to characterize and compare different locales. A monitoring system of this disclosure can be implemented using a general purpose computer and specialized software (such as a server executing service software), a special purpose computing system and specialized software (such as a mobile device or network appliance executing service software), or other computing configurations. In addition, any or all of the module(s) may be stored in the memory 808 and/or the storage unit 812 and executed by the processor 802.
The implementations described herein are implemented as logical steps in one or more computer systems. The logical operations of the present invention are implemented (1) as a sequence of processor-implemented steps executing in one or more computer systems and (2) as interconnected machines or circuit modules within one or more computer systems. The implementation is a matter of choice, dependent on the performance requirements of the computer system implementing the invention. Accordingly, the logical operations making up the implementations described herein are referred to variously as operations, steps, objects, or modules. Furthermore, it should be understood that logical operations may be performed in any order, adding and omitting as desired, unless explicitly claimed otherwise or a specific order is inherently necessitated by the claim language.
The above specification provides a complete description of the structure and use of exemplary implementations of the invention. The above description provides specific implementations. Features and/or elements may be interchanged among the various implementations. It is to be understood that other implementations are contemplated and may be made without departing from the scope or spirit of the present disclosure. The above detailed description, therefore, is not to be taken in a limiting sense. While the present disclosure is not so limited, an appreciation of various aspects of the disclosure will be gained through a discussion of the examples provided.
Unless otherwise indicated, all numbers expressing feature sizes, amounts, and physical properties are to be understood as being modified by the term “about.” Accordingly, unless indicated to the contrary, any numerical parameters set forth are approximations that can vary depending upon the desired properties sought to be obtained by those skilled in the art utilizing the teachings disclosed herein.
As used herein, the singular forms “a”, “an”, and “the” encompass implementations having plural referents, unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.
Spatially related terms, including but not limited to, “bottom,” “lower”, “top”, “upper”, “beneath”, “below”, “above”, “on top”, “on,” etc., if used herein, are utilized for ease of description to describe spatial relationships of an element(s) to another. Such spatially related terms encompass different orientations of the device in addition to the particular orientations depicted in the figures and described herein. For example, if a structure depicted in the figures is turned over or flipped over, portions previously described as below or beneath other elements would then be above or over those other elements.
Since many implementations of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the claims hereinafter appended. Furthermore, structural features of the different implementations may be combined in yet another implementation without departing from the recited claims.
Number | Name | Date | Kind |
---|---|---|---|
8466781 | Miller | Jun 2013 | B2 |
8604920 | Armitage et al. | Dec 2013 | B2 |
9082308 | Armitage et al. | Jul 2015 | B2 |
9315195 | Armitage et al. | Apr 2016 | B2 |
20080243350 | Harkness | Oct 2008 | A1 |
20100045452 | Periwal | Feb 2010 | A1 |
20110254655 | Maalouf | Oct 2011 | A1 |
20130179027 | Mitchell | Jul 2013 | A1 |
20140167946 | Armitage et al. | Jun 2014 | A1 |
20140199662 | Armitage | Jul 2014 | A1 |
20140306826 | Ricci | Oct 2014 | A1 |
20150019067 | Chakravarty et al. | Jan 2015 | A1 |
20150258892 | Wu | Sep 2015 | A1 |
Number | Date | Country | |
---|---|---|---|
20180297518 A1 | Oct 2018 | US |