The present disclosure relates to safety systems and methods for a vehicle, and in particular to a system and method for determining if a driver of a vehicle is using an electronic device.
Driving while using an electronic device, for example a smartphone, is one of the leading causes of traffic accidents in the United States. The United States Department of Transportation notes that cell phones contribute to 1.6 million auto accidents each year which cause 500,000 injuries and take 6,000 lives. Many states require that electronic devices only be used in a hands-free mode while driving a vehicle, and have taken other steps to discourage use of electronic devices while driving a vehicle.
There are several approaches to solving the problem of detecting when an electronic device is being used in a vehicle. Some of these approaches are simplistic, for example assuming that if the device is moving above walking speed, then the device must be in a moving vehicle. These approaches use the GPS sensor on the device to determine the speed of the device. However, these approaches do not distinguish between the driver of the vehicle and the passenger(s), thereby providing inaccurate results at best. Other approaches attempt to solve the driver versus passenger dilemma by asking the user of the device a question that requires intense concentration. For the passenger, this is no problem at all. For the driver, answering a question that requires intense concentration violates the very reason for the vehicle safety system: preventing distracted driving of a vehicle. A few approaches use the accelerometer and gyroscope sensors to detect movement of the mobile device; but these approaches also cannot distinguish who is causing the movement of the mobile device: the driver or a passenger.
Prior solutions have attempted to solve the driver versus passenger identification problem by challenging the electronic device user with a simple “unlock” test. This approach works by placing a test on the device screen when the vehicle is in motion, such as a math problem. The theory is that solving the test requires the device user to focus on the screen. Unfortunately, this approach requires additional driver attention on the device screen to solve the test, which presents the unintended consequence of actually making the problem worse since solving the test requires the driver to focus on the test, further distracting the driver from actually driving the vehicle.
It would be desirable to have a system and method to perform one or more of the following: to determine if a driver of a vehicle was using an electronic device while the vehicle was moving, to distinguish between driver and passenger usage of the electronic device, and to disable certain features of the device for driver usage while the vehicle is moving.
An electronic beacon, for example a Bluetooth beacon, can be used to locate an electronic device, for example a mobile device or cell phone, within a vehicle and to determine if the device is being used in hands free mode. Accelerometers, gyroscopes or other sensors in the electronic device or the vehicle can be used to determine if the electronic device is being used. Global Positioning System (GPS) or other sensors in the electronic device or the vehicle can be used to determine if the vehicle is moving. From this information, the system can determine if the driver is using an electronic device while the vehicle is moving. The system can distinguish driver mobile device usage from passenger mobile device usage.
In some embodiments, the system can disable certain features on the device when the system determines that the device is in a vehicle that is moving and the device is in close proximity to the driver. The device features that can be disabled can include, but are not limited to sending and receiving text messages, sending and receiving e-mails, accessing the Internet via Web browser, and placing and receiving telephone calls.
A vehicle safety system is disclosed that controls usage of a mobile device in a vehicle. The vehicle safety system includes an electronic beacon, a proximity sensor, a movement sensor and a processor. The electronic beacon is located in the vehicle, and the electronic beacon transmits a location signal. The proximity sensor generates device location data using the location signal. The device location data monitors the location of the mobile device in the vehicle. The movement sensor detects movement of the vehicle or the mobile device, and generates movement data. The processor receives the device location data and the movement data, determines whether the mobile device is being used by a driver of the vehicle using the device location data, and determines whether the vehicle is moving using the movement data. The processor monitors usage of the mobile device based on whether the mobile device is being used by the driver of the vehicle while the vehicle is moving. On some mobile platforms, the processor can also limit usage of the mobile device while the vehicle is moving.
The electronic beacon can be a Bluetooth beacon that transmits a Bluetooth signal, and the proximity sensor can be a Bluetooth component on the mobile device that detects the Bluetooth signal of the electronic beacon. The motion sensor can be a GPS sensor on the mobile device that detects movement of the mobile device. The electronic beacon can be located in the vehicle between a steering column and a driver-side doorjamb.
The vehicle safety system can also include a device usage monitor and an enforcement list of mobile device functionality. The device usage monitor detects functionality of the mobile device being used, and generates functionality data that indicates what functionality of the mobile device is currently being used. The enforcement list indicates mobile device functionality to be limited by the vehicle safety system when the mobile device is being used by the driver of the vehicle while the vehicle is moving. The processor can receive the functionality data, determine if any functionality of the mobile device currently being used is on the enforcement list, and if any functionality of the mobile device currently being used is on the enforcement list then the processor can limit that functionality of the mobile device according to the enforcement list.
The vehicle safety system can also include device motion sensors that detect motion of the mobile device in the vehicle, and that generate device motion data. The processor can receive the device motion data and determine whether the driver of the vehicle is moving the mobile device using the device location data and the device motion data. The processor can limit usage of the mobile device based on whether the mobile device is being used by the driver of the vehicle while the vehicle is moving and whether the driver of the vehicle is moving the mobile device while the vehicle is moving. The device motion sensors can be an accelerometer sensor and a gyroscope sensor on the mobile device.
The processor can determine a device motion/usage profile using the device motion data and the functionality data. At selected upload times, the processor can transmit the device location data, the movement data, the functionality data, the device motion data and the device motion/usage profile to a server.
A vehicle safety method for controlling usage of a mobile device in a vehicle is disclosed that includes generating device location data indicating the location of the mobile device in the vehicle; generating vehicle movement data indicating whether the vehicle is moving; determining whether the mobile device is being used by a driver of the vehicle based on the device location data; and limiting usage of the mobile device based on whether the mobile device is being used by the driver of the vehicle while the vehicle is moving.
Generating device location data and determining whether the mobile device is being used by the driver can include using a wireless receiver on the mobile device to receive a location signal from an electronic beacon located in the vehicle; determining a distance between the mobile device and the electronic beacon using the location signal; and determining whether the distance between the mobile device and the electronic beacon locates the mobile device at a driver's seat or at a passenger seat in the vehicle. Alternatively, generating device location data and determining whether the mobile device is being used by a driver of the vehicle can include using a wireless receiver on the mobile device to receive location signals from one or more electronic beacons located in the vehicle; determining a distance between the mobile device and each of the one or more electronic beacons using the location signals; determining a device location using the one or more distances between the mobile device and each of the one or more electronic beacons; and determining whether the device location locates the mobile device at a driver's seat or at a passenger seat in the vehicle.
The vehicle safety method can also include monitoring activation and usage of functionality of the mobile device; generating device functionality data indicating activation and usage of functionality of the mobile device; maintaining an enforcement list of mobile device functionality to be limited when the mobile device is being used by the driver of the vehicle while the vehicle is moving; determining if any functionality of the mobile device that is on the enforcement list is attempting to activate, and if any functionality of the mobile device on the enforcement list is attempting to activate, limiting or disabling activation of that functionality of the mobile device according to the enforcement list. In an embodiment where text messaging is on the enforcement list, the vehicle safety method can include allowing a user to edit a default response text message to be sent in response to any text message received by the user while the user is driving the vehicle and the vehicle is moving; detecting receipt of a text message on the mobile device of the user; and automatically sending the default response text message in response to the received text message received by the user if the user is driving the vehicle and the vehicle is moving.
The vehicle safety method can also include generating device motion data indicating motion of the mobile device in the vehicle; determining whether the driver of the vehicle is moving the mobile device; and generating a device motion/usage profile indicating usage of the mobile device by the driver based on the functionality data and the device motion data. Generating device motion data can include monitoring accelerometer outputs of an accelerometer sensor on the mobile device; monitoring gyroscope outputs of a gyroscope sensor on the mobile device; computing a gross movement vector based on the accelerometer outputs and the gyroscope outputs; and determining motion of the mobile device in the vehicle based on the difference between the gross movement vector and a minimum movement threshold.
The vehicle safety method can also include scoring the driver of the vehicle based on the device motion/usage profile while the driver is driving the vehicle. The vehicle safety method can also include uploading the device location data, the vehicle movement data, the functionality data, the device motion data and the device motion/usage profile to a server. The vehicle safety method can also include allowing an administrator to customize the enforcement list of mobile device functionality to be limited when the mobile device is being used by the driver of the vehicle while the vehicle is moving.
The above-mentioned aspects of the present disclosure and the manner of obtaining them will become more apparent and the disclosure itself will be better understood by reference to the following description of the embodiments of the disclosure, taken in conjunction with the accompanying drawings, wherein:
Corresponding reference numerals are used to indicate corresponding parts throughout the several views.
The embodiments of the present disclosure described below are not intended to be exhaustive or to limit the disclosure to the precise forms in the following detailed description. Rather, the embodiments are chosen and described so that others skilled in the art may appreciate and understand the principles and practices of the present disclosure.
One or both of the beacons 110, 112 and the components of the electronic device 200 can be used to precisely locate the electronic device 200 within the vehicle 100 and to determine if the electronic device 200 is being used in hands free mode. A component of the electronic device 200 can be used to determine the distance of the electronic device 200 from the beacon 110. For example, if the beacon 110 is a Bluetooth beacon, the Bluetooth component 332 of the electronic device 200 can be used to determine the distance to the beacon 110. The accelerometer sensor 320 and the gyroscope sensor 322 of the electronic device 200 can be used to determine if the electronic device 200 is being moved within the vehicle 100. The GPS sensor 330 of the electronic device 200 can be used to determine if the vehicle 100 is moving. The operating system 300 can report to the driver safety component 302, or the driver safety system 302 can directly determine, these sensor readings and if other functionality of the device 200 is being activated. Combining this information, the driver safety system 302 can determine if the driver is using the electronic device 200 while the vehicle 100 is moving and what functionality of the device 200 is being used. The placement of the beacon 110 near the driver's seat 108 and away from the passenger seat 118 enables the system to separate driver mobile device usage from passenger mobile device usage using the single beacon 110.
An exemplary control method 400 for a vehicle safety system is illustrated in
The beacon 110 can be registered with the device 200 and the driver safety method can be manually or automatically activated when the device 200 comes into close proximity of the beacon 110. This can take place similar to how an electronic device can be registered with an automobile Bluetooth system, and then will be recognized for hands free functions when in close proximity of the automobile.
At block 402, the driver safety system determines the location of the electronic device 200 in the vehicle 100. The beacon 110 can be a Bluetooth Low Energy (BLE) beacon that is located near the driver seat 108 between the driver side door jamb 106 and the steering column 104 of the vehicle 100. The Bluetooth component 322 on the electronic device 200 can calculate the distance to the beacon 110. The driver safety system can separate distances into multiple categories: for example, immediate, near, far and unknown. As an example, the immediate category can include distances of less than 1 meter, the near category can include distances from 1 to 10 meters, the far category can include distances from 10 to 50 meters, and the unknown category can include distances greater than 50 meters. The distance between the device 200 and the beacon 110 can be used to determine the location of the device 200 in the vehicle 100. Based on this location and/or category, the user of the device 200 can be classified as either Driver or Passenger. The immediate category can be used to represent the Driver and the near category can be used to represent a Passenger.
At block 404, the driver safety system determines if the device 200 is in a vehicle 100 that is moving. Many electronic devices and vehicles come equipped with GPS (Global Positioning System) sensors that can be used to determine current location as well as speed. The GPS sensor 330 of the device 200 can be used to determine if the device 200 is in a moving vehicle. The GPS sensor data indicates the speed at which the device 200 is traveling. Any speed above zero indicates that the device 200 is moving. When combined with the beacon detection determined at block 402, the driver safety system can determine where the device 200 is in the vehicle 100 and whether that vehicle 100 is moving.
At block 406, the driver safety system determines if the device 200 is being moved within the vehicle 100. Many electronic devices come equipped with three-dimensional accelerometer and gyroscope sensors that can be used to determine if the device is being moved. The accelerometer and gyroscope sensors 320, 322 of the device 200 can be used to determine if the device 200 is being moved. An exemplary method for detecting motion is to use six data points: Accelerometer X value (Ax), Accelerometer Y value (Ay), and Accelerometer Z value (Az) from the accelerometer sensor 320; and Gyroscope X value (Gx), Gyroscope Y value (Gy), and Gyroscope Z value (Gz) from the gyroscope sensor 322. The individual sensor readings fluctuate slightly over time; however, when treated as a vector, large changes indicate movement of the device 200. A gross movement vector (v) for the device 200 can be calculated as:
v=Square Root (Ax2+Ay2+Az2+Gx2+Gy2+Gz2)
The device accelerometer and gyroscope sensors 320, 322 typically report these values several times per second and indicate changes in acceleration and rotation of the device 200. A MINIMUM_THRESHOLD value can be used to eliminate minor fluctuations in the gross movement vector v. When the calculated value of the vector v is above the MINIMUM_THRESHOLD, the driver safety system can determine that the device 200 is being moved.
At block 408, the driver safety system characterizes a motion and/or usage profile of the device 200. The motion detection of device 200 at block 406 detects gross movement of the device 200, and each of these device movements can be further classified by examining the trends in the sensor data and other information. For example, when the accelerometer vector (Ax, Ay, Az) shows large changes, but the gyroscope vector (Gx, Gy, Gz) shows little or no changes, the system could determine that the device 200 is being picked up, as evidenced by the rapid acceleration. Whereas, if the accelerometer vector shows little or no changes, but the gyroscope vector shows large changes, the system could determine that the device 200 is being tapped on, as evidenced by the slight twisting motion caused by the tapping. The driver safety system can categorize and catalog the motions and usages of the device 200 into a “motion/usage profile”. This motion/usage profile can include but is not limited to the following types of device motions and usages, which are each described with an example of how they can be detected:
The types of motions characterized by the system can be customized by using a combination of sensor values and rules. This extensible system allows operators of the system to change the motion and usage profile settings based on the policies being enforced. For example, if the system is deployed using devices that utilize a bar-code scanner, the operator could define a motion profile for the scanning motion. This profile could be used for monitoring package delivery drivers who are scanning packages while driving. Each motion profile can define which sensors and applications are being used and which values are required to satisfy the motion/usage profile.
At block 410, the driver safety system can disable one or more features on the device 200. On some device platforms, application developers are permitted to customize and even disable certain features of the platform. For example, on Google's Android operating system, a developer can implement code that listens for incoming text messages and prevents the user from seeing those messages while in a moving vehicle. This may be beneficial for a driver, but not for a passenger of the vehicle. Feature disablement can include, but is not limited to, sending and receiving text messages, sending and receiving e-mails, accessing the Internet via Web browser, and placing and receiving telephone calls.
Feature disablement can be accomplished by monitoring the list of current applications that are running on the device 200, and comparing this list against all applications that the system is authorized to block (text messaging, e-mail, web browser, phone, etc.). If the system has determined the device 200 is in a moving vehicle 100 (Block 404), and the device 200 is in close proximity to the driver (Block 402), then the driver safety system can intercept any attempts to access an application that the system is authorized to block. The driver safety system can also allow a user to predetermine a reply message, for example a predetermined voice message for an incoming telephone call or a predetermined text reply to an incoming text message. This predetermined reply message can be sent by the driver safety system when it determines that the requested application should be blocked because the user is driving. For example, if the user of the device is driving and receives a text message, the driver safety system can send a predetermined text reply message back to the sender of the message such as “Sorry, I can't reply to you right now since I am driving.”
At block 412, the driver safety system can award points or score a driver based on his/her historical motion/usage profile data. As motion/usage data is captured over time, a pattern of a user's behavior with his/her mobile device starts to emerge. By assigning points or scores to each of the motion/usage profile categories, a user's behavior can be quantified. For example, Typing on the device 200 might be given a relatively high score compared to Picking Up the device 200, since Typing may be considered “worse” than Picking Up. The driver safety system can have a scoring system that allows a user's motion/usage profile to be scored over several time periods: for example one day, one week, one month, one year, etc. These scores can be used to track a user's behavior and compare against other users. In aggregate, these scores can also be used to create a safe driving guideline. For example, a score of 5 Typing in one day might indicate an unsafe motion/usage profile. The table below illustrates one possible implementation of a driver safety scoring system:
The table above shows an exemplary implementation of a driver safety scoring system. The scoring system for the motion data can be customized by an administrator or operator based on the policies being enforced. The points assigned for each violation can be defined accordingly. For example, if an administrator determines that using E-mail while driving is an important action to prevent, relatively more points can be assigned to the E-mail motion. Likewise, if using the Camera is considered less important, then relatively fewer points can be assigned to the Camera motion. By adjusting this scoring system, the administrator or operator can configure the system to match the policies being enforced.
At block 414, the driver safety system stores and/or forwards driver safety data from the mobile device 200 or the other device where the driver safety system is resident, for example the vehicle 100 or beacon 110. Driver safety data from the sensors and other components of the device 200 can be captured continuously while the device 200 is in the immediate proximity of the beacon 110 in the vehicle 100. This data can be cataloged and stored to properly detect device usage, detect motion, classify the motion/usage profile, and calculate the motion/usage profile score. A data collection system can cache this data locally and transmit the driver safety data to a remote server. The driver safety data can be captured in real-time in a local database. As an example, the driver safety data can include sensor data that is captured several times per second, and the captured sensor data can include:
While the disclosure has been illustrated and described in detail in the drawings and foregoing description, such illustration and description is to be considered as exemplary and not restrictive in character, it being understood that illustrative embodiment(s) have been shown and described and that all changes and modifications that come within the spirit of the disclosure are desired to be protected. It will be noted that alternative embodiments of the present disclosure may not include all of the features described yet still benefit from at least some of the advantages of such features. Those of ordinary skill in the art may readily devise their own implementations that incorporate one or more of the features of the present disclosure and fall within the spirit and scope of the present invention as defined by the appended claims.
This application is a continuation application of U.S. patent application Ser. No. 15/355,999, filed on Nov. 18, 2016 and issued as U.S. Pat. No. 9,749,866, entitled “VEHICLE SAFETY SYSTEM AND METHOD”; which claims priority to U.S. Provisional Patent Application Ser. No. 62/257,773, filed Nov. 20, 2015 entitled “VEHICLE SAFETY SYSTEM AND METHOD”, the disclosures of which are expressly incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
8527013 | Guba et al. | Sep 2013 | B2 |
8634816 | Xiao et al. | Jan 2014 | B2 |
8803677 | Miller | Aug 2014 | B1 |
9037125 | Kadous | May 2015 | B1 |
20110105097 | Tadayon | May 2011 | A1 |
20120071151 | Abramson et al. | Mar 2012 | A1 |
20130150004 | Rosen | Jun 2013 | A1 |
20140335902 | Guba | Nov 2014 | A1 |
20150099480 | Reiter | Apr 2015 | A1 |
20150256999 | Doorandish | Sep 2015 | A1 |
20150296371 | Kong | Oct 2015 | A1 |
20160021238 | Abramson | Jan 2016 | A1 |
20160044575 | Rajeevalochana | Feb 2016 | A1 |
20160174049 | Levy et al. | Jun 2016 | A1 |
20170019525 | Hannon et al. | Jan 2017 | A1 |
20170144671 | Memani et al. | May 2017 | A1 |
20170257479 | Marcum | Sep 2017 | A1 |
Number | Date | Country | |
---|---|---|---|
20170374553 A1 | Dec 2017 | US |
Number | Date | Country | |
---|---|---|---|
62257773 | Nov 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15355999 | Nov 2016 | US |
Child | 15687646 | US |