Many traffic surveillance systems have been developed to monitor vehicle traffic in real time. The monitoring techniques used by developed nations may include global positioning system (“GPS”) devices fixed to vehicles, fixed-position cameras, inductive loop vehicle detectors in the roads, Doppler radar, and so on. Based on the collected information, these systems typically estimate the speed and volume of the traffic at various locations. Because the roads are typically in good condition and traffic typically proceeds in an orderly manner in developed nations, the speed and volume information can be quite useful indications of traffic patterns. The speed and volume information can be reported to drivers (e.g., via a web site and a dedicated traffic reporting device) so that they can plan their trips accordingly. Some drivers may move up or delay their anticipated departure times or select alternative routes based on the reported information. The speed and volume information can also be reported to a department of transportation to help control the rate at which vehicles enter the flow of traffic. Because the costs of these techniques for monitoring traffic are quite high, traffic is typically monitored only at the busiest stretches of roads.
These monitoring techniques, however, may not provide predictions of traffic patterns that are as useful in developing nations for various reasons. One reason is that the road quality tends to be quite variable in developing nations. For example, bumpy roads and potholes may be common even in city centers. Another reason is that many different types of vehicles may be used in developing nations. For example, roads may be congested by two-wheeled vehicles (e.g., scooters), three-wheeled vehicles (e.g., automatic rickshaws), four-wheeled vehicles (e.g., passenger cars), and larger-number-wheeled vehicles (e.g., buses and trucks). Each type of vehicle may only be able to travel at certain speeds depending on the road conditions. For example, only two-wheeled vehicles may be able to travel on certain narrow or bumpy roads. Another reason is that traffic flows may be more chaotic because drivers in developing nations may not adhere to right-of-way protocols at intersections and may rely on sounding their horns to help establish their right-of-way. Although such sounding of horns is socially unacceptable or illegal in many developed nations, it is acceptable and quite common in many developing nations.
A system for sensing road and traffic conditions (“sensing system”) is provided. A sensing system includes a traffic sensing server and mobile traffic sensing (“MTS”) devices that send traffic reports to the traffic sensing server. An MTS device may use an accelerometer to detect potholes, to detect when the vehicle is braking, to detect whether the MTS device is being transported via a vehicle or a pedestrian, and so on. The MTS device determines the orientation of the accelerometer relative to the vehicle based on the direction of travel as indicated by braking and the influence of gravity. The MTS device may also use a microphone of a mobile phone to collect ambient noise, which can help determine whether horns are sounding and whether the vehicle is enclosed or open. The MTS device may also communicate with neighboring MTS devices using a local area wireless network (e.g., Bluetooth) to send and receive traffic reports to one another. The MTS device may report the various conditions to the traffic sensing server for accurate assessment of traffic conditions at stretches of road through which vehicles transporting MTS devices travel.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
A road and traffic sensing system that collects information on traffic conditions is provided. In some embodiments, the sensing system includes a traffic sensing server and a mobile traffic sensing (“MTS”) device that sends traffic reports to the traffic sensing server. An MTS device may be a smart phone that includes a 3-axis accelerometer (or a mobile phone that is augmented with an external 3-axis accelerometer) with an MTS system that includes software components to collect traffic-related information relating to a vehicle (or person) that is transporting the MTS device and to generate traffic reports based on analysis of the collected traffic-related information. Because an MTS device can be an existing smart phone with only software components added, the sensing system can be implemented using existing mobile phone infrastructure. An MTS device may use the accelerometer to detect potholes, to detect when the vehicle is braking, to detect whether the MTS device is being transported via a vehicle or a pedestrian, and so on. Because it is unlikely that the accelerometer of the MTS device would have its orientation aligned with the vehicle in which it is being transported, the MTS device determines the orientation of the accelerometer relative to the vehicle based on the direction of travel as indicated by braking and the influence of gravity. This orientation allows the MTS device to determine changes in acceleration in the direction of travel (e.g., braking) and in the vertical direction (e.g., caused by a pothole). The MTS device may also use a microphone of the mobile phone to collect ambient noise, which can help determine whether horns are sounding and whether the vehicle is closed (e.g., car) or open (e.g., scooter). The MTS device may also communicate with neighboring MTS devices using a local area wireless network (e.g., Bluetooth) to send and receive traffic reports to one another. An MTS device may use such traffic reports to determine whether the vehicle is a mass transit vehicle based on proximity to the neighboring devices. The MTS device may report the various conditions (e.g., braking, horns sounding, potholes detected, and travel speed) to the traffic sensing server for accurate assessment of traffic conditions at stretches of road through which vehicles transporting MTS devices travel.
In some embodiments, an MTS device is a smart phone, a mobile phone with an integrated accelerometer that includes various computation, communication, and sensing capabilities. The computing capabilities may include a central processing unit, memory, and an operating system. The communication capabilities may includes a radio for basic cellular voice communication (e.g., GSM) and for collecting cellular tower information and a personal-area wireless network (e.g., local area wireless network, Bluetooth, and WiFi) for communicating with neighboring MTS devices. The sensing capabilities may include a microphone, a GPS receiver, an accelerometer, and a camera. Each of these capabilities is provided by some smart phones that are currently on the market—although no smart phone necessarily has all these capabilities. The MTS devices may include various subsets of these capabilities. Certain MTS devices may be augmented with additional capabilities. For example, an accelerometer with a local area wireless network interface can be connected to certain smart phones that do not have those capabilities.
In some embodiments, an MTS device needs to virtually orient its accelerometer to the travel direction of the vehicle and the vertical direction. The MTS device performs this virtual orientation based on the influence of gravity on the accelerometer when stationary or traveling at a steady speed and based on the influence on the accelerometer during a braking event as detected using GPS locations. The MTS device uses the influence of gravity to help virtually orient the vertical axis of the accelerometer to the vertical axis of the vehicle. The MTS device uses the influence of braking to help virtually orient the forward axis of the accelerometer to the forward axis of the vehicle.
In general, the accelerometer of an MTS device is a 3-axis accelerometer that can be arbitrarily oriented relative to the travel direction and vertical direction of the vehicle. In the following, the axes of the accelerometer are represented as (x, y, z), and the axes of the vehicle are represented as (X, Y, Z). For example, if the accelerometer of a smart phone is oriented with its x axis toward the top of the phone, its y axis toward the right of the phone, and its z axis toward the back of the phone, then a phone positioned vertically in a cradle would have its z axis aligned with the direction of travel and its x axis aligned opposite the vertical axis. The x axis of the vehicle is in the direction of travel, the y axis of the vehicle is to the right of the direction of travel, and the z axis is in the down direction. The MTS system of an MTS device uses a Z-Y-Z formulation of Euler angles to determine the orientation of the accelerometer relative to the orientation of the vehicle. The orientation of the accelerometer can be represented by a pre-rotation angle of φpre about Z, followed by a tilt angle of θtilt about Y, and then a post-rotation angle of ψpost again about Z. When the accelerometer is stationary or in steady motion, the only acceleration it experiences is due to gravity. (Note: It is assumed that the accelerometer will report the strength of the force field so the acceleration for the z axis, αz, is 1 g, assuming it is correctly aligned with the z axis of the vehicles.) The tilt operation is the only operation that changes the orientation of the z axis relative to the Z axis. As a result, the following equation illustrates the transformation from z to Z:
αz=αz cos(θtilt).
Since αz=1 g, the tilt angle is represented by the following equation:
θtilt=cos−1(αz).
The pre-rotation followed by tilt would also result in a nonzero acceleration for the x and y axes, αx and αy, due to the effect of gravity. The values of αx and αy are equal to the projections of the 1 g acceleration along the Z axis onto the x and y axes. To calculate the projections, the MTS system decomposes each of αx and αy into their components along the X and Y axes, respectively. When the tilt (about Y) is applied, only the components of αx and αy along the X axis would be affected by gravity. Thus, after the pre-rotation and the tilt, the values are represented by the following equations:
αx=cos(φpre)sin(θtilt)
αy=sin(φpre)sin(θtilt)
solving for φpre results in the following equation:
φpre tan(φpre)=αy/αx
followed by the following equation:
φpre=tan−1(αy/αx).
To estimate θtilt and φpre using these equations, the MTS system may identify periods when the MTS device is stationary (e.g., at a traffic light) or in steady motion (e.g., using GPS to estimate speed). Alternatively, the device may use an averaged value of αx, αy, and αz collected over a certain period of time. The averaged value may be the median over a 10-second window. Thus, by computing αx, αy, and αz over short time windows, the MTS system is able to estimate θtilt and φpre on an ongoing basis relatively inexpensively (i.e., by not using a high power consumption device such as a GPS device). Any significant change in θtilt and φpre would indicate a significant change in the orientation of the MTS device. In such a case, the MTS system can perform a complete virtual re-orientation of the accelerometer.
Since post-rotation (like pre-rotation) is about the Z axis, it has no impact with respect to the gravitational force field, which runs parallel to the Z axis. As a result, the MTS system uses a different force field with a known orientation that is not parallel to the Z axis to estimate the angle of post-rotation. The MTS system could use either the acceleration or braking of the vehicle, each of which produces a force field in a known direction of the X axis, which is in line with the direction of motion of the vehicle. To obtain a measurement for such a force, the MTS system monitors the location of the vehicle via the GPS device to identify periods of sharp deceleration without a significant curve in the path (i.e., the GPS track is roughly linear). Given the measured accelerations (αx, αy, αz), and the angles of pre-rotation φpre and tilt θtilt, the MTS system estimates the angle of post-rotation ψpost as the one that maximizes the estimate of α′x of the acceleration along the X axis, which is the direction of braking.
The MTS system computes α′x by running through the steps of pre-rotation, tilt, and post-rotation in sequence. At each step, the MTS system applies the decomposition discussed above. Starting with just pre-rotation, the result is represented by the following equations:
α′Xpre=αx cos(φpre)+αy sin(φpre)
α′Ypre=−αx sin(φpre)+αy cos(φpre).
After the tilt is applied, the result is represented by the following equations:
α′Xpre-tilt=α′pre cos(θtilt)−αz sin(θtilt)
α′Ypre-tilt=α′Ypre.
Finally, after post-rotation is applied, the result is represented by the following equation:
α′X=α′Xpre-tilt-post=α′Xpre-tilt cos(ψpost)+α′Ypre-tilt sin(ψpost).
Expanding these equations, results in the following equation:
To maximize α′x consistent with the period of sharp deceleration, the MTS system sets its derivative with respect to
to zero, as represented by the following equation:
−[(αx cos(φpre)+αy sin(φpre))cos(θtilt)−αz sin(θtilt)] sin(ψpost)+[−αx sin(φpre)+αy cos(φpre)] cos(ψpost)=0,
which yields an estimate of ψpost represented by the following equation:
Thus, to estimate the post-rotation angle, the MTS system first estimates the pre-rotation and tilt angles. The MTS system then identifies an instance of sharp deceleration using GPS data and records the mean αx, αy, and αz during this period (e.g., 2 seconds). Compared to estimating the pre-rotation and tilt angles, estimating the post-rotation angle is more elaborate and expensive, requiring the GPS device to be turned on. Thus, the MTS system monitors the pre-rotation and tilt angles on an ongoing basis, and only if there is a significant change in these or there is other evidence that the MTS device's orientation may have changed (e.g., a call being made or other user interaction with the phone) does the MTS system perform a complete virtual re-orientation of the accelerometer.
In some embodiments, the MTS system detects braking events, which may indicate poor driving conditions (e.g., fog) or heavy traffic. Although the GPS data could be used to detect a braking event, it would incur high energy costs. To avoid this cost, the MTS system monitors the acceleration in the forward direction as indicated by the accelerometer. If the mean acceleration over a sliding window of a certain number of seconds exceeds a threshold acceleration, then the MTS system signals a braking event. For example, if the deceleration is at least 1 m/s2 sustained over four seconds (i.e., a decrease in speed of at least 14.4 kmph over 4 seconds), then the MTS system signals a braking event.
In some embodiments, the MTS system uses different algorithms to detect a pothole based on whether the vehicle is traveling at a slow speed or not. A slow speed may be defined as below a slow speed threshold (e.g., 25 kmph). If the vehicle is not traveling at a slow speed, then the MTS system checks for a spike in the acceleration in the vertical direction. If a spike in the acceleration is greater than a threshold acceleration, then the MTS system signals that a pothole has been detected. If the vehicle is traveling at a slow speed, then the MTS system looks for a sustained dip in the acceleration in the vertical direction, for example, if the object is below a threshold acceleration for at least 20 milliseconds (e.g., seven samples at a sampling rate of 310 Hz). Since only an approximate vehicle speed is needed, the MTS system may use a convex hull location algorithm (described below) to estimate the location of the MTS device at different points in time and derive the speed from the changes in location.
In some embodiments, the MTS system may determine whether the MTS device is being transported by a pedestrian or by a vehicle or is stationary. Since a vehicle traveling in stop-and-go traffic will brake often, the MTS system relies on the characteristics of vehicle braking events to distinguish the vehicle in stop-and-go traffic traveling at a pedestrian speed from a pedestrian transporting the MTS device. So, when braking events are detected while the speed of the MTS device is below a pedestrian speed threshold, the MTS system signals that a vehicle, rather than a pedestrian, is transporting the MTS device.
In some embodiments, the MTS system samples a microphone to determine whether horns are being sounded. The MTS system collects sound samples over a time period and performs a discrete Fourier transform to convert the samples to the frequency domain. The MTS system then detects frequency spikes, which may be defined to be a certain number (e.g., 5 to 10) of times greater than the mean amplitude of the frequencies. The sounding of a horn may be defined as having at least two frequency spikes with one being within the 2.5 kHz to 4 kHz range, which is a characteristic frequency that corresponds to the range of highest human ear sensitivity. One skilled in the art will appreciate, however, that different criteria can be used to detect different sounds by different types of horn. The criteria can be determined based on experimental sampling of horn sounds.
In some embodiments, the MTS system samples a microphone to determine the enclosure type of a vehicle. The MTS system may sample the microphone over a certain period (e.g., 10 seconds) and calculate the mean sound level. If the sound level is nearer a minimum sound level than to a maximum sound level, then the MTS system designates the enclosure type as closed (e.g., a car). If, however the sound level is nearer the maximum sound level, then the MTS system designates the enclosure type as open (e.g., a scooter). The MTS system may establish the minimum and maximum sound levels by sampling sound levels of vehicles known to be open and vehicles known to be closed. The ambient noise of an open vehicle that is very high may be an indication of chaotic traffic.
In some embodiments, the MTS system compares the location of the MTS device to the location of neighboring MTS devices to determine whether the vehicle type is mass transit or not. If the MTS system determines that several neighboring MTS devices are in close proximity and have similar traffic characteristics (e.g., braking patterns and vehicle speed), then the MTS system assumes that all the devices are on a mass transit vehicle such as a bus or train. The presence of many neighboring MTS devices in close proximity, but not on the same mass transit vehicle, may be an indication of congested traffic.
In some embodiments, the MTS system uses algorithms performed based on data collected by lower energy consumption devices to determine when to enable algorithms based on data collected by higher energy consumption devices. For example, a cellular localization algorithm based on cellular tower (or cellular transmitter) information requires data from the cellular radio, which is a lower energy consumption device, while a GPS localization algorithm based on GPS data requires data from the GPS device, which is a higher energy consumption device. The MTS system uses the cellular localization algorithm to identify the approximate location of a pothole. When an MTS device (that MTS device or another) later approaches the approximate location of that pothole, the MTS system may enable the GPS localization algorithm to determine a more precise location of the pothole when it is encountered again. As described above, the MTS system also uses the braking activity and the corresponding change in acceleration as measured by the accelerometer to determine whether a reorientation of the accelerometer should be performed, which uses GPS data.
The components of the traffic sensing system may include a central processing unit, memory, input devices, output devices, and storage devices, and communication ports. The memory and storage devices are computer-readable storage media that may be encoded with computer-executable instructions that implement the components of the traffic sensing system, which means a computer-readable storage medium that contains the instructions. In addition, the instructions, data structures, and message structures may be stored or transmitted via a data transmission medium, such as a signal on a communication link.
The components of the traffic sensing system may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, and so on that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments. For example, depending on the bandwidth of the communication link between the MTS devices and the traffic sensing server, some of the functionality described as being performed at an MTS device may be performed at the traffic sensing server.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. Accordingly, the invention is not limited except as by the appended claims.
This application claims the benefit of U.S. Provisional Application No. 61/024,798, filed Jan. 30, 2008, and entitled “TRAFFICSENSE: RICH MONITORING OF ROAD AND TRAFFIC CONDITIONS USING MOBILE SMARTPHONES,” which is incorporated herein in its entirety by reference.
Number | Date | Country | |
---|---|---|---|
61024798 | Jan 2008 | US |