This invention relates to the field of smart transportation, specifically through the development of an interactive smartphone application capable of estimating real-time transport mode and CO2 emissions based on mode of transport.
The commoditization of sensors in mobile phones has increased their availability and provided researchers with opportunities to study large populations in a very low cost manner. One area of interest which can take advantage of the pervasiveness of these sensors is ‘activity inference’, i.e., the ability to tell what activity a person is performing based upon sensor information. ‘Activity inference’ has been applied in different areas, such as health monitoring, recommendation systems and study of personal behavior. Our attention here is focused on the transportation mode inference, to support the real time estimation of the carbon footprint of a traveler, using information from mobile phone sensors.
Each day, hundreds of people move around cities without realizing the effect of their transportation mode on the environment. According to Industrial Energy Analysis, transportation accounts for one quarter of the world's greenhouse gas emissions [1], with personal mobility consuming about two thirds of the total transportation energy use [2]. As carbon dioxide is considered one of the most important green house gases (GHG), environmental scientists have interest in making the public more aware of their impact on CO2 emissions in order to aid its reduction. As a direct result, a myriad of web sites and mobile phone applications have been created to calculate the individual carbon footprint, i.e., the personal carbon emission.
These carbon footprint calculators fall into three broad groups based on the type of data input required: aggregated data, individual diary, and trip-by-trip data. All current web applications require manual data input—such as the number of miles traveled per year, vehicle type and size, etc., whereas some mobile phone applications use different levels of automatic recognition. The main drawback of these latter applications is that they use only the GPS velocity and heading to detect and identify the transportation mode. This can potentially cause two problems: This approach does not work in places where the GPS is weak due to the canyoning effect or is entirely absent [6]. Moreover, these systems do not exploit the latitude/longitude information: the user location can be snapped into digital maps to get a robust evaluation of the transportation mode (e.g., a vehicle moving on a railway will likely be a train). On the other hand, the accelerometer data is preferable for its availability but its measurements are deeply influenced by how the phone is being held. For example, if the user does not move but shakes the phone, the accelerometer gauges fake accelerations and the classification becomes inaccurate. Our system aims to combine the complementary sensors' behavior to guarantee transportation mode accuracy and availability.
The system disclosed herein is the first integrated smartphone system that is able to leverage built-in sensors to detect in real time, mode of transportation and CO2 emissions, and present them to the user in order for them to view their individual CO2 emissions from a journey. Furthermore it also provides the user with a means of comparison, allowing users to share their travel routes and emissions with other users. Consequently they are able to identify whether they contribute to an increase or decrease in average CO2 emissions. This information enables users to make more informed decisions as to their choice of transport and route of their journey, in order to reduce CO2 emissions generated.
The system of the invention for automatically estimating in real time a person's carbon dioxide emissions includes a mobile device including an accelerometer, a GPS receiver and a data plan connection for computing distance travelled. The mobile device, such as a smartphone, is programmed to pre-process signals from the accelerometer to address variable inter-sample intervals. It is also programmed to apply a supervised machine learning algorithm based on functional trees to features computed by Fast Fourier Transform of total acceleration acting on the mobile device and computed from the pre-processed signals to determine the mode of transportation of the mobile device. Carbon dioxide emissions are computed from the mode of transportation and distance travelled.
CO2GO, as the system disclosed herein is known, proposes a novel method to identify the transportation mode in real-time using inertial information gathered from mobile phone sensors. The algorithm, based on a Functional Tree algorithm, provides a real-time, fine grained identification of the transportation mode among eight classes: bus, subway, walk, bike, train, car, motorcycle and still. The system also leverages the result of the identification for estimating the emissions of CO2 in real time. Finally, an application implementing the classification algorithm for mobile phone based on Android operating systems has been developed and tested.
While there has been some research in this field, most efforts have focused on the deployment of ad hoc sensors carried by people to identify the transportation mode, hence limiting the size of deployment and accessibility. In contrast, CO2GO uses standard smartphones and a custom developed algorithm using data from an accelerometer, GPS and online map readings. Furthermore, the algorithm is structured in a way that allows the cell phone to be randomly positioned in a user's pocket. The device does not require specific positioning or orientation.
Our approach for the first time enables an unlimited number of people to run this application all day long on standard smartphones. We make use of an existing infrastructure (smartphones) that are already available in large numbers, Potentially, this could allow very large numbers of people to adopt it, providing them with information on their mobility patterns. Also, this will allow an unprecedented collection of data on mobility when shared with researchers,
In order to restrict the battery consumption by the applications, CO2GO implements a battery saving strategy that automatically switches to an idle state, turning off the accelerometer, GPS and data connection, when no movement is detected.
Finally, the data is made relevant to the user by converting it into CO2 emissions (as a function of mode of transportation and distance) and burnt calories (health monitoring). This information is provided through the user interface, which is updated in real-time alongside a map tracing the user's route. The user is able to view their own CO2 emissions from a journey, as well as other user's total and average emission values through the “city” view. The information provides the user with an insight into whether they contribute to an increase or decrease in average CO2 emissions. Furthermore this application provides information, which allows the user to make more informed decisions as to their journeys. For example, one might choose an alternative route that is used by another user and depicted on the “city” view, based on its lower emissions. CO2GO allows users to tap into the collective effort to reduce CO2 emissions created by urban mobility.
A description of the CO2O application is provided here, with each element of its development examined in detail. The first section describes the algorithm for the automatic identification of the transportation mode, which consists of two further sub-sections. First, the signals acquired from the accelerometers and GPS are pre-processed and combined with digital maps to extract the characteristic features. Then, a supervised machine learning algorithm based on the Functional Trees is applied to the features computed. The second section provides information as to the distance computation and battery savings strategy.
The CO2GO application may be implemented on any mobile phone provided it has an accelerometer and a GPS receiver. The digital map can be integrated inside the application or can be queried using web services (in our implementation we used OpenStreetMapx-API). For the algorithm design and testing, a development phone was chosen: a Google Nexus One with the Google Android 2.2 operating system. Primarily this phone was employed, as it is programmable with a fully-fledged programming language based on Java syntax, inside an integrated development environment. The accelerometer integrated in the Google Nexus One is a BMA150. It measures the accelerations within a range of ±2 g (±19.61 m/s2 ) with a sensitivity of 4 mg (0.039 m/s2). The OpenStreetMap maps are chosen because they provide information about the railway, subway and bike-lane.
The traces collection and labeling according to different transportation modality is 130 performed through a custom application developed for such purpose.
Google Nexus One samples the accelerations with an average sampling rate of 25 Hz and the GPS data (absolute position according to WGS-84 datum, accuracy and speed) with a frequency of 1 Hz. Unfortunately, the operating system did not guarantee a fixed sampling frequency which varies according to the user activity. For this reason, data pre-processing is required.
Signal Pre-Processing: The transportation mode classification algorithm is based on features computed on the FFT coefficients of the total acceleration and it relies on samples acquired with a fixed sampling time. Moreover, different mobile phones have different average sampling frequencies, due to computation power or active services. Therefore, the FFT cannot be performed directly, but a signal pre-processing phase is used. Piecewise linear interpolation is employed as it is faster to compute and easier to implement on the mobile phone. Moreover, the high-frequencies introduced by the piecewise linear interpolation can be removed by a low-pass filter. The signal is therefore interpolated, re-sampled with a constant sampling frequency of 50 Hz and then filtered with a digital, second-order, low-pass filter with a cut-off frequency of 5 Hz. The average slower sampling frequency among the mobile phone that we were able to try was 25 Hz. Therefore, the filter has been designed to have an attenuation of −20 dB in stop band at 12.5 Hz according to the Nyquist theorem (see
Moreover, the filter order is chosen as a compromise between the attenuation rate and the implementation complexity.
Feature computation: Acceleration features are computed from an orientation invariant signal, rather than using a fixed, known or estimated orientation. Such signal is the total acceleration, âtot(t) computed as follows:
{circumflex over (a)}tot(t)=√{square root over ({circumflex over (a)}x(t)2+ây(t)2+âz(t)2)}, (1)
where âx(t), ây(t) and âz(t) are the accelerations according to the reference system shown in
Other orientation invariant signals can be computed, such as the sum of the absolute value of the acceleration. However, the total acceleration has been chosen for its clear physical meaning.
The signal âtot(t) differs from one transportation mode to another.
The windows size and overlap—i.e., the percentage of overlapping of two consecutive windows—affect the temporal resolution of the spectrogram and therefore the classification accuracy.
The frequency resolution is also important for the classification algorithm.
The accuracy of the classification strongly depends on these three parameters: window size, window overlap and number of FFT coefficients. The value of the parameter which maximizes the classification accuracy is computed through an optimization carried out in two steps.
The GPS signal provided by the phone every 1 Hz measures the velocity, orientation with respect to north pole, latitude, and longitude of the receiver. The features used by the machine-learning algorithm are computed by analyzing this information inside the time window.
Moreover, the latitude and the longitude are combined with digital maps to strengthen the approach accuracy. In
The phone periodically queries a digital map to extract all the railway, subway and bike-lanes near the GPS points. For each GPS point (xGPS, yGPS) the algorithm computes the geometrical distance (2) d from all the over ground segments. The minimum distance is computed for each category (railway, subway, bike-lane) and then used as an additional feature.
For our CO2GO application, supervised algorithms are used, primarily as we have a training set which is labeled with the actual transportation mode. Different supervised-learning techniques can be used as classifier. We compared different algorithms available and the Functional Tree algorithm has been shown to perform better then all the others. Furthermore, they can correlate the FFT coefficients value with the transportation mode. In this way, the signal processing can be iteratively optimized for further improving the classification accuracy.
The functional tree algorithm has been trained using Weka [17], a well-known environment for knowledge analysis. The tree has been generated using the algorithm proposed in [12] and validated using the k-fold cross validation [13], where k is equal to 10. The k-fold cross validation is preferred because it performs better for small size sets.
It is worth noting that each instance represents a 5-seconds window of the signal.
The feature set is therefore composed of:
Distance computation: The CO2 emissions are computed as the sum of the product between the distance traveled with a transportation mode and a coefficient, estimated by environmental agencies (Coefficients are summarized in Table 1). The model used in the computation can be formalized as follows.
All the coefficients, except the ones for walking and biking, have been provided by the French Environmental Agency.
Previous work has computed the distance traveled exploiting the Global Positioning System GPS). All modern smartphones contain a GPS receiver, however the estimation accuracy of their position is low. Although, considering the approximation on the computation of the CO2 coefficients, it can be considered sufficient for our purpose. Nonetheless, the GPS technology has a main drawback: It does not perform in an in-doors environment. This raises the issue of how to compute the distance in a building, underground or inside tunnels.
As an example,
l The Internet provides several web services for computing the distance or the route between a source and a destination. Most of them provide a basic function for free, and then upgrade service after the payment of a fee. For example, Google Maps allows only 2,500 queries per day at its direction web service. This limitation limits the number of computations allowed. However, every query can contain one source, one destination and up to 8 waypoints, which means 9 legs. This pushes the limitation up to 22,500 points.
Energy efficiency: A key factor in every smartphone application that extensively uses sensors is its power consumption. Previous works [5],[9],[11] have shown the impact of the GPS receiver on the battery duration. We have estimated in 10 continuous hours the time needed by the application to completely discharge the phone battery (1400 mAh). It is worth noticing that CO2GO is usually not running continuously. A battery saving strategy (depicted in
The classification algorithms have been trained and validated using real-world data, gathered using a custom mobile application able to label data with the transportation mode. The generated functional tree has 110 leaves and a size of 219, with the confusion matrix associated with the classification algorithm in Table 2.
The experimental results show an accuracy identification of around 90%, with walking correctly classified 406 times out of 407. The confusion matrix further allows us to identify the transportation modes which require improvements to their classification.
The CO2GO application presents information through a user interface, with the mode of transport shown to ensure the correct functioning. Travel time, distance covered and associated CO2 emissions are depicted in real time, along with a map of the user's route. The “city” view provides insight into how the user's carbon emissions and travel distance compare to their fellow user's total and average values. This enables the user, among others, to identify whether they are contributing to an increase or decrease in average CO2 emissions. Within the “share” screen a user can give others access to select travel routes and their emissions as well as being able to consult other user's low emission routes-tapping into a collective effort to reduce CO2 emissions generated by urban mobility. Finally, the present invention informs users about calories burned during their individual journey, offering an insight into health issues while on the move.
CO2GO as described here is thus a software engine responsible for the collection and interpretation of data generated by a smartphone's sensors. Accelerometer and GPS traces are interpreted by the algorithm which allows eight different transportation modes to be identified: bus, subway, walk, bike, train, car, motorcycle and still. Furthermore the GPS data alongside online map queries construct the route of the user's journey, which may be viewed by the user. The system leverages the results of the identification for estimating the emissions of CO2 in real time, thus providing the users with an insight into their personal carbon footprint, alongside additional information such as the total calories burned during their journey. The CO2GO application also provides a “city” view, which allows the user to view other user's total and average CO2 emissions values. It consequently provides the individual with a tool to identify whether they are contributing to an increase or a decrease in average CO2 emissions. Furthermore the “share” screen permits users to share travel routes and emissions. Finally the invention offers user's information about the calories burnt during their journey.
The numbers in brackets refer to the references listed herein. The contents of all these references are incorporated herein by reference.
It is recognized that modifications and variations of the invention will be apparent to those of ordinary skill in the art and it is intended that all such modifications and variations be included within the scope of the appended claims.
[1] Sthephane de la Rue du Can and L. Price. Sectoral trends in global energy use and greenhouse gas emissions. Energy Policy, 36(4):1386-1403, 2008.
[2] International Energy Agency. International energy agency, open energy technology bulletin. http://www.iea.org/impagr/cip/archived_bulletins/issue_no23.htm, November 2004.
[3] Carbon Diem. http://www.carbondiem.com.
[4] Green Meter. http://hunter.pairsite.com/greenmeter/.
[5] Simjee, F.; Chou, P. H.; “Accurate battery lifetime estimation using high-frequency power profile emulation,” Low Power Electronics and Design, 2005. ISLPED '05. Proceedings of the 2005 International Symposium on, vol., no., pp. 307-310, 8-10 Aug. 2005.
[6] B. W. Parkinson, “GPS error analysis,” Global Positioning System: Theory and Applications, vol. 1, pp. 469-483, 1996.
[7] Lester, J., Hurvitz, P., Chaudhri, R., Hartung, C. and Borriello G. (2008) MobileSense—Sensing Modes of Transportation in Studies of the Built Environment. In proceedings of UrbanSense 2008, November 2008, Raleigh, N.C., USA, pp. 46-50.
[8] MSP Research Initiative. http://seattle.intel-research.net/MSP/.
[10] J. Ross, N. Shantharam, and B. Tomlinson. Collaborative filtering and carbon footprint calculation, In Sustainable Systems and Technology (ISSST), 2010 IEEE International Symposium on, pages 1-6. IEEE, 2010.
[11] W. Ballantyne, G. Turetzky, G. Slimak and J. Shewfelt. “Achieving low energy-per-fix in cell phones,” GPS World, July 2006.
[12] J. Gama (2004). Functional trees. Machine Learning, Springer.
[13] McLachlan, G. J. and Do, K. A. and Ambroise, C. (2004) “Analyzing microarray gene expression data”, Wiley
[14] Lustrek, M. and Kaluza, B. (2008) “Fall Detection and Activity Recognition with Machine Learning,” Informatica, vol. 33, pp. 205-212.
[15] Phithakkitnukoon, S. and Horanont, T. and Di Lorenzo, G. and Shibasaki R. and Ratti, C., “Activity-Aware map: Identifying human daily activity pattern using mobile phone data”, Human Behavior Understanding—Lecture Notes in Computer Science, pp. 14 25, Springer, 2010.
[16] Liao, L. and Patterson D. J. and Fox D. and Kautz H., “Learning and inferring transportation routines,” Artificial Intelligence vol. 17, pp. 311-331, 2007.
[19] Bao. L. and Intille, S. S. (2004), “Activity recognition from user-annotated acceleration data”, Pervasive Computing, pp. 1-17, Springer.
[20] Nham, B. and Siangliulue, K. and Yeung, S. “Predicting Mode of Transport from iPhone Accelerometer Data”, Stanford University class project.
This application claims priority to provisional application Ser. No. 61/429,820 filed on Jan. 5, 2011 and to provisional application Ser. No. 61/429,928 filed on Jan. 5, 2011, the contents of both of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
61429928 | Jan 2011 | US | |
61429820 | Jan 2011 | US |