The present application claims priority to and all the benefits of Italian Patent Application No. 102017000144561, filed on Dec. 14, 2017, which is hereby expressly incorporated herein by reference in its entirety.
The present invention relates to techniques for recognizing the driving style of a driver of a land vehicle on the basis of information on the dynamics of the land vehicle, of the type that envisages acquiring information on the dynamics of the vehicle from sensors and calculating, as a function of said information on the dynamics of the vehicle, a class of membership of the driving style of the driver.
Recognition of the driving style can lead to a reduction in fuel consumption and an increase in road safety, by identifying any potentially dangerous behaviour, in so far as the information on the driving style can be used by the electronic systems on board the vehicle in order to optimize consumption levels and performance of the vehicle itself. It can moreover be used as basic element in implementation of more complex systems for evaluation of the driver in the perspective of fleet management (for example, for applications in car sharing, insurance, etc.)
The object of the present invention is to provide an improved method that will enable recognition of the driving style (profiling of the driver) on the basis of the information on the dynamics of the vehicle and reconstruction of the manoeuvre performed.
According to the present invention, the aforesaid object is achieved thanks to a method for recognizing the driving style, as well as to a corresponding apparatus having the characteristics recalled specifically in the ensuing claims.
Other objects, features and advantages of the present invention will be readily appreciated as the same becomes better understood after reading the subsequent description taken in connection with the accompanying drawings.
Other advantages of the invention will be readily appreciated as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
In brief, the solution according to the invention regards a method for recognizing the driving style of a driver of a land vehicle, of the type that envisages acquiring information on the dynamics of the vehicle from sensors, for example lateral and longitudinal accelerations of the vehicle, as well as yaw and longitudinal velocity, and calculating, as a function of said information on the dynamics of the vehicle, a class of membership of the driving style of the driver, for example comfortable or relaxed driving style, normal driving style, or sporting driving style, where it is envisaged to:
In this connection,
The blocks 10 and 20 correspond, for example, to processor modules (possibly implemented via one and the same processor) that implement the aforesaid operations. The apparatus that implements the method described herein hence comprises one or more microprocessor modules.
The block 10 follows the above operation of manoeuvre detection and identification on the basis of information DI on the dynamics of the vehicle, which, in the example described, also comprises information ERC on the road condition or external environment, detected by corresponding direct or indirect sensors arranged in the vehicle TV, but not shown in the figures.
Block 10 configured for carrying out detection and identification of the manoeuvre is in particular configured, as specified more fully in what follows, for detecting the start and/or end of an event corresponding to a manoeuvre defined a priori or successive combinations of standard manoeuvres such as:
Once the start of a new manoeuvre has been recognized, through a technique of Dynamic Time Warping, it is envisaged, once again in block 10, to carry out a search for the manoeuvre on the basis of the data of longitudinal velocity vlong longitudinal acceleration along, lateral acceleration alat, and the road and/or environmental condition ERC within a database containing the information corresponding to the standard manoeuvres, such as the ones listed above, in the form of templates or models tp, as described more fully in what follows.
Dynamic Time Warping, which is in itself known to the person skilled in the sector, is in general an algorithm that has the purpose of carrying out alignment between two sequences, in particular of processing sequences in which individual components have characteristics that vary over time (for example, these are sequences of displacement data corresponding to manoeuvres performed at different velocities of displacement) and that can enable a measurement of distance between the two sequences. Hence, in the case described herein, the algorithm enables determination of the correspondence of the manoeuvre acquired with a model of manoeuvre stored in the database irrespective of the speed of execution or form of the manoeuvre itself; for example, a change of two lanes is always identified as one lane change.
Once the type of manoeuvre mvr has been recognized, as has been said, the data of the dynamics of the vehicle, i.e., the longitudinal velocity vlong, the longitudinal acceleration along, the lateral acceleration alat, and the road and/or environmental condition ERC are used by block 20, which implements the operation of driving-style recognition 20.
For this purpose, the module 20 comprises, stored therein, an analytical description of driving styles stl, defined through classes of driving style, for example three classes CL:
The operation of driving-style recognition 20 makes use of the inputs indicated above as regards information DI on the dynamics, in particular the accelerations and velocities, and as regards the type of manoeuvre mvr identified, and envisages determining the driving style stl on the basis of the location, during the manoeuvre, of the values of longitudinal acceleration along and lateral acceleration alat, which, for example, are acquired by the corresponding sensors at a given acquisition rate, for example, every 10 ms, in a diagram of a G-G type such as the one shown in
The regions or surfaces S1, S2, S3, which are defined with a definition process described in what follows, are manifolds, or topology varieties of dimension 2, and are defined, for example, on the basis of the results obtained by the strategy of characterization of the driving styles 300 provided in what follows with reference to
In order to identify the driving style stl, the method proposed defines cost functionals, designated by J, to determine the membership of the accelerations on the G-G diagram to the manifold S1, S2, S3 corresponding to each style, in particular comfortable or relaxed driving style, normal driving style, or sporting driving style. The cost functional J from among these that has the lowest value identifies the manifold closest to the distribution of the accelerations for a given manoeuvre mvr being recognized, and hence the driving style with which the driver has performed the manoeuvre mvr.
Using these approaches, the method described herein is able to provide information on the manoeuvres made by the vehicle TV and on how these manoeuvres are performed by the driver.
To come now to a more detailed description,
As may be noted, the apparatus comprises a module 25 for recognition of start and end of a manoeuvre-recognition event in order to establish the manoeuvre mvr and the style stl corresponding to the event.
The above module 25 receives at input the lateral acceleration alat and the longitudinal acceleration along and the longitudinal velocity vlong and issues an activation/de-activation command cmd to an event-recognition block, which comprises the manoeuvre-detection-and-identification module 10 and the driving-style-recognition module 20. The manoeuvre-detection-and-identification module 10 in turn comprises a manoeuvre-reconstruction module 10a, which receives the longitudinal velocity vlong the longitudinal acceleration along, the lateral acceleration alat, and the angle of yaw ψ and produces at output a horizontal-component time series mvrx and a vertical-component time series mvry of the manoeuvre mvr being recognized, i.e., the manoeuvre that has triggered the event recognized by block 25 and activation of block 30, computed as described more fully in what follows, which represents the input of a submodule 10b configured for identifying the manoeuvre mvr via Dynamic Time Warping and supplying it to the driving-style-recognition module 20.
The method described, i.e., for example, in particular the operations implemented by the modules 10, 20, 25, can be implemented in a control unit of the vehicle, i.e., in a microprocessor module of the vehicle, or else in a computer terminal, such as an Android smartphone or tablet, provided with triaxial accelerometer and GPS position detector. The method can exploit data on accelerations, velocities, and attitude coming from the vehicle INS (Inertial Navigation System) platform or from the smartphone itself.
The flowchart of
Basically, the operations 110 to 150 correspond to the operation of manoeuvre detection and identification, implemented in the block or module 10 of
The method described may in general not comprise some of the operations indicated, for example filtering 110, in the case where the signals are of good quality.
It is clear that the operation of recognition 130 of start and end of the manoeuvre-recognition event comprises, when the end of a manoeuvre event mvr is identified on the basis of the values of the information DI, sending a command cmd for de-activation of the manoeuvre-recognition module 30, which consequently stops processing the signals regarding the information DI.
The operations of the method 100 are now described in further detail.
Acquisition Operation 110
As has been said, the operation 110 of acquisition of signals regarding information on the dynamics of the vehicle DI can resort to direct sensors, for example accelerometers, or indirect sensors of the vehicle TV, and similar information coming from the INS system of the vehicle or also from external sensors that transmit information to the vehicle. The signals corresponding to the operation 110 of acquisition of signals regarding information on the dynamics of the vehicle DI comprise, as has been said, the longitudinal velocity vlong, the longitudinal acceleration along, the lateral acceleration alat, and the angle of yaw ψ and may moreover comprise, as in the example described, also a given road and/or environmental condition ERC. The signals of the sensors may arrive through a bus or a wireless connection, in particular a CAN bus, of the vehicle to the processor or processors that implement the method 100 and the modules 10, 20 of
Filtering Operation 120
The operation of filtering 120 of the acceleration input signals coming from the accelerometers and/or from a vehicle bus, for example, the CAN bus, provides that they are filtered in order to reduce the noise contained therein. The filters used are low-pass filters and filters with forgetting factor in order to take into account only a certain number of previous samples or low-pass filters for the reduction of noise.
Operation 130 of Recognition of Start and End of the Manoeuvre-Recognition Event
This operation 130, which is, for example, carried out in the module 25, envisages making an analysis of the aforesaid input signals regarding the information DI, in particular the lateral acceleration alat, in order to discriminate the start of a manoeuvre-recognition event. From the start of the event, following upon which a command cmd is sent for activating the modules 10, 10a, 10b, and 20 in the module 30 of
For example, it is envisaged to evaluate overstepping of a threshold value, which is a function of the vehicle velocity vlong and is calibratable, by the lateral acceleration alat and/or by the longitudinal acceleration along, preferably filtered through a filter with forgetting factor or a low-pass filter. When the lateral acceleration alat and/or the longitudinal acceleration along exceed/exceeds the aforesaid threshold for a given time, which is also calibratable so as to prevent activations of the calculation following upon false positives, the method described activates via the command cmd the recognition module 30 and the modules 10 and 20 comprised therein, for reconstructing the manoeuvre mvr, identifying it, and determining the driving style stl.
Alternatively, it is possible to evaluate overstepping of a threshold value by the lateral acceleration alat and/or the longitudinal acceleration along by evaluating overstepping of a threshold, which is calibratable and is a function of the vehicle velocity vlong by the moving average (simple moving average, SMA), which, for example for the lateral acceleration alat, is defined as follows:
where k is the length of the time window in which the average of the lateral acceleration alat is to be observed, and i is the index of the acceleration value acquired in a time series of acquired values. If the moving average SMA is higher than an upper threshold thu, then the acceleration value alat(i−k−1) represents the start of the manoeuvre event.
It may be envisaged to operate in a similar way for the first derivative of the signals of lateral acceleration alat, and longitudinal acceleration along.
The subsequent values of lateral acceleration alat, are concatenated until the moving average SMA is lower than a lower threshold th1. If the duration of the event exceeds a pre-set time, the event is rejected.
Once the module for recognition of start/end of event 25 has activated the calculation performed in the modules of the event-recognition block 30, the aim is to reconstruct the displacement of the vehicle TV so as to provide a time series representing the displacement n order to identify the manoeuvre performed.
Operation 140 of Reconstruction of the Manoeuvre Mvr as a Function of the Information on the Dynamics of the Vehicle DI
Considering the dynamic behaviour of the vehicle, the module 10a is configured, in the context of the operation 140, so as to reconstruct the displacement of the vehicle TV along orthogonal axes x and y, defined for convenience as horizontal and vertical, in the plane XY of displacement of the vehicle, as a function of the longitudinal velocity vlong the lateral velocity vlat and the angle of yaw ψ (path reconstructor), to obtain components Xg(t) and Yg(t) of the displacement according to the aforesaid axes as a function of time t, as:
X
g(t)=∫0t[cos(ψ(τ))·vlong(τ)−sin(ψ(τ))·vlat(τ)]dτ (2)
Y
g(t)=∫0t[sin(ψ(τ))·vlong(τ)−cos(ψ(τ))·vlat(τ)]dτ (3)
The lateral velocity vlat can be obtained by integration of the lateral acceleration alat or else also via a system of complementary filters.
This approach provides the evolution in time of the displacement of the vehicle TV.
Starting from activation of the manoeuvre-recognition event, the method proposed envisages calculating the displacement of the vehicle TV according to Eqs. (2) and (3) and calculating, on the basis of the aforesaid components Xg(t) and Yg(t), the displacement according to the above axes as a function of time t, the corresponding displacement time series, i.e., series mvrx of values of horizontal components Xg(t) and series mvry of values of vertical components Yg(t) of the displacement at given sampling instants, for example every 10 ms, which represent the manoeuvre mvr.
Operation 150 of Identification of the Manoeuvre Mvr
Once the time series mvrx, mvry representing the manoeuvre mvr made by the vehicle TV in the module 10a has been reconstructed, this is supplied to the module 10b for identification 150 of the specific manoeuvre mvr. In the context of this operation 150, it is envisaged to have available, stored in a database, designated by 10c in
This resemblance is evaluated by comparing the time series of the reconstructed manoeuvre mvrx, mvry with the template series tp using, as mentioned, a Dynamic-Time-Warping (DTW) algorithm, which is in itself known to the person skilled in the sector, for example, from the publication authored by Stan Salvador and Philip Chan, 2007, “Toward accurate dynamic time warping in linear time and space”, Intell. Data Anal. 11, 5 (October 2007), 561-580. This algorithm is able to determine optimal alignment between two time series that do not necessarily have the same temporal axis, but may also be expanded or compressed.
Given two time series, namely, X, corresponding to the reconstructed time series, and Y, corresponding to the time series selected from the templates stored, which are of length m and n, respectively,
X=x
1
,x
2
, . . . ,x
m (4)
Y=y
1
,y
2
, . . . ,y
m (5)
the Euclidean distance between points xi, yj of the two time series is defined as
D(i,j)=∥xi−yj∥ (6)
The total cost cp of the alignment between the two series X and Y is defined as the sum of the distances computed over the optimal path which is the result of the DTW problem and defined by the K pairs of points (i1,j1) . . . (iK,jK):
Given the total cost cp of alignment of the reconstructed series mvrx, mvry for each of the templates stored, the template that entails the minimum value of the total cost cp represents the closest series and hence the manoeuvre mvr carried out. In particular, the component of the reconstructed series along the axis x mvrx is compared with the corresponding component along the axis X of the template, and likewise the component of the reconstructed series along the axis y mvry is compared with the corresponding component along the axis Y of the template.
Operation 210 of Definition of the Manifolds S1, S2, S3
Once the manoeuvre mvr has been identified, the profiles, i.e., the sequences of values in the framework of the event recognized in step 130, of the longitudinal acceleration along and of the lateral acceleration alat are supplied to the driving-style-recognition module 20 in order to estimate the driving style stl with which the driver has made the manoeuvre.
As has been mentioned, the manifolds S1, S2, S3 that then determine the driving styles are defined on the basis of the results obtained by the strategy 300 of characterization of the driving styles provided in
The estimation of the maximum acceleration starts from the limit conditions of Newton's second law:
F
R
=mgμ=m|ā| (8)
where FR is the force of friction, m is the mass of the vehicle, g is the acceleration of gravity, μ is the coefficient of friction, and |ā| is the modulus of the accelerations. Eq. (8) represents the limit between the condition of adherence and the condition of non-adherence: if the points of the longitudinal and lateral accelerations fall within these limits, the conditions of adherence are verified. This condition can be defined as safety condition.
The coefficient of friction μ depends upon the conditions of the road surface, the wear of the tires and other factors, and this value is here assumed as remaining constant. The force of friction is conventionally divided into the two longitudinal and lateral components in relation to the direction of motion. Using the relation between the longitudinal coefficient of friction μx,max and the vehicle velocity v, proposed in R. Lamm, B. Psarianos, T. Mailaender, “Highway Design and Traffic Safety Engineering Handbook”, McGraw-Hill, 1999, and valid for dry conditions, we obtain:
where v is the vehicle velocity expressed in km/h.
Once again according to the aforesaid text by Lamm et al., the relation between the lateral component μy,max and the longitudinal component μx,max can be expressed as:
μy,max=0.925μx,max (10)
Considering Eqs. (8), (9), and (10), it is possible to determine the modulus of the maximum acceleration |ā| that identifies the limit conditions for the tire-road adherence as a function of the vehicle velocity:
The maximum value of acceleration |ā| obtained from Eq. (11) is used in the solution described herein for defining the three manifolds within the ellipse of maximum adherence EA that identifies the maximum value of acceleration |ā| in the G-G diagram of
The numeric coefficient expressed in Eqs. (9), (10), and (11) can vary on the basis of the vehicle and are defined on the basis of the types of vehicle considered.
The manifolds S1, S2, S3 representing the three driving styles are defined by three driving-style parameters PAR_MAN1, PAR_MAN2, and PAR_MAN3 that multiply the maximum acceleration |ā| and define a corresponding condition for the modulus of the acceleration of the vehicle, namely, respective values of maximum acceleration of the manifolds |ā|max,cmft, |ā|max,nrm, |ā|max,sprt, illustrated in
|ā|max,cmft=|ā|PAR_MAN1 (12)
|ā|max,nrm=|ā|PAR_MAN2 (13)
|ā|max,sprt=|ā|PAR_MAN3 (14)
for the relaxed or comfortable driving style (12), the normal driving style (13), and the sporting driving style (14), respectively. Characterization of the parameters PAR_MAN1, PAR_MAN2, and PAR_MAN3, which are usually of a value lower than one (even though, according to the calibrations made, they may even have values slightly exceeding unity) and indicate the description of the three distinct manifolds is defined in what follows.
The values of acceleration are converted into mg units and plotted on the G-G acceleration diagram.
Operation 220 of Computation of Cost Functionals Jcmft, Jnrm, Jsprt
The solution described herein envisages identifying the driving style by the manifold S1, S2, or S3 that is closest to the distribution of the accelerations of the manoeuvre mvr supplied by the module 10b (operation 150). For this purpose, cost functionals J are defined, respectively Jcmft, Jnrm, Jsprt, for the three driving styles, which calculate a distance between the point defined by the value of acceleration in the G-G plane and the boundary of each of the three manifolds S1, S2, S3, which is preferably represented by the respective values of maximum acceleration of the manifold |ā|max,cmft, |ā|max,nrm, |ā|max,sprt. The manifold that entails the lowest functional J identifies the driving style CL1, CL2, CL3 with which the manoeuvre mvr has been performed.
The cost functionals Jcmft, Jnrm, Jsprt are defined as the plots in time, preferably weighted through forgetting factors, of the quadratic radial distances dcmft, dnrm, dsprt, represented in
d
cmft=(|a|max,cmft−|āc|)2 (15)
d
nrm=(|a|max,nrm−|āc|)2 (16)
d
sprt=(|a|max,sprt−|āc|)2 (17)
Operation 230 of identification of the driving style stl on the basis of the cost functionals Jcmft, Jnrm, Jsprt
The driving style stl is identified by the manifold S1, S2, S3 closest to the distribution of the accelerations and hence by the minimum cost functional J:
if min(Jcmft,Jnrm,Jsprt)=Jcmft→sts=DRVSTL_STS_CMFT (18)
if min(Jcmft,Jnrm,Jsprt)=Jnrm→sts=DRVSTL_STS_NRM (19)
if min(Jcmft,Jnrm,Jsprt)=Jsprt→sts=DRVSTL_STS_SPRT (20)
DRVSTL_STS_CMFT, DRVSTL_STS_NRM, DRVSTL_STS_SPRT are string values that identify the comfortable or relaxed driving style, the normal driving style, and the sporting driving style and that are assigned to the variable sts that identifies the driving style stl, as a function of the results of Eqs. (18), (19), (20).
According to a further aspect of the solution described herein, the possible transitions between two styles during a manoeuvre are managed so as to prevent oscillations in the characterization of the driver. The transitions between one style and another are allowed when the new style, and hence the new minimum cost functional, is lower than the previous one by an amount Δ for a calibratable time interval DT, defined previously. This approach is illustrated in
The manoeuvre mvr identified is preferably used as further input by the driving-style-identification block 20 (for example, a high number of lane changes may be indicative of an aggressive or sporting driving style).
Described in what follows is a procedure of definition of the classes of driving style CL1, CL2, CL3 and of parameters of the regions S1, S2, S3 used by the recognition method described herein, for example by the method 100.
Hence,
Designated by 310 is a procedure of analysis of the characterization data, which uses in general information DI on the dynamics of the vehicle, commands of the driver U, such as the steering angle, information on the habitual driving style Z of the driver, and values of peak frequency fp of a frequency analysis that will be described in what follows with reference to
Hence, characterization 300 of the driving style is based upon the evaluation of dynamic quantities such as, inter alia, lateral acceleration, longitudinal acceleration, vehicle velocity, and steering angle. For the characterization of the driving styles, a classification has been carried out on the basis of the analysis of data of different real drivers for manoeuvres that are such as to stress the dynamics of the vehicle, in particular the lateral dynamics, and are, for example:
For example, one of the indices used for classification of the driver is the value of the peak frequency obtained from the frequency analysis, mentioned above, of the spectrogram of the normalized lateral acceleration alat or, equivalently, of a normalized steering-wheel angle during execution of the double-lane-change manoeuvre.
Similar analyses are carried out, for example, also on the longitudinal acceleration and on the steering angle, to arrive at the identification of classes of values for these quantities analysed in step 320 that represent the three driving styles CL1, CL2, CL3. By combining the results of the analyses, each driver is characterized in step 330, where a driving style stl is attributed to each of them, i.e., associated to each driver is one of the three driving styles CL1, CL2, CL3.
After the step 330 of characterization of the drivers, or independently thereof, the data of the manoeuvres of step 310 are used for calibrating, in a step 340, the manifolds S1, S2, S3 described previously. In particular the values of the style parameters PAR_MAN1, PAR_MAN2, and PAR_MAN3, defined in Eqs. (12), (13), and (14) respectively, are calculated so that each manifold S1, S2, S3 will approximate as closely as possible the distribution of the accelerations. The parameters are computed by applying the relations:
Namely, the parameter corresponding to a style is the one that minimizes the respective cost functional J, applied, for example, to the acceleration of the drivers that are undergoing the testing procedure and are then classified according to the classes CL1, CL2, CL3, instead of to the current acceleration as described previously. In other words, the parameters are defined on the basis of the data of the drivers who have performed the tests. Subsequently, these parameters define the manifolds for real-time classification according to the current acceleration. In this way, the maximum values of acceleration that delimit the regions S1, S2, S3, |a|max,cmft, |a|max,nrm, |a|max,sprt are defined.
Hence, basically, the procedure 300 of characterization of the driving styles comprises acquiring values of information DI on the dynamics of the vehicle from sensors, and possibly commands of the driver such as the steering commands, corresponding to execution by a plurality of drivers of a given set of manoeuvres, calculating spectra of the above values, for example the power spectral density, and values of peak frequency fp of the spectra, plotting the frequency values fp as a function of the velocity v of the vehicle TV, and defining, in the velocity-frequency plane thus defined, regions Z1, Z2, Z3 corresponding to classes of driving style CL1, CL2, CL3.
The procedure 300 of characterization of the driving styles may in addition or alternatively comprise, not only the step 310 that envisages acquiring values of information DI on the dynamics of the vehicle from sensors corresponding to execution by a plurality of drivers of a given set of manoeuvres, but also using these values for a step 340 of calibration of the driving-style parameters PAR_MAN1, PAR_MAN2, and PAR_MAN3 in such a way that each region S1, S2, S3 of the G-G plane will approximate as closely as possible the distribution of the accelerations in the aforesaid data, in particular selecting the driving-style parameter that minimizes the respective cost functional.
In conclusion, by analyzing real data coming from different drivers, an index identifying the driving style is defined, through which it is possible to characterize the method via definition of the manifolds in the G-G diagram.
Once the classes CL1, CL2, and CL3 corresponding to the driving styles have been identified (see
Hence, from what has been described above, the advantages of the solution proposed emerge clearly.
The solution described advantageously enables recognition of the driving style on the basis of the information on the dynamics of the vehicle, enabling definition of the driving style on the basis of three defined levels:
Each type of driver can be characterized on the basis of the evaluation of how the driver performs given manoeuvres.
In particular, starting from the information of vehicle dynamics, it is possible to arrive at the manoeuvre performed (i.e., curving to the right, curving to the left, lane changing, etc.). On the basis of the evaluation of the vehicle velocity, lateral acceleration, and longitudinal acceleration, a cost function is defined that is able to determine the driving style.
The invention has been described in an illustrative manner. It is to be understood that the terminology which has been used is intended to be in the nature of words of description rather than of limitation. Many modifications and variations of the invention are possible in light of the above teachings. Therefore, within the scope of the appended claims, the invention may be practiced other than as specifically described.
Number | Date | Country | Kind |
---|---|---|---|
102017000144561 | Dec 2017 | IT | national |