Human-machine shared control based on trajectory prediction

Information

  • Patent Grant
  • 12280809
  • Patent Number
    12,280,809
  • Date Filed
    Friday, May 10, 2024
    a year ago
  • Date Issued
    Tuesday, April 22, 2025
    a month ago
Abstract
The present invention relates to the field of intelligent vehicles, and more specifically, to a human-machine shared control method based on trajectory prediction. It comprises: establishing a road-vehicle model based on vehicle-related parameters and then designing a path-tracking controller; further predicting the driver's driving trajectory, evaluating the driving risk, and switching the control power between the automatic system and the human driver based on the driving risk. The present invention ensures that when the driver's inputs will cause high risk to the vehicle, the driver's input is deprived of; and that when the driver's driving inputs will not cause high risk to the vehicle, the driving is carried out by the driver, so that in the case where the automatic system is having a problem, the driver can effectively realize a safe intervention, and the safety of the intelligent driving is improved.
Description
PRIOR ART

The prior art discloses an intervention-based shared control method and device for forward collision avoidance scenarios of an autonomous driving vehicle. This invention proposes a vehicle model decoupling method for solving the controller and predicting the risk in a high-speed forward collision avoidance scenario. The acquired vehicle state information is input into a forward collision avoidance control model to obtain the optimal nominal collision avoidance trajectory of the self-driving vehicle, and the acquired steering input data of the driver is used to establish the shared control method under a forward collision avoidance scenario of an autonomous driving vehicle. However, the method will determine the driver's intervention or not only by whether the vehicle's risk of forward collision is large, and when the vehicle's risk of forward collision is already large enough, the system deprives the control of the driver and completely relies on autonomous driving to follow the optimal nominal collision avoidance trajectory, without judging the safety of the driver's own driving behavior. So the proposed shared control method fails to consider the driver's own driving behavior fully, and the system will not be able to evaluate the driving risk from the driver's own driving behavior. When the vehicle's risk is relatively high and the autopilot encounters problems, the driver is unable to intervene, resulting in a significant safety risk.


BACKGROUND OF THE INVENTION

Human-machine co-driving (or shared control) refers to the sharing of vehicle control between drivers and intelligent systems to complete the driving tasks through deep cooperation in perception, decision-making and control. Intelligent systems have the advantages of agile perception, rule-based decision, and precise control, while drivers have better multi-source information fusion, reasoning learning, and manipulating adaptation. Human-machine co-driving can give full play to the respective strengths of the driver and the intelligent system to realize the human-machine integrated driving process. However, when the driver and the intelligent system control the vehicle together, the intelligent system is not limited to a simple interaction mode to remind or assist drivers, and its performance is directly related to the degree of intelligence of the system. When the intelligent system is in line with the driver's maneuvering style and habits, the system will play a good auxiliary effect, but when contrary to the driver's behavioral pattern, it will increase the driver's driving load, and even lead to a serious vehicle accident. In order to solve the human-machine conflict problem caused by the introduction of intelligent driver assistance systems and to improve driving safety, researchers have successively used switching control, model predictive control, fuzzy control, game theory and elliptic safety field in the design of indirect shared steering control strategies. However, as the core of shared steering control of intelligent vehicles, the weight distribution strategy of the current research is mostly based on the influence of the current state of the vehicle on the control weight, and lacks the prediction and comprehensive analysis of the factors influencing the control to drive. In addition, the driver, as an important participant of human-machine shared control, is still insufficiently considered about the influence of the driver's driving behavior on the allocation of control weights. Thus when the automatic system fails, the driver's behavior is unable to change the situation of the vehicle, which causes a serious safety hazard.


SUMMARY OF THE INVENTION

The present invention designed a path tracking controller to predict the trajectory of the driver, and then evaluate the driving risk of the human driver based on the predictive path. Ultimately, the shared control system will determine the distribution strategy of the control weight between the human driver and the automatic system according to the driving risk of the driver. The present invention ensures that when the driver's control input will cause a higher risk to the vehicle, the human-machine shared control system will translate the control weight from the human driver to the automatic system, and that in the case where the driver's Driving inputs do not pose a high risk to the vehicle, driving is carried out by the driver, making it possible for the driver to effectively realize safe interventions in the event of a problem with the automatic driving, and improving the safety of intelligent driving.





BRIEF DESCRIPTION OF DRAWINGS


FIG. 1 shows the method for human-machine shared control based on trajectory prediction described in Embodiment 1;



FIG. 2 shows the assessment result of the driver's driving risk described in Embodiment 3;



FIG. 3 shows a graph of the steering angle for the driver and automatic system described in Embodiment 3;



FIG. 4 shows a graph of the steering angle based on the human-machine shared control strategy described in Embodiment 3;





DETAILED DESCRIPTION OF THE INVENTION

An object of the present invention is to disclose a trajectory-prediction-based shared control method for human-machine co-driving, which is more secure.


In order to realize the above purpose, the present invention provides a human-machine shared control method based on trajectory prediction, comprising:

    • S1: Establish the road-vehicle model according to the kinematic and dynamic characteristics of the vehicle;
    • S2: Design the path tracking controller based on the road-vehicle model;
    • S3: Trajectory prediction based on the path tracking controller;
    • S4: Risk assessment of the predicted trajectory;
    • S5: The switching of control between the automatic system and the driver is realized according to the driving risk.


Further, in step S1, the vehicle-related parameters include intrinsic parameters as well as implementation parameters;


Where the vehicle's intrinsic parameters include: vehicle mass m, longitudinal velocity vy, sampling time T, rotational inertia Iz, distance from center of mass to front axle lf, distance from center of mass to rear axle lr, cornering stiffness of front wheels cf, cornering stiffness of rear wheels cr, position coordinates of static obstacles (Xob,Yob), minimum steering angle of the vehicle δmin, maximum steering angle of the vehicle δmax, minimum steering increment of the vehicle Δδmin, maximum steering increment of the vehicle Δδmax, the shortest distance coefficient between the vehicle and an obstacle Z, safety distance threshold coefficient between the vehicle and an obstacle G0;


Implementation parameters include: position coordinates of the vehicle (X,Y), lateral velocity vy, heading angle ϕ and yaw rate r.


In step S2, establishing the road-vehicle model based on the vehicle-related parameters: first establishing a vehicle dynamics model and a vehicle kinematics model based on the vehicle-related parameters, and then establishing the road-vehicle model based on the two vehicle models obtained.


The vehicle-related parameters for modeling the vehicle dynamics characteristics comprise: letting the longitudinal velocity of the vehicle vx be independently controlled and constant, and the lateral force of the vehicle can be expressed as:

Fxf cos δ−Fxf sin δ+Fyr=m({dot over (v)}y+vxr)


Where δ is the front wheel steering angle of the vehicle, vx and vy are the longitudinal and lateral velocities at the center of mass of the vehicle, r is the yaw rate of the vehicle, Fyr and Fxr are the lateral and longitudinal forces on the rear wheels of the vehicle, and Fxf as well as Fxf are the lateral and longitudinal forces on the front wheels of the vehicle;


Assuming that the vehicle is moving only in a two-dimensional plane without lateral slip and the vehicle's tire force satisfy a linear model, so the moment equations of the vehicle, the front and rear wheel slip angle (αf and αr), and the tire forces on the front and rear wheels (Fxf and Fyr) can be expressed as follows, respectively:









l
f



(


F
yf


cos

δ

)


-


l
r



(


F
yr

-


F

x

f



sin

δ


)



=


I
z



r
˙









α
f

=



tan

-
1


(



v
y

+


l
f


r



v
x


)

-
δ








α
r

=


tan

-
1


(



v
y

+


l
f


r



v
x


)








F
yf

=


-

c
f




α
f









F
yr

=


-

c
r




α
r






Where lf and lr are the distances from the center of mass to the centers of the front and rear wheels, Iz is the moment of the vehicle's inertia around the z axis, and cf as well as cr are the cornering stiffnesses of the front and rear wheels, respectively;


Therefore, the vehicle dynamics model can be obtained as follows:








v
.

y

=





-


c
f

[



tan

-
1




(



v
y

+


l
f


r



v
x


)


-
δ

]



cos

δ

-


c
r



tan

-
1




(



v
y

-


l
r


r



v
x


)



m

-


v
x


r









r
˙

=




-

l
f





c
f

[



tan

-
1


(



v
y

+


l
f


r



v
x


)

-
δ

]


cos

δ

+


l
r



c
r




tan

-
1


(



v
y

-


l
r


r



v
x


)




I
z






Using a small angle approximation of the trigonometric functions, the linearized model is obtained:








v
.

y

=




-

(


c
f

+

c
r


)



m


v
x





v
y


+


[





l
r



c
r


-


l
f



c
f




m


v
x



-

v
x


]


r

+



c
f

m


δ









r
.

=






l
r



c
r


-


l
f



c
f





I
z



v
x





v
y


+



-

(



l
f
2



c
f


+


l
r
2



c
r



)




I
z



v
x




r

+




l
f



c
f


m


δ






This two-wheeled model is transformed into a four-wheeled vehicle model, so the vehicle model can be represented as:







[





v
.

y






r
.




]

=



[






-
2



(


c
f

+

c
r


)



m


v
x








2


(



l
r



c
r


-


l
f



c
f



)



m


v
x



-

v
x








2


(



l
r



c
r


-


l
f



c
f



)




I
z



v
x








-
2



(



l
1
2



c
f


+


l
r
2



c
r



)




I
z



v
x






]

[




v
y





r



]

+


[





2


c
f


m







2


l
f



c
f


m




]


δ






In addition, when the vehicle performs path tracking, the lateral error ed and heading error eϕ can be expressed by the following equation:

ėd=vx sin(eϕ)+vy cos(eϕ)
ėϕ=r−vxρ


Where ed is the lateral error between the center of the vehicle's mass and the reference trajectory, and eϕ is the heading error between the vehicle and the reference trajectory. In addition, a small angle assumption (i.e., sin(eϕ)≈eϕ,cos(eϕ)≈1) is used for the heading error eϕ, so the tracking error can be simplified as:

ėd=vxeϕ+vy
ėϕ=r−vxρ


In summary, the dynamics model of the vehicle can be expressed as:







[





v
.

y






r
.







e
.

d







e
.

ϕ




]

=




[






-
2



(


c
f

+

c
r


)



mv
x







2


(



l
r



c
r


-


l
f



c
f



)



mv
x


-

v
x




0


0






2


(



l
r



c
r


-


l
f



c
f



)




I
z



v
x








-
2



(



l
f
2



c
f


+


l
r
2



c
r



)




I
z



v
x





0


0




1


0


0



v
x





0


1


0


0



]

[




v
y





r





e
d






e
ϕ




]

+


[





2


c
f


m







2


l
f



c
f


m





0




0



]


δ

+


[



0




0




0





-

v
x





]


ρ






Further, according to the kinematic characteristics of the vehicle, the kinematic model of the vehicle can be described as follows:

{dot over (X)}=vx cos ϕ−vy,sin ϕ
{dot over (Y)}=vx sin ϕ+vy cos ϕ


Again, assuming that the vehicle is in a driving condition with a small steering angle, the model is simplified as:

{dot over (X)}=vx−vyϕ
{dot over (Y)}=vxϕ+vy


Further, building a road-vehicle model based on the vehicle dynamics model and the vehicle kinematics model:

{dot over (x)}(t)=Ax(t)+Bu(t)+B107ω(t)


Where








x

(
t
)

=


[


v
y

,
r
,
ϕ
,

e
d

,

e
ϕ

,
X
,
Y

]

T


,








u

(
t
)

=

δ

(
t
)


,







ω

(
t
)

=


[

ρ
,

v
x


]

T








A
=

[






-
2



(


C
f

+

C
r


)



mv
x






2


(



l
r



C
r


-


l
f



C
f



)



mv
x




0


0


0


0


0






2


(



l
r



C
r


-


l
f



C
f



)




I
z



v
x








-
2



(



l
f
2



C
f


+


l
r
2



C
r



)




I
z



v
x





0


0


0


0


0




0


1


0


0


0


0


0




1


0


0


0



v
x



0


0




0


1


0


0


0


0


0





-
ϕ



0


0


0


0


0


0




1


0



v
x



0


0


0


0



]


,








B

=

[





2


c
f


m







2


l
f



c
f


m





0




0




0




0




0



]


,







B
ω

=

[



0


0




0


0




0


0




0


0





v
x



0




0


1




0


0



]





For computer simulation, T is used as the sampling time and Euler's method is utilized:








x
˙

(
t
)

=



x

(

k
+
1

)

-

x

(
k
)


T





Converting a continuous vehicle model into a discrete vehicle model:

ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k)


Where Ā=AT+I, B=BT, Bω=BωT, I denotes the unit matrix with corresponding dimensions.


Further, in step S2, designing the path-tracking controller according to the road-vehicle model: the prediction step of the path-tracking controller is Np, the control step is Nc, and the system states at each moment of time x(t) will be used as the starting point of the prediction sequence x(0|t) for the optimization computation, and the optimal control sequence u*(k|t), k∈[0,Np−1] and sequences of states x*(k|t), k∈[1,Np] will be obtained within the prediction time domain [t,t+Np] and the first value of the optimal control sequence (i.e., u*(0|t)) will be used as a control input at the current moment of time to act on the vehicle;


Due to the dynamic change of the vehicle state, it is necessary to calculate the optimal steering angle according to the current actual vehicle condition while avoiding frequent steering angle changes. Therefore, the path tracking controller based on the model predictive control method is designed with the objective function:

min J(x(k),u(k),ω(k))=min(YTQY+ΔUTRΔU)
s.t. ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k)


Where ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k) is the road-vehicle model, and Y=[y(k+1), y(k+2), . . . , y(k+Np)]T the predicted output of the system; Q denotes the output weight matrix, and ΔU=[Δu(k),Δu(k+1), . . . ,Δu(k+Nc−1)]T the control increment sequence; R denotes the control weight matrix, and in addition for achieving the goal of path tracking, the output equation is taken as







y
=

[




e
d






e
ϕ




]


;




Considering the control limit constraints and the control increment constraints in the control process:

umin(t+k)≤u(t+k)≤umax(t+k)
Δumin(t+k)≤Δu(t+k)≤Δumax(t+k)
k=0,1, . . . ,Nc−1


Further, in step S3, the driver's driving trajectory is predicted according to the path tracking controller:

min J(x(k),u(k),ω(k))=min(YTQY+ΔUTRΔU)
s.t. ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k)  Objective function:
umin(t+k)≤u(t+k)≤umax(t+k)
Δumin(t+k)≤Δu(t+k)≤Δumax(t+k)
k=0,1, . . . ,Nc−1  Constraints:


By solving this quadratic programming problem, the optimal control sequence to achieve target tracking can be obtained:

U=[u(k),u(k+1), . . . ,u(k+Nc−1)]


The predicted sequence of system states Ξ is also worked out by utilizing both the state equations of the system and the obtained optimal control sequence:

Ξ=Γx(k)+γU+ΠΩ


Where







Ξ
=

[




x

(

k
+
1

)






x

(

k
+
2

)











x

(

k
+

N
c


)




]


,







U
=

[




u

(
k
)






u

(

k
+
1

)











u
(

k
+

N
c

-
1





]


,







Ω
=

[




ω

(
k
)






ω

(

k
+
1

)











ω

(

k
+

N
c

-
1

)




]


,







Γ
=

[




A
~







A
~

2












A
~


N
c





]


,







ϒ
=

[




B
~



0





0






A
~



B
~





B
~






0





















A
~


(


N
c

-
1

)




B
~







A
~


(


N
c

-
2

)




B
~








B
~




]


,








=

[




B
~



0





0






A
~




B
~

ω






B
~

ω






0





















A
~


(


N
c

-
1

)





B
~

ω







A
~


(


N
c

-
2

)





B
~

ω









B
~

ω




]






The predictive trajectory sequence of driver is:

[(Xk+1,Yk+1),(Xk+2,Yk+2), . . . . ,(Xk+N,Yk+Nc)]


Further, in step S4, the driving risk based on the predicted trajectory could be evaluated by the following way:


The driving risk based on the positional relationship between the driver and the obstacle will be evaluated by employing an artificial potential field approach;


First, define the field strength of the repulsive field:









U
R

(
X
)

=



{





0.5



Z

(


1

R
R


-

1

G
0



)

2


,





R
R



G
0







0
,





R
R

>

G
0










Where (X,Y) denotes the current position of the vehicle and (XOB,YOB) denotes the position of the obstacle; Z denotes the shortest distance coefficient between the vehicle and an obstacle, G0 is used to characterize the safety distance threshold coefficient for an obstacle, and RR Indicates the actual shortest distance between the vehicle and an obstacle RR=√{square root over ((X−XOB)2+(Y−YOB)2)}.


Thus, the field force of the repulsive field FR formed around the obstacle can be described by a negative gradient in the field strength









U
R

(
X
)

:

F
R


=


-

grad
[


U
R

(
X
)

]


=

{






Z

(


1

R
R


-

1

G
0



)

×

1

R
R
2



,





R
R



G
0







0
,





R
R

>

G
0











While the field force of the repulsive field can be categorized into longitudinal field force FRx and lateral field force FRy:






{





F

R

x


=


F
R

·

cos

(
ϕ
)









F
Ry

=


F
R

·

sin

(
ϕ
)










Where ϕ denotes the angle formed by the line connecting the vehicle and the obstacle with the x-axis of the global coordinates;


Thus, the predicted trajectory with the control step Nc has a longitudinal risk Rx and a lateral risk Ry described by the average of the risks, and the total driving risk Rrisk is obtained:






{





R
x

=





k
=
1


N
c




F

R

x


(


X

p

r

e

d

k

,

Y

p

r

e

d

k


)



N
c









R
y

=





k
=
1


N
c




F

R

y


(


X

p

r

e

d

k

,

Y

p

r

e

d

k


)



N
c













R
risk

=


R
x

+

R
y






Further, in step S5, realizing the switching of control between the automatic system and the driver based on the driving risk. The detail can be described as follow: performing a risk assessment of the predicted trajectory in step S4 to obtain a driving risk Rrisk, giving a threshold of the driver's driving risk Rrisk* and switching the control of the vehicle to the automatic system when the driving risk be equal or greater than the risk threshold (i.e. Rrisk≥Rrisk*); and switching the control of the vehicle to the human driver when the driving risk be less than the risk threshold (i.e. Rrisk<Rrisk*).


The beneficial effects of the technical solution from the present invention compared to the prior art are as below:


The present invention designs a path-tracking controller to predict the trajectory, and then predicts the driver's driving risk of the trajectory to determine whether the vehicle is controlled by the driver or by the automatic system. The present invention ensures that when the driver's driving input will cause a higher risk to the vehicle, the shared control module will deprive the driver of his or her driving input, and drive entirely by the automated system, and that when the driver's driving inputs do not pose a high risk to the vehicle, the driving manipulation is carried out by the driver, making it possible for the driver to effectively realize safe interventions in the event of a problem from the automatic system, and improving the safety of intelligent driving.


Application Instances


The drawings are attached to exemplary illustration only and are not to be construed as a limitation of this patent.


The technical solution of the present invention is further described below in connection with the accompanying drawings and embodiments.


Embodiment 1

This embodiment discloses, as shown in figure. 1, a human-machine shared control method based on trajectory prediction, comprising the following steps:

    • S1: Establish the road-vehicle model according to the kinematic and dynamic characteristics;
    • S2: Design the path tracking controller based on the road-vehicle model;
    • S3: Trajectory prediction based on the path tracking controller;
    • S4: Risk assessment of predicted trajectories;
    • S5: Switching of control between the automatic system and the driver is realized according to the driving risk.


The embodiment predicts the trajectory by designing a path tracking controller, and then determines whether the vehicle is controlled by the driver or by the automatic system by means of predicting the driving risk of the driver. This embodiment ensures that when the driving input from the driver would pose a higher risk to the vehicle, the shared control module will deprive the driver of his or her driving input, and drive entirely by the automatic system. The embodiment also ensures that when the driver's driving inputs do not pose a high risk to the vehicle, the driving manipulation is carried out by the driver, making it possible for the driver to effectively realize safe interventions in the event of a problem from the automatic system, and improving the safety of intelligent driving.


Embodiment 2

This embodiment is further disclosed based on embodiment 1:

    • In step S1, the vehicle-related parameters include intrinsic parameters as well as implementation parameters;
    • Where the vehicle's intrinsic parameters include: mass m, longitudinal velocity vy, sampling time T, rotational inertia Iz, distance from center of mass to front axle lf, distance from center of mass to rear axle lr, cornering stiffness of front wheels cf, cornering stiffness of rear wheels cr, position coordinates of static obstacles (Xob,Yob), minimum steering of the vehicle δmin, maximum steering of the vehicle δmax, minimum steering increment of the vehicle Δδmin, maximum steering increment of the vehicle Δδmax, parameter of the shortest distance between the vehicle and an obstacle Z, safety distance threshold parameter between the vehicle and an obstacle G0;
    • Implementation parameters include: position coordinates of the vehicle (X,Y), lateral velocity vy, heading angle ϕ and angular velocity r.


Establishing the road-vehicle model according to the vehicle-related parameters in step S2: first establishing a vehicle dynamics model and a vehicle kinematics model based on the vehicle-related parameters, and then establishing the vehicle road-vehicle model according to the vehicle dynamics model and the vehicle kinematics model.


The modeling process of vehicle dynamics based on vehicle-related parameters is as follows: letting the longitudinal speed of the vehicle vx be independently controlled and constant, and the lateral force of the vehicle can be expressed as:

Fxf cos δ−Fxf sin δ+Fyr=m({dot over (v)}y+vxr)


Where δ is the front wheel angle of the vehicle, vx and vy are the longitudinal and lateral velocities at the center of mass of the vehicle, r is the yaw rate of the vehicle, Fyr and Fr are the lateral and longitudinal forces on the rear wheels of the vehicle, and Fxf and Fxf are the lateral and longitudinal forces on the front wheels of the vehicle;


Assuming that the vehicle is moving only in a two-dimensional plane without lateral slip and the vehicle's tire force is a linear model, the moment equations of the vehicle, the front and rear wheel slip angle (αf and αr), and the tire forces on the front and rear wheels (Fxf and Fyr) can be expressed as follows, respectively:












l
f



(


F
yf


cos

δ

)


-


l
r



(


F
yr

-


F

x

f



sin

δ


)



=


I
z



r
˙









α
f

=



tan

-
1




(



v
y

+


l
f


r



v
x


)


-
δ








α
r

=


tan

-
1




(



v
y

-


l
r


r



v
x


)









F
yf

=


-

c
f




α
f









F
yr

=


-

c
r




α
r









Where lf and lr are the distances from the center of mass to the centers of the front and rear wheels, Iz is the moment of the vehicle's inertia around the z axis, and cf and cr are the cornering stiffnesses of the front and rear wheels, respectively;


Therefore, the vehicle dynamics model can be obtained as follows:











v
.

y

=





-


c
f

[



tan
1



(



v
Y

+


l
f


r



v
X


)


-
δ

]



cos

δ

-


c
r



tan
1



(



v
Y

-


l
r


r



v
X


)



m

-


v
x


r









r
˙

=




-

l
f





c
f

[



tan

-
1


(



v
y

+


l
f


r



v
x


)

-
δ

]


cos

δ

+


l
r



c
r




tan

-
1


(



v
y

-


l
r


r



v
x


)




I
z









Using the small angle approximation of the trigonometric functions, a linearization is obtained:











v
.

y

=




-

(


c
f

+

c
r


)



m


v
x





v
y


+


[





l
r



c
r


-


l
f



c
f




m


v
x



-

v
x


]


r

+



c
f

m


δ









r
.

=






l
r



c
r


-


l
f



c
f





I
z



v
x





v
y


+



-

(



l
f
2



c
f


+


l
r
2



c
r



)




I
z



v
x




r

+




l
f



c
f


m


δ









This two-wheeled model is transformed into a four-wheeled vehicle model, so the vehicle model can be represented as:







[





v
.

y






r
.




]

=



[






-
2



(


c
f

+

c
r


)



m


v
x








2


(



l
r



c
r


-


l
f



c
1



)



m


v
x



-

v
x








2


(



l
r



c
r


-


l
f



c
f



)




I
z



v
x








-
2



(



l
f
2



c
f


+


l
r
2



c
r



)




I
z



v
x






]

[




v
y





r



]

+


[





2


c
f


m







2


l
f



c
f


m




]


δ






In addition, when the vehicle performs path tracking the lateral error ed and heading error eϕ can be expressed by the following equation:

ėd=vx sin(eϕ)+vy cos(eϕ)
ėϕ=r−vxρ


Where, ed is the lateral error between the center of the vehicle's mass and the reference trajectory, and eϕ is the heading angle error between the vehicle and the reference trajectory, and a small angle assumption (i.e., sin(eϕ)≈eϕ, cos (eϕ)≈1) is used for the heading error eϕ, so the tracking error can be simplified as:

ėd=vxeϕ+vy
ėϕ=r−vxρ


In summary, the dynamics model of the vehicle can be expressed as:








[





v
.

y






r
.







e
.

d







e
.

ϕ




]

=

[






-
2



(


c
f

+

c
r


)



m


v
x








2


(



l
r



c
r


-


l
f



c
1



)



m


v
x



-

v
x




0


0






2


(



l
r



c
r


-


l
f



c
f



)




I
z



v
x








-
2



(



l
f
2



c
f


+


l
r
2



c
r



)




I
z



v
x





0


0




1


0


0



v
x





0


1


0


0



]






[




v
y





r





e
d






e
ϕ




]

+


[





2


c
f


m







2


l
f



c
f


m





0




0



]


δ

+


[



0




0




0





-

v
x





]


ρ






Modeling the vehicle's kinematic characteristics based on vehicle-related parameters: according to the kinematic characteristics of the vehicle, the kinematic model of the vehicle can be described as follows:

{dot over (X)}=vx cos ϕ−vy sin ϕ
{dot over (Y)}=vx sin ϕ+vy cos ϕ


Assuming again that the vehicle is in a driving condition with a small steering angle, the model is simplified as:

{dot over (X)}=vx−vyϕ
{dot over (Y)}=vxϕ+vy


Further, establishing the road-vehicle model based on the vehicle dynamics model and the vehicle kinematics model:

{dot over (x)}(t)=Ax(t)+Bu(t)+B107ω(t)


Where










x

(
t
)

=


[


v
y

,
r
,
ϕ
,

e
d

,

e
ϕ

,
X
,
Y

]

T


,


u

(
t
)

=



δ

(
t
)

.

ω

(
t
)


=


[

ρ
,

v
x


]

T













A
=

[






-
2



(


C
f

+

C
r


)



m


v
x








2


(



l
r



C
r


-


l
f



C
1



)



m


v
x



-

v
x




0


0


0


0


0






2


(



l
r



C
r


-


l
f



C
f



)




I
z



v
x








-
2



(



l
f
2



C
f


+


l
r
2



C
r



)




I
z



v
x





0


0


0


0


0




0


1


0


0


0


0


0




1


0


0


0



v
x



0


0




0


1


0


0


0


0


0




ϕ


0


0


0


0


0


0




1


0



v
x



0


0


0


0



]


,










B
=

[





2


C
f


m







2


l
f



C
f


m





0




0




0




0




0



]


,


B
ω

=

[



0


0




0


0




0


0




0


0





v
x



0




0


1




0


0



]







To discretize the road-vehicle model, T is used as the sampling time and Euler's method is utilized:








x
˙

(
t
)

=



x

(

k
+
1

)

-

x

(
k
)


T





Converting a continuous vehicle model into a discrete vehicle model:

ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k)

    • where Ā=AT+I, B=BT, Bω=BωT, I denotes the unit matrix of the corresponding dimensions.


In step S2, designing the path tracking controller according to the road-vehicle model: the prediction step of the path tracking controller is Np, and the control step is Nc, the system measurements at each momentx(t) will be used as the starting point of the prediction sequence x(0|t) for the optimization calculation, and the optimal sequence of the controlled variables u*(k|t), k∈[0,Np−1] and the sequence of the states x*(k|t), k∈[0,Np−1] will be obtained within the prediction time domain [t,t+Np] and the first value of the optimal control sequence (i.e., u*(0|t)) will be used as the control input at the current moment to act on the vehicle;


Due to the dynamic change of vehicle states, it is necessary to calculate the optimal steering angle according to the current actual vehicle condition while avoiding frequent steering angle changes. Therefore, the path tracking controller based on the model predictive control method is designed with the objective function:

min J(x(k),u(k),ω(k))=min(YTQY+ΔUTRΔU)
s.t. ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k)


Where, ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k) is the road-vehicle model, the predicted output of the system Y=[y(k+1), y(k+2), . . . , y(k+Np)]T, Q denotes the output weight matrix, the control increment sequence ΔU=[Δu(k),Δu(k+1), . . . ,Δu(k+Nc−1)]T, R denotes the control weight matrix, and in addition for achieving the goal of path tracking, the output equation is taken as







y
=

[




e
d






e
ϕ




]


;




Considering the limit constraints and the increment constraints of the controlled variables in the control process:

umin(t+k)≤u(t+k)≤umax(t+k)
Δumin(t+k)≤Δu(t+k)≤Δumax(t+k)
k=0,1, . . . ,Nc−1


In step S3, the driving trajectory is predicted according to the path tracking controller:

min J(x(k),u(k),ω(k))=min(YTQY+ΔUTRΔU)
s.t. ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k)  Objective function:
umin(t+k)≤u(t+k)≤umax(t+k)
Δumin(t+k)≤Δu(t+k)≤Δumax(t+k)
k=0,1, . . . ,Nc−1  Constraints:


By solving this quadratic programming problem, the optimal control sequence to achieve target tracking can be obtained:

U=[u(k),u(k+1), . . . ,u(k+Nc−1)]


The predicted sequence of system states Ξ is also computed by utilizing both the state equations of the system and the obtained optimal control sequence:

Ξ=Γx(k)+γU+ΠΩ


Where







Ξ
=

[




x

(

k
+
1

)






x

(

k
+
2

)











x

(

k
+

N
c


)




]


,

U
=

[




u

(
k
)






u

(

k
+
1

)











u

(

k
+

N
c

-
1

)




]


,

Ω
=

[




ω

(
k
)






ω

(

k
+
1

)











ω

(

k
+

N
c

-
1

)




]


,

Γ
=



[




A
~







A
~

2












A
~


N
c





]

·

ϒ

=

[




B
~



0





0






A
~



B
~





B
~






0





















A
~


(


N
c

-
1

)




B
˜







A
~


(


N
c

-
2

)




B
˜








B
˜




]



,

Π
=

[





B
~

ω



0





0






A
~




B
~

ω






B
~

ω






0





















A
~


(


N
c

-
1

)





B
~

ω







A
~


(


N
c

-
2

)





B
~

ω









B
~

ω




]






The driver prediction sequence is:

[(Xk+1,Yk+1),(Xk+2,Yk+2), . . . . ,(Xk+N,Yk+Nc)]


In step S4, performing a risk assessment of the predicted trajectory: the driver's driving risk will be evaluated using an artificial potential field approach based on the positional relationship between the driver and the obstacle.


Firstly, define the field strength of the barrier field:









U
R

(
X
)

=



{





0.5



Z

(


1

R
R


-

1

G
0



)

2


,





R
R



G
0







0
,





R
R

>

G
0










Where (X,Y) denotes the current position coordinates of the vehicle and (XOB,YOB) denotes the position coordinates of the obstacle. Z denotes the shortest distance coefficient between a vehicle and an obstacle, G0 is used to characterize the safety distance threshold for an obstacle; the RR indicates the shortest distance between a vehicle and an obstacle RR=√{square root over ((X−XOB)2+(Y−YOB)2)}.


Thus, the field force of the repulsive field FR formed around the obstacle can be described by a negative gradient in the field strength UR (X)







F
R

=


-

grad
[


U
R

(
X
)

]




{






Z

(


1

R
R


-

1

G
0



)

×

1

R
R
2



,





R
R



G
0







0
,





R
R

>

G
0











At this point, the field force of the repulsive field can be categorized into the longitudinal field force FRx and the lateral field force FRy:






{





F

R

x


=


F
R

·

cos

(
ϕ
)









F
Ry

=


F
R

·

sin

(
ϕ
)










Where ϕ denotes the angle formed by the line connecting the vehicle and the obstacle with the x-axis of the global coordinates;


Thus, the longitudinal risk Rx, the lateral risk Ry and the total driving risk Rrisk of the predicted trajectory with a control step Nc are obtained:






{





R
x

=





k
=
1


N
c




F

R

x


(


X

p

r

e

d

k

,

Y

p

r

e

d

k


)



N
c









R
y

=





k
=
1


N
c




F

R

y


(


X

p

r

e

d

k

,

Y

p

r

e

d

k


)



N
c













R
risk

=


R
x

+

R
y






In step S5, realizing the switching of control between the automatic system and the driver based on the driving risk: performing the driving risk assessment of the predicted trajectory in step S4 to obtain a driving risk Rrisk, given a threshold of the driver's driving risk Rrisk*, switching the control of the vehicle to the automatic system when the driving risk be equal or greater than the risk threshold (i.e. Rrisk≥Rrisk*); and switching the control of the vehicle to the human driver when the driving risk is less than the risk threshold (i.e. Rrisk<Rrisk*).


The present embodiment predicts the trajectory by designing a path tracking controller, and then determines whether the vehicle is actually controlled by the driver or by the automatic system by predicting the driver's driving risk when there is a driving input from the driver, this embodiment ensures that when the driving input from the driver will cause a higher risk to the vehicle, the driving input from the driver is deprived, and the automatic driving is carried out entirely by the automatic system, and in the event that the driver's driving inputs do not pose a high risk to the vehicle, and the driving is carried out by the driver so that the driver can effectively realize safe interventions when the automatic driving has a problem, and the safety of the intelligent driving is improved. Moreover, this embodiment adopts the method of artificial potential field, comprehensively considers the lateral and longitudinal risk of the vehicle, and improves the accuracy of the driving risk assessment.


Embodiment 3

This embodiment is disclosed based on Embodiment 2:


The vehicle parameters are set as follows: vehicle's mass m=1575, rotational inertia Iz=2875, distance from center of mass to front axle lf=1.2, distance from center of mass to rear axle lr=1.6, cornering stiffness of front wheels cf=19000, cornering stiffness of rear wheels cr=33000, output weight matrix Q=I(Np×Np) ⊗diag(100,100), control weight matrix R=5·I(Nc×Nc), (where I(N×N) denotes the unit matrix of dimension N×N and the symbol ⊗ denotes the Kronecker product). The initial coordinates of the vehicle are X=0 and Y=0, the coordinates of the static obstacle are Xob=50 and Yob=0.1, the parameter in the risk assessment is taken as Z=1000, G0=100, the risk threshold is taken ask Rrisk*=0.8, and the limit constraints and the increment constraints in the objective function are taken as:

umin=−0.78,umax=0.78,Δumin=−0.0082,Δumax=0.0082


Applied to the scenario of lane change to the left with a duration of 60 s, sampling time 0.05 s, prediction step Np=6, and control step Nc=3, we obtain the graphs of driver's driving risk assessment, the graphs of steering angle from the driver and the automated system, and the graphs of vehicle steering angle based on the human-machine shared control strategy as shown in figures 1. 2, 3, and 4.


The present embodiment predicts the trajectory by designing a path tracking controller, and then determines whether the vehicle is actually controlled by the driver or by the automated system by predicting the driving risk of the trajectory when there is a driving input from the driver. This embodiment ensures that when the driving input from the driver will cause a higher risk to the vehicle, the driving input from the driver is deprived, and the automated driving is carried out entirely by the automated system, and ensures that when the driver's driving input do not pose a high risk to the vehicle, and the driving is carried out by the driver, so that the driver can effectively realize safe interventions when the automatic driving has a problem, and the safety of the intelligent driving is improved. Moreover, this embodiment adopts the method of artificial potential field, comprehensively considers the lateral and longitudinal risk of the vehicle, and improves the accuracy of the driving risk assessment.


In summary, embodiments of the present invention provide a human-machine shared control method based on trajectory prediction. This includes: establishing a road-vehicle model based on vehicle-related parameters; designing a path-tracking controller based on the road-vehicle model; predicting a driving trajectory based on the path-tracking controller; performing a driving risk assessment of the predicted trajectory; and finally realizing switching of control between the automation system and the human driver based on the driving risk. It ensures that when the driver's own driving inputs will cause high risk to the vehicle, the driver's own driving inputs are deprived of, and the vehicle is completely carried out by the automatic driving, and in the case that the driver's own driving inputs will not cause high risk to the vehicle, the vehicle is carried out by the driver, so that the driver can effectively realize the safe intervention, and the safety of the intelligent driving is improved.


Obviously, the above embodiments of the present invention are merely embodiments for the purpose of clearly illustrating the present invention, and are not intended to be a limitation of the embodiments of the present invention. For those of ordinary skill in the professional filed, other variations or changes in different forms may be made on the basis of the above description. It is neither necessary nor possible to exhaust all the embodiments herein. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention shall be included in the scope of protection of the claims of the present invention.

Claims
  • 1. A method for human-machine shared control based on trajectory prediction, characterized in that it comprises the following steps: S1: establishing a road-vehicle model according to vehicle-related parameters;S2: designing a path tracking controller according to the road-vehicle model: first, establishing a vehicle dynamics model and a vehicle kinematics model according to the vehicle-related parameters, and then establishing the road-vehicle model according to the vehicle dynamics model and the vehicle kinematics model;wherein according to the vehicle dynamics model and the vehicle kinematics model, the road-vehicle model is obtained as follows: {dot over (x)}(t)=Ax(t)+Bu(t)±Bωω(t)wherein
  • 2. The method for human-machine shared control based on trajectory prediction according to claim 1, characterized in that the vehicle-related parameters comprise intrinsic parameters and implementation parameters of the vehicle in step S1; wherein the intrinsic parameters include: mass in, longitudinal velocity vy sampling time T, rotational inertia lz, distance from center of mass to front axle lf, distance from center of mass to rear axle lr, cornering stiffness of front wheels cf, cornering stiffness of rear wheels cr, position coordinates of static obstacles (Xob, Yob), minimum steering of the vehicle δmin, maximum steering of the vehicle δmax, minimum steering increment of the vehicle Δδmin, maximum steering increment of the vehicle Δδmax, parameter of a shortest distance between the vehicle and an obstacle Z, safety distance threshold parameter between the vehicle and an obstacle G0;the implementation parameters comprise: position coordinates of the vehicle (X, Y), lateral velocity vy, heading angle ϕ and angular velocity r.
  • 3. The method for human-machine shared control based on trajectory prediction according to claim 1, wherein the step of establishing the vehicle dynamics model based on vehicle-related parameters comprises; setting a longitudinal velocity vx of the vehicle to be independently controlled and constant, and a lateral force of the vehicle is expressed as: Fxf cos δ−Fxf sin δ+Fyr=m({dot over (v)}y+vxr)wherein δ is a front wheel steering angle of the vehicle, vx and vy, are longitudinal and lateral velocities at a center of mass of the vehicle, r is a yaw rate of the vehicle, Fyr and Fxr are lateral and longitudinal forces on rear wheels of the vehicle, and Fxf and Fxf are lateral and longitudinal forces on front wheels of the vehicle;under the condition that the vehicle is moving only in a two-dimensional plane without lateral slip and a vehicle's tire force is a linear model, a moment equations of the vehicle, a front and rear wheel slip angle (αf and αr), and tire forces on the front and rear wheels (Fyf and Fyr) is expressed as follows, respectively:
  • 4. The method for human-machine shared control based on trajectory prediction according to claim 1, wherein the step of establishing the vehicle kinematic model based on vehicle-related parameters comprises: according to kinematic characteristics of the vehicle, setting the kinematic model of the vehicle as follows: {dot over (X)}=vx cos ϕ−vy sin ϕ{dot over (Y)}=vx sin ϕ+vy cos ϕwherein the vehicle is in a driving condition with a small steering angle, the kinematic model is simplified as: {dot over (X)}=vx−vyϕ{dot over (Y)}=vxϕ+vy.
  • 5. The method for human-machine shared control based on trajectory prediction according to claim 1, wherein in step S3, the step of predicting the driving trajectories according to the path tracking controller comprises: min J(x(k),u(k),ω(k))=min(YTQY+ΔUTRΔU)s.t. ξ(k+1)=Ãξ(k)+{tilde over (B)}u(k)+{tilde over (B)}ωω(k)  objective function:umin(t+k)≤u(t+k)≤umax(t+k)Δumin(t+k)≤Δu(t+k)≤Δumax(t+k)k=0,1, . . . ,Nc−1  constraints:by solving a quadratic programming problem, obtaining the optimal control sequence to achieve target tracking: U=[u(k),u(k+1), . . . ,u(k+Nc−1)]calculating a predicted sequence of system states Ξ by utilizing both a state equation of the system and the optimal control sequence: Ξ=Γx(k)+γU+ΠΩwherein
  • 6. The method for human-machine shared control based on trajectory prediction according to claim 5, wherein the step of evaluating the driving risk of the predicted driving trajectories in step S4 comprises: evaluating the driving risk based on a positional relationship between the driver and an obstacle-by using an artificial potential field approach, wherein a field strength of a barrier field is defined:
  • 7. The method for human-machine shared control based on trajectory prediction according to claim 6, wherein the step of performing the switching of control between the automatic system and the driver based on the driving risk in step S5 comprises: performing a risk assessment of the predicted driving trajectory in step S4 to obtain a driving risk Rrisk giving a risk threshold of a driver's driving risk Rrisk*, and switching the control of the vehicle to the automatic system when the driving risk is equal or greater than the risk threshold Rrisk≥Rrisk*; switching the control of the vehicle to the driver when the driving risk be less than the risk threshold (i.e. Rrisk<Rrisk*).
Priority Claims (1)
Number Date Country Kind
202311750441.9 Dec 2023 CN national
US Referenced Citations (27)
Number Name Date Kind
10627812 Eggert Apr 2020 B2
10759439 Lee Sep 2020 B2
11834077 Sadeghi Dec 2023 B2
11932306 Febbo Mar 2024 B2
20170132334 Levinson May 2017 A1
20190369637 Shalev-Shwartz Dec 2019 A1
20200089245 Yadmellat Mar 2020 A1
20200174481 Van Heukelom Jun 2020 A1
20200353926 Zheng Nov 2020 A1
20210139048 Russell May 2021 A1
20210253128 Nister Aug 2021 A1
20220035375 Rezaee Feb 2022 A1
20220169247 Borrello Jun 2022 A1
20220169278 Refaat Jun 2022 A1
20220227391 Wang Jul 2022 A1
20220242413 Jing Aug 2022 A1
20230021615 Inaba Jan 2023 A1
20230084578 Sadeghi Mar 2023 A1
20230110713 Degirmenci Apr 2023 A1
20230182775 Beaurepaire Jun 2023 A1
20230192127 Funke Jun 2023 A1
20240001955 Etesami Jan 2024 A1
20240092390 Philion Mar 2024 A1
20240132107 Cho Apr 2024 A1
20240190458 Aguilar Marsillach Jun 2024 A1
20240253621 Duan Aug 2024 A1
20240351615 Song Oct 2024 A1
Foreign Referenced Citations (5)
Number Date Country
107804315 Mar 2018 CN
113320542 Aug 2021 CN
113460088 Oct 2021 CN
114291109 Apr 2022 CN
114379583 Apr 2022 CN
Non-Patent Literature Citations (1)
Entry
The first office action with search report of CN patent application No. 202311750441.9 issued on Mar. 23, 2024.