This application claims priority to European Patent Application Number 21166327.3, filed Mar. 31, 2021, and European Patent Application Number 20172809.4, filed May 4, 2020, the disclosures of which are hereby incorporated by reference in their entireties herein.
The present disclosure relates to methods and systems for determining alignment parameters of a radar sensor. Radar-sensors, for example in automotive applications, may need to be aligned with the chassis of a host-vehicle so that the location of detected objects is accurately known. Alignment procedures performed when the host-vehicle is assembled are not able to compensate for pitch or elevation errors caused by heavy cargo and yaw, azimuth or roll errors caused by miss-alignment of the wheels or chassis of the host-vehicle which may cause ‘crabbing’ or ‘dog-tracking’ by the host-vehicle while traveling. Accordingly, there is a need to provide for reliable determination of alignment parameters.
The present disclosure provides a computer implemented method, a radar system, a computer system, a vehicle, and a non-transitory computer readable medium according to the independent claims. Embodiments are given in the subclaims, the description and the drawings.
In one aspect, the present disclosure is directed at a computer implemented method for determining alignment parameters of a radar sensor, the method comprising the following steps performed (in other words: carried out) by computer hardware components: determining measurement data using the radar sensor, the measurement data comprising a range-rate measurement, an azimuth measurement, and an elevation measurement; determining a velocity (in other words: speed) of the radar sensor (for example using a velocity sensor or together with the misalignment parameters); and determining the misalignment parameters based on the measurement data and the velocity, the misalignment parameters comprising an azimuth misalignment, an elevation misalignment, and a roll misalignment.
It will be understood that determining a velocity of the radar sensor may either be carried out explicitly (for example using a velocity sensor) or implicitly (for example by including the velocity into an optimization problem, as described for the 2D case and for the 3D case herein).
According to various embodiments, misalignment parameters may be determined by comparing a velocity determined by a velocity sensor (which may be independent from the radar sensor) and velocity information which is determined based on radar measurement data.
The measurements data may be related to the radar sensor, for example to a radar sensor mounted on a vehicle (for example at least partially autonomously driving vehicle, for example car), for example on the chassis of the vehicle. The velocity sensor may be external to the radar sensor; for example, the velocity sensor may be the velocity sensor of a vehicle, for example based on odometry measurements, gyroscope measurements, and/or acceleration measurements.
According to another aspect, the misalignment parameters further comprise a speed-scaling error.
It has been found that provided a three-axial-auto-alignment with speed-scaling-error estimation improves the detection quality of radar sensors.
According to another aspect, the computer implemented method further comprises the following step carried out by the computer hardware components: determining system parameters, the system parameters comprising at least one of a desired azimuth mounting angle, a desired elevation mounting angle, and a desired roll mounting angle; wherein the misalignment parameters are determined further based on the system parameters.
The system parameters may be set by the manufacturer of the system (for example vehicle) on which the radar sensor is provided. The system parameters may describe or define how the radar sensor is provided (for example mounted) in the vehicle.
According to another aspect, the measurement data is related to a plurality of objects external to the radar sensor. For example, measurement results related to at least three objects may be provided. For example, measurement results related to at least four objects may be provided. For example, measurement results related to at least five objects may be provided. The number of objects may be chosen so that the system for determining the misalignment parameters is at least not under-determined, for example so that the system is over-determined (i.e. more measurement results may be available than unknown misalignment parameters are to be determined; this may allow for implicit correction of measurement inaccuracies or measurement errors, for example by using regression methods to determine the misalignment parameters).
The objects may be provided outside a vehicle in which the radar sensor is provided.
According to another aspect, the plurality of objects are stationary. Thus, it may be considered known that the velocity determined by the velocity sensor is identical to the (relative) velocity of the stationary objects (relative to the radar sensor). This may be used for determining the misalignment parameters by determining the misalignment parameters so that the velocity determined based on the radar measurements is in agreement with the velocity determined by the velocity sensor (for example so that the difference between the velocity determined based on the radar measurements is in agreement with the velocity determined by the velocity sensor is minimized).
According to another aspect, the misalignment parameters are determined based on an iterative method.
A closed-form solution to the determination of the misalignment parameters may not be available or may be numerically instable. An iterative method may be used, starting from an initial estimate (or guess), for example with all misalignment parameters set to a default value (for example 0). The estimate values may be iteratively updated. The misalignment parameters may already be of reasonable accuracy after one iteration. Depending on the resources like time and computational power, more than one iteration may be performed. The iterations may continue until a pre-determined stop criterion is reached, for example a maximum time available for the determination of the misalignment parameters, or a pre-determined accuracy of the misalignment parameters (which may for example be determined based on how much (for example absolutely or relatively) the estimates for the misalignment parameters change from one iteration to the next iteration).
According to another aspect, the misalignment parameters are determined based on an optimization method.
The optimization method may optimize the misalignment parameters so that the difference between the velocity measured by the velocity sensor and the velocity which is determined based on the measurement data is minimized. The optimization method may determine the misalignment parameters from an overdetermined system (wherein more measurements, for example related to a plurality of objects, are available than would be required for a closed form determination of the misalignment parameters). The optimization method may use the Jacobian matrix, including partial derivatives of the modeled output with respect to the misalignment parameters.
According to another aspect, the misalignment parameters are determined based on a non-linear least squares regression method. According to another aspect, the misalignment parameters are determined based on a non-linear total least squares regression method.
According to another aspect, the misalignment parameters are determined based on filtering. For example, the misalignment parameters that have been determined based on the optimization or regression method may be subject to filtering, for example Kalman filtering, to further improve the misalignment parameters.
According to another aspect, the measurement data are determined using a plurality of radar sensors (which may include the radar sensor and at least one further radar sensor).
According to another aspect, the velocity of the radar sensor and the misalignment parameters are determined simultaneously by solving an optimization problem.
With the method according to various embodiments, the overall performance of the alignment may be improved, which may have a positive impact on the performance of further radar processing.
In another aspect, the present disclosure is directed at a computer implemented method for determining corrected measurement data, the method comprising the following steps carried out by computer hardware components: determining measurement data using a radar sensor; correcting the measurement data to obtain the corrected measurement data based on misalignment parameters determined according to the computer-implemented method described herein.
With the corrected measurement data, improved detection results may be achieved.
Based on the misalignment parameters, the control of the radar sensor (for example the area in which the radar sensor is to determine measurements) may be adjusted (for example to the desired area or desired field of view).
In another aspect, the present disclosure is directed at a computer system, said computer system comprising a plurality of computer hardware components configured to carry out several or all steps of the computer implemented method described herein. The computer system can be part of a vehicle.
The computer system may comprise a plurality of computer hardware components (for example a processor, for example processing unit or processing network, at least one memory, for example memory unit or memory network, and at least one non-transitory data storage). It will be understood that further computer hardware components may be provided and used for carrying out steps of the computer implemented method in the computer system. The non-transitory data storage and/or the memory unit may comprise a computer program for instructing the computer to perform several or all steps or aspects of the computer implemented method described herein, for example using the processing unit and the at least one memory unit.
In another aspect, the present disclosure is directed at a radar system comprising a radar sensor for which the misalignment parameters are determined according to the computer implemented method described herein.
In another aspect, the present disclosure is directed at a vehicle comprising the radar system described herein.
In another aspect, the present disclosure is directed at a non-transitory computer readable medium comprising instructions for carrying out several or all steps or aspects of the computer implemented method described herein. The computer readable medium may be configured as: an optical medium, such as a compact disc (CD) or a digital versatile disk (DVD); a magnetic medium, such as a hard disk drive (HDD); a solid state drive (SSD); a read only memory (ROM), such as a flash memory; or the like. Furthermore, the computer readable medium may be configured as a data storage that is accessible via a data connection, such as an internet connection. The computer readable medium may, for example, be an online data repository or a cloud storage.
The present disclosure is also directed at a computer program for instructing a computer to perform several or all steps or aspects of the computer implemented method described herein.
Exemplary embodiments and functions of the present disclosure are described herein in conjunction with the following drawings, showing schematically:
Radar alignment is a process of determining the angular misalignment of radar facing direction. Correction of those mounting errors may be crucial for proper operation of radar based tracking methods and most of the feature functions that operate on detections or tracked objects provided by a radar sensor. Two main classes of methods/approaches aimed at solving misalignment problem are:
To calculate the misalignment in case of a misalignment in azimuth and elevation (disregarding a possible misalignment in roll), the range rate equation of stationary detections may be used. It may be derived from the projection of the negative vehicle velocity vector to the vector of distance, which forms the equation below:
{dot over (R)}=−V
X cos αVCS cos βVCS−VY sin αVCS cos βVCS−VZ sin βVCS (1)
where:
VCS aligned measurement angles may be decomposed into sensor mounting angles, sensor detection measurement angles as well as sensor mounting misalignment angles:
αVCS=αSCS+αB+aM (2)
βVCS=βSCS+βB+βM (3)
where:
Further expanding the equation with speed correction factor Vc (which may also be referred to as (vehicle) speed-scaling-error or speed compensation factor) leads to:
where:
An equation may be created which may be used to find unknown parameters (B), based on measurements (X), known constants (C) and equation result (Y) as follows:
f(C{αB,βB},X{αSCS,βSCS,VXm,VYm,VZm},B{αM,βM,Vc})=Y{{dot over (r)}} (7)
Various methods, such as iterative non-linear least squares regression or error-in-variables methods, may be used to determine the unknown parameters. The parameters found by these methods may then further be refined by filtering in time methods such as Kalman filter.
Significant roll misalignment angle of the sensor (desired sensor roll is usually zero) can greatly impact the azimuth and elevation measurements, because it reduces radar field of view as shown below.
Roll angle misalignment may influence the azimuth-elevation misalignment calculation itself.
As can be seen from
The impact of the roll angle misalignment may be almost unobservable for small angles (for example less than 1 [deg]), and may be growing exponentially with the roll, introducing highest error at the corners of field-of-view. At a 30 [deg] radar roll (i.e. a misalignment of the radar sensor in roll angle of 30 deg), as is illustrated in
The radar roll angle misalignment may be determined by extending the range rate equation, which makes estimation of the roll angle possible. The equation may further improve estimation of yaw and pitch angle misalignments. After the estimation of 3 angle misalignments (yaw, pitch, roll) the measured detections may be corrected to represent detections in vehicle coordinate system or in extreme misalignment the estimated value may trigger an alert which will stop the execution of further radar functions.
The range rate equation (1) may be used together with equations (2) and (3), which may be extended with the roll angle influence, what leads to following equations:
αVCS=αSCS′+αB+αM (8)
βVCS=βSCS′+βB+βM (9)
αSCS′=αSCS cos(γM+γB)−βSCS sin(γM+γB) (10)
βSCS′=αSCS sin(γM+γB)+βSCS cos(γM+γB) (11)
where:
Therefore, α′ SCS and β′ SCS may be visualized as detections with the same distance from radar center of view (0, 0), but rotated (aligned) with regard to a horizon line (assuming desired roll mounting angle of 0 [deg]), forming a ‘compensated field of view’ as shown on
After substitution of eqns. (8) and (9) (α′ and β′ SCS) to eqns. (2) (3) for αSCS and βSCS, respectively, the following equations may be obtained:
αVCS=αSCS cos(γM+γB)−βSCS sin(γM+γB)+αB+αM (12)
βVCS=αSCS sin(γM+γB)+βSCS cos(γM+γB)+βB+βM (13)
This change modifies the general model in equation (7) to:
ƒ(C{αB,βB,γB},C{αSCS,βSCS,VXm,VYm,VZm},B{αM,βM,γM,Vc})=Y{{dot over (r)}} (14)
The general form of this model can be derived from range rate equation (1)
Eq. (13) can be simplified with the assumption of the vehicle moving only in forward direction (VYm and VZm equal to 0) and elevation and roll desired mounting angles θ [deg], to get the following form:
Equation (16) may be used to compose (create) an overdetermined system of equations which can be solved by various methods to find parameters of interest i.e. misalignment angles and speed compensation factor. In an example, equation (14) may be used as a model for non-linear least square regression. For example, the model may be iterative, which means that the method will iterate over the same dataset containing data from one time instance to converge to the solution of non-linear equation in multiple steps defined by linearization of the model around its operating point:
(JT·J)ΔB=JT·ΔY (17)
The matrix equation (17) can be transformed to:
ΔB=(JT·J)−1·JT·ΔY (18)
where:
The Jacobian matrix may take the following form:
where:
The non-linear regression model described by equations (18) to (24) may be solved after assuming initial values of parameters:
where m is the number of successful alignment cycles (radar cycles). In other words, a misalignment of 0 in the azimuth, elevation and roll angles and in the speed-correction factor may be assumed as the starting point for the first iteration, and the results of the previous iteration may be used as starting point for the next iteration.
Therefore, equation (26) may update model parameter values with values at i-th iteration:
B
i
=B
i-1
+ΔB
i (26)
Bi may converge to real speed-scaling-error and misalignment angles at infinite number of iterations (or as iteration number approaches infinity):
The method according to various embodiments provides alignment parameters also for the roll axis, which accurately describes the physical model.
The result of only a single iteration (first iteration) of each of compared method is shown in each of
As shown in
According to various embodiments, the misalignment parameters may further include a speed-scaling error.
According to various embodiments, system parameters may be determined, wherein the system parameters may include at least one of a desired azimuth mounting angle, a desired elevation mounting angle, and a desired roll mounting angle. The misalignment parameters may be determined further based on the system parameters.
According to various embodiments, the measurement data may be related to a plurality of objects external to the radar sensor.
According to various embodiments, the plurality of objects may be stationary.
According to various embodiments, the misalignment parameters may be determined based on an iterative method.
According to various embodiments, the misalignment parameters may be determined based on an optimization method.
According to various embodiments, the misalignment parameters may be determined based on a non-linear least squares regression method.
According to various embodiments, the misalignment parameters may be determined based on a non-linear total least squares regression method.
According to various embodiments, the misalignment parameters may be determined based on filtering.
According to various embodiments, the measurement data may be determined using a plurality of radar sensors.
According to various embodiments, the velocity of the radar sensor and the misalignment parameters may be determined simultaneously by solving an optimization problem.
Each of the steps 802, 804, 806 and the further steps described above may be performed by computer hardware components.
The measurement data determination circuit 902 may be configured to determine measurement data using a radar sensor, the measurement data comprising a range-rate measurement, an azimuth measurement, and an elevation measurement. The radar sensor may be a part of the measurement data determination circuit 902 or may be provided external to the measurement data determination circuit 902.
The velocity determination circuit 904 may be configured to determine a velocity of the radar sensor. The velocity sensor may be a part of the velocity determination circuit 904 or may be provided external to the velocity determination circuit 904.
The misalignment parameters determination circuit 906 may be configured to determine misalignment parameters of the radar sensor based on the measurement data and the velocity, the misalignment parameters comprising an azimuth misalignment, an elevation misalignment, and a roll misalignment.
The measurement data determination circuit 902, the velocity determination circuit 904, and the misalignment parameters determination circuit 906 may be coupled with each other, e.g. via an electrical connection 908, such as e.g. a cable or a computer bus or via any other suitable electrical connection to exchange electrical signals.
A “circuit” may be understood as any kind of a logic implementing entity, which may be special purpose circuitry or a processor executing a program stored in a memory, firmware, or any combination thereof.
The processor 1002 may carry out instructions provided in the memory 1004. The non-transitory data storage 1006 may store a computer program, including the instructions that may be transferred to the memory 1004 and then executed by the processor 1002. The radar sensor 1008 may be used for determining measurement data as described above. The velocity sensor 1010 may be used to determine the velocity as described above.
The processor 1002, the memory 1004, and the non-transitory data storage 1006 may be coupled with each other, e.g. via an electrical connection 1012, such as e.g. a cable or a computer bus or via any other suitable electrical connection to exchange electrical signals. The radar sensor 1008 and/or the velocity sensor 1010 may be coupled to the computer system 1000, for example via an external interface, or may be provided as parts of the computer system (in other words: internal to the computer system, for example coupled via the electrical connection 1012).
The terms “coupling” or “connection” are intended to include a direct “coupling” (for example via a physical link) or direct “connection” as well as an indirect “coupling” or indirect “connection” (for example via a logical link), respectively.
It will be understood that what has been described for one of the methods above may analogously hold true for the alignment parameter estimation system 900 and/or for the computer system 1000.
In the following, further embodiments will be described. These embodiments may provide simultaneous estimation of host vehicle velocity and radar misalignment based on multiple Doppler radars detections.
As used herein, various coordinate systems may be used.
An ISO—earth fixed coordinate system may be based on an axis system which remains fixed in the inertial reference frame. The origin of this coordinate system may be fixed on the ground plane. The position and orientation may be chosen in an arbitrary manner (for example based on the desired application). The naming in ISO standard for the system may be (xE; yE; zE).
A further coordinate system may be the vehicle coordinate system.
A further coordinate system may be the sensor coordinate system.
Sensors like LiDARs and radars report detections in the polar coordinate system. Each detection may be described by the trio of: range; azimuth; elevation.
Every radar scan may produce a set of (radar) detections, where each of the detections may have following properties:
Target planar motion may be described by:
V
t=[ωtxtyt]T
The range rate equation for a single raw detection from target may be given as:
{dot over (r)}
i
+v
x
s cos θi+vys sin θi=vxt cos θi+vyt,sin θi
where:
To simplify the notation, the notion of a compensated range rate may be introduced and defined as:
{dot over (r)}
cmp
i
={dot over (r)}
i
+v
x
s cos θi+vyh sin θi
Then range rate equation may be reduced to:
{dot over (r)}
cmp
i
=v
x
t cos θi+vxt sin θi
In vector form, it may be described as follows:
Coefficients vxt and vyt, may be called velocity profile.
The velocity profile may be successfully estimated if at least 2 detections from one target object are available. This estimation can be done by application of least squares method or method presented in US 2019/0369228. Both methods may provide an estimation of velocity profile and its covariance matrix:
The Gauss-Newton optimization method may be used for minimization of a function in quadratic form:
Q(μ)=ƒ(μ)Tƒ(μ)
The Gauss-Newton optimization method may include the following steps:
1. The point μ0, function ƒ(μ) and its Jacobian matrix
may be given initially. Set i=0.
2. Set γi=1.
μi+1=μi+γi(J(μi)TJ(μi))−1J(μi)Tƒ(μi)
4. If Q(μi+1)>Q(μi), set γi=½ γi and repeat from 3.
5. Terminate if stop criteria reached.
6. Otherwise set i=i+1 and repeat from 2.
According to various embodiments, devices and methods may be provided for simultaneous estimation of vehicle velocity and radars misalignment angles. Such an approach may not be possible for a single radar, because only by having multiple radars, the measurement from one sensor may be corrected based on other sensors measurements.
In the following, the method for the 2D (two-dimensional) case will be described.
Range rate equation in the 2D case may have the following form:
where:
{dot over (r)} may be the range rate of detection,
θ may be the azimuth of detection,
[vs,xscs vs,yscs]T may be the sensor velocity reported in Sensor Coordinate System (SCS).
If α is sensor yaw angle, then the detection range rate may be a function of sensor velocity in the Vehicle Coordinate System (VCS) and may have the following form:
where
α=α0+αm
The sensor velocity may be also presented as function of host velocity in VCS:
where
Based on those equation range rate equation may be written as:
Considering all static detections from all radars may provide the following system of equations:
In short, this may be written as:
−
where
Based on this, the vector
ƒ(
This optimization may be done by the Gauss-Newton method as described above, where the Jacobian matrix has the following form:
where:
Based on this Jacobian matrix, the Hessian matrix may be approximated in the following form:
where:
Moreover, for the optimization method, the matrix
J(
may be needed, and it may be calculated as:
In the following, the 3D case will be described.
In the 3D case, the range rate equation may have the following form:
where:
In this case, radar orientation may be assumed to be in 3D, so it may have yaw, pitch, and roll angle:
Also, in this case real orientation may be the sum of calibrated orientation and misalignment:
Taking this orientation into account, the range rate may be presented by sensor velocity in VCS by the following equation:
where
To simplify calculations, the following assumptions may be reasonable:
αm,⋅≈0,
α0,r=0,
v
s,z
vcs≈0.
It will be understood that the dot in the first assumption may stand for r and/or p, and/or y.
Then the rotation matrix may have the following form:
where:
r
11=cos α0,y−αm,y sin α0,y,
r
21=(sin α0,y+αm,y cos α0,y)(cos αp,0−αm,p sin α0,p),
r
31=sin α0,p+αm,p cos α0,p,
r
12=(sin α0,y+αm,y cos α0,y)+αm,r(cos α0,y−αm,y sin α0,y)(sin α0,p+αm,p cos α0,p),
r
22=(cos α0,y−αm,y sin α0,y)−αm,r(sin α0,y−αm,y cos α0,y)(sin α0,p+αmp cos α0,p),
r
32=−αm,r(cos α0,p−αm,p sin α0,p),
r
13=(sin α0,y+αm,y cos α0,y)−αm,r(cos α0,y−αm,y sin α0,y)(sin α0,p+αm,p cos α0,p),
r
23=−αm,r(cos α0,y−αm,y sin α0,y)+(sin α0,y+αm,y cos α0,y)(sin α0,p+α0,p cos α0,p),
r
33=cos α0,p−αm,p sin α0,p.
Summing up all of these equations, the range rate equation may be written as:
−{dot over (r)}=vs,xvcs(cos θ cos φr11+sin θ cos φr21−sin φr31)+vh,yvcs(cos θ cos φr12+sin θ cos φr22−sin φr32)
Considering all detections from all radars, an optimization problem may be formulated for finding the host velocity and radars misalignments angles (which may be similar to the 2D case as described above):
−
where:
This may be solved by a nonlinear least squares method with usage of a Gauss-Newton method, as described above, for which the Jacobian may be provided in the following form:
where the parameters of the Jacobian are defined as:
Number | Date | Country | Kind |
---|---|---|---|
20172809.4 | May 2020 | EP | regional |
21166327.3 | Mar 2021 | EP | regional |