The present application claims priority to European Patent Application No. 10 2022 23193743.4, to Gustav, et al., filed Aug. 28, 2023, the contents of which is incorporated by reference in its entirety herein.
The present disclosure relates to technologies and techniques for estimating and applying current positions of sensor elements in an array sensor. Furthermore, the present disclosure relates to a computer program product, a computer-readable storage medium as well as to an array sensor employing the presently disclosed technologies and techniques.
Estimating the current positions of sensor elements in an array sensor is a well-known problem in the state of the art. For at least partially automated motor vehicles, it is important to know the sensor position with high precision to capture the surroundings more accurately, thereby enabling safer control of the motor vehicle in its environment.
GP 2002 344 223 A1 provides a method of determining the position of an array antenna element to improve its output performance. An array antenna unit is equipped with a STAP controller and includes the following functions: a first function is obtained by summing the expectations of the squared absolute values of auto-correlation functions of the general impulse response of all desired waves; a second function is obtained by summing the expectations of the squared absolute values of cross-correlation functions between the general impulse response of all desired waves and the general impulse response of all interference waves; a third function is the sum of the first and second functions; and a fourth function involves the relative positioning of the remaining (n-1) antennas, with reference to a specific antenna element. An antenna position designing unit determines the position of n antenna elements by calculating the positions of the other (n-1) antenna elements to minimize the fourth function.
U.S. Pat. No. 11,005,580 B2 discloses an array antenna calibration method and device used for calibrating an array antenna in real time within an open calibration environment. The method includes: determining an initial beam weight vector matrix for an array antenna to be calibrated based on a preset direction angle of each preset beam direction, and emitting a first calibration signal from a test antenna in a standard beam direction to the array antenna to be calibrated; determining, based on the first calibration signal received by each channel of the array antenna to be calibrated, a magnitude-phase arrow between the first calibration signal received by a center channel and the first calibration signal received by each channel; and using the magnitude-phase arrow to calibrate the initial beam weight vector matrix, resulting in a compensation beam weight vector matrix.
According to U.S. Pat. No. 7,714,776 B2, an antenna array comprises a surface with a replicated pattern of conductive tracks, which define multiple ports. A plurality of antennas are located at ports distributed across the surface. A plurality of radiative transceivers are electrically connected to respective antennas. Additionally, a plurality of reference transceivers are electrically connected to non-radiative impedances located at respective ports so that each reference transceiver is surrounded by a group of antennas and electrically coupled to the group of antennas via the tracks. At least one antenna from each group belongs to another group of antennas. Calibration circuitry includes a controller associated with each reference transceiver, which is configured to transmit a calibration signal through the associated reference transceiver and receive and store a calibration signal from a selected transceiver in the group of antennas coupled to the reference transceiver. The calibration circuitry further includes, for each other transceiver in the group, circuitry to adjust the phase and amplitude of signals transmitted and received by the radiative transceivers relative to the stored calibration signals for the selected radiative transceiver.
It is an object of the present disclosure to disclose a method, a computer program product, a computer-readable storage medium, and an array sensor by which improved estimation of current positions of sensor elements in the array sensor is achieved.
Certain aspects are disclosed in the respective subject matter of the independent claims. Further implementations and preferred embodiments are the subject matter of the dependent claims.
In some examples, a method for estimating current positions of sensor elements in an array sensor is disclosed. Initial position estimates of the sensor elements are determined by an electronic computing device of the array sensor. A sensor signal is transmitted in the surroundings of the array sensor by a transmitting device, and a reflected sensor signal is received by a receiving device of the array sensor, where the sensor signal is reflected on at least one calibration target in the surroundings. At least a direction of arrival of the reflected signal is determined by the electronic computing device. A virtual position of each of the sensor elements is estimated analytically depending on the direction of arrival by the electronic computing device based on a criterion of smallest residuum. The current positions are estimated depending on the virtual positions and the initial position estimates by the electronic computing device.
Thus, an analytical method for estimating current positions of sensor elements is disclosed. Determining at least a direction of arrival of a reflected signal may be performed by the electronic computing device itself or by other target localization devices or techniques.
Furthermore, the present disclosure relates to a computer-readable storage medium comprising at least the computer program product as disclosed herein.
In some examples, an array sensor is disclosed, particularly a sensor device and/or communication device for a motor vehicle or any kind of vehicle, comprising at least one transmitting device, one receiving device, and one electronic computing device, wherein the array sensor, particularly the sensor device and/or communication device, is configured to perform a method as disclosed herein.
The method may be performed by the sensor device and/or communication device.
In some examples, a motor vehicle is disclosed, comprising at least the sensor device and/or communication device as disclosed herein.
Advantageous embodiments of the method are also regarded as advantageous embodiments of the computer program product, the computer-readable storage medium, the sensor device and/or communication device, and the motor vehicle. Therefore, the sensor device and/or communication device, as well as the motor vehicle, may include means for performing the method.
The present disclosure also includes the control device/electronic computing device for the motor vehicle. The control device may comprise a data processing device or a processor device adapted to perform an example of the method as disclosed herein. For this purpose, the processor device may include at least one microprocessor and/or at least one microcontroller and/or at least one FPGA (field-programmable gate array) and/or at least one DSP (digital signal processor). A CPU (Central Processing Unit), GPU (Graphical Processing Unit), or NPU (Neural Processing Unit) may be used as the microprocessor in each case. Furthermore, the processor device may have program code configured to perform the method when executed by the processor device. The program code may be stored in a data memory of the processor device. The processor device may be based, for example, on at least one circuit board and/or at least one SoC (system on chip).
The motor vehicle according to the present disclosure is preferably designed as a motor vehicle, particularly as a passenger car or truck, or as a passenger bus or motorcycle.
As a further solution, the present disclosure also includes a computer-readable storage medium comprising program code which, when executed by a computer or computer network, causes the computer or computer network to execute an example of the method as disclosed herein. The storage medium may be disclosed at least in part as a non-volatile data storage (e.g., as a flash memory and/or as an SSD-solid state drive) and/or at least in part as a volatile data storage (e.g., as a RAM-random access memory). The storage medium may be arranged in the computer or computer network. However, the storage medium may also be operated, for example, as a so-called app store server and/or cloud server on the Internet. A processor circuit with, for example, at least one microprocessor may be disclosed by the computer or computer network. The program code may be disclosed as binary code and/or as assembly code and/or as source code of a programming language (e.g., C) and/or as a program script (e.g., Python).
The present disclosure also encompasses combinations of the features of the described examples. Thus, it also encompasses implementations that combine features of more than one of the described examples, provided that the examples have not been described as mutually exclusive.
Exemplary embodiments are described hereafter. In the drawings:
In the figures the same elements are comprising the same reference signs.
As disclosed herein, the objective is to estimate three-dimensional antenna positions and complex channel imbalances for measured range/Doppler/channel maps, for example, with at least four disjoint calibration targets. When restricted to a subspace, a d-dimensional position estimate requires a number of d targets, plus one additional target if channel imbalances are also to be estimated.
Targets can be in the near-field, but their locations should ideally be “known.” The closer the target is to the array, the more precisely the range needs to be known. In the far-field, only the direction of arrival (DoA) information suffices. In principle, an estimate of target location information can be obtained even with the sensor itself. The signal-to-noise ratio (SNR) is sufficiently high to prevent noise from significantly disturbing the phases.
Prior knowledge of antenna positions is important for a successful outcome, ideally with a 3D error accuracy better than half of the operating wavelength (lambda/2).
The range of sets of peak shifts due to cable delays can also be compensated, but this task is independent of the estimation of antenna position and channel imbalances. In a dynamic scene with moving platforms, range migration over ramps must be compensated for first.
The method disclosed herein is analytical, meaning that no costly numerical optimization is required.
In the near-field case, the method relies on certain “fudge factors” (i.e., “correction coefficients” or “adjustment parameters”), which are determined from prior knowledge of antenna positions and target locations. These factors are used to pre-transform the data to eliminate unwanted terms in the bistatic range's Taylor series, which would otherwise prevent analytical treatment.
The derivation of the method assumes that the data samples are noise-free. However, it can still be applied to noisy data, although its performance may be more sensitive to noise than other methods.
As disclosed herein, at least four reflected signals from at least four calibration targets are received. It is also possible to use fewer than four calibration targets. For example, a d-dimensional position estimate requires d targets, plus one additional target if channel imbalances are also to be estimated. Therefore, if a two-dimensional position estimate is computed, just two calibration targets are used. If the two-dimensional estimation includes channel imbalances, at least three calibration targets are used. For three-dimensional estimation, three targets are used. If channel imbalances are also estimated, four calibration targets are used. This approach enables precise estimation of the current positions.
In another embodiment, the distance to at least one calibration target is disclosed, and the virtual position is additionally determined based on the disclosed distance. The distance can be provided externally. Thus, depending on the distance, precise estimation of the current sensor positions is realized.
In another embodiment, a channel imbalance of the antenna is determined based on the estimated current positions. The channel imbalances of the array sensor are also determined based on the estimated current positions. Thus, the disclosed method allows for the estimation of channel imbalances, enabling the determination of countermeasures.
In another embodiment, the channel imbalance is determined using a singular value decomposition algorithm. This provides a precise method for determining the channel imbalance.
In another embodiment, the channel imbalance is determined using a higher-order singular value decomposition algorithm. This provides a precise method for determining the channel imbalance.
In another embodiment, the initial positions are nominal positions. This allows for normalization of the data, which decouples the estimation of positions from imbalances.
In another embodiment, the estimated virtual positions are bootstrapped as the initial positions. This allows for further calculation/estimation of the positions, particularly with higher precision.
In another embodiment, the received signal is compensated for phase contributions due to geometry from the received signal. This enables more precise estimation of the current sensor positions.
In another embodiment, the sensor device is disclosed as a radar device and/or a communication device. Thus, the sensor device can be used as a radar device and/or communication device. This offers the advantage of being suitable for communication, such as with a satellite, and/or for capturing the surroundings of a motor vehicle.
As disclosed herein, the method is a computer-implemented method. Therefore, another aspect of the disclosure relates to a computer program product comprising program code means for performing the method as disclosed herein.
According to an embodiment of the method, initial position estimates 9 of sensor elements 10, 11, 12, 13 of the array sensor 3 are disclosed by the electronic computing device 8. As shown in
A sensor signal 14 is transmitted in the surroundings 15 of the array sensor 3 by the transmitting device 6, and reflected sensor signals 16 are received by the receiving device 7, where the sensor signal 14 is reflected on at least one calibration target 17, 18, 19, 20.
At least the direction of arrival of the reflected signal 16 is determined by the electronic computing device 8. A virtual position of each of the sensor elements 10, 11, 12, 13 is estimated based on the direction of arrival by the electronic computing device 8, using a criterion of the smallest residuum. The current positions 9 are estimated based on the virtual positions and the initial positions as determined by the electronic computing device 8.
As shown in
Furthermore, based on the estimated current positions 9, a channel imbalance of the sensor elements 10, 11, 12, 13 is determined.
In another embodiment, the channel imbalance is determined using a singular value decomposition algorithm. Alternatively, the channel imbalance is determined using a higher-order singular value decomposition.
Specifically,
Now, the steps S1 to S6 are presented in more detail. According to the first step S1, normalization of the data is disclosed.
An array consists of Tx m=1, . . . , NTx and Rx n=1, . . . , NRx with (3D Cartesian) positions tm, rn∈3, respectively. Radar operates at wavelength λ.
Data model for range/Doppler snapshots: For Cartesian target location pk,
where k=0, . . . , K targets and l=(m, n)=0, . . . , L virtual channels with position
The complex channel imbalances are γl, while sk are the target amplitudes. Note that virtual positions are defined here as the mean, not just the sum, of Tx and Rx position. Note also there is no additive Gaussian noise in the model.
Select a virtual ‘reference channel’ (wlog, l=0), which will also serve as coordinate origin v0=0 in the following.
Divide now element-wise by the signal in the reference channel and compensate with the following (estimated) residual phases
where (omitting indices k, l, etc)
and {circumflex over (Δ)} analogously, with antenna positions (and in a potential extended version of the method also target locations) replaced with their priors. The target direction (DoA) is denoted by u.
Here, a correction coefficient f is introduced, which is usually set to
and {circumflex over (v)} the prior on virtual position.
On the choice of correction coefficients, there may be more than one valid rationale for setting these coefficients. One approach is to minimize the (first-order terms of) the RMSE under Gaussian perturbations of the ideal Δ and its practically available estimate, i.e.,
The result for f is independent of the error variance σpos2, whereas the RMSE scales linearly
is the projection on v.
Note that the Δ can be estimated rather accurately even with only modest prior knowledge of antenna positions and target locations. For far-field targets, the RMSE converges to zero.
Another appropriate choice of correction coefficients is:
This choice is based on the observation that
where O( ) here refers to Landau's big-O notation (indicating that the term is negligible if the target is sufficiently far from the array). Thus, this choice aims to eliminate the lowest-order term.
Both choices generally exhibit similar performance, with the former possibly having a slight edge in the near-field.
To avoid numerical instabilities for virtual channels near the origin (other than the reference channel), in one possible embodiment f is set to zero for those channels if it would otherwise exceed some maximum value. (Possible criterion: f<<λ|p|/σpos2=:fmax where σpos is typical position error.) Usually this should not be necessary, as arrays positions are designed such that they are spread over the aperture.
Choose further a ‘reference target’ (wlog, k=0) and divide element-wise along the channel dimension to eliminate the channel imbalances
where, again, the last equation holds only approximate in the case of estimated Δ.
This step can be skipped in case that channel imbalances have already been compensated, i.e. γl=const. All the formulas remain valid with the obvious modifications, e.g., f0=0, u0=0, K→K+1.
In the second step S2 the virtual positions are estimated. For the normalized phases of zkl, defined as
There is the equation (indices l can be dropped since the problem is decoupled in the virtual positions vl),
In vector notation, introduce
(i.e., c→0 is far-field condition for fixed correction coefficients) and the following formula is used:
with z∈K (which immediately may be drop ped as subindex from ζ) This equation can be solved analytically, as shown in the following proof:
Derivation of analytic solution for (Eq.1). (This can be skipped on first reading.)
Now let Q=(n, {tilde over (Q)})∈SO(3). Recall that by definition of orthogonal matrices, we have I3=QQT=nnT+{tilde over (Q)}{tilde over (Q)}T and QTQ=[nTn, nT{circle around (Q)}; {tilde over (Q)}tn, {tilde over (Q)}T{tilde over (Q)})=(1, 0T; 0, I2).
With w=QTv=(w1; {tilde over (w)})∈3, we have
Stated equivalently,
from which following formula can be found
Apparently w1:=w1− must be the meaningful solution, as it gives results consistent with the far-field case
while w1+ diverges.
In summary, the sought-after position estimate is given by the formula
In the case K=3, every ζ gives a valid solution (within the limits of prior knowledge). In the case K>3, the residiuum
helps to discard ‘pseudo solutions’: a large residuum stems from comprises made by the pseudo-inverse (Eq.1), while a true solution should ideally have no residuum at all.
How exactly additional calibration targets increase the unambiguous cell depends on the precise location and seems difficult to describe.
In any case, one has to search over a grid in ζ. Prior knowledge on vp gives an idea for a grid center
The method is ‘exact’ in the far-field case
and depends on correction coefficient estimate quality in the near-field case. The selection of correction coefficients could be guided by an appropriate robustness criterion.
The method can be adapted in the spatial degrees of freedom. For example, if it is known that antenna positions can vary only in a 2D plane or the target configuration is degenerated such that position estimation along one axis is not reasonably possible, one can modify the position variables to
and (Eq.1) takes the form
An analytic solution for {tilde over (v)}∈2 can be found as in the general case.
In the third step S3 the real positions are estimated. Once that estimates {circumflex over (V)}∈3×N
3×N
3×N
The (NTxNRx×NTx+NRx) matrix
(with IT∈N
N
Adding some more rows to M is convenient for numerical stability and to fix another degree of freedom (note that shifting Rx and Tx arrays against each other leaves virtual positions unchanged). They can be used to set e.g. the array centers according to prior knowledge.
At this stage, identifying virtual position estimates that may have fallen into ambiguity traps may also be performed. If there is a single combination of Tx/Rx that is an outlier with respect to the others, it will manifest in the residuum:
as unusual large values, possibly larger than a wavelength A. Those rows can then be discarded, and the estimation of real positions repeated for a potentially much better overall result.
Next, the optional fourth step S4 may be performed, wherein bootstrapping with current estimates as prior knowledge is conducted. With new current estimates of antenna positions {circumflex over (T)}, {circumflex over (R)}, the steps S1 to S3 can be repeated so far with these hopefully improved estimates as prior knowledge.
This type of bootstrapping has the potential to greatly increase accuracy if the performance on the first run was already decent. On the other hand, first estimates that fell into an ‘ambiguity trap’ may become further consolidated in the wrong position, which can result in an overall degeneration of estimation quality for other channels as well.
In the fifth step S5, compensating data is performed, particularly by using the estimated positions and potentially extended target model. With estimates of antenna positions, estimates of bistatic ranges for each target of known location can also be used. Returning to the original samples, the phase due to geometry can be compensated based on the antenna position estimates:
where the last equation holds only approximately. Even if it has not been used in the steps before yet, at least in this last equation it is advisable to make use of extended target models for refined compensation of e.g. cylinder shapes (cf. Alhazen's problem).
In the sixth step S6 estimating channel imbalances can be performed by using SVD or HOSVD to find rank-1 of approximation. Channel imbalances can now be estimated easily:
For a ‘full’ model without further structure
the singular value decomposition (SVD) {tilde over (X)}=UΣVH can be applied and the first column of U (corresponding to the largest singular value) as estimate for γ. (With a single target, this is just ‘conventional’ calibration routine) can be extracted.
For a ‘Kronecker’ model with structure (as appropriate for MIMO radar)
the higher order SVD for a refined estimate can be applied.
Once the current positions of sensor elements in an array sensor are accurately estimated, the vehicle can utilize this information to enhance various functions critical to its operation. For example, in the context of automated or semi-automated driving systems, precise sensor positioning allows for improved detection and tracking of objects in the vehicle's surroundings. This can result in more accurate inputs to systems responsible for collision avoidance, lane keeping, and adaptive cruise control.
By ensuring that the sensor elements are accurately aligned with the vehicle's real-time position and orientation, the array sensor can provide more reliable data to the vehicle's control systems. This, in turn, allows for better decision-making in dynamic environments, such as when the vehicle is navigating through traffic, avoiding obstacles, or responding to sudden changes in road conditions.
Furthermore, accurate sensor positioning is essential in applications where the array sensor is used as a communication device. For example, in vehicle-to-vehicle (V2V) or vehicle-to-infrastructure (V2I) communication systems, knowing the precise location of each sensor element can improve the quality and reliability of signal transmission and reception, thereby enhancing overall communication efficiency.
In addition, precise sensor positioning can be used to calibrate and optimize the vehicle's radar systems, ensuring that the radar accurately maps the environment and detects objects with high precision. This capability is particularly important in scenarios where the vehicle must operate in complex environments, such as urban areas or highways, where the ability to accurately detect and track multiple objects simultaneously is critical.
Overall, the accurate estimation of sensor positions within the array sensor contributes to the vehicle's ability to interact with and respond to its environment effectively, thereby improving safety, efficiency, and overall performance.
Number | Date | Country | Kind |
---|---|---|---|
23193743.4 | Aug 2023 | EP | regional |