This application claims the benefit of European Patent Application No. 23169255, filed on Apr. 21, 2023, which application is hereby incorporated herein by reference.
The present disclosure relates to radar signal processing. Examples relate to an apparatus, a radar system, an electronic device and a method.
Crosstalk (e.g., between transmit and receive antennas) and near-range obstacles (e.g., a casing) may result in undesired signal components appearing in an intermediate frequency (IF) signal of a radar sensor, which in turn can lead to erroneous detection and tracking of objects. Hence, there may be a demand for improved radar signal processing.
Some aspects of the present disclosure relate to an apparatus, comprising processing circuitry configured to determine a harmonic spectrum of an intermediate frequency (IF) signal of a radar sensor, determine an undesired signal component of the IF signal caused by at least one of a crosstalk of the radar sensor and a near-range obstacle in a field of view of the radar sensor based on the harmonic spectrum, and determine a calibrated signal having a reduced contribution from the undesired signal component based on the undesired signal component and the IF signal.
Some aspects of the present disclosure relate to a radar system, comprising the above apparatus, and the radar sensor, wherein the radar sensor is configured to emit a radio frequency signal into the field of view of the radar sensor and generate the IF signal based on a reflection of the radio frequency signal.
Some aspects of the present disclosure relate to an electronic device, comprising the above radar system, and control circuitry configured to control an operation of the electronic device based on the calibrated signal.
Some aspects of the present disclosure relate to a method, comprising determining a harmonic spectrum of an IF signal of a radar sensor, determining an undesired signal component of the IF signal caused by at least one of a crosstalk of the radar sensor and a near-range obstacle in a field of view of the radar sensor based on the harmonic spectrum, and determining a calibrated signal having a reduced contribution from the undesired signal component based on the undesired signal component and the IF signal.
Some examples of apparatuses and/or methods will be described in the following by way of example only, and with reference to the accompanying figures, in which
Some examples are now described in more detail with reference to the enclosed figures. However, other possible examples are not limited to the features of these embodiments described in detail. Other examples may include modifications of the features as well as equivalents and alternatives to the features. Furthermore, the terminology used herein to describe certain examples should not be restrictive of further possible examples.
Throughout the description of the figures same or similar reference numerals refer to same or similar elements and/or features, which may be identical or implemented in a modified form while providing the same or a similar function. The thickness of lines, layers and/or areas in the figures may also be exaggerated for clarification.
When two elements A and B are combined using an “or”, this is to be understood as disclosing all possible combinations, i.e., only A, only B as well as A and B, unless expressly defined otherwise in the individual case. As an alternative wording for the same combinations, “at least one of A and B” or “A and/or B” may be used. This applies equivalently to combinations of more than two elements.
If a singular form, such as “a”, “an” and “the” is used and the use of only a single element is not defined as mandatory either explicitly or implicitly, further examples may also use several elements to implement the same function. If a function is described below as implemented using multiple elements, further examples may implement the same function using a single element or a single processing entity. It is further understood that the terms “include”, “including”, “comprise” and/or “comprising”, when used, describe the presence of the specified features, integers, steps, operations, processes, elements, components and/or a group thereof, but do not exclude the presence or addition of one or more other features, integers, steps, operations, processes, elements, components and/or a group thereof.
The apparatus 100 comprises processing circuitry 110 and, optionally, interface circuitry 120. In case interface circuitry 120 is present, the interface circuitry 120 may be communicatively coupled (e.g., via a wired or wireless connection) to the processing circuitry 110, e.g., for data exchange between the interface circuitry 120 and the processing circuitry 110.
The interface circuitry 120 may be any device or means for communicating or exchanging data. In case the apparatus 100 comprises the interface circuitry 120, the interface circuitry 120 may be configured to receive data indicating an IF signal of the radar sensor. For instance, the interface circuitry 120 may be communicatively coupled to the radar sensor or to a storage device storing the data. The interface circuitry 120 may receive the data, e.g., via a wired or wireless coupling to the radar sensor or the storage device.
Depending on the specific implementation, the apparatus 100 may dispense with the interface circuitry 120: For example, the processing circuitry 110 may determine said data. For instance, the processing circuitry 110 may be integrated into the radar sensor. The radar sensor may be configured to emit a radio frequency signal into the field of view of the radar sensor and generate the IF signal based on a reflection of the radio frequency signal. The IF signal may be any type of signal that is generated in a receiver of the radar sensor. The IF signal may, e.g., be created by mixing the reflection with a local oscillator signal at a specific frequency. The processing circuitry 110 may determine data indicating the IF signal by, e.g., sampling the IF signal and perform further processing of the data within the radar sensor. The processing circuitry 110 may optionally modify the sampled IF signal in a pre-processing step, e.g., for noise-reduction, DC-removal (direct current) or alike. For instance, the apparatus 100 may comprise memory configured to store the determined data.
Alternatively, the processing circuitry 110 may partially determine the data. For instance, the processing circuitry 110 may determine a first part of the data, whereas at least one external processing circuitry may determine at least one second part of the data. The processing circuitry 110 and the external processing circuitry may, e.g., be connected within a distributed computing environment for jointly determining the data. In this case, the processing circuitry may either be integrated into the radar sensor or may be external to the radar sensor. The processing circuitry 110 may receive the second part of the data, e.g., via an interface to the external processing circuitry such as interface circuitry 120, and further process the first and the second part of the data, as described below.
In another alternative, the processing circuitry 110 is partially integrated into the radar sensor and is partially external to the radar sensor. In such cases, the interface circuitry 120 is optional. The processing circuitry 110 may, for instance, comprise a first part (first processing circuitry) which is integrated into the radar sensor and a second part (second processing circuitry) which is external to the radar sensor. In this case, the determination of the data and/or further processing, as described below, may be performed by the first and second part of the processing circuitry 110 in a distributed manner.
The processing circuitry 110 may be, e.g., a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which or all of which may be shared, a digital signal processor (DSP) hardware, an application specific integrated circuit (ASIC), a microcontroller or a field programmable gate array (FPGA). The processing circuitry 110 may optionally be coupled to, e.g., read only memory (ROM) for storing software, random access memory (RAM) and/or non-volatile memory.
The processing circuitry 110 is configured to determine a harmonic spectrum of the IF signal of the radar sensor and determine an undesired signal component of the IF signal caused by at least one of a crosstalk of the radar sensor and a near-range obstacle in a field of view of the radar sensor based on the harmonic spectrum. For instance, the processing circuitry 110 may determine the undesired signal component based on a frequency estimation technique using a harmonic model.
The harmonic spectrum may refer to power signals, having line (or discrete) spectra, consisting of linear combination of complex exponentials with harmonically related frequencies, i.e., periodic signals. Harmonic model may refer to a class of a Pole-Zero models with complex-conjugate unit poles, i.e., a model suitable for modelling periodic signals with undamped amplitudes, e.g., spectral components of the IF radar signal.
The processing circuitry 110 may determine the harmonic spectrum based on any spectral analysis method. For example, the processing circuitry 110 may be configured to determine the harmonic spectrum based on an eigendecomposition of the IF signal, e.g., based on an eigendecomposition of an (auto) correlation or covariance matrix of the IF signal. For instance, an eigendecomposition may decompose the IF signal's matrix into its eigenvalues and eigenvectors. The eigendecomposed IF signal may, for instance, indicate measures of statistical properties of the IF signal. The eigenvectors may represent, for instance, a frequency vector corresponding to an intelligent and/or a noise signal in the IF signal, whereas a corresponding eigenvalue may represent a power of said frequency vector. Eigendecomposition-based methods may be advantageous since they may exhibit high robustness to noise and interference compared to other methods, such as Fourier analysis. This may be due to the eigendecomposition being based on statistical properties of the IF signal. Further, the eigendecomposition-based methods may provide the ability to handle non-stationary signals and to identify multiple harmonics with low computational complexity.
The crosstalk, e.g., a Tx-Rx-crosstalk (leakage), or interference may refer to an unwanted coupling of energy from one signal path of the radar sensor to another. Crosstalk may occur between different channels within a radar sensor, or between multiple radar sensors operating in close proximity. The near-range obstacle may refer to any, e.g., static, obstacle, such as a housing or case of the radar sensor, in a proximity or near range of a receiver of the radar sensor. The near range may refer to a range which is potentially affected by crosstalk. For example, in case of a 60 GHz (Gigahertz) radar sensor, the near-range obstacle may have a proximity of less than 40, 20 or 1 cm (centimeters) to the receiver. Both, the crosstalk as well as a near-range obstacle may undesirably distort the IF signal, for example, it may decrease the detection accuracy of the radar sensor, introduce false near-range targets into the IF signal and/or mask actual near-range targets. A radar sensor suffering from Tx-Rx leakage, or an undesired near-range obstacle may complicate, for instance, detection of a static target closer than approximately 40 cm. The apparatus 100 may provide a technique to overcome such shortcomings.
Conventionally, crosstalk may be determined based on a low-order, e.g., least-squares, polynomial fit to the IF signal or raw ADC (analog-to-digital converted) data in order to detect the shape of a profile of the leakage. However, such conventional approaches may highly rely on this initial polynomial fitting and may suffer from poor fitting or over-fitting. For example, assuming a complex shape of the leakage profile with an increasing complexity in case of a near-range obstacle such as a sensor casing being present, the low order polynomial fit may provide an insufficient estimation of the leakage profile and hence may fail to reduce its effect on the near-range bins of the IF signal. High-order polynomial fit, on the other hand, may fit into a potential near-range target and suppress it, acting as a high-pass filter (HPF). The latter is illustrated by
By contrast, the harmonics-based approach of the apparatus 100 may successfully remove a near-range obstacle from the IF signal (radar sensor's field of view) and at the same time enable a confident near-range (e.g., less than 40 cm) target detection. This may be due to (e.g., complex) exponentials present in the IF signals contained in white noise for which a sinusoidal or harmonic model may be more accurate. The use of the harmonic spectrum may provide the ability to resolve (complex) exponentials closely spaced in frequency and may therefore lead to a super-resolution determination of the undesired signal component.
In the following, details are given on examples of how the harmonic spectrum may be determined:
The processing circuitry 110 may be configured to determine the harmonic spectrum, e.g., based on a harmonic model of the IF signal. The harmonic model may be a model that represents the IF signal as a sum of harmonic components, e.g., sine and cosine waves with frequencies that are integer multiples of a reference frequency.
In some examples, the processing circuitry 110 may be configured to determine the harmonic spectrum by partitioning the IF signal into a signal subspace and a noise subspace (based on a signal-noise subspace decomposition). For instance, the processing circuitry 110 may determine the undesired signal component based on at least one noise eigenvector of the IF signal, whereas the noise eigenvector may be found by partitioning the IF signal into the subspaces. This may allow modelling the IF signal as a combination of a (e.g., deterministic) signal and a (e.g., stochastic) noise signal. For instance, the processing circuitry 110 may determine the undesired signal component within the noise subspace which may increase the accuracy of the crosstalk/obstacle detection.
The processing circuitry 110 may, for instance, be configured to determine the harmonic spectrum based on at least one of an eigendecomposition of an autocorrelation matrix of the IF signal and a singular value decomposition of a data matrix of the IF signal. For instance, the above-mentioned partitioning into noise and signal subspace may be realized by the eigendecomposition and/or on the singular value decomposition.
The eigendecomposition may be a diagonalization of the autocorrelation matrix which decomposes said matrix into eigenvectors and eigenvalues. Eigendecomposition may involve finding the eigenvectors and eigenvalues of the matrix and using them to factorize it. The singular value decomposition may be performed by, e.g., forming a data matrix from the IF signal, where each column of the data matrix represents a time instant of IF signal samples, performing the singular value decomposition on the data matrix to obtain the left singular vectors and the singular values of the data matrix, and using the left singular vectors to form the signal subspace and the noise subspace. The signal subspace may comprise the eigenvectors (singular vectors) associated with the largest eigenvalues (singular values), while the noise subspace may comprise the (noise-) eigenvectors (singular vectors) associated with the smallest eigenvalues (singular values). The IF signal may be projected on the signal subspace and/or onto the noise subspace to obtain the harmonic components of the signal.
The processing circuitry 110 may, for example, be configured to determine the harmonic spectrum by determining a pseudo-spectrum and/or a rooted representation of a pseudo-spectrum (i.e., a rooted counterpart of the pseudo-spectrum determination) of a harmonic model (harmonic-based signal model) of the IF signal. The processing circuitry 110 may determine the pseudo-spectrum based on a Fourier transform of individual and/or an assembly of the noise-eigenvectors (e.g., obtained from a signal to noise partition). The processing circuitry 110 may determine the rooted representation of the pseudo-spectrum based on a z-transform of the noise-eigenvectors (associated with the noise subspace).
For instance, the processing circuitry 110 may determine the harmonic spectrum using at least one of a minimum-norm based method (e.g., a minimum-norm method and/or a minimum-norm root method), a multiple signal classification (MUSIC) based method (e.g., a multiple signal classification method and/or a multiple signal classification root method), an eigenvalue based method (e.g., an eigenvalue method and/or a rooted eigenvalue method), a Pisarenko harmonic decomposition based method (e.g., a Pisarenko harmonic decomposition method and/or a rooted Pisarenko harmonic decomposition method), and an estimation of signal parameters via rotational invariance technique (ESPRIT). The latter may be a singular value decomposition technique, whereas the other methods may be eigendecomposition based techniques. These methods may be used to determine at least one noise eigenvector of the IF signal. For instance, the Pisarenko based methods may use a single noise eigenvector which makes it faster, but less robust. The MUSIC based methods may use all noise eigenvectors to calculate individual pseudospectra or roots of the z-transformed noise eigenvectors' polynomials. The final result may be the average of individual pseudospectra/polynomials. The MUSIC based methods may increase robustness due to averaging but may be more computationally intense. The eigenvalue-based methods may be similar to MUSIC, with the difference that individual noise eigenvectors are normalized with their respective eigenvalues. They may exhibit higher robustness than MUSIC in case that the noise is not white or the amount of data is limited. The minimum-norm based method may determine a pseudo-spectrum by finding a minimum-norm vector, which efficiently represents the assembly of the noise eigenvectors. They may be less intense computationally-wise, but less robust than MUSIC or eigenvalue-based methods.
In the following, the minimum-norm based methods may be explained in more detail. However, this is to be understood as an example which may be preferred in target applications aiming for computational efficiency. The alternative methods described herein as well as other methods for determining noise eigenvectors may be likewise used for determining the undesired signal component. The minimum-norm based methods in some concrete embodiments described herein may be understood interchangeable with or transferable to these alternative methods.
The minimum-norm method may be based on an estimation of a spectrum of a signal source in the IF signal in the presence of additive noise. The signal source may be a signal component of the IF signal caused by actual power transmission, e.g., due to a potential target, crosstalk or near-range obstacles, thus, not due to noise. The minimum-norm method may further be based on the assumption that the eigenvectors of the Hermitian symmetric autocorrelation matrix, formed using the IF signal vector, are orthogonal to each other and hence are the signal and noise eigenvectors. The processing circuitry 110 may, for example, estimate the signal source's spectrum by finding a projection of the IF signal onto the two subspaces spanned by the signal and noise eigenvectors. This may be done by forming Hermitian symmetric correlation matrix and dividing it to the signal and noise subspace after eigendecomposition. A result of the latter operation may be a vector, representing the noise subspace and being orthogonal and having its norm minimized with respect to the signal subspace. The use of the minimum-norm method may provide computational simplicity and ease of implementation.
For example, the processing circuitry 110 may determine an autocorrelation matrix of the IF signal. The latter may, e.g., be done similarly to when using a Capon MVDR (minimum variance distortionless response) method. The autocorrelation matrix Rx may be written in terms of its eigendecomposition according to Equation 1:
where λm are eigenvalues of the autocorrelation matrix in descending order m, qm are the corresponding eigenvectors, Λ is a diagonal matrix with the eigenvalues in descending order on the diagonal, the columns of Q are the corresponding eigenvectors.
The processing circuitry 110 may then determine an eigendecomposition of the autocorrelation matrix, resulting in eigenvalues that are due to one or more signal sources and remaining eigenvalues that are due to noise only. The former may be written as the sum of the signal power in time and noise as per Equation 2:
where M refers to a predefined time window of length M in which the IF signal is observe, P is the number of exponentials, αm is a magnitude of the signal component and σw2 is a noise power in the time window M (e.g., of white noise).
The remaining eigenvalues may be defined as per Equation 3:
The processing circuitry 110 may further be configured to determine the harmonic spectrum based on a noise subspace of the IF signal. For instance, the processing circuitry 110 may be configured to determine the noise subspace by associating at least one eigenvalue of an autocorrelation matrix of the IF signal to the noise subspace. The P largest eigenvalues of the autocorrelation matrix of Equation 1 may correspond to the signal made up of exponentials and remaining eigenvalues may have an equal value and correspond to noise. Thus, the processing circuitry 110 may partition the correlation matrix into portions due to the signal (signal subspace) and noise (noise subspace). An example of an eigendecomposed representation of the (auto) correlation matrix is defined by Equation 4:
where Qs and Qw are matrices whose columns comprise signal and noise eigenvectors, respectively. The matrix Λs is a P×P diagonal matrix comprising signal eigenvalues from Equation 2. Thus, the M-dimensional subspace comprising the observations of a time-window signal vector may be split into two subspaces spanned by the signal and noise eigenvectors, respectively. These two subspaces may be orthogonal to each other, e.g., due to the (auto) correlation matrix being Hermitian symmetric.
The orthogonality of the signal and noise eigenvectors is schematically illustrated by
For example, the processing circuitry 110 may determine a minimum-norm vector umn from vectors lying in the noise subspace. For instance, the processing circuitry 110 may determine the minimum-norm vector by solving a constrained minimization problem, such as given by Equation 5:
where an example of a constraint is that the first element of u must be non-zero, e.g., equal to 1, Pw is a projection onto the noise subspace QwQwH.
A solution to the constrained minimization problem may be found by using Lagrange multipliers, for instance. The processing circuitry 110 may then determine a pseudospectrum minimum-norm vector based on the noise subspace. An example of a pseudospectrum Rmn is given by Equation 6:
where vH(f) denotes a frequency vector (of an eigenvector), umn the minimum-norm vector, and where the operation in the denominator of Equation 6 is essentially a Fourier transform. A frequency estimate of the signal component may then be obtained from the peaks in the pseudospectrum.
As an alternative, the processing circuitry 110 may determine the harmonic spectrum based on the minimum-norm root method, thus, determine at least one root of the (e.g., complex polynomial) minimum-norm vector. The minimum-norm root method may be a variant of the minimum-norm method that provides an estimation of frequencies of sinusoidal components of a signal source in the IF signal by finding roots of a polynomial that may be constructed from the minimum-norm vector umn as described above. The minimum-norm root method may provide a zero-pole representation of the harmonic spectrum (estimate) and may be more efficient computationally, compared to Fourier transform calculations of the minimum-norm vector umn. It may provide an increased visual discrimination of closely spaced targets and signal sources. It may therefore simplify spectral analysis of the undesired signal components.
Since the computational effort may be higher than that of the minimum-norm method, the minimum-norm root method may be exclusively used during calibration (i.e., the use of the minimum-norm root method might be restricted to the calibration process only) whereas during operation the results (e.g., a leakage profile) from the calibration may be used and, optionally, updating of these results may be based on other methods such as the minimum-norm method. Therefore, in some examples, the processing circuitry 110 may be configured to, in a calibration mode of the apparatus 100, determine the harmonic spectrum of the IF signal based on the minimum-norm root method. Further details of the implementation of the minimum-norm root method to determine the undesired signal component are explained further below.
The method for determining the harmonic spectrum may be chosen depending on the requirements and circumstances of a specific target application. For instance, an alternative may be the use of a MUSIC method. This method may estimate the frequencies of sinusoidal components in the IF signal by exploiting the subspace structure of the noise to distinguish between signal and noise components, similarly to what has been demonstrated for the minimum-norm method above. The MUSIC method may be used to improve the accuracy of the pseudo-spectrum calculations, by further reduction of the spurious spectral peaks due to averaging of multiple pseudo-spectra, computed for the individual noise eigenvectors. An alternative to the MUSIC method is the MUSIC root method which is based on finding roots of a polynomial that is constructed from the noise subspace.
Alternatively, an eigenvalue method may be used. The processing circuitry 110 may, for instance, estimate frequencies of sinusoidal components of a signal source by finding eigenvectors of the autocovariance matrix. A variant of the eigenvalue method is the rooted eigenvalue method which is based on the estimation of the frequencies of sinusoidal components of a signal source by finding roots of a polynomial that is constructed from the eigenvalues of the IF signal. A fundamental difference of the eigenvector method, compared to MUSIC, may be that the individual pseudospectra, calculated from each eigenvector, are normalized with respect to their corresponding eigenvalues. This results in greater spectrum estimation accuracy if the noise is not white or only limited amount of data is available for constructing autocorrelation matrix.
Another method for determining the harmonic spectrum is the Pisarenko harmonic decomposition method. For instance, the processing circuitry 110 may estimate frequencies and amplitudes of sinusoidal components of a signal source by solving a linear system of equations that is constructed from the autocorrelation matrix of the IF signal. The Pisarenko harmonic decomposition method may provide information about the power of the signal sources, included in the IF signal.
Further, the ESPRIT method may be used for determining the harmonic spectrum. The ESPRIT method may be based on the principle of rotational invariance of signal subspaces. It may be based on a rotational property of staggered subspaces of the IF signal to generate the harmonic spectrum (frequency estimates) of the IF signal. In the case the IF signal comprises a discrete-time signal or time series, this property may rely on observations of the signal over two identical intervals staggered in time. By computing the singular value decomposition of these matrices and using their left singular vectors, a noise and a signal subspace may be obtained. The subspaces may correspond to the frequency components of the IF signal, and their intersection may provide an estimate of the frequency parameters. The ESPRIT method may be a non-iterative method that is computationally efficient and particularly useful for estimating the frequencies of closely spaced sinusoidal signals.
In the following, details are given on examples of how the undesired signal component may be determined:
The determination of the undesired signal component may, for instance, depend on free-space measurements. A free-space measurement may be a measurement performed by the radar sensor where the radio frequency signal propagates through free space at least in the near range, without any obstructions or reflections, or where the radio frequency signal has no other obstacle than the near-range obstacle at least in the near range. Such a free-space measurement may be a snapshot of the radar sensing recorded in the IF signal, e.g., as at least one frame of the IF signal. The free-space measurements may increase the accuracy of a calibration of the radar sensor and simplify the calibration. Alternatively to the free-space measurement, a known scenario may be given for determining the undesired signal component, or long-term observations may be performed to retrieve the undesired signal component.
In case of using free-space measurements, the processing circuitry 110 may be configured to determine whether at least one frame of the IF signal indicates a free-space measurement based on the harmonic spectrum and determine the undesired signal component based on the free-space measurement. For instance, in case a root-based method such as minimum-norm root method is used, the processing circuitry 110 may be configured to determine whether the at least one frame indicates a free-space measurement based by determining one or more roots (e.g., the roots/all roots) of a (minimum-norm) polynomial representing a noise subspace of the IF signal and determining whether the root indicates (or the roots indicate) the free-space measurement. For instance, the processing circuitry 110 may determine roots of the minimum-norm vector umn derived from Equation 5. The roots of the polynomial may be found based on a z-transform of the minimum-norm vector umn. The roots of the polynomial may indicate the harmonic spectrum of a signal source and may therefore efficiently reveal whether a frame indicates a free-space measurement. The processing circuitry 110 may, for instance, be configured to determine the one or more roots (e.g., the roots/all roots) of the polynomial based on a noise subspace of the IF signal. Thus, the roots of a polynomial approximating (representing) a noise subspace of the IF signal may be determined.
In order to decide whether the one or more roots indicate a free-space measurement, the root locus may be determined and analyzed. The root locus may indicate possible locations of the roots, where the locations may be the coordinates of the roots in a complex plane. The root loci and/or other characteristics of the roots may, for instance, be compared to predefined root loci and/or predefined characteristics which indicate a free-space measurement and which are, e.g., specific for a certain radar sensor type. The latter is illustrated by
A unity circle 520 and a noise threshold circle 530 are plotted in the complex plane 500. Further, a detection threshold 540 which is a section of the unity circle 520 and a crosstalk threshold 550 which is a smaller section of the unity circle 520 within the detection threshold 540. The noise threshold circle 530, the detection threshold 540 and the crosstalk threshold 550 may be determined, e.g., heuristically, and may be predefined for an operation of the radar sensor. The latter predefined thresholds may be adapted to application-specific requirements or assumptions made for a target application. This means that the threshold shown in
For example, the processing circuitry 110 may be configured to determine whether the one or more roots indicate the free-space measurement by determining whether at least one of a real value, a complex value, an imaginary value, a phase and a magnitude of the one or more roots is within a predefined value range. Additionally or alternatively, the processing circuitry 110 may be configured to determine whether the one or more roots indicate the free-space measurement by determining whether a number of complex roots and/or a number of real roots of the one or more roots satisfy a predefined criteria and/or by determining whether the one or more roots are located at a predefined location. Additionally or alternatively, the processing circuitry 110 may be configured to determine whether the one or more roots indicate the free-space measurement by determining whether the roots exhibit at least one of a predefined root structure (e.g., whether the roots or a subset thereof are structured as at least one of a complex conjugate pair of roots, a single complex root and a single real-valued root), a predefined number of complex roots and a predefined number of real roots. For example, at least one of the predefined value range, a predefined number of complex or real roots, the root structure, and the predefined location may correspond to predefined free-space conditions.
For instance, in the example of
Further, roots which are outside the detection threshold 540 may be discarded since they may be due to targets or signal sources beyond the detection threshold. For instance, root 510-4 may be a distant target at about 1.4 meters which may be beyond the detection threshold of the radar sensor. Any roots which are located inside the detection threshold 540 and not inside the crosstalk threshold 550 may indicate near-range obstacles or targets and, hence, indicate a frame which is classified as not being a free-space frame.
In the example of
The processing circuitry 110 may therefore compare the characteristics of the roots with predefined characteristics, select relevant roots (and optionally discard irrelevant ones, e.g., such roots which are outside the detection threshold 540 or not close enough to the unity circle 520) and/or apply predefined constraints to the roots. In the example of
Examples of how different scenarios affect the determination of the undesired signal component are illustrated by
The harmonics-based approach of the apparatus 100 may in many cases increase the reliability of the determination of near-range targets and/or crosstalk. The latter is illustrated by
In
Consequently, the harmonics-based approach of the apparatus 100, e.g., using minimum-norm root method, may improve a differentiation between free-space frame (e.g., by detecting DC and low-frequency sine-wave components of the IF signal) and frames with a near range target/obstacle (e.g., by detecting either two low-frequency sine-wave components or low-frequency and medium frequency sine-wave components of the IF signal). Further, the apparatus 100 may detect free-space measurements automatically without supervision, e.g., using the minimum-norm root method, whereas conventional approaches may need manual adaption of the scenario, indication whether a free-space measurement is provided or other not objectively measurable parameters to be input by a user. Thus, the apparatus 100 may simplify the implementation of crosstalk cancellation since no input from a user of the apparatus 100 is required. The predefined characteristics for identifying the root signature (e.g., leakage roots loci) may be definable by the solution provider, e.g., may be measured on the factory side for different sensors or radar sensor casings. Compared to conventional approaches, the apparatus 100 may also be applicable to radar sensors with a cover (e.g., when the radar sensor module is installed inside the product, such as a fridge, robot, car, etc.). The apparatus 100 may automatically adapt to the casing presence (and additionally to leakage) and may still provide confident detection for near-range targets.
The processing circuitry 110 may further use a frame indicating a free-space measurement for further processing in order to determine the undesired signal component. For example, the processing circuitry 110 may be configured to, in response to determining that the at least one frame indicates a free-space measurement, determine whether a predefined number of frames of the IF signal indicate a respective free-space measurement and, in response to determining that a predefined number of frames of the IF signal indicate the respective free-space measurement, determine the undesired signal component based on the predefined number of frames. For example, the frames with free-space measurements may be collected (stored in memory) over a certain time period, e.g., during calibration of the apparatus 100. For instance, a number of 32 frames may be sufficient to determine the undesired signal component with high accuracy. The processing circuitry 110 may further be configured to, in a calibration mode of the apparatus 100 and in response to determining that the at least one frame does not indicate a free-space measurement, discard the at least one frame. Compared to conventional approaches, the apparatus 100 may get along with few number of frames which may decrease the computational effort and the time for calibration of the radar sensor. Even an interrupted free-space measurement may be possible since non valid in-between frames may be discarded.
The processing circuitry 110 is, in some examples, configured to determine the undesired signal component by averaging over the predefined number of frames. For instance, the processing circuitry 110 may determine a crosstalk (leakage) or near-range obstacle profile based on the frames. Averaging may be performed with additional weighting (of samples) of the frames, for instance. Alternatively, any function, e.g., a fitting function, may be used to combine the frames to an updated profile of the undesired signal component. For instance, the processing circuitry 110 may determine the undesired signal component by applying at least one of a Savitzky-Golay algorithm and polynomial fitting to the frames. The Savitzky-Golay algorithm may be a type of least-squares polynomial fitting that uses a sliding window and a set of precomputed coefficients to estimate the underlying signal. The algorithm may work by fitting a polynomial of a given order to a subset of the data points of the IF signal within a sliding window, and then computing the value of the polynomial at the center point of the window. The coefficients of the polynomial may be precomputed using a least-squares approach and optimized for smoothing and/or differentiation depending on the chosen parameters. The resulting estimates may be used to replace the original noisy data points, resulting in a smoother signal. Alternatively, it may include computing the derivative of the polynomial at the center point of the window and optimizing the precomputed coefficients of the polynomial for minimizing the error in the estimated derivatives, resulting in a more accurate estimate of the underlying signal derivative. The use of the Savitzky-Golay algorithm may allow a removal of the crosstalk while keeping distant targets (like 1.4 m away) intact.
The processing circuitry 110 may, for instance, be configured to average over respective range representations of the predefined number of frames. For instance, the processing circuitry 110 may determine the respective range representations by, e.g., applying an FFT to each of the frames. The range representation may be an arrangement of the IF signal into range bins. Samples of the respective range representations may then, for instance, be superimposed to determine the undesired signal component. In some examples, the processing circuitry 110 is configured to average over all range bins of the respective range representations. The latter may enable a crosstalk cancellation over all range bins such that no discontinuity in the range spectrum or residual leakage sidelobes occur.
The processing circuitry 110 is further configured to determine a calibrated signal having a reduced contribution from the undesired signal component based on the undesired signal component and the IF signal. Such calibrated signal may then be used for performing a radar task, e.g., ranging, motion detection or alike. For instance, the processing circuitry 110 may be configured to determine at least one near-range target in the field of view of the radar sensor based on the calibrated signal. Since the apparatus 100 may more precisely determine the undesired signal component without any fitting errors or other distortion of the near-range components of the IF signal, the resulting calibrated signal may make near-range targets detectable.
The processing circuitry 110 may, for example, be configured to determine the calibrated signal by at least one of attenuating, subtracting and filtering the undesired signal component in the IF signal. In other words, a leakage and/or near-range obstacle profile may be attenuated in the IF signal. For instance, the profile may be applied to further (subsequent) frames of the IF signal. The processing circuitry 110 may therefore be configured to determine the calibrated signal by at least one of attenuating, removing, filtering and suppressing the undesired signal component in at least one subsequent frame of the IF signal, i.e., subsequent to the free-space frames used for determining the undesired signal component.
Examples of a calibrated signal 830 are illustrated by
A further concern addressed by the apparatus 100 may be the long-term use of the apparatus 100 without a decline of the accuracy of the crosstalk/near-range obstacle profile.
Therefore, the apparatus 100 may provide, in some examples, a continuous update of the undesired signal component. For instance, in a calibration mode of the apparatus 100, an initial profile may be determined, e.g., based on more sophisticated methods such as a root-based method. During an operation the apparatus 100 may update the profile, e.g., based on less computationally heavy methods, for example conventional fitting or minimum-norm method.
For example, the processing circuitry 110 may be configured to determine a harmonic spectrum of the calibrated signal, determine whether the calibrated signal comprises a further free-space measurement based on the harmonic spectrum of the calibrated signal and, in response to determining that the calibrated signal comprises a further free-space measurement, update the determined undesired signal component based on the further free-space measurement. That is, free-space measurements that are detected, e.g., in an operation mode of the apparatus 100, may be used for updating the profile. For a light-weighted computation, the processing circuitry 110 may be configured to determine the harmonic spectrum of the calibrated signal based on a minimum-norm method. In contrast to conventional approaches where updating of the profile is cumbersome, the apparatus 100 may enable a regular updating, e.g., based on each free-space frame of the IF signal. The updating may be performed by, e.g., averaging over the newly and previously identified free-space frames and optionally by applying a weighting to the frames, e.g., in accordance with respective occurrence times and a time-dependent drift model.
The apparatus 100 may enable a free-space/near-range target case discrimination using super-resolution minimum-norm root method. Data collected for the free-space measurements may be used for the generation of a leakage profile calculation and for removal of the leakage from the radar sensor's raw data. This technique may also be successfully applied to remove a near-range obstacle (e.g., a radar casing) from the radar sensor's field of view while still maintaining the ability to confidently detect near-range (e.g., less than 40 cm) targets.
Although the apparatus 1110 and the radar sensor 1120 are depicted as separate blocks in
In case the apparatus 1110 is only partially included in the radar sensor 1120, the radar system 1100 may include distributed processing circuitry carrying out respective parts of the processing steps, e.g., in the form of first processing (sub-) circuitry included in the radar sensor 1120, and second processing (sub-) circuitry external to the sensor and in communication with the first processing circuitry through interface circuitry (e.g., interface circuitry 120), for instance, for exchange of data between the first and the second processing circuitry.
In case the apparatus 1110 is integrated in the radar sensor 1120, the processing circuitry and the radar sensor 1120 may be jointly integrated in a single semiconductor chip, or in more than one semi-conductor chip.
In case the apparatus 1110 is not included in the radar sensor 1120, the processing circuitry may take the form of circuitry external to the radar sensor 1120 and may be communicatively coupled therewith through interface circuitry.
More details and aspects of the radar system 1100 are explained in connection with the proposed technique or one or more examples described above, e.g., with reference to
The radar system 1100 may enable a free-space/near-range target case discrimination using decomposition-based methods, such as super-resolution minimum-norm root method. Data collected for the free-space measurements may be used for the generation of a leakage profile calculation and for removal of the leakage from the radar sensor's raw data. This technique may also be successfully applied to remove a near-range obstacle (e.g., a radar casing) from the radar sensor's field of view while still maintaining the ability to confidently detect near-range (e.g., less than 40 cm) targets.
The control circuitry 1220 may be a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which or all of which may be shared, a digital signal processor (DSP) hardware, an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The control circuitry 1220 may optionally be coupled to, e.g., read only memory (ROM) for storing software, random access memory (RAM) and/or non-volatile memory.
The electronic device 1200 may be any device with a sensing, e.g., ranging, function. The electronic device 1200 may be, e.g., a consumer device. The electronic device 1200 may be, e.g., be a fridge. The control circuitry 1220 may control the operation of the electronic device 1200, e.g., by activating or deactivating a certain function of the electronic device 1200 based on the determined calibrated signal, e.g., a certain function may be activated if it is determined that a user of the electronic device 1200 is present. For instance, the control circuitry 1220 may, if it is determined that a user is close, automatically control a light source to be activated, e.g., (in case of the fridge) such that the user may look into the fridge through a transparent window without opening a door of the fridge.
The electronic device 1200 may enable a free-space/near-range target case discrimination using decomposition-based method, such as super-resolution minimum-norm root method. Data collected for the free-space measurements may be used for the generation of a leakage profile calculation and for removal of the leakage from the radar sensor's raw data. This technique may also be successfully applied to remove a near-range obstacle (e.g., a radar casing) from the radar sensor's field of view while still maintaining the ability to confidently detect near-range (e.g., less than 40 cm) targets.
More details and aspects of the method 1300 are explained in connection with the proposed technique or one or more examples described above, e.g., with reference to
The method 1400 comprises receiving and/or determining 1410 a frame of an IF signal of a radar sensor and determining 1420 whether a calibration of the apparatus is complete. If not, the method 1400 continues with calibrating 1430 the apparatus which may be a further external or integrated (sub-) method, such as the method described with reference to
The method 1400 further comprises receiving and/or determining 1450 the undesired signal component (e.g., a leakage profile) derived from calibration 1430 and/or updating (1460). If it is determined that the calibration is complete, the method 1400 comprises processing 1440 the frame. For instance, processing 1440 may comprise determining a calibrated signal having a reduced contribution from the undesired signal component based on the undesired signal component and the IF signal. For example, the calibrated signal may be determined by attenuating the undesired signal component in the frame of the IF signal (which may be at least one frame subsequent to the frame which is used to determine the undesired signal component).
The calibrated (residual) signal may be further processed after leakage profile removal or attenuation from the frame raw data, e.g., using a minimum-norm algorithm. For instance, processing 1440 may comprise determining a harmonic spectrum of the calibrated signal. The method 1400 further continues with determining 1470 whether the calibrated signal comprises a further free-space measurement (e.g., based on a minimum-norm method) based on the harmonic spectrum of the calibrated signal (determining whether a target is detected). In response to determining that the calibrated signal comprises a further free-space measurement, the method 1400 continues with updating 1460 the determined undesired signal component based on the further free-space measurement. Thus, if no target is detected in the current frame, said frame may be used to update the leakage profile (the leakage profile may change over time). Processing 1440 may further comprise, e.g., determining at least one near-range target in the field of view of the radar sensor based on the calibrated signal.
The method 1400 further comprises outputting 1480 a signal to a user based on the determined calibrated signal.
The method 1500 comprises receiving and/or determining 1510 a frame of an IF signal of a radar sensor and determining 1520 whether said frame indicates a free-space measurement (comprises a near-range target). For instance, determining 1520 may comprise determining a harmonic spectrum of the frame, e.g., based on the minimum-norm root method. If it is determined that the frame does not indicate a free-space measurement, the method 1500 continues with discarding 1530 the frame and maintaining 1540 the calibration mode. If it is determined that the frame does indicate a free-space measurement, the method 1500 continues with storing 1550 said frame in memory. The method 1500 continues with determining 1560 whether a predefined number N of frames indicate a (respective) free-space measurement (whether N frames are accumulated). If not, the method 1500 continues with maintaining 1570 the calibration mode. If so, the method 1500 continues with determining 1580 an undesired signal component of the IF signal caused by at least one of a crosstalk of the radar sensor and a near-range obstacle in a field of view of the radar sensor based on the harmonic spectrum, e.g., by averaging over the predefined number of frames. The method 1500 may then continue with finishing 1590 the calibration mode, thus, starting an operation mode of the apparatus.
The methods 1400 and 1500 may enable a free-space/near-range target case discrimination based on noise eigenvectors of the IF signal, e.g., using super-resolution minimum-norm root method. Data collected for the free-space measurements may be used for the generation of a leakage profile calculation and for removal of the leakage from the radar sensor's raw data. This technique may also be successfully applied to remove a near-range obstacle (e.g., a radar casing) from the radar sensor's field of view while still maintaining the ability to confidently detect near-range (e.g., less than 40 cm) targets. In calibration mode, more accurate harmonics analysis may be applied such as a minimum-norm root method whereas in operation mode, a faster harmonics analysis may be applied such as minimum-norm method. The collected free-space measurements in operation mode may be used for continuously updating the leakage profile.
In the following, some examples of the proposed technique are presented:
An example (e.g., example 1) relates to an apparatus, comprising processing circuitry configured to determine a harmonic spectrum of an intermediate frequency, IF, signal of a radar sensor, determine an undesired signal component of the IF signal caused by at least one of a crosstalk of the radar sensor and a near-range obstacle in a field of view of the radar sensor based on the harmonic spectrum, and determine a calibrated signal having a reduced contribution from the undesired signal component based on the undesired signal component and the IF signal.
Another example (e.g., example 2) relates to a previous example (e.g., example 1) or to any other example, further comprising that the processing circuitry is configured to determine the calibrated signal by at least one of attenuating, subtracting and filtering the undesired signal component in the IF signal.
Another example (e.g., example 3) relates to a previous example (e.g., one of the examples 1 or 2) or to any other example, further comprising that the processing circuitry is configured to determine the harmonic spectrum based on a harmonic model of the IF signal.
Another example (e.g., example 4) relates to a previous example (e.g., one of the examples 1 to 3) or to any other example, further comprising that the processing circuitry is configured to determine the harmonic spectrum by partitioning the IF signal into a signal subspace and a noise subspace.
Another example (e.g., example 5) relates to a previous example (e.g., one of the examples 1 to 4) or to any other example, further comprising that the processing circuitry is configured to determine the harmonic spectrum based on at least one of an eigendecomposition of an autocorrelation matrix of the IF signal and a singular value decomposition of a data matrix of the IF signal.
Another example (e.g., example 6) relates to a previous example (e.g., one of the examples 1 to 5) or to any other example, further comprising that the processing circuitry is configured to determine the harmonic spectrum based on at least one of a minimum-norm method, a minimum-norm root method, a multiple signal classification method, a multiple signal classification root method, an eigenvalue method, a rooted eigenvalue method, a Pisarenko harmonic decomposition method, a rooted Pisarenko harmonic decomposition method, and an estimation of signal parameters via rotational invariance technique.
Another example (e.g., example 7) relates to a previous example (e.g., one of the examples 1 to 6) or to any other example, further comprising that the processing circuitry is configured to, in a calibration mode of the apparatus, determine the harmonic spectrum of the IF signal based on a minimum-norm root method.
Another example (e.g., example 8) relates to a previous example (e.g., one of the examples 1 to 7) or to any other example, further comprising that the processing circuitry is configured to determine the harmonic spectrum based on a noise subspace of the IF signal.
Another example (e.g., example 9) relates to a previous example (e.g., example 8) or to any other example, further comprising that the processing circuitry is configured to determine the noise subspace by associating at least one eigenvalue of an autocorrelation matrix of the IF signal to the noise subspace.
Another example (e.g., example 10) relates to a previous example (e.g., one of the examples 1 to 9) or to any other example, further comprising that the processing circuitry is configured to determine whether at least one frame of the IF signal indicates a free-space measurement based on the harmonic spectrum, and determine the undesired signal component based on the free-space measurement.
Another example (e.g., example 11) relates to a previous example (e.g., example 10) or to any other example, further comprising that the processing circuitry is configured to determine whether the at least one frame indicates a free-space measurement based by determining one or more roots of a polynomial representing a noise subspace of the IF signal, and determining whether the root indicates the free-space measurement.
Another example (e.g., example 12) relates to a previous example (e.g., example 11) or to any other example, further comprising that the processing circuitry is configured to determine whether the one or more roots indicate the free-space measurement by determining whether at least one of a complex value, a real value and an imaginary value of the one or more roots is within a predefined value range.
Another example (e.g., example 13) relates to a previous example (e.g., one of the examples 11 or 12) or to any other example, further comprising that the processing circuitry is configured to determine whether the one or more roots indicate the free-space measurement by determining whether the one or more roots whether a number of complex roots and/or a number of real roots of the one or more roots satisfy a predefined criteria and/or by determining whether the one or more roots are located at a predefined location.
Another example (e.g., example 14) relates to a previous example (e.g., one of the examples 11 to 13) or to any other example, further comprising that the processing circuitry is configured to in response to determining that the at least one frame indicates a free-space measurement, determine whether a predefined number of frames of the IF signal indicate a respective free-space measurement, and in response to determining that a predefined number of frames of the IF signal indicate the respective free-space measurement, determine the undesired signal component based on the predefined number of frames.
Another example (e.g., example 15) relates to a previous example (e.g., example 14) or to any other example, further comprising that the processing circuitry is configured to determine the undesired signal component by averaging over the predefined number of frames.
Another example (e.g., example 16) relates to a previous example (e.g., example 15) or to any other example, further comprising that the processing circuitry is configured to average over respective range representations of the predefined number of frames.
Another example (e.g., example 17) relates to a previous example (e.g., example 16) or to any other example, further comprising that the processing circuitry is configured to average over all range bins of the respective range representations.
Another example (e.g., example 18) relates to a previous example (e.g., one of the examples 10 to 17) or to any other example, further comprising that the processing circuitry is configured to, in a calibration mode of the apparatus and in response to determining that the at least one frame does not indicate a free-space measurement, discard the at least one frame.
Another example (e.g., example 19) relates to a previous example (e.g., one of the examples 10 to 18) or to any other example, further comprising that the processing circuitry is configured to determine the calibrated signal by attenuating the undesired signal component in at least one subsequent frame of the IF signal.
Another example (e.g., example 20) relates to a previous example (e.g., one of the examples 1 to 19) or to any other example, further comprising that the processing circuitry is configured to determine a harmonic spectrum of the calibrated signal, determine whether the calibrated signal comprises a further free-space measurement based on the harmonic spectrum of the calibrated signal, and in response to determining that the calibrated signal comprises a further free-space measurement, update the determined undesired signal component based on the further free-space measurement.
Another example (e.g., example 21) relates to a previous example (e.g., example 20) or to any other example, further comprising that the processing circuitry is configured to determine the harmonic spectrum of the calibrated signal based on a minimum-norm method.
Another example (e.g., example 22) relates to a previous example (e.g., one of the examples 1 to 21) or to any other example, further comprising that the processing circuitry is configured to determine at least one near-range target in the field of view of the radar sensor based on the calibrated signal.
An example (e.g., example 23) relates to a radar system, comprising the apparatus of a previous example (e.g., one of the examples 1 to 22) or any other example, and the radar sensor, wherein the radar sensor is configured to emit a radio frequency signal into the field of view of the radar sensor and generate the IF signal based on a reflection of the radio frequency signal.
An example (e.g., example 24) relates to an electronic device, comprising the radar system of a previous example (e.g., example 23) or any other example, and control circuitry configured to control an operation of the electronic device based on the calibrated signal.
Another example (e.g., example 25) relates to a previous example (e.g., example 24) or to any other example, further comprising that the radar system is configured to determine at least one near-range target in the field of view of the radar sensor based on the calibrated signal, and wherein the control circuitry is configured to control the operation of the electronic device based on the determined at least one near-range target.
An example (e.g., example 26) relates to a method, comprising determining a harmonic spectrum of an intermediate frequency, IF, signal of a radar sensor, determining an undesired signal component of the IF signal caused by at least one of a crosstalk of the radar sensor and a near-range obstacle in a field of view of the radar sensor based on the harmonic spectrum, and determining a calibrated signal having a reduced contribution from the undesired signal component based on the undesired signal component and the IF signal.
Another example (e.g., example 27) relates to a non-transitory machine-readable medium having stored thereon a program having a program code for performing the method according to example 26, when the program is executed on a processor or a programmable hardware.
Another example (e.g., example 28) relates to a program having a program code for performing the method according to example 26, when the program is executed on a processor or a programmable hardware.
The aspects and features described in relation to a particular one of the previous examples may also be combined with one or more of the further examples to replace an identical or similar feature of that further example or to additionally introduce the features into the further example.
Examples may further be or relate to a (computer) program including a program code to execute one or more of the above methods when the program is executed on a computer, processor or other programmable hardware component. Thus, steps, operations or processes of different ones of the methods described above may also be executed by programmed computers, processors or other programmable hardware components. Examples may also cover program storage devices, such as digital data storage media, which are machine-, processor- or computer-readable and encode and/or contain machine-executable, processor-executable or computer-executable programs and instructions. Program storage devices may include or be digital storage devices, magnetic storage media such as magnetic disks and magnetic tapes, hard disk drives, or optically readable digital data storage media, for example. Other examples may also include computers, processors, control units, (field) programmable logic arrays ((F) PLAs), (field) programmable gate arrays ((F) PGAs), graphics processor units (GPU), application-specific integrated circuits (ASICs), integrated circuits (ICs) or system-on-a-chip (SoCs) systems programmed to execute the steps of the methods described above.
It is further understood that the disclosure of several steps, processes, operations or functions disclosed in the description or claims shall not be construed to imply that these operations are necessarily dependent on the order described, unless explicitly stated in the individual case or necessary for technical reasons. Therefore, the previous description does not limit the execution of several steps or functions to a certain order. Furthermore, in further examples, a single step, function, process or operation may include and/or be broken up into several sub-steps, -functions, -processes or -operations.
If some aspects have been described in relation to a device or system, these aspects should also be understood as a description of the corresponding method. For example, a block, device or functional aspect of the device or system may correspond to a feature, such as a method step, of the corresponding method. Accordingly, aspects described in relation to a method shall also be understood as a description of a corresponding block, a corresponding element, a property or a functional feature of a corresponding device or a corresponding system.
The following claims are hereby incorporated in the detailed description, wherein each claim may stand on its own as a separate example. It should also be noted that although in the claims a dependent claim refers to a particular combination with one or more other claims, other examples may also include a combination of the dependent claim with the subject matter of any other dependent or independent claim. Such combinations are hereby explicitly proposed, unless it is stated in the individual case that a particular combination is not intended. Furthermore, features of a claim should also be included for any other independent claim, even if that claim is not directly defined as dependent on that other independent claim.
Number | Date | Country | Kind |
---|---|---|---|
23169255 | Apr 2023 | EP | regional |