The present invention is directed in general to radar systems and associated methods of operation. In one aspect, the present invention relates to an automotive radar system configured to process received radar signals to identify near-range targets in a complex target environment.
A radar system transmits an electromagnetic signal and receives back reflections of the transmitted signal. The time delay between the transmitted and received signals can be determined and used to calculate the distance and/or the speed of objects causing the reflections. For example, in automotive applications, automotive radar systems can be used to determine the distance and/or the speed of oncoming vehicles and other obstacles.
Automotive radar systems enable the implementation of advanced driver-assistance system (ADAS) functions that are likely to enable increasingly safe driving and, eventually, fully autonomous driving platforms.
In order for a vehicle's ADAS system to maintain a safe distance from other nearby vehicles, the distance to the nearest portion of adjacent vehicles must be accurately estimated. In some conventional radar systems, however, a nearby vehicle may present itself as a single-phase center point, which may be located further away than the closest portion of the vehicle. For example, a vehicle's wing mirror may present a strong source of radar reflections causing an ADAS system to determine that a closest portion of the vehicle is located nearby or closer to the vehicle's wing mirrors. In that case, a trailing vehicle employing a radar based ADAS system may not recognize that the rear portion of the vehicle (e.g., the vehicle's rear bumper) represents the actual closest portion of the vehicle and may instead determine that the closest portion of the vehicle is closer to the location of the strong radar reflections from other parts of the vehicle's body. For effective ADAS system operation it is important that the system be able to process the multiple radar reflections that may emanate from multiple locations on an adjacent vehicle's body to determine a location of the closest portion of that vehicle.
A more complete understanding of the subject matter may be derived by referring to the detailed description and claims when considered in conjunction with the following figures, wherein like reference numbers refer to similar elements throughout the figures.
The following detailed description is merely illustrative in nature and is not intended to limit the embodiments of the subject matter of the application and uses of such embodiments. As used herein, the words “exemplary” and “example” mean “serving as an example, instance, or illustration.” Any implementation or embodiment described herein as exemplary, or an example is not necessarily to be construed as preferred or advantageous over other implementations. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, or the following detailed description.
In the context of the present disclosure, it will be appreciated that radar systems may be used as sensors in a variety of different applications, including but not limited to automotive radar sensors for road safety and vehicle control systems, such as advanced driver-assistance systems (ADAS) and autonomous driving (AD) systems.
In congested traffic conditions, ADAS (or AD) systems operating within vehicles generally require precise data regarding the closest portions of objects that are in close proximity to an operating vehicle. It is not adequate, for example, for the ADAS system to accurately estimate the general location of a central point of an adjacent vehicle or object, as that location may be inadequate to enable the ADAS system to navigate about that adjacent vehicle or object. Instead, the ADAS system should have knowledge of the closest portion of that adjacent vehicle (e.g., a bumper or wing mirror) or object to ensure that the ADAS system can properly navigate about that adjacent vehicle or object.
Typical vehicle radar systems provide range resolution on the order of tens of centimeters (cm) due to maximum implementable chirp bandwidth constraints of such systems. In combination with those bandwidth constraints, in complex target environments in which nearby objects may present a dense number of radar reflections emanating from multiple locations on a particular target object (e.g., an adjacent vehicle), the nearest range error can be quite high making it difficult for the vehicle radar system to output data that can be used by an ADAS to properly navigate about those nearby objects.
The present disclosure, therefore, provides a system and method that may be implemented to provide improved near-range object detection and ranging as compared to conventional vehicle radar approaches. In this disclosure, near-range objects may be those at distances ranging from 0.5 meters (m) to 5 m, for example. However, in different applications, a different definition of “near-range” may be utilized (e.g., in ADAS applications anticipated for vehicles maneuvering at higher speeds, near-range objects may include those at distances less than 10 m). As described herein, embodiments of the present disclosure may make use of thresholding, sub-framing, super-resolution estimation and one-dimensional clustering, as a means of estimating the location of the nearest portion of a target object with accuracy, even in unfavorable scenarios.
If a radar system processes all signals reflected by an adjacent vehicle (e.g., from the vehicle's bumpers, wing mirrors, windows, door panels, etc.), the resulting calculated central point may not be an accurate indicator of the closest portion of each adjacent vehicle. Due to the complex shape of vehicles (and the complexity of their corresponding radar reflections), or other objects in general, relative to the automotive radar wavelength, multiple phase-centers may be identified in the reflected signals, which may lead to incorrect estimates of the nearest point of contact with adjacent vehicles, which can affect how a corresponding ADAS navigates about those adjacent vehicles or objects.
Typically, frequency modulated continuous wave (FMCW) modulation radars are used to identify the distance, velocity, and/or angle of a radar target, such as a car or pedestrian, by transmitting Linear Frequency Modulation (LFM) waveforms from transmit antennas so that reflected signals from the radar target are received at receive antennas and processed to determine the radial distance, relative radial velocity, and angle (or direction) for the radar target.
To illustrate the design and operation of a vehicle radar system, reference is now made to
Within radar system 100 each radar device 10 includes one or more transmitting antenna elements 102 and receiving antenna elements 104 connected, respectively, to one or more radio frequency (RF) transmitter (TX) units 11 and receiver (RX) units 12. For example, each radar device (e.g., 10) is shown as including individual antenna elements 102, 104 (e.g., TX1,i, RX1,j) connected, respectively, to three transmitter modules (e.g., 11) and four receiver modules (e.g., 12), but these numbers are not limiting and other numbers are also possible, such as four transmitter modules 11 and six receiver modules 12, or a single transmitter module 11 and/or a single receiver module 12.
Each radar device 10 also includes a chirp generator 112 that is configured and connected to supply a chirp input signal to the transmitter modules 11. To this end, the chirp generator 112 is connected to receive a separate and independent local oscillator (LO) signal and a chirp start trigger signal. The operation of transmitter modules 11 may be controlled by a controller 110 that may be implemented, in whole or in part, by processor 20. Chirp signals 113 are generated and transmitted to transmitter modules 11, usually following a pre-defined transmission schedule, where the chirp signals 113 are filtered at the RF conditioning module 114 and amplified at the power amplifier 115 before being fed to the corresponding transmit antenna 102 (TX1,i) and radiated. By sequentially using each transmit antenna 102 to transmit successive pulses in the chirp signal 113, each transmitter module 11 operates in a time-multiplexed fashion in relation to other transmitter modules 11 because they are programmed to transmit identical waveforms on a temporally separated schedule.
The radar signal transmitted by the transmitter antenna elements 102 (TX1,i, TX2,i) may by reflected by an object, and part of the reflected radar signal reaches the receiver antenna elements 104 (RX1,i) at the radar device 10. At each receiver module 12, the received (radio frequency) antenna signal is amplified by a low noise amplifier (LNA) 120 and then fed to a mixer 121 where the received signal is mixed with the transmitted chirp signal generated by the RF conditioning module 114. The resulting intermediate frequency signal is fed to a first high-pass filter (HPF) 122. The resulting filtered signal is fed to a first variable gain amplifier 123 which amplifies the signal before feeding it to a first low pass filter (LPF) 124. This re-filtered signal is fed to an analog/digital converter (ADC) 125 and is output by each receiver module 12 as a digital signal 126 (D1). The receiver module compresses target echo of various delays into multiple sinusoidal tones whose frequencies correspond to the round-trip delay of the echo.
The radar system 100 also includes a radar controller processing unit 20 that is connected to supply input control signals to the radar device 10 (e.g., via controller 110) and to receive therefrom digital output signals (e.g., digital signal 126) generated by the receiver modules 12.
In selected embodiments, the radar controller processing unit 20 may be embodied as a micro-controller unit (MCU) or other processing unit that is configured and arranged for signal processing tasks such as, but not limited to, target identification, computation of target distance, target velocity, and target direction, and generating control signals. The radar controller processing unit 20 may, for example, be configured to generate calibration signals, receive data signals, receive sensor signals, generate frequency spectrum shaping signals (such as ramp generation in the case of FMCW radar) and/or register programming or state machine signals for RF (radio frequency) circuit enablement sequences. In addition, the radar controller processor 20 may be configured to program the transmitter modules 11 to operate in a time-division fashion by sequentially transmitting LFM chirps for coordinated communication between the transmit antenna elements 102 TX1,i, RX1,j.
Radar controller processor 20 is configured to process digital signal 126 to ultimately identify a distance to target objects as well as an angular position of those objects with respect to radar system 100. Digital signal 126 includes a sequence of digital values representing magnitudes of radar signals received by receiving antenna elements 104 captured over time. Typically, each digital value is associated with a particular chirp number and sample number, where a single sample number may capture signals associated with a number of different chirps.
The content of digital signals 126 is made up of a series of data frames of that includes a number of digital sample values (e.g., captured by ADCs 125 of receiver units 12) where the sample values are arranged in a two-dimensional matrix that is generated based upon a sequence of pulsed signals. The data structure making up a single captured frame is depicted by matrix 150 in
For each received frame of data represented by matrix 150, radar controller processor 20 initially performs a fast-time range frequency Fourier transform (FFT) 21 (
In a next step radar controller processor 20 performs an additional fast-time range frequency Fourier transform (FFT) 22 (
Accordingly, the radar controller processor 20 performs constant false alarm rate (CFAR) target detection 23 (
If a potential target has been detected, radar controller processor 20 performs MIMO array measurement construction 24 (
As discussed above, a radar system 100 configured to implement the signal processing algorithm depicted in
Consequently, the present disclosure provides a system and method configured to implement fine near range target estimation that can enable more accurate determination of the location of the closest portion of a nearby object.
As shown in
With the potential near-range targets determined, processor 20 performs MIMO array measurement construction 24 on those potential targets and direction of arrival (DOA) estimation 25 for each target. The final target information, which may include a target identifier, DOA, velocity, and other related information is then passed by radar controller processor 20 to an ADAS or other system configured to utilize the target information to control one or more vehicle system.
Referring to
In step 304, method 300 includes identifying which of the potential targets (also referred to as target clusters) identified by CFAR 156 have coarse ranges less than the threshold value THFNR. At the completion of step 304, therefore, a listing of potential near-range target clusters has been identified, where each potential near-range target cluster is associated with a particular coarse range value.
In step 306, a first one of the potential near-range target clusters is selected and processed. Specifically, for the first potential near-range target cluster, the entire signal encoded into the range-Doppler matrix at the range associated with the first target is extracted out of each range Doppler matrix 154, to generate a set of range spectrum slices 352 for that particular near-range target. In some embodiments, this involves only extracting a single signal (i.e., a row) out of each range-Doppler matrix 154 at the particular distance associated with the target cluster although in some embodiments multiple neighboring rows may additionally be extracted, where those neighboring signals have data values that exceed a non-noise threshold magnitude indicating that those neighboring signals may include useful target information for the target cluster.
With the range spectrum slices 352 determined, in step 308 the range slices 352 for each channel are combined to generate a single one-dimensional range cluster 354 for the potential target being processed.
In step 310, a low pass filter (e.g., a smoothing filter) is applied in the frequency domain to the data values of the one-dimensional range cluster 354 to select for near-range targets. The low pass filter is configured to operate as a decimation filter, which may reduce the effective sampling rate associated with the output of the low pass filter and removes data from the range spectrum slices 352 associated with non-near-range targets from the processed signal.
After executing the low pass filter, in step 312 the portion of the signal output by the low pass filter for distances less than THFNR can be extracted to generate a fine-near range signal (see block 358 in
In step 314 an inverse fast Fourier transform (IFFT) (see block 360 in
The time domain values generated by step 314 are then processed using super resolution spectral estimation algorithms to identify localized peaks within the time domain values at smaller dimension than conventional estimation techniques (e.g., with a distance resolution that is smaller than the distance covered by the time domain values generated by step 314). At this point in the algorithm, the time domain values comprise a range profile that describes, at different distances away from the radar transmitter (e.g., transmitting antenna elements 102) a magnitude of the received radar signal at that distance. An example of this approach is illustrated in
In contrast,
Returning to
Finally in step 320, the target information as determined by step 318 for a number of different channels may be combined (e.g., via interpolation of the range-spectrum slices at the obtained fine near-ranges) to generate another set of target data that can be output to a vehicle control system in step 322. The vehicle control system can then use the fine near-range data received in steps 316 and 322 to determine the location, movement, and/or DOA of nearby objects to refine operations of various vehicle control and safety systems.
In step 324 the system determines whether there are any remaining near-range target clusters to be processed. If so, the method returns to step 308 to process the next target cluster. If no target clusters remain, the method moves on to step 326 and ends.
In real-world vehicle radar system applications, the radar systems can often inadvertently detect radar reflections (i.e., interference) from the vehicle's own bumper (or other vehicle body structures that are in proximity to the vehicle's own radar systems or false reflection signals that may result from component spill-over in which electrical fields being generated by one set of components within the vehicle radar systems can cause electrical signals to be induced within other components of the radar system. When processing received radar signals to identify, with precision, near-range targets, it may be beneficial to remove the effects of these bumper reflections and spill-over signals before processing the received signals to identify near-range targets.
Although any suitable approach could be utilized in accordance with the present disclosure to remove bumper reflections and spill-over signals from signals being processed.
As illustrated in
Consequently, if in step 402 the system determines that near-range targets are present, in step 406 the signal profile stored in step 404 can be subtracted from the input signal to remove the bumper reflection and spill-over effects. With those effects removed, the spill-over and bumper reflection removal process ends in step 408 and the method returns to step 304 of
In another embodiment of the present disclosure, the present near-range target estimation approach may be modified to include analysis of range spectrum slices of the input range profile data. In this approach, a typical radar data frame is divided into sub-frames that represent range spectrum slices, each associated with different ranges or distances, and each sub-frame is processed in accordance with the present disclosure (e.g., utilizing the approach of method 300, described above). With the different subframes processed individually, the range of the nearest target within each sub-frame is saved into a vector. The vector is sorted, and the median value of the vector may be determined to be the distance to a nearest object. In some embodiments, the distance to the nearest object may be set equal to the value within the sorted vector that is closest to the median value of all values in the vector, where the value also falls within a particular range of the determined median value (e.g., within a predetermined number of standard deviations of the determined median value) and where the median value is determined with a particular confidence level (e.g., p-value). In some embodiments, the distance to the nearest object may be determined to be the median value with some offset applied (e.g., −0.5 m, −1 m, or −2 m). The implementation offers a trade-off between performance and signal-to-noise ratio (SNR). The performance of this method may be improved by the sorting/clustering procedure, which is configured to remove outliers, while the SNR is reduced due to sub-framing. However, high SNR is generally assured by the low path-loss suffered by signals reflected from near-range objects.
In step 502 a counter is set to increment, starting at a value of 1, through the number of subframes M to be processed. This counter is utilized by method 500 to iterate through each subframe in the set of subframes having detections.
In step 504 the current M′th subframe is selected out of those received at step 502.
In step 506 targets are identified within the M′th subframe having coarse range indications that are less than the threshold value THFNR are identified. At the completion of step 506, therefore, a listing of potential near-range targets have been identified for the subframe M, where each potential near-range target is associated with a particular range value.
In step 508, a first one of the potential near-range targets is selected and processed. Specifically, for the first potential near-range target, the entire signal encoded into the range-Doppler matrix at the range associated with the first target is extracted out of each range Doppler matrix (e.g., range-Doppler matrix 154), to generate a set of range spectrum slices 352 (e.g., range spectrum slices 352) for that particular near-range target. In some embodiments, this involves only extracting a single signal (i.e., a row) out of each range-Doppler matrix although in some embodiments multiple neighboring rows signals may be extracted, where those neighboring signals have data value exceeding some non-noise threshold magnitude indicating that those neighboring signals may include useful target information.
With the range spectrum slices determined, in step 510 the range slices for each channel are combined to generate a single one-dimensional range cluster for the potential target being processed.
In step 512, a low pass filter (e.g., a smoothing filter) is applied in the frequency domain to the data values of the range cluster to select for near-range targets. The low pass filter is configured to operate as a decimation filter, which may reduce the effective sampling rate associated with the output of the low pass filter and removes data associated with non-near-range targets from the processed signal.
After executing the low pass filter, in step 514 the portion of the signal output by the low pass filter for distances less than THFNR can be extracted to generate a fine-near range signal (see block 358 in
In step 516 an inverse fast Fourier transform (IFFT) (see block 360 in
The time domain values generated by step 516 are then processed using super resolution spectral estimation algorithms in step 518 to identify localized peaks within the time domain values. At this point in the algorithm, the time domain values comprise a range profile that describes, at different distances away from the radar transmitter (e.g., transmitting antenna elements 102) a magnitude of the received radar signal at that distance.
In step 526, the system determines whether there are any remaining near-range target clusters to be processed in the current subframe M. If so, the method returns to step 508 to process the next target cluster. If no target clusters remain, the method moves on to step 528 where a determination is made as to whether any additional subframes remain to be processed. If so, the method returns to step 502 to increment the counter value M and process the next subframe.
When all subframes have been processed in step 530 the closest detected targets in the set of M subframes that was processed are identified. The range and amplitude of that closest detected target can then be reported a vehicle control system in step 532. The control system can then use the fine near-range data received in step 532 to determine the location (and movement or DOA) of nearby objects to refine operations of various vehicle control and safety system. In step 534 the algorithm exits.
By performing the method of
This is further illustrated in
In contrast,
In some aspects, the techniques described herein relate to an automotive radar system, including: at least one transmitter and at least one receiver, wherein the at least one transmitter and the at least one receiver are configured to transmit and receive radar signals, wherein the at least one transmitter and the at least one receiver are coupled to a vehicle; and a processor configured to: receive, from the at least one receiver, a first received radar signal, process the first received radar signal to generate a range-Doppler data frame, identify a first target cluster at a first range in the range-Doppler data frame, determine that the first range is less than a threshold distance, extract a range spectrum data set from the range-Doppler data frame, wherein the range spectrum data set is associated with the first range, apply a low-pass filter to the range spectrum data set to extract a first portion of a spectrum of the range spectrum data set, compute an inverse fast Fourier transform (IFFT) of the first portion of the spectrum to generate a time-domain set of signal magnitudes, apply a super-resolution spectral estimation to the time-domain set of signal magnitudes to identify a first range of a first target associated with the first target cluster, and transmit the first range to a vehicle controller.
In some aspects, the techniques described herein relate to a signal processing system, including: a radar system; and a processor coupled to the radar system, the processor being configured to: receive a first subframe of a first range-Doppler data frame, wherein the first range-Doppler frame is generated based upon a radar signal received from the radar system, identify a first target cluster at a first range in the first subframe, determine that the first range is less than a threshold distance, extract a first range spectrum data set from the first subframe, wherein the first range spectrum data set is associated with the first range, apply a low-pass filter to the first range spectrum data set to extract a first portion of a first spectrum of the first range spectrum data set, compute an inverse fast Fourier transform (IFFT) of the first portion of the spectrum extracted from the first range spectrum data set to generate a first time-domain set of signal magnitudes, apply a super-resolution spectral estimation to the first time-domain set of signal magnitudes to identify a first range of a first target associated with the first target cluster, receive a second subframe of the first range-Doppler data frame, identify a second target cluster at a second range in the second subframe, determine that the second range is less than the threshold distance, extract a second range spectrum data set from the second subframe, wherein the second range spectrum data set is associated with the second range, apply the low-pass filter to the second range spectrum data set to extract a second portion of a second spectrum of the second range spectrum data set, compute the inverse fast Fourier transform (IFFT) of the second portion of the spectrum extracted from the second range spectrum data set to generate a second time-domain set of signal magnitudes, apply the super-resolution spectral estimation to the second time-domain set of signal magnitudes to identify a second range of a second target associated with the second target cluster, and transmitting at least one of the first range of the first target and the second range of the second target to a vehicle controller.
In some aspects, the techniques described herein relate to a method, including: receiving, from a radar system, a first received radar signal; processing the first received radar signal to generate a range-Doppler data frame, identifying a first target cluster at a first range in the range-Doppler data frame, determining that the first range is less than a threshold distance, extracting a range spectrum data set from the range-Doppler data frame, wherein the range spectrum data set is associated with the first range, applying a low-pass filter to the range spectrum data set to extract a first portion of a spectrum of the range spectrum data set, computing an inverse fast Fourier transform (IFFT) of the first portion of the spectrum extracted from the range spectrum data set to generate a time-domain set of signal magnitudes, applying a super-resolution spectral estimation to the time-domain set of signal magnitudes to identify a second range of a first target associated with the first target cluster, and transmitting the second range of the first target to a vehicle controller.
Although the examples have been described with reference to automotive radar systems, the systems and methods described herein may be implemented in conjunction with other types of radar systems. Devices or components described as being separate may be integrated in a single physical device. Also, the units and circuits may be suitably combined in one or more semiconductor devices. That is, the devices described herein may be implemented as a single integrated circuit, or as multiple integrated circuits.
The preceding detailed description is merely illustrative in nature and is not intended to limit the embodiments of the subject matter or the application and uses of such embodiments.
As used herein, the word “exemplary” means “serving as an example, instance, or illustration.” Any implementation described herein as exemplary is not necessarily to be construed as preferred or advantageous over other implementations. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, or detailed description.
The connecting lines shown in the various figures contained herein are intended to represent exemplary functional relationships and/or physical couplings between the various elements. It should be noted that many alternative or additional functional relationships or physical connections may be present in an embodiment of the subject matter. In addition, certain terminology may also be used herein for the purpose of reference only, and thus are not intended to be limiting, and the terms “first”, “second” and other such numerical terms referring to structures do not imply a sequence or order unless clearly indicated by the context.
As used herein, a “node” means any internal or external reference point, connection point, junction, signal line, conductive element, or the like, at which a given signal, logic level, voltage, data pattern, current, or quantity is present. Furthermore, two or more nodes may be realized by one physical element (and two or more signals can be multiplexed, modulated, or otherwise distinguished even though received or output at a common node).
The foregoing description refers to elements or nodes or features being “connected” or “coupled” together. As used herein, unless expressly stated otherwise, “connected” means that one element is directly joined to (or directly communicates with) another element, and not necessarily mechanically. Likewise, unless expressly stated otherwise, “coupled” means that one element is directly or indirectly joined to (or directly or indirectly communicates with, electrically or otherwise) another element, and not necessarily mechanically. Thus, although the schematic shown in the figures depict one exemplary arrangement of elements, additional intervening elements, devices, features, or components may be present in an embodiment of the depicted subject matter.
While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or embodiments described herein are not intended to limit the scope, applicability, or configuration of the claimed subject matter in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the described embodiment or embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope defined by the claims, which includes known equivalents and foreseeable equivalents at the time of filing this patent application.
Number | Date | Country | Kind |
---|---|---|---|
A 2023 00077 | Feb 2023 | RO | national |