The present invention is directed to radar systems, and more particularly to radar systems for vehicles.
The use of radar to determine range and velocity of objects in an environment is important in a number of applications including automotive radar and gesture detection. A radar system typically transmits radio signals and listens for the reflection of the radio signals from objects in the environment. By comparing the transmitted radio signals with the received radio signals, a radar system can determine the distance to an object. Using multiple transmissions, the velocity of an object can be determined. Using multiple transmitters and receivers, the location (angle) of an object can also be determined.
Methods and systems of the present invention provide for a shared radar and communication system that simultaneously operates as a radar (for detecting and estimating location and velocity of objects in the environment) as well as a communication system that sends and/or receives information bits to and from other systems with similar capabilities. The system operates under a variety of environments, with a variety of external information, and with a variety of objective functions to modify the transmission and reception processing at a given time to optimize the system with respect to a given objective function. This radar and communication system is designed to act in complimentary fashion. Information available from radar may be used for improving communication performance and vice versa.
A shared radar and communication system for a vehicle in accordance with an embodiment of the present invention includes the use of same signaling schemes for both radar operation and communication of information bits.
In an aspect of the invention, a PMCW-based signaling scheme transmits information by the choice of spreading code used. In accordance with another aspect of the invention, the information bits are modulated on top of the spreading code.
A shared radar and communication system for a vehicle in accordance with an embodiment of the present invention includes at least one transmitter, at least one receiver, at least one antenna, a memory, and a control processor. The at least one transmitter is configured for installation and use on a vehicle. The at least one transmitter is operable to or configured to transmit a radio signal. The transmitted radio signal is generated by up-converting a baseband transmitted signal. The baseband signal is modulated with desired information bits. The at least one receiver is configured for installation and use on the vehicle and is operable to or configured to receive a reflected radio signal. The reflected radio signal is the transmitted radio signal(s) reflected from an object or multiple objects. The at least one receiver is also operable to or configured to receive radio signals transmitted by other similar systems. The radar system includes one or more receivers. In each receiver, the received radio signal is down-converted (with in-phase and quadrature signals), and then sampled and quantized using an analog-to-digital converter (ADC) to produce possibly complex baseband samples. The resulting complex signal from the ADC is processed by a digital processor. The control processor is operable to or configured to change the characteristics of the transmitted signal and to change the way the receiver processes the reflected radio signal to generate estimates of range, velocity, and angle of objects in the environment and at the same time enable communications with other similar systems. The change of the characteristics can be in response to (i) radar detection information, (ii) information received over communications with other similar systems, and (iii) in response to information available from external devices, such as a vision-based system.
These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
The present invention will now be described with reference to the accompanying figures, wherein numbered elements in the following written description correspond to like-numbered elements in the figures. Methods and systems of the present invention achieve radar and communication capabilities on a same system. Radar signaling is based on signals which have good auto and cross correlation properties. Information bits are encoded into these signals while maintaining the same correlation properties.
There are several types of signals used in different types of radar systems. One type of radar signal is known as a frequency-modulated continuous waveform (FMCW). In an FMCW radar system, the transmitter of the radar system sends a continuous signal in which the frequency of the signal varies. This is sometimes called a chirp radar system. Mixing (multiplying) the reflected wave from an object with a replica of the transmitted signal results in a CW signal with a frequency that represents the distance between the radar transmitter/receiver and the object. By sweeping up in frequency and then down in frequency, the Doppler frequency can also be determined.
Another type of radar signal is known as a phase-modulated continuous waveform (PMCW). For this type of radio signal, the phase of the transmitted signal is modulated according to a certain pattern or code, sometimes called the spreading code, known at the PMCW radar receiver. The transmitted signal is phase modulated by mixing a baseband signal (e.g., with two values +1 and −1) with a local oscillator to generate a transmitted signal with a phase that is changing corresponding to the baseband signal (e.g., +1 corresponding to a phase of 0 radians and −1 corresponding to a phase of π radians). For a single transmitter, a sequence of phase values that form the code or spreading code that has good autocorrelation properties is required so that ghost objects are minimized. The rate at which the phase is modulated determines the bandwidth of the transmitted signal and is called the chip rate.
In a PMCW radar system, the receiver performs correlations of the received signal with time-delayed versions of the transmitted signal and looks for peaks in the correlation. The time-delay of the transmitted signal that yields peaks in the correlation corresponds to the delay of the transmitted signal when reflected off an object. The distance to the object is found from that delay and the speed of light.
A radar system utilizes one or more transmitters to transmit signals. These signals are reflected from objects (also known as targets) in the environment and received by one or more receivers of the radar system. A transmitter-receiver pair is called a virtual radar (or sometimes a virtual receiver).
The transmitted radio signal from each radar transmitter consists of a baseband transmitted signal, which is up-converted to an RF signal by an RF upconverter. The up-converted RF signal may be obtained by mixing the baseband transmitted signal with a local oscillator signal at a carrier frequency. The baseband transmitted signal used for transmission by one transmitter of the radar system might be phase modulated using a series of codes. These codes, for example, consist of repeated sequences of random or pseudo-random binary values for one transmitter, e.g., (−1, −1, −1, −1, 1, 1, 1, −1, 1, 1, −1, −1, 1, −1, 1), although any sequence, including non-binary sequences and non-periodic sequences could be used and different sequences could be used for phase modulating the outputs of different transmitters. Each value of the phase modulation code sequence is often called a chip. A chip would last a certain duration called the chip time. The inverse of the chip time is the chip rate. That is, the chip rate is the number of chips per second. In an exemplary aspect of the present invention, the sequences of random binary values may be provided by a truly random number generator. A truly random number generator is explained in more detail in U.S. Pat. No. 9,575,160, which is hereby incorporated by reference herein in its entirety. The random bit stream (with values +1 or −1) from the truly random number generator may be multiplied with an output of pseudorandom binary values from a pseudorandom number generator (PRNG).
The transmitted radio signals are reflected from objects in the environment and are received back at the radar receivers (or virtual receivers). Each object in the environment may reflect the transmitted radio signal. The received radio signal at the radar system would consist of the sum of the radio signals reflected from various objects (targets) in the environment. In addition, a second radar system operating in the vicinity of the first radar system will generate a transmitted radio signal that may be received by the first radar system and interfere with the reflected radio signals from the first radar system. In other words, the first radar system would receive radio signals that include radio signals from transmitters of the first radar system that are reflected from objects in the environment, as well as radio signals transmitted by one or more other radar systems.
At the receiver (receive pipeline) of the radar system, the received radio signal is down-converted by typical amplification, filtering, and mixing with in-phase and quadrature-phase components of an oscillator. The output after down-conversion and sampling is a sequence of complex value digitized samples comprising a mathematical real component and a mathematical imaginary component that are provided to a processor. The baseband signals used at the transmitter and the reflected radio signals after down-conversion in the receiver are provided to correlators. The complex valued digitized samples at the output of the down-converter are correlated with various time-delayed replicas of the baseband transmitted signals for different receivers to produce complex correlation values over a certain duration. That is, a sequence of digitized samples that correspond to a certain time duration of the received signal are correlated with a time-delayed replica of the baseband transmitted signal. The process is repeated for subsequent samples, thus producing a sequence of complex correlation values for a given time-delay. This process is also performed for different transmitter/receiver pairs (virtual receivers).
A selected correlator that has a replica that is matched in delay to the time delay of the reflected radio signal from an object will produce a large magnitude complex correlator output. A single correlator will produce a sequence of correlator outputs that are large if the reflected signal has a delay that matches the delay of the replica of the baseband transmitted signal. If the velocity of the radar system is different from the velocity of the object causing the reflection, there will be a Doppler shift in the frequency of the reflected signal relative to the transmitted signal. A sequence of correlator outputs for one particular delay corresponding to an object moving in the environment will have complex values that rotate at a rate related to the Doppler shift. Using a sequence of correlator outputs (also referred to as a scan), the Doppler shift may be estimated, and thus the velocity of the object in the environment determined. The longer the sequence of correlator outputs used to estimate the Doppler frequency, the greater the accuracy and resolution of the estimation of the Doppler frequency, and thus the greater the accuracy in estimating the velocity of the object.
The correlation values for various time delays and various virtual radars are arranged in two-dimensional arrays known as time slices. A time slice is a two-dimensional array with one dimension corresponding to delay or range bin and the other dimension corresponding to the virtual radar (transmitter-receiver pair). The samples are placed into respective range bins of the two-dimensional array (as used herein, a range bin refers to a distance range corresponding to a particular time delay corresponding to the round-trip time of the radar signal from a transmitter, to the target/object, and back to the receiver). The virtual receivers of the radar system define one axis of the two-dimensional time slice and the range bins define the second axis of the two-dimensional time slice. Another new time slice comprising complex correlation values is generated every 2-30 microseconds. Over a longer time interval, herein referred to as a “scan” (typically, in a duration of 1-60 milliseconds or longer), multiple time slices are accumulated to form a three-dimensional radar data cube. One axis or dimension of the three-dimensional radar data cube is defined by time (of each respective time slice requiring 2-30 microseconds), while the receivers (or virtual radar) define a second axis of the three-dimensional radar data cube, and the range bins and their corresponding time delays define a third axis of the three-dimensional radar data cube. A radar data cube may have a preselected or dynamically defined quantity of time slices. For example, a radar data cube may include 100 time slices or 1000 time slices of data. Similarly, a radar data cube may include different numbers of range bins. The optimized use of radar data cubes is described in detail in U.S. Pat. No. 9,599,702, which is hereby incorporated by reference herein in its entirety.
A single correlator output corresponding to a particular range bin (or delay) is a complex value that corresponds to the sum of products between a time-delayed replica of the baseband transmitted signal—with a time-delayed replica corresponding to each range bin—and the received down-converted complex samples. When a particular time-delayed replica in a particular range bin correlates highly with the received signal, it is an indication of the time delay (i.e., range of the object) for the transmitted radio signal that is received after the transmitted radio signal reflects from an object. Multiple correlators produce multiple complex correlation values corresponding to different range bins or delays. As discussed herein, each time slice contains one correlation value in a time series of correlation values upon which Doppler processing is performed (e.g., Fast Fourier Transform). In other words, a time series of complex correlation values for a given range bin is used to determine the Doppler frequency and thus the velocity of an object in the range bin. The larger the number of correlation values in the time series, the higher the Doppler resolution. A matched filter may also be used to produce a set of outputs that correspond to the correlator outputs for different delays.
There may be scans for different correlators that use replicas of the transmitted signal with different delays. Because there are multiple transmitters and multiple receivers, there may be correlators that process a received radio signal at each receiver that are matched to a particular transmitted radio signal by a particular transmitter. Each transmitter-receiver pair is called a “virtual radar” (a radar system preferably has 4 virtual radars, or more preferably 32 virtual radars, and most preferably 256 or more virtual radars). The receive pipeline of the radar system will thus generate a sequence of correlator outputs (time slices) for each possible delay and for each transmitter-receiver pair. This set of data is called a radar data cube (RDC). The delays are also called range bins. The part of the radar data cube for one point in the sequence of correlator outputs is called a time slice, and it contains one correlator output for each range bin and transmitter-receiver pair combination.
The complex-valued correlation values contained in a three-dimensional radar data cube may be processed, preferably by a processor established as a CMOS processor and coprocessor on a semiconductor substrate, which is typically a silicon substrate. In one embodiment, the processor comprises fixed function and programmable CPUs and/or programmable logic controls (PLCs). Preferably, the system will be established with a radar system architecture (including, for example, analog RF circuitry for the radar, processor(s) for radar processing, memory module(s), and other associated components of the radar system) all on a common semiconductor substrate. The system may preferably incorporate additional processing capabilities (such as, for example, image processing of image data captured by one or more vehicle cameras such as by utilizing aspects of the systems described in U.S. Pat. Nos. 5,877,897; 5,796,094; 6,396,397; 6,690,268 and 5,550,677, which are hereby incorporated herein by reference in their entireties) within the same semiconductor substrate as well.
The ability of a continuous wave radar system to distinguish multiple targets is dependent upon the radar system's range, angle, and Doppler resolutions. Range resolution is limited by a radar's bandwidth (i.e., the chip rate in a phase modulated continuous wave radar), while angle resolution is limited by the size of the antenna array aperture. Meanwhile, increasing Doppler resolution only requires a longer scan. A high Doppler resolution is very valuable because no matter how close two objects or targets are to each other, as long as they have slightly differing radial velocity (their velocity towards or away from the radar system), they can be distinguished by a radar system with a sufficiently high enough Doppler resolution. As discussed herein, the detection of objects with a PMCW radar system may be adversely effected by the nearby operation of one or more frequency modulated continuous wave (FMCW) radar systems.
The radar sensing system of the present invention may utilize aspects of the radar systems described in U.S. Pat. Nos. 9,575,160 and/or 9,599,702, and/or U.S. patent application Ser. No. 15/481,648, filed Apr. 7, 2017, Ser. No. 15/416,219, filed Jan. 26, 2017, and/or Ser. No. 15/292,755, filed Oct. 13, 2016, and/or U.S. provisional applications, Ser. No. 62/382,857, filed Sep. 2, 2016, Ser. No. 62/381,808, filed Aug. 31, 2016, Ser. No. 62/327,003, filed Apr. 25, 2016, Ser. No. 62/327,004, filed Apr. 25, 2016, Ser. No. 62/327,005, filed Apr. 25, 2016, Ser. No. 62/327,006, filed Apr. 25, 2016, Ser. No. 62/327,015, filed Apr. 25, 2016, Ser. No. 62/327,016, filed Apr. 25, 2016, and/or Ser. No. 62/327,018, filed Apr. 25, 2016, which are all hereby incorporated by reference herein in their entireties.
There are several ways to implement a shared radar and communication system. One way, shown in
An exemplary shared radar and communications system 300 with multiple antennas, transmitters, and receivers (MIMO) is illustrated in
The shared radar and communications system 300 may be connected to a network via an Ethernet connection or other types of network connections 314. The system 300 will have memory (310, 312) to store software used for processing the signals in order to determine range, velocity and location of objects. The software also performs necessary operations to modulate the information bits onto the radar signal as well as extracting information bits embedded in the radar signals from other similar systems. Memory can also be used to store information about targets in the environment.
A basic block diagram of a PMCW system with a single transmitter and receiver is illustrated in
It is possible to use the concept described herein with various means for modulating the data onto a transmitted signal. For example, it is possible to use a variety of modulation techniques including Gaussian minimum shift keying (GMSK) modulation scheme which provides better control of the power spectrum of the output signal. In another embodiment, an orthogonal frequency division multiplex (OFDM)-based modulation scheme, which spreads the information into the time-frequency plane can be used for a shared use of radar detection and communication.
As mentioned herein, there are various types of signals used in radar systems. One type of continuous wave radar signal is known as phase-modulated continuous-wave (PMCW). The phase of the transmitted signal is varied in PMCW systems. Often, the variation of the phase is according to a spreading code. The spreading code may be binary (e.g., +1 and −1), in which case the phase of the transmitted signal at any time takes on one of two possible values (e.g., 0 and π radians). Spreading codes with more than two levels can also be used. Often, the code repeats after a certain time duration, sometimes called the pulse repetition interval (PRI). Various types of spreading codes can be used. These include pseudorandom binary sequence (PRBS) codes also called m-sequences, almost perfect autocorrelation sequences (APAS), Golay codes, constant amplitude zero autocorrelation codes (CAZAC), also known as Frank-Zadoff-Chu (FZC) sequences, as well as many other codes that can be used. In a radar system with a single antenna, a single spreading code is used. The autocorrelation of this single code determines the capability of the radar to estimate the range (range resolution and maximum unambiguous range).
In a multiple-input, multiple-output (MIMO) system, there are multiple transmitters that operate simultaneously. Each transmitter uses a spreading code and thus multiple codes are needed, one for each transmitter. In this case (multiple transmitters), codes that have good autocorrelation, as well as good cross-correlation properties are desirable. Generally, the better the autocorrelation of codes, the worse the cross-correlation properties.
Systems with multiple transmitters can also be used to transmit the same spreading code. In this case, by controlling the phase of each transmitter, one can transmit more power in a given direction. This is known as phased array beamforming in the industry.
In order to achieve communication shared with radar communication, information bits can be incorporated into the spreading codes (for modulating a transmit signal) in various ways. In one preferred embodiment, information bits are modulated on the transmit signal on a spreading code basis. In this case, one can choose any of the codes mentioned earlier, e.g., almost perfect autocorrelation sequences (APAS), Golay codes, constant amplitude zero autocorrelation codes (CAZAC), or m-sequences.
In a preferred embodiment, the information bits are directly modulated onto the spreading codes. Alternatively, the information bits can themselves be used to generate the spreading code. As illustrated in
Before modulation, the information bits can be differentially encoded. This means that instead of sending the bits themselves, the difference of a current bit to a previous bit is sent. Mathematically, this operation is equivalent to dk=bk ⊕bk-1, where ⊕ represents a Boolean XOR operation. This makes the communication system robust to constant phase rotation, such as what might be experienced as the transmitter and the receiver are not moving at a same velocity.
As illustrated in
The complex baseband output consists of two aspects of the signal. A first aspect includes reflections from objects that are copies of the transmitted signal. A second aspect includes information bits that are transmitted by other systems. For example, in
Referring to
In one preferred embodiment, the information bits are transmitted based on the scheme illustrated in
In another preferred embodiment, the information bits are transmitted based on the scheme illustrated
The information bits can be arranged in blocks as illustrated in
The system can be enhanced through the use of various channel coding systems as are known in the industry. The channel coding mechanism can include simple repetition coding, where the same data block is repeated several times, or more advanced channel coding schemes like convolutional coding, block coding, turbo coding, or low density parity check coding.
The description herein includes a shared radar and communication system in which there are NT transmitters and NR receivers. For radar detections, this results in NT×NR virtual radars, one for each transmitter-receiver pair. For example, a radar system with eight transmitters and eight receivers will have 64 pairs or 64 virtual radars (with 64 virtual receivers). This set of virtual receivers can be used to determine the angle of arrival (AOA) of reflection signals. For communication, only the NR receivers can be used to determine the AOA of the received signal. These NR receivers can then be used to focus the signal reception in the given direction to increase a signal level. The NT transmitters can also be used to focus the transmitted signal in any desired direction. This is illustrated in
If the multiple transmitters and the multiple receivers are used to focus (beam form) information bit transmission and reception in a given direction, the radar detection can only be done in the region covered by the signal transmission. In one preferred embodiment, the shared radar and communication system takes a time division multiplexing approach. In this method, the system alternately uses a broad transmission for radar detection and a narrow focused transmission for communications. In another preferred embodiment, the system allocates a subset of transmitters and receivers for broad transmission used in radar detection and a different subset for narrow focused transmission used for communication. In this case, radar detection and communications can be carried out simultaneously.
The system can analyze the radar detection data to analyze the potential sources of other systems to be communicated with and design transmission parameters such as transmission direction and power, and necessary coding based on location(s) of the remote systems. The system can also take data from external sources, such as: camera based systems, and a GPS map to analyze potential sources to be communicated with and optimize thereof.
The information available from other vehicles received over a communication channel can also be used to optimize operations of the radar in a shared radar and communications system. If an advanced knowledge of locations with vulnerable road users (VRU), such as pedestrians, is available to a vehicle not yet visible in a radar screen, the system can design radar scans optimized to identify the activities of such VRU beforehand.
Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the present invention, which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.
The present application claims the filing benefits of U.S. provisional application, Ser. No. 62/327,017, filed Apr. 25, 2016, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
62327017 | Apr 2016 | US |