The entirety of each of the following applications is hereby incorporated herein by reference:
U.S. provisional patent application 62/155,728 titled “Multistatic Radar via an Array of Multifunctional Automotive Transceivers” filed on May 1, 2015;
U.S. patent application Ser. No. 15/142,926 titled “Multistatic Radar via an Array of Multifunctional Automotive Transceivers” filed on Apr. 29, 2016;
U.S. provisional patent application 62/160,316 titled “Scalable Architecture for an Automotive Radar System” filed on May 12, 2015;
U.S. provisional patent application 62/154,840 titled “Multifunctional Automotive Radar” filed on Apr. 30, 2015;
U.S. patent application Ser. No. 15/142,935 titled “Multifunctional Automotive Radar” filed on Apr. 29, 2016;
U.S. provisional patent application 62/162,206 titled “Dynamic OFDM Symbol Shaping for Radar Applications” filed on May 15, 2015; and
U.S. provisional patent application 62/167,950 titled “Cooperative and Crowd-Sourced Multifunctional Automotive Radar” filed on May 29, 2015.
Limitations and disadvantages of conventional automotive radar systems and methods will become apparent to one of skill in the art, through comparison of such approaches with some aspects of the present method and system set forth in the remainder of this disclosure with reference to the drawings.
Methods and systems are provided for calibration of a multifunctional automotive radar system, substantially as illustrated by and/or described in connection with at least one of the figures, as set forth more completely in the claims.
The radar function comprises transmitting millimeter wave signals and processing the reflections/returns of such signals to detect the presence of, identity of, direction of, distance to, and/or speed of objects in the environment surrounding the automobile 100 (the “scene”).
The positioning function comprises use of the same millimeter wave signals used for the radar function to improve upon coarse position determined through other mechanisms such as GPS.
The communication function comprises communicating data among the multifunction radar transceivers 102 using the same millimeter wave signals as are used for the radar function. Such data may include, for example, pixel or voxel data (and time and position metadata) generated using the radar and positioning functions.
Through a combination of the radar function, the positioning function, and the communication function, the multifunctional radar transceivers 1021-1028 are operable to generate a scene representation (e.g., 2D pixel grid or 3D voxel grid) where the absolute time of capture of the scene representation and the absolute position of the pixels (2D) or voxels (3D) in the scene representation are known.
The circuitry 110 represents other circuitry of the automobile 100 such as one or more transceivers (e.g., cellular, Wi-Fi, Bluetooth, GPS, etc.), instrumentation (e.g., entertainment system, driver indicators/gauges, driver controls), sensors for safety systems, etc. The circuitry 110 may be communicatively coupled to the transceivers 102 via a CAN_bus, for example. The circuitry 110 may be operable to process data from the transceivers and take action (e.g., trigger driver alerts, transmit messages via one or more of its transceivers, trigger braking or other safety systems, etc.) in response to such data. The circuitry 110 may also generate data which it may pass to the transceiver(s) 102 for communication to a remote transceiver 102 (e.g., that is mounted to another automobile and/or to infrastructure such as the road, sign post, stop-light, etc.) In an example implementation, the circuitry 110 may comprise a cell phone that connects to an electronics system of the automobile 100 via USB, Bluetooth, Wi-Fi, or any other suitable interface and then the electronics system 110 of the automobile 100 leverages the cellular transceiver of the circuitry 110 for connecting to a cellular network.
Each of the receive antenna elements 2081-2084 comprises, for example, a copper microstrip patch antenna on a printed circuit board (e.g., FR4, Duroid, or the like). Although four elements 208 are shown for illustration, any number may be used.
Each receive SoC 202n is operable to receive millimeter wave signals (e.g., in the 76 to 81 GHz band) via the antenna elements 2081-2084. The receive SoC 202n is operable to process received millimeter wave signals for supporting the radar, positioning, and communication functions. The receive SoC 202n is also operable to communicate over data bus 212 and to synchronize its timing to a signal output by reference clock 214 onto clock distribution bus 216. Additional details of an example receive SoC 202n are described below with reference to
Each of the transmit antenna elements 210 comprises, for example, a copper microstrip patch antenna on a printed circuit board (e.g., FR4, Duroid, or the like). Although four elements 210 are shown for illustration, any number may be used.
The transmit SoC 204n is operable to transmit millimeter wave signals (e.g., in the 76 to 81 GHz band) via the antenna elements 2101-2104. The transmit SoC 204n is operable to generate the signals in such a manner as to support the radar, positioning, and communication functions. The transmit SoC 204n is also operable to communicate over data bus 212 and to synchronize its timing to a signal output by reference clock 214 onto clock distribution bus 216. Additional details of an example transmit SoC 204n are described below with reference to
The bus controller 206 is operable to relay data between the data bus 212 interconnecting the multifunction radar transceivers 1021-102N and a data bus of the automobile 100 (e.g., a CAN bus). The bus 212 may, for example, be a high speed serial bus and the bus controller 206, receive SoC 202n, and transmit SoC 204n may each be operable to perform serialization and deserialization for communicating over the bus 212.
The reference clock generator 214 comprises a crystal oscillator, phase locked loop, and/or other circuitry for generating a signal to act as a phase reference for receive SoC 202, and transmit SoC 204n. In an example implementation, the frequency of the reference signal may be relatively low compared to the millimeter wave frequencies (e.g., on the order of tens or hundreds of MHz), which may greatly relax the routing requirements for the bus 216 as compared to trying to distribute a reference signal in the 77 to 81 GHz range. In another example implementation, the frequency of the reference signal may be the same as the millimeter wave carrier frequency (e.g., it the range 77 to 81 GHz).
Each of the Rx AFEs 252 is operable to process a millimeter wave signal (e.g., in the band from 76 to 81 GHz) from a respective one of the plurality of antenna elements 208. The processing may comprise, for example, low noise amplification, filtering, and down-conversion so as to output a 1 to 5 GHz wide intermediate frequency or baseband signal.
Each of the ADCs 254 is operable to digitize the output of a corresponding one of the Rx AFEs 252. For example, each Rx AFE 252 may downconvert a received 76 to 77 GHz band to a 1 GHz wide baseband signal which the corresponding ADC 254 may then digitize to generate a 1 GHz wide digital signal. As another example, each Rx AFE 252 may downconvert a received 76 to 81 GHz band to a 5 GHz wide baseband signal which the corresponding ADC 254 may then digitize to generate a 5 GHz wide digital signal 255.
The digital signal processing circuitry 256 is operable to process the digitized signals from the plurality of ADCs 254 to recover information conveyed by the received signals. Such information may be conveyed by characteristics (e.g., latency, Doppler shift, signal strength, etc.) of the received signals, as is the case in a conventional radar system, and/or may be data that was modulated onto the received signals.
The processing performed by the digital signal processing circuit 256 may comprise, for example, channel estimation and equalization.
The processing performed by the digital signal processing circuit 256 may, where the millimeter wave signals are modulated by a data signal, comprise demodulation. For example, the millimeter wave signals transmitted by transceivers 102 may comprise bursts (or “chirps”) whose amplitude is modulated relatively slowly as compared to the channel frequency (e.g., a few MHz as compared to a channel frequency of 76-81 GHz), and the digital signal processing circuitry 256 may be operable to track the signal envelope to recover the data signal. As another example, the millimeter wave signals transmitted by transceivers 102 may comprise OFDM symbols and the digital signal processing circuit 256 may be operable to demodulate the received signals using a discrete Fourier transform. The digital signal processing circuit 256 may then be operable to demap the modulated signal according to one or more symbol constellations, deinterleave the demapped bits, and decode the demapped bits. The recovered bits may then be provided to the control and memory subsystem 262 and/or output onto the bus 212.
The processing performed by the digital signal processing circuit 256 may comprise beamforming. The beamforming may comprise time-domain beamforming in which one or more sets of phase and amplitude coefficients is applied to each of the signals 255 in the time domain. Alternatively, or additionally, the beamforming may comprise frequency-domain beamforming in which the signals 255 are first transformed to the frequency domain (e.g., via a DFT) and then each subband (e.g., each OFDM bin or group of OFDM bins) is processed using a corresponding one or more beamforming matrices determined for that subband. In this manner, different subbands may be communicated on beams pointed in different directions.
The processing performed by the digital signal processing circuit 256 may comprise spectral analysis of the received signals. The spectral analysis may comprise, for example, mixing received signals with one or more reference signals to generate a difference signal. The spectral analysis may comprise, for example, performing a discrete Fourier transform on received signals. The spectral analysis may be used to, for example, determine Doppler shift of received signals and/or to generate spectral signatures of detected objects in the scene (i.e., objects off of which the received signals reflected.).
The processing performed by the digital signal processing circuit 256 may comprise separating different transmitted signals (e.g., originating from different ones of the transceivers 1021-1028). The processing may comprise, for example, correlating the received signals with different orthogonal codes and/or pseudorandom sequences used by different ones of the transceivers 1021-1028. Alternatively, or additionally, separating different transmitted signals (e.g., to determine which transceiver 102 sent which signal) may comprise directly recovering a respective identifier (e.g., a unique identifier such as a MAC address or similar) modulated onto each of the millimeter wave signals. The ability to distinguish which, if any, energy arrived from each transceiver 1021-1028 may be useful for performing the radar function, the positioning function, and the communication function of the transceivers 102. For the radar and positioning functions, for example, the identification of which of transceivers 1021-1028 sent any particular received signal may be used for determining the position and angle from which the signal was transmitted (since the different transceivers 1021-1028 are at different positions on the automobile 100), which may be used for determining precise distance to, and location of, objects in the scene. For the communication function, for example, the identification of which of transceivers 1021-1028 sent any particular received signal may be used in a manner similar to a “from” address in many networking protocols.
The data processing circuitry 264 is operable to process data output by the digital signal processing circuitry 256. Such processing may comprise, for example, implementing algorithms to generate a representation of the scene detected using the radar function. Based on the angle, strength, timing, spectral content, and/or other characteristics of the received signals, the data processing circuitry 264 may generate a 2D pixel grid or 3D voxel grid. In an example implementation, each pixel or voxel may indicate an absolute position to which it corresponds (determined via the positioning function of the multifunction radar system), the strength of returns, if any, received from that location (determined via the radar function of the multifunction radar system), spectral content of returns, if any, received from that location, and/or time(s) at which returns were received from that location and/or at which the pixel or voxel data was updated.
The data processing circuitry 264 may also be operable to process data received from the data bus 212. For example, positioning information may be received via the bus 212 (e.g., GPS coordinates from a GPS receiver of the vehicle 100) and combined with data recovered from the digital processing circuitry 264 for performing the positioning function.
The processing (performed by data processing circuitry 264) of data output by digital signal processing circuitry 256 may comprise, for example, preparing data for output onto the data bus 212. For example, a scene representation generated from the output of the digital signal processing circuity 256 may be transmitted onto the data bus 212.
The bus controller circuitry 258 may be substantially similar to the bus controller 206 described above.
The clock generation circuitry 260 is operable to generate a plurality of timing signals that are synchronized to the timing signal received via bus 216. The timing signals may comprise, for example: a local oscillator signal for direct downconversion of received millimeter wave signals (e.g., in the 76 to 81 GHz range), a sampling clock for the ADCs 254 (e.g., between 2 and 20 GHz), and one or more clocks for clocking the digital processing circuitry 256, the bus controller 258, and the control and memory subsystem 262.
The control portion of subsystem 262 is operable to manage operations of the receiver SoC 202n (e.g., implement a state machine and/or other control logic that controls the configuration of the other components of the receive SoC 202n). The control portion of subsystem 262 may, for example, configure beamforming matrices used by the digital signal processing circuitry 256. For example, the control portion of subsystem 262 may determine that particular directions are of interest at a given time and may configure the beamforming to point beams in those particular directions. Particular directions may be of interest because, for example, it is desired to determine more information about objects located in that direction and/or to listen for communications from other transceivers 102 that are likely to come from that direction. Directions of interest may be determined based on, for example, data received via the data bus, data carried in previously received millimeter wave signals, and/or previously generated scene representations.
The memory portion of subsystem 262 is operable to store relatively large amounts (e.g., hundreds of megabits) of information of a variety of forms. For example, beamforming matrices, an identifier of the transceiver 102, scrambling codes, and messages received from (via data bus 212) and/or to be communicated to (via data bus 212 and/or via millimeter wave signals) other transceivers are just some examples of the information which may be stored in the memory and readily accessible to the SoC 202n.
Each of the Tx AFEs 272 is operable to receive an analog baseband signal from a respective one of ADCs 274, upconvert the signal to a millimeter wave (e.g., a 1 GHz to 5 GHz wide signal in the band from 76 to 81 GHz), and amplify the millimeter wave signal for output to a respective one of antenna elements 2101-2104.
Each of the ADCs 274 is operable to convert a digital signal 275 from the digital signal processing circuitry 276 to an analog representation. For example, each signal 275 may be a 1 GHz to 5 GHz wide baseband signal.
The digital signal processing circuitry 276 is operable to process one or more data streams from data processing circuitry 284 to generate a plurality (four in the example shown) of digital baseband signals 275. Processing performed by digital signal processing circuitry 276 may comprise, for example, encoding, interleaving, bit-to-symbol mapping, frequency mapping (mapping of symbols to subbands), modulation (e.g., using discrete Fourier transform and/or inverse discrete Fourier transform) beamforming, and/or the like.
The processing performed by the digital signal processing circuit 276 may comprise generating modulated signals 2751-2754 and/or generating a data signal to be modulated onto a carrier. As an example of the former case, the digital signal processing circuit 276 may output a continuous wave signal, or a chirp whose amplitude is modulated by a data signal whose frequency is relatively low (e.g., a few MHz) as compared to the channel frequency (e.g., between 76 GHz and 81 GHz). As another example of the former case, the digital signal processing circuit 276 may output an OFDM signal. As an example of the latter case, the digital signal processing circuit 276 may output a relatively low bandwidth data signal (e.g., a few MHz) which may modulate a millimeter wave chirp generated by the clock generator 280.
The processing performed by the digital signal processing circuit 276 may comprise beamforming. The beamforming may comprise time-domain beamforming and/or frequency-domain beamforming.
Data processing circuit 284 is operable to generate one or more data signals for modulation onto the millimeter wave signals transmitted by the SoC 204n. The datastreams may, for example, be read from memory of the SoC 202n (e.g., an identifier of the module 102n) and/or generated algorithmically (e.g., timestamps generated based on a clock of the control portion of subsystem 282). Additionally, or alternatively, the data may be received from bus 212 via bus controller 278. The data processing circuit 284 may packetize and/or otherwise format the data.
Bus controller 278 may be substantially similar to the bus controller 206 described above.
Clock generation circuit 280 is operable to generate a plurality of timing signals that are synchronized to the timing signal received via bus 216. The timing signals may comprise, for example: a local oscillator signal for upconversion of baseband signals to millimeter wave signals (e.g., in the 76 to 81 GHz range), a sampling clock for the DACs 274 (e.g., between 2 and 20 GHz), and one or more clocks for clocking the digital processing circuitry 276, the bus controller 278, and the control and memory subsystem 282.
The control portion of subsystem 282 is operable to manage operations of the receiver SoC 204n (e.g., implement a state machine and/or other control logic that controls the configuration of the other components of the receive SoC 204n). The control portion of subsystem 282 may, for example, configure beamforming matrices used by the digital signal processing circuitry 276. For example, the control portion of subsystem 282 may determine that particular directions are of interest at a given time and may configure the beamforming to point beams in those particular directions. Particular directions may be of interest because, for example, it may be desirable to determine more information about objects located in that direction and/or to listen for communications from other transceivers 102 that are likely to come from that direction. Directions of interest may be determined based on, for example, data received via the data bus 212, scene scanning algorithms, and/or the like.
The memory portion of subsystem 282 is operable to store relatively large amounts (e.g., hundreds of megabits) of information of a variety of forms. For example, beamforming matrices, and messages received from (via data bus 212 and/or millimeter wave signals) and/or to be communicated to (via data bus 212 and/or modulated onto millimeter wave radar signals) other transceivers are just some examples of the information which may be stored in the memory and readily-accessible to the SoC 204n.
Data modulated onto the millimeter wave signal may be forward error correction encoded for robustness. Data modulated onto the millimeter wave signal may be scrambled or encrypted for security (e.g., to prevent spoofing, sniffing of communications, etc.).
Although four beams/lobes are shown for illustration, the multifunctional radar transceivers are not limited to any particular number of beams/lobes. There may be different numbers of beams at different times based on, for example, the number of objects and/or angles of objects it is determined necessary or desirable to identify or track at any given time. There may be different numbers of beams at different times based on, for example, number and/or location of other transceivers with which it is necessary or desirable to communicate at any given time. Similarly, the directions of the beams may vary over time. For example, the directionality of any one or more of the beams 402, 404, 406, and 408 may change periodically, based on what is detected in the scene, based on desired communication to be sent or received, and/or the like.
Now referring to
In block 704, the transceiver 102 transmits a signal using the currently set beamforming coefficient vector (i.e.,
Referring briefly to
In block 708, the measured antenna pattern is analyzed to determine whether it is acceptable (e.g., side lobes below some threshold) and/or optimal (e.g., side lobes levels as low as can be obtained.) If not, then the process advances to block 710.
In block 710, the system determines a new beamforming coefficient vector, denoted
In block 712, the beamforming coefficients of transceiver 102a are set to
Returning to block 708, once a suitable and/or optimal value of
and where the matrix
In block 716,
In accordance with an example implementation of this disclosure, a multifunctional radar transmitter comprises bus interface circuitry (e.g., 278) and beamforming circuitry (e.g., part of 276). The beamforming circuitry, with use of a plurality of beamforming coefficients, is operable to process a plurality of baseband signals to generate a millimeter wave radar burst corresponding to a radiation pattern that comprises a first lobe (e.g., “desired 1 of
The present method and/or system may be realized in hardware, software, or a combination of hardware and software. The present methods and/or systems may be realized in a centralized fashion in at least one computing system, or in a distributed fashion where different elements are spread across several interconnected computing systems. Any kind of computing system or other apparatus adapted for carrying out the methods described herein is suited. A typical combination of hardware and software may be a general-purpose computing system with a program or other code that, when being loaded and executed, controls the computing system such that it carries out the methods described herein. Another typical implementation may comprise an application specific integrated circuit or chip. Some implementations may comprise a non-transitory machine-readable (e.g., computer readable) medium (e.g., FLASH drive, optical disk, magnetic storage disk, or the like) having stored thereon one or more lines of code executable by a machine, thereby causing the machine to perform processes as described herein.
While the present method and/or system has been described with reference to certain implementations, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the present method and/or system. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the present disclosure without departing from its scope. Therefore, it is intended that the present method and/or system not be limited to the particular implementations disclosed, but that the present method and/or system will include all implementations falling within the scope of the appended claims.
As utilized herein the terms “circuits” and “circuitry” refer to physical electronic components (i.e. hardware) and any software and/or firmware (“code”) which may configure the hardware, be executed by the hardware, and or otherwise be associated with the hardware. As used herein, for example, a particular processor and memory may comprise a first “circuit” when executing a first one or more lines of code and may comprise a second “circuit” when executing a second one or more lines of code. As utilized herein, “and/or” means any one or more of the items in the list joined by “and/or”. As an example, “x and/or y” means any element of the three-element set {(x), (y), (x, y)}. In other words, “x and/or y” means “one or both of x and y”. As another example, “x, y, and/or z” means any element of the seven-element set {(x), (y), (z), (x, y), (x, z), (y, z), (x, y, z)}. In other words, “x, y and/or z” means “one or more of x, y and z”. As utilized herein, the term “exemplary” means serving as a non-limiting example, instance, or illustration. As utilized herein, the terms “e.g.,” and “for example” set off lists of one or more non-limiting examples, instances, or illustrations. As utilized herein, circuitry is “operable” to perform a function whenever the circuitry comprises the necessary hardware and code (if any is necessary) to perform the function, regardless of whether performance of the function is disabled or not enabled (e.g., by a user-configurable setting, factory trim, etc.). As used herein, “microwave” frequencies range from approximately 300 MHz to 300 GHz and “millimeter wave” frequencies range from approximately 30 GHz to 300 GHz. Thus, the “microwave” band includes the “millimeter wave” band.
This application claims priority to the following application(s), each of which is hereby incorporated herein by reference: U.S. provisional patent application 62/160,015 titled “Calibration of a Multifunctional Automotive Radar System” filed on May 12, 2015.
Number | Name | Date | Kind |
---|---|---|---|
3725938 | Black | Apr 1973 | A |
8947294 | Wasiewicz | Feb 2015 | B1 |
20110109495 | Takeya | May 2011 | A1 |
20120268325 | Hansen | Oct 2012 | A1 |
20120299773 | Stirling-Gallacher | Nov 2012 | A1 |
Entry |
---|
Wikipedia article, “Beamforming”, Mar. 17, 2016 version (Year: 2016). |
Number | Date | Country | |
---|---|---|---|
20160334511 A1 | Nov 2016 | US |
Number | Date | Country | |
---|---|---|---|
62160015 | May 2015 | US |