Various embodiments of the present disclosure are generally directed to a method and apparatus for generating and processing pulses in a light detection and ranging (LiDAR) system.
Without limitation, some embodiments provide an emitter which outputs phase modulated continuous wave (PMCW) light sequences encoded with a selected encoding scheme such as a pseudo-random bit sequence (PRBS). An analog processing circuit processes reflected light sequences from a potential target illuminated by the PMCW light sequences by performing analog extraction of a doppler component and analog encoding correlation prior to digitalization of the received signal.
The analog processing circuit can include a plurality of demodulation stages each multiplying the input signals by positive and negative magnitudes of a scalar value at times corresponding to signal transitions of a different associated doppler clock frequency. A threshold circuit applies suitable thresholding, after which the signals are digitized by an analog-to-digital converter (ADC) for further processing in the digital domain to obtain range information associated with the detected target.
These and other features and advantages of various embodiments can be understood from a review of the following detailed description in conjunction with a review of the accompanying drawings.
Various embodiments of the present disclosure are generally directed to optimization of an active light detection system.
Light Detection and Ranging (LiDAR) systems are useful in a number of applications in which range information (e.g., distance, velocity, etc.) regarding a target is detected by irradiating the target with electromagnetic radiation in the form of light. The range information is determined in relation to timing characteristics of reflected light received back by the system. LiDAR applications include topographical mapping, guidance, surveying, and so on. One increasingly popular application for LiDAR is in the area of autonomously piloted or driver assisted vehicle guidance systems (e.g., self driving cars, autonomous drones, etc.). While not limiting, the light wavelengths used in a typical LiDAR system may range from ultraviolet to near infrared (e.g., 250 nanometers, nm to 1550 nm or more). Other wavelength ranges can be used.
There are a number of ways in which the emitted light from a LiDAR system can be emitted and detected. Examples include coherent, incoherent, pulsed wave, frequency modulated continuous wave (FMCW), phase modulated continuous wave (PMCW), and others.
A PMCW LiDAR system applies phase encoding to a continuous wave light beam to determine range and velocity of a given target. A PMCW based system generally operates to change the phase of the transmitted signal according to a certain pattern or code, sometimes referred to as the spreading code. The transmitted signal can be phase modulated by mixing a baseband signal with a local oscillator to generate a transmitted signal with a phase that is changed corresponding to the baseband signal. The phase may be modulated using a random signal from a random number generator (RNG) source, a cyclical pseudo-random signal from a pseudo-random bit sequence (PRBS) source, or from some Other modulation source.
For a single transmitter, a sequence of phase values that form the spreading code that has good autocorrelation properties is usually utilized to minimize ghost targets in the received signal. The rate at which the phase is modulated determines the bandwidth of the transmitted signal and is called the chip rate.
In a PMCW based LiDAR system, the detector (receiver) performs correlations of the received signal with time-delayed versions of the transmitted signal and searches for peaks in the correlation. The time-delay of the transmitted signal that yields peaks in the correlation corresponds to the delay of the transmitted signal when reflected off of a down range target. The distance to the target can be determined based on the time delay and the speed of light in the applicable medium. The phase encoding usually requires decoding in order to make an accurate determination of the range information, and this can be confounded by the addition of a doppler component induced by the velocity of the target.
Existing generation PMCW LiDAR systems tend to perform such decoding at the detector stage by digitizing the received signal at a high sample rate and applying digital signal processing operations such as via a digital signal processor (DSP) or other digital circuitry. While operable, this can require the use of a fast, high sample rate analog to digital converter (ADC) as well as a complex digital processor to perform fast and real-time computations.
Accordingly, various embodiments of the present disclosure are directed to an apparatus and method for performing detection decoding of a phase modulated continuous wave (PMCW) LiDAR signal using an analog regime. In some embodiments, analog processing is provided, after which the resulting data may be converted to a digital form and fed into a DSP or other digital processing circuitry for downstream analysis (e.g., a visualizer, an artificial intelligence neural network, etc.).
Instead of performing high sample rate digitalization of the input data, the bulk of the signal processing of the PMCW input data is carried out by various embodiments in the analog domain using specially configured analog processing circuitry. All of the processing can be completed in the analog domain so that the resulting range information is obtained using the analog processing circuitry, or the results of the analog processing stage can be fed forward via an ADC into digital processing circuitry for further processing to arrive at the range information. Analog domain processing as described herein provides certain advantages and efficiencies, including the ability to capture and/or filter frequency spectra that would otherwise normally be filtered out by the upstream digitalization step.
While not limiting, it is contemplated that the various embodiments enable ADC speeds to be reduced in range from hundreds of MHz (106 Hz) or more, to tens of MHz or less. It is further contemplated that such analog decoding techniques described herein can enhance processing speed and resolution, facilitate higher bandwidth, reduce circuit complexity, cost and power consumption levels, as well as provide other benefits.
These and other features can be understood beginning with a review of
The LiDAR system 100 includes a controller 104 which provides top level control of the system. The controller 104 can take any number of desired configurations, including hardware and/or software. In some cases, the controller can include the use of one or more programmable processors with associated programming (e.g., software, firmware) stored in a local memory which provides instructions that are executed by the programmable processor(s) during operation. Other forms of controllers can be used, including hardware based controllers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), system on chip (SOC) integrated circuits, application specific integrated circuits (ASICs), gate logic, reduced instruction set computers (RISCs), etc.
An energy source circuit 106, also sometimes referred to as an emitter or a transmitter, operates to direct electromagnetic radiation in the form of light pulses toward the target 102. A detector circuit 108, also sometimes referred to as a receiver or a sensor, senses reflected light pulses received back from the target 102. The controller 104 directs operation of the emitted light from the emitter 106, denoted by arrow 110, and decodes information from the reflected light obtained back from the target, as denoted by arrow 112.
Arrow 114 represents the actual, true range information associated with the intervening distance (or other range parameter) between the LiDAR system 100 and the target 102. Depending on the configuration of the system, the range information can include the relative or absolute speed, velocity, direction, acceleration, distance, size, location, reflectivity, color, surface features and/or other characteristics of the target 102 with respect to the system 100.
The decoded range information can be used to carry out any number of useful operations, such as controlling a motion, input or response of an autonomous vehicle, generating a topographical map, recording data into a data structure for further analysis and/or operations, etc. The controller 104 perform these operations directly, or can communicate the range information to an external control system 116 for further processing and/or use.
In some cases, inputs supplied by the external control system 116 can activate and configure the system 100 to capture particular range information, which is then returned to the system 116 by the controller 104. The external system 116 can take any number of suitable forms, and may include a system controller (such as CPU 118), local memory 120, etc. The external system 116 may form a portion of a closed-loop control system and the range information output by the LiDAR system 100 can be used by the external system 116 to adjust the position of a moveable element.
As noted above, the controller 104 can take a number of forms. In some embodiments, the controller 104 incorporates one or more programmable processors (CPU) 122 that execute program instructions in the form of software/firmware stored in a local memory 124, and which communicate with the external controller 118.
An additional number of systems 126 can provide information to the external control system 116 and/or the LiDAR system 100. The external systems 126 can take any number of forms including but not limited to environmental sensors (e.g., temperature sensors, moisture sensors, timers, ambient light level sensors, ice detectors, etc.), cameras, geopositioning systems (e.g., global positioning systems, GPS), radar systems, proximity sensors, speedometers, etc.
The emitted light is processed by an output system 208 to issue a beam of emitted light 210 in a desired scanning pattern. The output system 208 can take a variety of forms including but not limited to a rotatable polygon, a solid-state array, a micro-mirror device, etc. It is contemplated that the emitted light will be in the form of phase modulated continuous wave (PMCW) light that is scanned by the output system 208 along one or multiple axial directions. As such, the PMCW light may be phase modulated using an encoder block 212, which encodes information into the output light sequences emitted by the system.
The encoder 212 may take a variety of forms based on the requirements of a given application. In some embodiments, the encoder 212 is a pseudo-random bit sequence (PRBS) generator which generates a pseudo-random bit sequence generated deterministically from a predetermined polynomial function. The signals may be periodic in nature so that one period of the PRBS can be selected to correspond to each LiDAR point beam in the sequence, although such is not necessarily required.
Other forms of encoding can be applied by the encoder 212, however, so that the various embodiments presented herein are not necessarily limited to PRBS encoding. In other embodiments, a random number generator (RNG) source can be used to provide each emitted beam point sequence with a unique code, predetermined sequences can be stored and used as required, etc. The manner in which the PMCW pulses are generated can vary and is not limiting. In some cases, the phase is shifted in a binary manner from 0 to π and the sequence of bits is randomly adjusted in relation to the PRBS or other encoding mechanism. In other cases, the output light at a continuous frequency does not necessarily have to have a duty cycle of 100%; rather, the light can be pulsed such as with a 10% duty cycle (on-time), 50% duty cycle, etc. with the phase being modulated within each pulse with the various encoding schemes described above. Other configurations can be used.
The FoV 300 in
The system 200 of
As explained below, the output of the front end 404 is processed by an analog processing circuit 406 which provides processing of the input signals in the analog domain. Once this processing is completed, the output from the analog processing circuit 406 may be converted to digital form using an analog to digital converter (ADC) 410, and this output is in turn further processed by a digital processing circuit 410 such as a DSP as required to generate a useful output 412. Of particular interest is the configuration and operation of the analog processing circuit 406, which will now be discussed with reference to
It is contemplated albeit not necessarily required that the output range information will have a resolution on the order of about 1 MHz, although other configurations can be used. The upstream digitization of the data will require a significantly higher resolution, such as on the order of 100 MHz or more.
In current generation detectors, it will be understood that PMCW light patterns are encoded, transmitted, received, and digitized prior to substantive processing using various signal processing techniques. As explained above, such current generation processing in the digital domain can include correlation operations of the received signal with time-delayed versions of the transmitted signal (from the emitter) to locate peaks in the correlation response. While operable, such processing has a number of limitations, including loss of resolution due to the sampling rate, the need for expensive and high-powered ADC circuitry, and high powered, complex circuitry to carry out the necessary signal processing.
By contrast, various embodiments of the present disclosure carry out the processing of received PMCW light signals in the analog domain in accordance with
The analog processing circuit 700 receives quadrature I and Q inputs obtained using mixer circuits as known in the art and which are provided to an analog filter operator block 702. The block 702 operates as a filter to clean up the signal and reduce non-desired frequency components, so that components of interest are passed on through remaining portions of the circuit.
The filtered signal is next passed to an array of demodulation blocks, also referred to as demodulation (DEM) channels 704. A total of N channels are provided. The number N can be any suitable plural value (e.g., 8, 16, etc.). Each DEM channel 704 can be tuned to a different frequency response, or can have the same demodulation characteristics.
A threshold circuit 706 applies one or more predetermined threshold levels to the outputs of the DEM channels. The output of the threshold circuit 706 is thereafter applied to an ADC 708, generally corresponding to the ADC 408 in
A doppler clock circuit is denoted at 710. This provides a clock signal at a selected frequency with repetitively occurring transitions Ti (such as positive going transitions). The resolution can vary based on different channels and is in a range to enable detection of doppler shift characteristics in the input signal.
The clock 710 is supplied to a timing circuit T 712 which detects each transition Ti and supplies a corresponding input to a multiplier block 714 in response thereto. The multiplier block 714 operates, in conjunction with the clock 710 and circuit 712, such that the input signal is multiplied by respective positive and negative values of a scaler value X at each transition Ti. At times other than the transitions Ti, the output of the multiplier block 714 goes to zero (0). It will be noted that if the actual doppler shift in the input signals (Tdoppler) is equal to Ti, then the circuit is perfectly matched and each input pulse will be multiplied (e.g., when Tdoppler=Ti, then all input pulses will be multiplied by the multiplier 714).
The output of the multiplier block 714 is supplied to an analog correlator block 716 which applies a transfer function hPRBS(−n) to correlate the received output sequence to the input sequence (such as from encoder 212,
As described herein, in contrast to some techniques known in the art, the analog processing circuit 700 may perform doppler removal at very high speeds by alternating the signal along the respective channels at the given frequencies, which may provide valuable enhancements over the existing art (e.g., by potentially reducing ADC speeds to tens of MHz or less, enhancing processing speed and resolution, increasing bandwidth, and/or reducing circuit complexity, cost and power consumption levels).
The pulse sequence is directed toward a target 808 within the associated FoV (see
In some cases, the transmitter (emitter) 804 includes a timing circuit 814 which operates to establish a time (e,g, a first time stamp) at which each emitted pulse sequence 806 is emitted. A corresponding timing circuit 816 can be incorporated into the receiver (decoder) 812, which identifies the time (e,g, a second time stamp) when the amplitude threshold circuit (e.g., 706,
A system such as 100, 800 is initialized at 902 for operation. The transitioning of the system to an operational state can include the configuration of a baseline FoV, block 904, and the establishment of suitable PMCW parameters, block 906. It will be noted that the PMCW profiles will be specially configured for analog detection as described herein.
The system transitions to normal operation at block 908 in which the emitter (e.g.,
The output data are digitized and processed at block 912 to output the desired range information regarding the potential targets illuminated in block 908. As desired, adaptive adjustments are made to the operation of the system at block 914, including changes in the emitted patterns of PMCW light, threshold levels, clock values, gain values, voltage thresholds, etc. in order to improve detection. As described above, this can include the use of profiles, learning systems, AI, visualization systems, etc.
The system 1000 includes an adaptive analog decoding manager 1002 which receives various inputs from the system including system configuration information, measured distances, various sensed parameters (both operational and environmental), history data based on previous detections, and various user selectable inputs to enable operation under different operational conditions.
Outputs by the manager circuit 1002 can be supplied to local memory to store history data 1004 and various operational profiles 1006 for different operational modes and conditions. Input control values are further supplied to a transmitter (Tx) 1008, corresponding to the emitters discussed above, and to a receiver (Rx) 1010, corresponding to the detectors discussed above.
In further embodiments, the manager circuit 1002 can include a learning system 1012 that utilizes inputs that can be processed at the digital stage level to assist in target processing, and a doppler shift adjustment circuit 1014 that can adaptively adjust various parameters to enhance operation of the analog domain processing stage.
While various embodiments have contemplated PRBS encoding to differentiate the PMCW sequences, other forms of encoding are contemplated and will be processed in similar fashion. The embodiments herein are contemplated as being particularly suitable for autonomous vehicle systems and related driver assistance guidance systems, but substantially any PMCW application can benefit from the various embodiments disclosed herein.
It is to be understood that even though numerous characteristics and advantages of various embodiments of the present disclosure have been set forth in the foregoing description, together with details of the structure and function of various embodiments of the disclosure, this detailed description is illustrative only, and changes may be made in detail, especially in matters of structure and arrangements of parts within the principles of the present disclosure to the full extent indicated by the broad general meaning of the terms in which the appended claims are expressed.
The present application makes a claim of domestic priority to U.S. provisional patent application No. 63/240,597 filed Sep. 3, 2021, the contents of which are hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
63240597 | Sep 2021 | US |