The present invention relates generally to the field of vehicle or robot or automated equipment safety and efficiency, and more particularly to the use of cost-effective robust time-of-flight (ToF) lidar sensors for real-time wide-field-of-view three-dimensional mapping and object detection, tracking and/or classification under a broad range of conditions, including adverse weather conditions, high optical noise, and weak reflections.
A lidar sensor is a light detection and ranging sensor. It is an optical remote sensing module that can measure the distance to a target or objects in a landscape, by irradiating the target or landscape with light, using pulses (or alternatively a modulated signal) from a laser, and measuring the time it takes photons to travel to said target or landscape and return after reflection to a receiver in the lidar module. The waveforms of the reflected pulses are detected and analyzed to determine which pulses represent reflections from solid objects whose sensing is desired (e.g., vehicle, person, wall, tree) as opposed to errant pulses reflected by environmental elements whose sensing is not desired (e.g., rain, dust). Errant pulses can have a low intensity (due to the small size or low reflectivity of the element causing the reflection) and/or a broadened width (due to the diffuse reflection obtained in backscattering). When one outgoing pulse generates multiple return pulses, the detection and analysis of the return pulses allow the selection of the pulse that corresponds to the object whose sensing is desired, with the time of flight and the intensity of the selected pulse being measures of the distance and the reflectivity of the sensed object, respectively.
Conventional waveform digitization and analysis permit accurate measurements of reflected laser pulses, however the method is expensive due to the costly components needed, such as fast Analog-to-Digital Converters (ADCs) that digitize the pulses (per U.S. Pat. No. 7,969,558), and field-programmable gate arrays (FPGAs) or fast digital signal processors (DSPs) that process the data.
Lower cost pulse width ToF methods have been developed more recently. In this approach, pulses that cross a voltage threshold trigger a Time-to-Digital Converter (TDC), which records the time of the event. A computer locates the pulse with the largest width, and uses a correlation table to compensate for “walk” error and calculate an assumed intensity. This low-cost approach has significant performance issues, including:
It can miss low intensity pulses that do not cross the voltage threshold trigger; this problem cannot be solved by lowering the voltage threshold trigger setting, as this change would increase the noise level
It incorrectly interprets returns from environmental elements whose sensing is not desired (e.g., rain, fog, dust), as a single pulse width measurement on a waveform can be ambiguous since it provides no information on the waveform shape, therefore not enabling to distinguish narrow waveforms of pulses reflected by objects whose sensing is desired from broadened waveforms backscattered by environmental elements whose sensing is not desired (e.g., rain, fog, dust)
It conventionally records only one to a few return pulses, making it unreliable in poor weather, when a large number of errant pulses are commonly reflected in addition to the desired reflected pulse.
A lidar-based apparatus and method are used for multi-signal detection, weak signal detection and signal disambiguation through waveform approximation utilizing a multi-channel time-to-digital converter (TDC) electronic circuit, with each TDC having an individually adjustable voltage threshold. This advanced TDC-based pulse width time-of-flight (ToF) approach achieves the low cost associated with the TDC-based pulse width ToF approach while solving the signal quality issues associated with the standard single-threshold TDC-based approach.
The following drawings are illustrative of embodiments of the present invention and are not intended to limit the invention as encompassed by the claims forming part of the application.
The schematic diagram of
The schematic diagram of
A lidar-based apparatus and method are used for multi-signal detection, weak signal detection and signal disambiguation through waveform approximation utilizing a multi-channel time-to-digital converter (TDC) electronic circuit, with each TDC having an individually adjustable voltage threshold. This advanced TDC-based pulse width ToF approach achieves the low cost associated with the TDC-based pulse width ToF approach while solving the signal quality issues associated with the standard single-threshold TDC-based approach: (1) the lowest voltage threshold is set sufficiently low to avoid missing low intensity pulses; (2) the waveform approximation achieved with multiple voltage thresholds eliminates ambiguity about the shape of incoming pulses, allowing to sort between reflections from objects whose sensing is desired and backscattering from environmental elements whose sensing is not desired (e.g., rain, dust), as the latter causes a broadening in the waveform; when two voltage thresholds are used, a trapezoidal waveform approximation is obtained; when four voltage thresholds are used, the waveform approximation obtained is substantially similar to the result obtained with the significantly more expensive conventional waveform digitization approach; (3) it further enhances poor weather performance, when a large number of errant pulses are commonly reflected in addition to the desired reflected pulse, as it is capable of recording virtually unlimited pulses by means of a data buffer and a high speed data bus. The multi-channel TDC electronic circuitry with multiple voltage thresholds can be implemented with discrete integrated circuits (ICs), in the form of FPGA logic, as part of an application-specific integrated circuit (ASIC), or integrated into the pixels of a detector array (e.g., Single-Photon Avalanche Diode [SPAD] array).
The present Application claims the benefit of priority from U.S. Provisional Application Ser. No. 61/757,222, filed Jan. 27, 2013. U.S. Patent Documents5,455,669October 1995Wetteborn7,295,298 B2November 2007Willhoeft7,345,271 B2March 2008Boehlau7,570,793 B2August 2009Lages7,684,590 B2March 2010Kämpchen7,746,271 B2June 2010Fürstenberg7,746,449 B2June 2010Ray7,969,558 B2June 2011Hall2011/0216304 A1September 2011Hall2011/0313722 A1December 2011Zhu
Number | Date | Country | |
---|---|---|---|
61757222 | Jan 2013 | US |