This application relates to detection technologies, and is applied to the fields such as intelligent driving, intelligent transportation, surveying and mapping, and intelligent manufacturing, and in particular, to a detection control method and an apparatus.
With development of information technologies and computer vision, a detection technology is developed rapidly, and various detection apparatuses bring great convenience to people's life and travel. For example, an advanced driver assistance system (ADAS) plays a very important role in intelligent vehicles. The ADAS uses a detection apparatus installed on a vehicle to detect an ambient environment, collect data, and identify a still object and a moving object in a driving process of the vehicle, and performs a systemic operation and systemic analysis with reference to map data of a navigator. In this way, a driver perceives a potential danger in advance, to effectively improve driving comfort and safety of the vehicle. The detection apparatus may be considered as an “eye” of an electronic device (e.g., a vehicle, a robot, or an uncrewed aerial vehicle) for sensing an environment, and includes a visual sensor like a camera and a radar sensor like a millimeter-wave radar, a lidar, and an ultrasonic radar. The lidar (Lidar) has high resolution, good detection performance, and strong concealment, and is one of important detection apparatuses in sensing.
As a requirement for a sensing result is increasingly high, a multi-channel and high-parallelism requirement for the lidar is also increasingly high. However, a real-time, multi-channel, and high-parallelism lidar imposes high requirements on manufacturability and costs of a chip of the lidar.
How to improve detection performance of the lidar without significantly increasing hardware design complexity and costs is a hot topic that is being studied by a person skilled in the art.
Embodiments of this application provide a detection control method and an apparatus, to improve effectiveness of a detection signal, so as to further improve detection performance of a lidar.
According to a first aspect, an embodiment of this application discloses a detection control method, including:
The first time window is related to the first time location and first duration, the first time window includes the first time location, and the first duration is predefined or preconfigured.
The method may be performed by a control apparatus. Optionally, the control apparatus may be a control apparatus in a detection apparatus, or may be a controller (e.g., a controller in a vehicle) connected to a detection apparatus. The detection apparatus includes the laser emitting unit and the laser detection unit. For example, the detection apparatus may be a lidar.
In a design, duration for receiving the first echo signal is greater than a length of the first time window.
In this embodiment of this application, a first phase of laser detection is used to determine a time location, and a second phase of laser detection is used for target detection in a time window including the first time location. In one aspect, when performing detection, the current detection apparatus usually receives an echo signal in entire duration of a detection time. Duration of the first time window (namely, the first duration) in the second phase of detection process in this embodiment of this application is usually less than duration of an original detection time (e.g., a detection time in the first time of detection process). The laser detection unit receives the echo signal in the first time window, so that a time for receiving the echo signal is shortened, and further detected data obtained based on the echo signal is also reduced. Consequentially, an amount of data that needs to be processed is reduced. In another aspect, a time location for receiving the echo signal in the second phase of detection process is positioned based on the time location and the first duration. In this case, the echo signal may not be received at a time location that does not belong to the first time window, so that an unrelated signal can be prevented from affecting a detection effect, effectiveness of the received echo signal is improved, and detection performance of the lidar is improved.
In a possible scenario, the time location is an interesting time location obtained after the first phase of detection. Therefore, in the second phase of detection process, a detection area corresponding to the time location is specially detected, so that a detection time is shortened, to compress an amount of data in the detection process. This improves effectiveness of a detection signal, and improves the detection performance of the lidar.
With reference to the first aspect, in a possible implementation of the first aspect, the first time location corresponds to a first feature signal. The first feature signal includes at least one of a pulse signal, a peak signal, a rising-edge signal, or the like.
For example, the first time location may be a time location at which the first feature signal is located. The first feature signal may indicate a special waveform feature.
In a possible scenario, the feature signal represents that there may be a target object in the detection area. Therefore, detection may be performed again at the time location at which the feature signal is located, so that a predicted target object can be detected, to improve the effectiveness of the detection signal.
With reference to the first aspect, in another possible implementation of the first aspect, the first feature signal may be obtained based on the first echo signal. For example, an electrical signal may be obtained based on the first echo signal, and the electrical signal may include at least one feature signal. The first feature signal may belong to the at least one feature signal.
With reference to the first aspect, in another possible implementation of the first aspect, the feature signal may be a signal having the special waveform feature. The signal having the special waveform feature may be a signal reflected by the target object, and a time location of the signal returned by the predicted target object is obtained. Therefore, a time window may be obtained, and the predicted target object is detected again in the time window.
With reference to the first aspect, in another possible implementation of the first aspect, the first duration is related to duration of the laser signal. For example, the first duration may indicate a width of the time window. For example, if the duration of the laser signal is 10 milliseconds (ms), the first duration may be set to 10 ms, or may be slightly greater than 10 ms or slightly less than 10 ms. If the echo signal returned by the target object exists at the first time location, because the width of the time window is related to the duration of the laser signal, the echo signal (corresponding to a continuous laser signal) continuously returned by the target object can be received, to improve accuracy of a detection result.
In a design, the control apparatus may control the duration of the laser signal emitted by the laser emitting unit, and the control apparatus may further control the width of the time window for receiving the echo signal by the laser detection unit. The duration of the laser signal is related to (e.g., equal to) the width of the time window.
With reference to the first aspect, in another possible implementation of the first aspect, the first control signal further indicates a second time location, and the first time window further includes the second time location.
With reference to the first aspect, in another possible implementation of the first aspect, the first control signal further indicates a second time location; and the controlling, based on the first control signal, the laser detection unit to receive a second echo signal in a first time window includes:
The foregoing describes a possible design of a control signal. The first control signal may indicate a plurality of time locations. Correspondingly, the laser detection unit may be controlled to perform detection in a plurality of time windows (each time window includes at least one of the plurality of time locations), to improve detection efficiency.
With reference to the first aspect, in another possible implementation of the first aspect, the first control signal further indicates a third time location, and the method further includes:
The foregoing describes another possible design of a control signal. The first control signal may indicate a plurality of time locations. The detection apparatus may perform a plurality of times of laser emission and a plurality of times of detection. In each laser emission and detection process, the detection unit is controlled to receive the echo signal in one or more time windows. Through the plurality of times of detection, an amount of data that needs to be processed after each time of detection can be reduced, and a data processing speed of a data processing module can be adapted to. Further, through the plurality of times of detection, in each detection process, a time for receiving an echo signal by a detector is short, so that detection accuracy can be improved, mutual interference between echo signals can be avoided, and the accuracy of the detection result can be improved.
With reference to the first aspect, in another possible implementation of the first aspect, the method further includes:
The foregoing describes another possible design of a control signal. A plurality of control signals may be output by using the first echo signal. The plurality of control signals may indicate a plurality of time locations. The detection apparatus may perform a plurality of times of laser emission and a plurality of times of detection based on the plurality of control signals. In each laser emission and detection process, the detection unit is controlled to receive the echo signal in one or more time windows (each time window includes at least one of the plurality of time locations). Through the plurality of times of detection, an amount of data that needs to be processed after each time of detection can be reduced, and a data processing speed of a data processing module can be adapted to. Further, through the plurality of times of detection, in each detection process, a time for receiving an echo signal by the detector is short, so that detection accuracy can be improved, mutual interference between echo signals can be avoided, and the accuracy of the detection result can be improved.
With reference to the first aspect, in another possible implementation of the first aspect, the laser detection unit includes at least one detection element. The detection element may obtain an electrical signal based on an optical signal. Optionally, the detection element may be one of a semiconductor avalanche photodiode (avalanche photo detector, APD), a single-photon avalanche diode (SPAD), an electron multiplying charge-coupled device (EMCCD), or the like.
With reference to the first aspect, in another possible implementation of the first aspect, the laser detection unit includes at least one single-photon detection element. The single-photon detection element has sensitivity of detection a single photon, and may also respond to a weak optical signal (e.g., a single photon), to obtain an electrical signal.
For example, the single-photon detection element may be an APD, an SPAD, or the like.
When the detection element of the laser detection unit is sensitive, a very weak optical signal from the detection area also makes the detection element saturated. However, the saturated detection element needs a specific time to restore a status, and cannot perform detection within a recovery time (also referred to as deadtime). If an optical signal of the target object reaches the detector within the recovery time, the optical signal may not be detected by the detection element. As a result, a true echo signal is submerged by a previous interference signal, and missed detection occurs on the signal. However, in this embodiment of this application, in the second phase of detection process, the detection element performs detection in the time window, so that a case in which the echo signal of the target object is submerged by the previous interference signal can be avoided or reduced, to improve the accuracy of the detection result.
With reference to the first aspect, in another possible implementation of the first aspect, the laser detection unit may be in an array form, for example, an array of a specification like a 1×2 array, a 2×3 array, or a 3×3 array. This is not limited in this application.
The laser detection unit in the array form may increase a detection field of view. In some possible designs, the laser detection unit in the array form may obtain pixel information of the detection area.
With reference to the first aspect, in another possible implementation of the first aspect, the laser detection unit includes a plurality of detection elements, and one detection element corresponds to an output signal of one pixel.
The first feature signal includes a signal obtained by performing superposition processing on output signals of adjacent pixels, and the adjacent pixels correspond to at least two adjacent detection elements in the laser detection unit.
The foregoing describes a process of obtaining the first feature signal. In a subsequent detection process, detection may be performed on a time location at which the feature signal is located, and detection is not performed on a location at which no feature signal exists. To avoid missed detection of a signal, output signals may be superposed, so that the feature signal is more obvious.
With reference to the first aspect, in another possible implementation of the first aspect, the method is applied to a laser detection apparatus.
A start time of the first time window is after a fourth time location or is the same as a fourth time location; and the fourth time location corresponds to a distance from the laser emitting unit to a first optical element, and the first optical element is an outermost optical element that belongs to the laser detection apparatus and that is in an emitting optical path of the second laser signal.
The foregoing describes a design of a time window. One or more optical elements, such as a lens, a diffuser, and a window, are usually disposed in the laser detection apparatus. The optical element reflects an optical signal. When the detection element is sensitive, an optical signal returned by an optical element of the laser detection apparatus may cause saturation of the detection element, and consequently, the echo signal is submerged. In the foregoing design, detection is performed after an optical signal returned by an outermost optical element reaches the detection element, so that the true echo signal can be prevented from being submerged. This reduces an amount of data, avoids missed detection of a signal, and improves the signal effectiveness and the accuracy of the detection result.
With reference to the first aspect, in another possible implementation of the first aspect, the outputting a first control signal based on the first echo signal includes:
The foregoing describes a design for determining a time location. The laser detection unit may receive the first echo signal, and obtain the electrical signal (namely, the to-be-detected signal) based on the first echo signal. A signal detection module may detect the to-be-detected signal, to determine the first time location.
With reference to the first aspect, in another possible implementation of the first aspect, the method further includes:
With reference to the first aspect, in another possible implementation of the first aspect, the controlling a laser emitting unit to emit a first laser signal includes:
With reference to the first aspect, in another possible implementation of the first aspect, the controlling the laser emitting unit to emit a second laser signal includes:
With reference to the first aspect, in another possible implementation of the first aspect, the controlling a laser detection unit to receive a first echo signal including a reflected signal corresponding to the first laser signal includes:
According to a second aspect, an embodiment of this application discloses a detection apparatus. The detection apparatus includes a laser emitting unit, a laser detection unit, and at least one processing unit.
The at least one processing unit is configured to control the laser emitting unit to emit a first laser signal, and is configured to control the laser detection unit to receive a first echo signal including a reflected signal corresponding to the first laser signal.
The at least one processing unit is further configured to output a first control signal based on the first echo signal, where the first control signal indicates a first time location.
The at least one processing unit is further configured to control the laser emitting unit to emit a second laser signal.
The at least one processing unit is further configured to control, based on the first control signal, the laser detection unit to receive a second echo signal in a first time window. The second echo signal includes a reflected signal corresponding to the second laser signal, and the second echo signal is used for target detection.
The first time window is related to the first time location and first duration, the first time window includes the first time location, and the first duration is predefined or preconfigured.
The at least one processing unit includes at least one integrated circuit and/or at least one digital signal processor.
In a possible implementation of the second aspect, the first time location corresponds to a first feature signal, the first feature signal is obtained based on the first echo signal, and the first feature signal includes at least one of a pulse signal, a peak signal, a rising-edge signal, or the like.
In another possible implementation of the second aspect, the first control signal further indicates a second time location, and the first time window further includes the second time location.
In another possible implementation of the second aspect, the first control signal further indicates a second time location, and the at least one processing unit is further configured to:
In another possible implementation of the second aspect, the first control signal further indicates a third time location.
The at least one processing unit is further configured to control the laser emitting unit to emit a third laser signal.
The at least one processing unit is further configured to control, based on the first control signal, the laser detection unit to receive a third echo signal in a third time window, where the third echo signal includes a reflected signal corresponding to the third laser signal, the third echo signal is used for target detection, the third time window is related to the third time location and the first duration, and the third time window includes the third time location.
In another possible implementation of the second aspect, the laser detection unit includes at least one single-photon detection element.
In another possible implementation of the second aspect, the laser detection unit includes a plurality of detection elements, and one detection element corresponds to an output signal of one pixel.
The first feature signal includes a signal obtained by performing superposition processing on output signals of adjacent pixels, and the adjacent pixels correspond to at least two adjacent detection elements in the laser detection unit.
In another possible implementation of the second aspect, the detection apparatus includes at least one optical element.
A start time of the first detection time window is after a fourth time location or is the same as a fourth time location; and the fourth time location corresponds to a distance of the second laser signal from the laser emitting unit to a first optical element in the at least one optical element, and the first optical element is an outermost optical element that belongs to the detection apparatus and that is in an emitting optical path of the second laser signal.
In another possible implementation of the second aspect, the laser detection unit is further configured to obtain a to-be-detected signal based on the first echo signal.
The at least one processing unit is configured to:
In another possible implementation of the second aspect, the at least one processing unit is further configured to obtain a detection result of a detection area based on the second echo signal.
According to a third aspect, an embodiment of this application discloses a processing apparatus. The processing apparatus includes at least one processor and a communication interface. The communication interface is configured to provide instructions or a data input and/or output for the processor, and the at least one processor is configured to implement the method described in any one of the first aspect or the possible implementations of the first aspect.
In a possible implementation of the third aspect, the at least one processor is configured to perform the following operations:
The first time window is related to the first time location and first duration, the first time window includes the first time location, and the first duration is predefined or preconfigured.
In another possible implementation of the third aspect, the first time location corresponds to a first feature signal, the first feature signal is obtained based on the first echo signal, and the first feature signal includes at least one of a pulse signal, a peak signal, a rising-edge signal, or the like.
In another possible implementation of the third aspect, the first control signal further indicates a second time location, and the first time window further includes the second time location.
In another possible implementation of the third aspect, the first control signal further indicates a second time location, and the at least one processor is further configured to:
control, based on the first control signal, the detector to receive the second echo signal in the first time window and a second time window, where the second time window is related to the second time location and the first duration, and the second time window includes the second time location.
In another possible implementation of the third aspect, the first control signal further indicates a third time location, and the at least one processor is further configured to:
In another possible implementation of the third aspect, the processing apparatus includes the detector, and the detector includes at least one single-photon detection element.
In another possible implementation of the third aspect, the processing apparatus further includes the detector, where the detector includes a plurality of detection elements, and one detection element corresponds to an output signal of one pixel.
The first feature signal includes a signal obtained by performing superposition processing on output signals of adjacent pixels, and the adjacent pixels correspond to at least two adjacent detection elements in the detector.
In another possible implementation of the third aspect, the processing apparatus further includes the laser emitter and at least one optical element.
A start time of the first detection time window is after a fourth time location or is the same as a fourth time location; and the fourth time location corresponds to a distance of the second laser signal from the laser emitter to a first optical element in the at least one optical element, and the first optical element is an outermost optical element that belongs to the processing apparatus and that is in an emitting optical path of the second laser signal.
In another possible implementation of the third aspect, the processing apparatus further includes the detector, and the detector is further configured to obtain a to-be-detected signal based on the first echo signal.
The at least one processor is further configured to:
In another possible implementation of the third aspect, the at least one processor is further configured to obtain a detection result of a detection area based on the second echo signal.
It should be noted that the at least one processor in the third aspect may be a processor (referred to as a dedicated processor for ease of differentiation) that is specially configured to perform these methods, or may be a processor that performs these methods by invoking a computer program, for example, a general-purpose processor. Optionally, the at least one processor may further include both the dedicated processor and the general-purpose processor.
Optionally, the computer program may be stored in a memory, and the memory may be a non-transitory (non-transitory) memory, for example, a read-only memory (ROM). When a detection apparatus includes the memory, the memory and the processor may be integrated into a same chip, or may be disposed on different chips. A type of the memory and a manner in which the memory and the processor are disposed are not limited in embodiments of this application.
In a possible implementation, the at least one memory is located outside the detection apparatus.
In another possible implementation, the at least one memory is located inside the detection apparatus.
In another possible implementation, a part of the at least one memory is located inside the detection apparatus, and the other part of the memory is located outside the detection apparatus.
According to a fourth aspect, an embodiment of this application discloses a terminal. The terminal is configured to implement the method described in any one of the first aspect or the possible implementations of the first aspect.
Optionally, the terminal may be a terminal like a fusion detection apparatus, a vehicle, an uncrewed aerial vehicle, or a robot.
According to a fifth aspect, an embodiment of this application discloses a terminal. The terminal includes the detection apparatus described in any implementation of the second aspect, and/or the terminal includes the processing apparatus described in any implementation of the third aspect.
Optionally, the terminal may be a terminal like a fusion detection apparatus, a vehicle, an uncrewed aerial vehicle, or a robot.
According to a sixth aspect, an embodiment of this application further provides a chip system. The chip system includes at least one processor and a communication interface. The communication interface is configured to send and/or receive data, and/or the communication interface is configured to provide an input/output for the at least one processor.
The at least one processor is configured to invoke a computer program, to enable the chip system to implement the method described in any one of the first aspect or the possible implementations of the first aspect.
According to a seventh aspect, an embodiment of this application discloses a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is run on one or more processors, the method described in any one of the first aspect or the possible implementations of the first aspect is implemented.
According to an eighth aspect, an embodiment of this application discloses a computer program product. When the computer program product runs on one or more processors, the method described in any one of the first aspect or the possible implementations of the first aspect is implemented.
It should be noted that some possible implementations of the second aspect to the eighth aspect of this application have a same concept as some implementations of the first aspect. For beneficial effects brought by the possible implementations of the second aspect to the eighth aspect, refer to the beneficial effects of the first aspect. Therefore, details are not described again.
The following describes the accompanying drawings used in embodiments of this application.
The following describes embodiments of this application with reference to the accompanying drawings in embodiments of this application.
For ease of understanding, the following first explains some terms in embodiments of this application.
1. Detection Apparatus
The detection apparatus mentioned in embodiments of this application may be a lidar (or a component inside a lidar, for example, a chip, an integrated circuit, or a software module), or may be another optical detection apparatus (or a component inside an optical detection apparatus, for example, a chip, an integrated circuit, or a software module), for example, a fusion detection apparatus. A working principle of the detection apparatus is detection a corresponding target object by emitting an optical signal and receiving an optical signal returned by the target object.
The detection apparatus in embodiments of this application can be applied to various fields such as intelligent driving, intelligent transportation, intelligent manufacturing, environment monitoring, surveying and mapping, and uncrewed aerial vehicle, and can complete one or more functions of target detection, distance measurement, speed measurement, target tracking, imaging recognition, and the like.
The detection apparatus in embodiments of this application can be applied to a vehicle-mounted detection apparatus (e.g., a vehicle-mounted radar), a roadside detection apparatus (e.g., an intersection radar), or the like, but can also be applied to another detection apparatus, for example, a detection apparatus installed on an apparatus like an uncrewed aerial vehicle, a robot, a railcar, a bicycle, a signal light, a speed measurement apparatus, or a base station. An installation location of the detection apparatus is not limited in this application.
2. Echo Signal
In embodiments of this application, an optical signal received by a detector of a detection apparatus is referred to as an echo signal. The echo signal may include a reflected signal of a signal emitted by the detection apparatus, and may further include a related optical signal of an ambient light source (e.g., may be an optical signal directly from the ambient light source, or may be a reflected signal obtained by reflecting an optical signal of the ambient light source). The ambient light source may include one or more of a natural light source (e.g., the sun), an artificial light source (e.g., a street lamp or a vehicle lamp), and the like.
3. Time of Flight
The time of flight (ToF) is duration in which a laser emitter sends a light pulse to a target object and then a detector receives light reflected from the target. A distance between the target object and a detection apparatus can be obtained based on a speed of light and the ToF. A ToF measurement technology may include a single laser pulse technology, a multi-laser pulse technology, and the like. In the single laser pulse technology, the measured time of flight is duration of returning a single pulse, and a high requirement is on a signal-to-noise ratio (SNR, or referred to as S/N). In the multi-laser pulse technology, duration of returning a plurality of pulses are measured each time, and detected data is obtained based on histogram data. The multi-laser pulse technology can obtain good detection results under different SNRs. If the SNR is improved, long-distance detection can be implemented.
4. Statistical Histogram
A laser signal emitted by a detection apparatus covers an entire field of view area (namely, a detection area of the detection apparatus), and the laser signal generates diffuse reflection on a target object in the field of view area. As a result, energy of a laser signal returned from the field of view area is reduced. In this case, ambient light (such as the sunshine, street lamp light, or a laser signal of another detection apparatus) is considered as noise, and may interfere with detection performed by the detector on the signal. In this case, because strength of the signal received by the detector is weak, the received laser signal may not correspond to the emitted laser signal, and consequently, a large error occurs when a flight signal is calculated. Therefore, a high-sensitivity optical detector is required in a detection process to detect a weak optical signal.
A single-photon detection element (also referred to as a single-photon detector) has sensitivity of detection a single photon, and may be used to detect a weak optical signal. Further, time precision at a picosecond level may be achieved by using a time-correlated single-photon counting (TCSPC) technology. Specifically, in optical signals returned from the field of view area, a photon first captured by the single-photon detection element may trigger the single-photon detection element, to generate an electrical signal. A time-to-digital converter (TDC) can convert a delay of the electrical signal relative to an emitting time point.
However, the single-photon detection element captures a photon that arrives at a specific moment in a segment of emitted laser signal, which is random. Therefore, the detection apparatus may repeatedly emit and detect a same laser signal for many times, to obtain statistical distribution of delays of electrical signals detected each time relative to the emitted signals, so as to obtain the statistical histogram. This statistical histogram restores a change of energy of the emitted signal over time, so that the time of flight of coming and returning of the pulse is obtained.
Generally, a vertical coordinate of the statistical histogram is the number of counts (number of counts), and a horizontal coordinate is the time (time, time bin, time window, or time line).
5. Time Location
The time location mentioned in this application is a relative location of a signal in time domain. Optionally, the time location may be indicated by using at least one of a moment, a periodicity, an offset, duration, a timer (timer), a time difference, or the like.
The time of flight corresponds to a distance between the target object and the detection apparatus. Therefore, when the detection apparatus emits a plurality of segments of laser signals to the target object, an echo signal from the target object fixedly falls to a specific time location.
For example,
As shown in (d) in
6. Unit
Terms such as “unit”, “module”, “component”, and “system” used in this application may indicate computer-related entities, hardware, firmware, combinations of hardware and software, software, or software being executed. For example, the unit may include but is not limited to hardware (e.g., one or more of a laser emitter entity, a detection component entity, a processor entity, a circuit entity, and a chip entity), software (e.g., one or more of a process that can run on a processor, an executable file, computer instructions, and a computer program), or a combination of hardware and software (e.g., a storage medium storing a computer program or a processor that executes computer instructions). For example, a laser emitting unit may include a laser emitter entity, and optionally, may further include one or more of a collimation apparatus, a laser emitting program, a laser emitting instruction, a chip or a processor that executes the laser emitting program, and a memory.
For example, a laser detection unit may include a laser detector, and optionally, may further include one or more of a detection program, a detection instruction, a chip, or a memory.
Descriptions of the foregoing related concepts may be applied to the following embodiments.
With development of information technologies and computer vision, a detection technology is developed rapidly, and various detection apparatuses bring great convenience to people's life and travel. For example, an advanced driver assistance system (ADAS) plays a very important role in intelligent vehicles. The ADAS uses a detection apparatus installed on a vehicle to detect an ambient environment, collect data, and identify a still object and a moving object in a driving process of the vehicle, and performs a systemic operation and systemic analysis with reference to map data of a navigator. In this way, a driver perceives a potential danger in advance, to effectively improve driving comfort and safety of the vehicle.
The detection apparatus may be considered as an “eye” of an electronic device for sensing an environment, and includes a visual sensor like a camera and a radar sensor like a millimeter-wave radar, a lidar, and an ultrasonic radar. The lidar has high resolution, good detection performance, and strong concealment, and is one of important sensors in vehicle sensing.
The detection apparatus 20 shown in
(1) The laser emitter 201 is configured to generate a laser signal. The laser emitter 201 may include a light emitting component like a laser diode (LD), a vertical cavity surface emitting laser (VCSEL), a distributed feedback laser diode (distributed feedback LD, DFB-LD), a distributed bragg reflection laser diode (distributed bragg reflection LD, DBR-LD), a grating coupled sampling reflection laser diode (Grating coupled sampling reflection LD, GCSR-LD), or a micro-opto-electro-mechanical system laser diode (micro-opto-electro-mechanical system LD, MOEMS-LD).
(2) The laser detector 202 is configured to: receive an optical signal, and further obtain an electrical signal based on the optical signal. Optionally, the laser detector 202 may include at least one of detection elements such as a semiconductor avalanche photodiode (avalanche photo detector, APD), a single-photon avalanche diode (SPAD), or an electron multiplying charge-coupled device (EMCCD). Optionally, the detection elements in the detector may be arranged in an array, for example, may be an array of a specification like a 1×2 array, a 2×3 array, or a 3×3 array. This is not limited in this application.
The laser detector 202 in this embodiment of this application may be controlled to be turned on or turned off. In a design, the detector may be controlled by using a gate circuit. For example,
In a possible design, the laser detector 202 may have different working modes. For example, the detector may have at least two working modes: a free running mode and a gate mode. In the free running mode, the laser detector 202 may be always in the on state, or always in the off state, or in an adaptively adjusted on or off state. In the gate mode, the laser detector 202 may be controlled by another apparatus or module to be in the on or off state.
(3) The controller 203 is configured to control all or some components in the detection apparatus 20. For example, the controller 203 is configured to control the laser emitter 201 and the laser detector 202 in the detection apparatus 20.
It should be understood that the controller 203 may include a plurality of sub-control units. For example, the controller 203 may include two sub-control units, one sub-control unit is configured to control the laser emitter, and the other sub-control unit is configured to control the detector. A person skilled in the art may learn that the plurality of sub-control units may be independent of each other in hardware, may be an integrated structure, or may be a plurality of logical functions implemented in software. This is not specifically limited in this application.
In a design, the controller 203 may generate a control signal and send the control signal to one or more components in the detection apparatus 20, to control the one or more components. For example, the controller 203 may send an emitting control signal to the laser emitter 201, and the laser emitter 201 responds to the emitting control signal, to emit a laser signal to the outside. For another example, the controller 203 may alternatively send a detection control signal to the laser detector 202, and the signal is used to control the laser detector 202 to receive an optical signal and convert the optical signal into an electrical signal.
Alternatively, the controller 203 may be connected to an external controller (or an external processor). For example, the detection apparatus 20 is a vehicle-mounted radar. The controller 203 in the detection apparatus 20 may be connected to a multi domain controller (MDC) in a vehicle or another possible in-vehicle controller. The in-vehicle controller may send instructions to the controller 203, and the controller 203 generates a control signal based on the instructions.
Optionally, the controller 203 may include hardware, software, or a combination of hardware and software. For example, the controller 203 may be implemented by using one or more of a chip, a circuit (or an integrated circuit), a processor, a computer program, and computer instructions.
(4) The processor 204 is configured to process data (e.g., an electrical signal) output by the detector, to obtain detected data. For example, the detected data may be one or more of a TOF value, point cloud information, a statistical histogram, or the like.
Further, the processor 204 may further obtain a detection result of a detection area based on the data output by the detector.
In a possible design, the processor 204 may include one or more of a signal detection module (e.g., one or more of a peak detector and the like), a time to digital converter (TDC), a filter, and a time of flight (ToF) extraction (extraction) module in the detection apparatus. The filter may further include one or more of a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, and the like.
It should be understood that the foregoing one or more modules may be implemented by using hardware (e.g., a processor, a chip, or a circuit), software (e.g., a computer program, computer instructions, or an executable file), or a combination of hardware and software. For example, the signal detection module may include hardware (e.g., a processor, a chip, or a circuit), software (e.g., a computer program, computer instructions, or an executable file), or a combination of hardware and software. For another example, the TDC is usually configured to calculate the time of flight, and is generally a circuit, but may alternatively be implemented by using software or a combination of software and hardware. Other details are not described one by one.
Optionally, when the foregoing module is in a form of hardware, a plurality of pieces of hardware may be independent or integrated. For example, when the signal detection module is a circuit entity and the TDC is a circuit entity, the signal detection module and the TDC may be independent of each other in hardware, or may be an integrated structure.
Alternatively, when the module is software, there are one or more hardware apparatuses that execute the software to implement functions. For example, the signal detection module and the TDC may be implemented by using computer instructions. Further, both the computer instructions used to implement the signal detection module and the computer instructions used to implement the TDC may be invoked by the processor 204, to implement corresponding functions.
It should be noted that, when the detection apparatus 20 includes the controller 203 and the processor 204, the processor 204 and the controller 203 may be integrated or independent.
(5) The memory 205 is configured to provide storage space. For example, the memory 205 may be configured to store one or more of the data (e.g., the electrical signal) output by the detector, the detected data, and the computer program.
Optionally, the memory 205 may be one or a combination of a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable read-only memory (compact disc read-only memory, CD-ROM), or the like.
(6) Optionally, the detection apparatus 20 may further include a communication interface (not shown in the figure). The communication interface is configured to provide an input and/or output for each component, and/or the communication interface is configured to receive and/or send data.
For example, the communication interface may output, to the processor, the electrical signal obtained by the detector.
For another example, the communication interface may output, to an external apparatus, the data (e.g., the electrical signal) output by the detector, or the detected data obtained by the processor.
It should be understood that the detection apparatus 20 may further include one or more of optical elements such as a collimation apparatus, a lens, a window, and an optical splitting apparatus.
When the detection apparatus 20 performs detection, the controller 203 may control the laser emitter 201 to emit a laser signal to the detection area. The detection area reflects an optical signal, and the reflected optical signal is received by the laser detector 202. The laser detector 202 generally includes a plurality of detection elements. Therefore, in a detection process (a laser unit emits a segment of laser signal and receives a reflected signal of the laser signal), the plurality of detection elements of the laser detector 202 output detected data of a plurality of channels. However, as a requirement for a detection result is increasingly high, for example, a requirement for detection precision and resolution is increasingly high, a multi-channel and high-parallelism requirement is increasingly high. Correspondingly, an increasing amount of data that needs to be processed by the detection apparatus also poses a great challenge to a computing capability, manufacturability, and costs of a chip.
In view of this, in this embodiment of this application, two phases of detection processes are included when a target detection area is detected. In a first phase of detection process, the controller 203 may control the laser emitter 201 to emit a laser signal (referred to as a first laser signal for ease of differentiation) to the detection area, and the laser detector 202 receives an echo signal (referred to as a first echo signal for ease of differentiation). The first echo signal includes a reflected signal corresponding to the first laser signal. The first echo signal may be used to determine one or more time locations (referred to as a first time location for ease of description). The first time location corresponds to a first feature signal. In a second phase of detection process, the controller 203 may control the laser emitter 201 to emit a laser signal (which is referred to as a second laser signal for ease of differentiation), and the controller 203 may control the laser detector 202 to receive an echo signal (which is referred to as a second echo signal for ease of differentiation) in a time window. The second echo signal includes a reflected signal of the second laser signal. The time window includes the first time location.
In this embodiment of this application, the first phase of laser detection is used to determine the first time location, and the second phase of laser detection is used for target detection in the time window including the first time location. In one aspect, duration of the first time window (namely, first duration) in the second phase of detection process is usually less than duration of an original detection time (e.g., a detection time in the first time of detection process). The laser detection unit receives the echo signal in the first time window, so that a time for receiving the echo signal is shortened, and further detected data obtained based on the echo signal is also reduced. Consequentially, an amount of data that needs to be processed is reduced. In another aspect, a time location for receiving the echo signal in the second phase of detection process is positioned based on the time location and the first duration. In this case, the echo signal may not be received at a time location that does not belong to the first time window, so that an unrelated signal can be prevented from affecting a detection effect, effectiveness of the received echo signal is improved, and detection performance of a lidar is improved.
In a possible design, the detection element of the laser detection unit is sensitive, and a very weak optical signal from the detection area also makes the detection element saturated. However, the saturated detection element needs a specific time to restore a status, and cannot perform detection within a recovery time (also referred to as deadtime). If an optical signal returned by a target object in the detection area reaches the detector within the recovery time, the optical signal may not be detected by the detection element. As a result, a true echo signal is submerged by a previous interference signal, and missed detection occurs on the signal. However, in this embodiment of this application, in the second phase of detection process, the detection element performs detection in the time window, so that a case in which the echo signal of the target object is submerged by the previous interference signal can be avoided or reduced, to improve accuracy of the detection result.
It should be understood that division of the plurality of modules shown in
The following describes a possible implementation form of a detection apparatus by using an example in which a detector is an array detector, a controller is a gate bias controller, and a processor is a signal detection module and a TDC.
The gate bias controller may be integrated into the array detector. The gate bias controller may be considered as the controller 203 shown in
In a detection process, the gate bias controller may control a laser emitter to emit a first laser signal. The gate bias controller may control the array detector to receive a first echo signal. The first echo signal includes a reflected signal corresponding to the first laser signal.
A first time location may be obtained, based on the first echo signal, by using a detection element and the signal detection module. The signal detection module may output the first time location or indication information of the time location to the gate bias controller by using a control signal. Correspondingly, the gate bias controller controls an emitting unit to emit a second laser signal, and controls the array detector to receive a second echo signal in a first time window. The second echo signal includes a reflected signal corresponding to the second laser signal.
Further, the second echo signal may output electrical signal data through the detection element. The electrical signal data is used to obtain a detection result of a detection area.
Optionally, the TDC converts the second echo signal to the detected data, for example, a statistical histogram shown in an area 401. Optionally, the detected data may be stored in the memory. Alternatively, the detected data may be further output to the data signal processor (DSP) or the like to perform an operation like filtering or TOF extraction, to obtain a detection result (e.g., one of point cloud data, an image, or depth data).
Optionally, one or more of the electrical signal data, the detected data, and the detection result may be output, through a communication interface, to an external apparatus for processing, for example, may be output, through a mobile industry processor interface (MIPI) shown in
It should be noted that, the figure is for ease of description, and therefore, modules that complete functions are described separately. This is not used as a limitation on a structure of the detection apparatus. The modules shown in
For example, it should be understood that the histogram establishment module shown in
In a possible design, the detection apparatus 20 and/or the detection apparatus 40 may be a laser detection apparatus like a lidar or a fusion detection radar.
In this embodiment of this application, target detection includes two phases of detection processes. In a first phase of detection process, the controller 503 may control the laser emitter 501 to emit a first laser signal to the detection area, and the laser detector 502 receives a first echo signal. The first echo signal includes a reflected signal corresponding to the first laser signal. The first echo signal may be used to determine a first time location, and the first time location corresponds to a first feature signal. In a second phase of detection process, the controller 503 may control the laser emitter 501 to emit a second laser signal, and the controller 503 may control the laser detector 502 to receive a second echo signal in a time window. The second echo signal includes a reflected signal of the second laser signal. The time window includes the first time location.
It should be noted that the lidar shown in
The following describes the method provided in embodiments of this application.
The method shown in
Step S601: Control a laser emitting unit to emit a first laser signal.
Specifically, step S601 may be implemented by a control apparatus. Optionally, the control apparatus may be included in the detection apparatus, or may be deployed outside the detection apparatus. For example, the control apparatus may be the controller 203 and/or the processor 204 in the detection apparatus 20 shown in
Optionally, the control apparatus may include one or more of the following apparatuses: a controller, a processor, an application processor (AP), a TDC, a filter, a graphics processing unit (GPU), a microprocessor unit (MPU), an application-specific integrated circuit (ASIC), an image signal processor (ISP), a digital signal processor (DSP), a field programmable gate array (FPGA), a complex programmable logic device (CPLD), a coprocessor (assisting a central processing unit in completing corresponding processing and application), a microcontroller unit (MCU), a neural-network processing unit (NPU), and/or the like. The laser emitting unit includes a laser emitter, configured to emit a laser signal. An action of emitting the laser signal by the laser emitting unit may be controlled by the control apparatus. For example, the control apparatus sends a control signal to the laser emitting unit, and the laser emitting unit emits a laser signal in response to the control signal.
In a possible design, the control apparatus may include a plurality of sub-control units. For example, as shown in
Step S602: Control a laser detection unit to receive a first echo signal including a reflected signal corresponding to the first laser signal.
Specifically, the first echo signal includes the reflected signal corresponding to the first laser signal.
The laser detection unit includes a detector, may receive the first echo signal, and may convert the first echo signal into an electrical signal. Further, the electrical signal may be output to another apparatus (e.g., a signal detection apparatus like the TDC) for signal detection.
The laser detection unit may include one or more detection elements. The detection element may be a single-photon detection element, for example, an APD or an SPAD. For example, the laser detection unit may be in an array form, for example, an array of a specification like a 1×2 array, a 2×3 array, or a 3×3 array. This is not limited in this application.
It should be understood that, if the laser detection unit is originally in an on state, the laser detection unit may be controlled to maintain the on state, to receive the first echo signal.
If the laser detection unit is originally in an off state, a control signal may be sent, to turn on the laser detection unit, so as to receive the first echo signal.
Step S602 may be implemented by the control apparatus. For details, refer to the control apparatus in step S601.
Further, the control apparatus may control a voltage of the detection element in the laser detection unit, to control a status of the laser detection unit. For example, as shown in
In a possible design, the control apparatus may include a plurality of sub-control units. For example, as shown in
Step S603: Output a first control signal based on the first echo signal.
The first control signal indicates a first time location. The first time location may be a detected time location at which a suspected detected object exists. Optionally, the first time location may be a time point, may be a time period (including a start time and an end time, including a start time and duration, including duration and an end time, or the like), or may be a plurality of time points or a plurality of time periods.
Optionally, the first time location may correspond to a first feature signal. The first feature signal belongs to one or more of feature signals, and may indicate a special waveform feature.
Optionally, the first feature signal may include at least one of a pulse signal, a peak signal, a rising-edge signal (or referred to as a front-edge signal), a waveform mass center signal, or the like. The pulse signal is a signal that transitorily fluctuates and that is like a pulse signal. The peak signal is a signal corresponding to a highest value of a signal value in a period of time. The rising-edge signal is a segment of signal of which signal value continuously increases in a period of time. The waveform mass center signal is a signal corresponding to a mass center location of waveform information.
In a possible scenario, the feature signal may correspond to a target object in the detection area. Therefore, detection may be performed again at a time location at which the feature signal is located, so that the predicted target object can be detected, to improve effectiveness of the detection signal. For example, as shown in
Certainly, the target object corresponding to the feature signal is predicted. Actually, the target object may exist, or the target object may not exist. For example, the vehicle-mounted radar is used as an example. A laser detector of a vehicle A receives a reflected signal that is reflected by an object and that is of a laser signal of a vehicle-mounted radar of the vehicle A, to form a pulse signal P1. The detection apparatus may predict, based on a time location of the pulse signal P1, that a target object T1 may exist at a corresponding distance. In this case, the detection apparatus detects again the time location at which the pulse signal P1 is located. This can reduce a possibility that another interference signal causes interference to a reflected signal of the target object T1, reduce an amount of data that needs to be processed, and improve detection performance of the detection apparatus.
For another example, the laser detector of the vehicle A may receive a related signal of an ambient light source (e.g., a reflected signal that is reflected by an object and that is of a laser signal of a vehicle B), to form a pulse signal P2. The detection apparatus may predict, based on a time location of the pulse signal P2, that a target object T2 may exist at a corresponding distance. However, the target object T2 actually does not exist, that is, the pulse signal P2 is a “false alarm signal”. In this case, the detection apparatus detects again the time location at which the false alarm signal is located. This can reduce interference of the false alarm signal to a detection result and improve the detection performance of the detection apparatus.
In a possible design, the first feature signal is obtained based on the first echo signal. Specifically, the laser detection unit may receive the first echo signal, and then output an electrical signal. The output electrical signal may include a plurality of feature signals, or a plurality of feature signals may be obtained by processing the output electrical signal (e.g., establishing a statistical histogram).
Step S603 may be implemented by the control apparatus. For details, refer to the control apparatus in step S601.
In a possible design, the control apparatus includes the signal detection module. The control apparatus may detect the electrical signal by using the signal detection module, to obtain the first time location. For example, the laser detection unit obtains the electrical signal by converting the first echo signal. The electrical signal may be output (which may be directly output or output after being processed by the TDC or the filter) to the signal detection module. The signal detection module detects the electrical signal, to obtain the first time location.
In another possible design, step S602 is completed by a processing module in the detection apparatus. For example, the detection apparatus 40 shown in
Optionally, if the detection unit is an array detection unit, an electrical signal obtained by receiving the first echo signal by the detection unit may be output signals of a plurality of pixels. For example, the laser detection unit includes N detection elements. One detection element may output an output signal of one pixel. In this case, the laser detection unit may output electrical signals of N pixels. Alternatively, for example, the laser detection unit includes M detection elements. Two detection elements may combine to output an output signal of one pixel. In this case, the laser detection unit may output electrical signals of M/2 pixels. A pixel combining manner is not specifically limited in this application.
Further, optionally, the first feature signal is obtained by performing superposition processing on output signals of adjacent pixels. The adjacent pixels correspond to at least two adjacent detection elements in the laser detection unit. For example,
There may be at least the following two possible designs when superposition processing is performed on the output signals of adjacent pixels:
Design 1: Output signals of any P adjacent pixels may be superposed. For example, output signals of horizontal pixels are superposed, or output signals of vertical pixels are superposed. For another example, as shown in
Design 2: Outputs of adjacent detection elements with signals are superposed. Further, in detection elements with signals, a superposition area may be divided. For example, signals of any plurality of adjacent detection elements with signals are superposed, or any plurality of adjacent detection elements with signals are divided based on a quantity, to obtain a plurality of areas, and then signals of detection elements in each area are superposed, or pixels with signals may be divided in another manner. The following gives two possible cases.
Case 1: The signals of any plurality of adjacent detection elements with signals are superposed.
In this case, if there is still a pixel having a signal in another area, and the pixel is not adjacent to any pixel in the area 901 and the area 902, the area is used as a third area for pixel superposition. As shown in (b) in
Optionally, when sub-area division is performed on a plurality of pixels with signals, division may be performed randomly, based on a mass center (to make pixels in the area as centralized as possible), or based on a feature of an echo signal, or a sub-area division method may be obtained through calculation in a manner like reinforcement learning. A quantity of pixels in a sub-area obtained through division may be preset or predefined, or may be determined based on a shape and a total quantity of pixels having signals. This is not limited in this application.
It should be understood that the foregoing two cases may coexist. For example, when a quantity of adjacent detection elements having signals does not exceed (less than, or less than or equal to) a threshold, direct superposition is performed, for example, the area 901, the area 902, and the area 903. When a quantity of adjacent detection elements having signals exceeds (greater than or equal to, or greater than) a threshold, the adjacent detection elements are divided into a plurality of sub-areas and then are superposed separately. Optionally, the threshold may be predefined or preset, or may be obtained through calculation by using an algorithm, a reinforcement learning model, or the like, or may be input by a user or another device.
For example,
Step S604: Control the laser emitting unit to emit a second laser signal.
Optionally, the laser emitting unit is configured to emit a laser signal. Emitting the laser signal by the laser emitting unit may be controlled by the control apparatus. For example, the control apparatus may send a control signal (referred to as a third control signal for ease of differentiation) to the laser emitting unit, and the laser emitting unit emits the second laser signal in response to the third control signal.
For related descriptions, refer to related descriptions in step S601.
Step S605: Control, based on the first control signal, the laser detection unit to receive a second echo signal in a first time window.
The second echo signal includes a reflected signal corresponding to the second laser signal. The first time window is related to the first time location, and the first time window includes the first time location.
For example,
Optionally, the first time window may be further related to first duration. The duration indicates a width of the time window. For example, if the first duration is 10 milliseconds (ms), an interval between a start time and an end time of the time window is 10 ms. Optionally, the first duration may be predefined or preset, or may be related to duration of the second laser signal. For ease of understanding, the following gives several possible time window designs.
Design 1: The first time location is at a middle location of the first time window. For example, a laser emitting time point is a moment 0 and the first duration is 10 ms. If the first time location is 15 ms to 19 ms, a start location of the first time window is 12 ms to 22 ms.
Design 2: The time location is at a start location of the first time window. For example, a laser emitting time point is a moment 0 and the first duration is 10 ms. If the first time location is 15 ms to 19 ms, a start location of the first time window is 15 ms to 25 ms.
Design 3: The time location is at a first preset location of the first time window. For example, a laser emitting time point is a moment 0, the first duration is 10 ms, and the first preset location is 1 ms after the start time of the time window. If the first time location is 15 ms to 19 ms, a start location of the first time window is 14 ms to 24 ms.
Optionally, step S605 may be implemented by the control apparatus. For details, refer to descriptions of the control apparatus in step S602.
Optionally, the second echo signal is used for target detection. Further, optionally, the second echo signal is processed, to obtain a detection result of the detection area, for example, distance information, point cloud information, and reflection intensity information of the detection area.
In a possible design, the first control signal may indicate a plurality of time locations. Optionally, the laser detection unit may be controlled to perform detection in a plurality of time windows (each time window includes at least one of the plurality of time locations), to improve detection efficiency. Alternatively, the detection apparatus may perform a plurality of times of laser emission and a plurality of times of detection. In each laser emission and detection process, the detection unit is controlled to receive the echo signal in one or more time windows. Through the plurality of times of detection, an amount of data that needs to be processed after each time of detection can be reduced, and a data processing speed of the data processing module can be adapted to. Further, through the plurality of times of detection, in each detection process, a time for receiving an echo signal by the detector is short, so that detection accuracy can be improved, mutual interference between echo signals can be avoided, and accuracy of the detection result can be improved.
For ease of understanding, the following uses three possible cases as examples.
Case 1: The first control signal may indicate a plurality of time locations, and the laser detection unit may be controlled to perform detection in the plurality of time windows, where each time window includes one or more time locations. For example,
As shown in (b) in
Case 2: The first control signal may indicate two time locations. The laser detection unit is controlled, by using the first control signal, to perform detection at least twice. Time windows in the two times of detection processes separately include the two time locations. For example,
The second phase of detection process may include a plurality of times of detection. The following uses an example in which a first time of detection and a second time of detection are included for description. During the first time of detection, the laser emitting unit emits the laser signal (referred to as the second laser signal for ease of differentiation), and the laser detection unit remains in the on state in the first time window, and may receive the second echo signal (the second echo signal includes the reflected signal of the second laser signal). As shown in (b) in
During the second time of detection, the laser emitting unit emits a laser signal (referred to as a third laser signal for ease of differentiation), and the laser detection unit remains in the on state in a third time window, and may receive a third echo signal (the third echo signal includes a reflected signal of the third laser signal). As shown in (c) in
Further, the second echo signal and the third echo signal that are received in the second phase of detection process is used to obtain the detection result of the detection area.
Case 3: The first control signal may indicate a plurality of time locations. At the plurality of time locations, time locations with close locations may be included in a same time window.
The second phase of detection process may include a plurality of times of detection. The following uses an example in which a first time of detection and a second time of detection are included for description. During the first time of detection, the laser emitting unit emits the laser signal (referred to as the second laser signal for ease of differentiation), and the laser detection unit remains in the on state in the first time window, and may receive the second echo signal (the second echo signal includes the reflected signal of the second laser signal). As shown in (b) in
During the second time of detection, the laser emitting unit emits a laser signal (referred to as a third laser signal for ease of differentiation), and the laser detection unit remains in the on state in a third time window, and may receive a third echo signal (the third echo signal includes a reflected signal of the third laser signal). As shown in (c) in
Further, the second echo signal and the third echo signal that are received in the second phase of detection process is used to obtain the detection result of the detection area.
It should be noted that the plurality of cases may be combined in a case in which the plurality of cases are not mutually exclusive.
Optionally, when the plurality of time locations are included, a plurality of control signals may alternatively be used to control the detection unit to receive the optical signal. For example, in an example in which two time locations (referred to as the first time location and a fifth time location for ease of differentiation) are included, the control apparatus may output two control signals (referred to as the first control signal and a fifth control signal for ease of differentiation). The first control signal indicates the first time location, and the detection unit may be controlled, by using the first control signal, to receive the second echo signal in the first time window. The fifth control signal indicates the fifth time location, and the laser detection unit may be controlled, by using the fifth control signal, to receive a fourth echo signal in a fourth time window. The fourth time window includes the fifth time location. Further, the second echo signal and the fourth echo signal are used to obtain the detection result of the detection area.
Optionally, the start time of the first time window is after the fourth time location or is the same as the fourth time location. The fourth time location corresponds to a distance between the laser emitting unit and a first optical element; the fourth time location corresponds to a distance between a first optical element and the laser detection unit; or the fourth time location corresponds to a distance between the laser emitting unit and a first optical element and a distance between a first optical element and the laser detection unit. The first optical element is an outermost optical element that belongs to the detection apparatus and that is in an emitting optical path (or a receiving optical path) of the second laser signal. For example, the outermost optical element may be an optical window of the detection apparatus. Optionally, optical elements included in the detection apparatus may be one or more of the following elements: a lens (including but not limited to one or more of a lens, a spectroscope, a polarizer, a wave plate, a cylindrical mirror, or an optical filter), an optical window, or another component that may be used for optical path design.
For example,
As shown in (a) in
For example, because the saturated detection element cannot be recovered in a short time, when the echo signal shown in (b) in
For example, because the time of flight corresponds to a distance, if the optical signal reflected by the outermost optical element (the optical element 1506) arrives at the fourth time location, the start time of the time window may be set to be after the fourth time location or the same as the fourth time location. In one aspect, a possibility that reflected light of an optical element of the detection apparatus causes interference to an echo signal can be reduced, missed detection of a signal is avoided, and signal effectiveness and accuracy of the detection result are improved. In another aspect, a detection time is shortened, so that an amount of data is correspondingly reduced, and consumption of a computing resource can be reduced.
In a possible design, the laser detection unit may have different working modes. For example, the laser detection unit may have at least two working modes: a free running mode and a gate mode. In the free running mode, the laser detection unit may be always in the on state, or always in the off state, or in an adaptively adjusted on or off state. In the gate mode, the laser detection unit may be controlled by another apparatus or module to be in the on or off state. Optionally, in step S601, the laser detection unit may be in the free running mode. In step S604, the laser detection unit is in the gate mode.
Optionally, the working mode of the laser detection unit may be controlled by using a control signal. For example, a gate starting signal is used, so that the laser detection unit may work in the gate mode.
For example,
As shown the signal in an area 1602, a gate starting (STR_Gate) signal is used, so that the laser detection unit enables the gate mode. After the gate mode is enabled, the laser detection unit may start to detect within a time window, as shown in a time window (Gate) signal. When the time window signal is at a high level, the laser detection unit is in the on state, and may receive the echo signal. When the time window signal is at a low level, the laser detection unit is in the off state. In a detection frame, a plurality of beam locations may be detected. When the end-of-frame signal (END_FR) is at a high level, the detection frame ends.
It can be learned that, at the first sub-beam location, first several pulses emitted by the laser emitting unit are used to determine a time location, and a start time and an end time of the time window may be determined based on the time location (or and the first duration). At a second sub-beam location, the laser detection unit works in the gate mode, and the laser detection unit receives the echo signal in the time window. This effectively reduces the amount of data and improves the signal effectiveness.
It should be noted that the foregoing uses the time sequence of the scanning-type detection apparatus as an example for description. This is not intended to limit an application scenario of this application. This application is also applicable to a flash-type (flash) detection apparatus.
Further, optionally, the first phase of detection process (e.g., the first subframe) may also be referred to as a coarse detection process, and the second phase of detection process (e.g., the second subframe) may also be referred to as a fine detection process.
In the embodiment shown in
The foregoing describes in detail the method in embodiments of this application. The following provides an apparatus in embodiments of this application.
The detection apparatus 180 is configured to implement the foregoing detection control method, for example, the detection control method in the embodiment shown in
In a possible implementation, the detection apparatus 180 may include at least one processing unit 1801. Optionally, the detection apparatus 180 may further include a laser emitting unit 1802 and a laser detection unit 1803.
In a possible implementation, the units are described as follows:
The at least one processing unit 1801 is configured to control the laser emitting unit 1802 to emit a first laser signal, and
The at least one processing unit 1801 is further configured to output a first control signal based on the first echo signal, where the first control signal indicates a first time location.
The at least one processing unit 1801 is further configured to control the laser emitting unit 1802 to emit a second laser signal.
The at least one processing unit 1801 is further configured to control, based on the first control signal, the laser detection unit 1803 to receive a second echo signal in a first time window, where the second echo signal includes a reflected signal corresponding to the second laser signal, and the second echo signal is used for target detection.
The first time window is related to the first time location and first duration, the first time window includes the first time location, and the first duration is predefined or preconfigured.
In a possible implementation, the first time location corresponds to a first feature signal, the first feature signal is obtained based on the first echo signal, and the first feature signal includes at least one of a pulse signal, a peak signal, or a rising-edge signal.
In another possible implementation, the first control signal further indicates a second time location, and the first time window further includes the second time location.
In another possible implementation, the first control signal further indicates a second time location, and the at least one processing unit 1801 is further configured to:
In another possible implementation, the first control signal further indicates a third time location.
The at least one processing unit 1801 is further configured to control the laser emitting unit 1802 to emit a third laser signal.
The at least one processing unit 1801 is further configured to control, based on the first control signal, the laser detection unit 1803 to receive a third echo signal in a third time window, where the third echo signal includes a reflected signal corresponding to the third laser signal, the third echo signal is used for target detection, the third time window is related to the third time location and the first duration, and the third time window includes the third time location.
In another possible implementation, the laser detection unit 1803 includes at least one single-photon detection element.
In another possible implementation, the laser detection unit 1803 includes a plurality of detection elements, and one detection element corresponds to an output signal of one pixel.
The first feature signal includes a signal obtained by performing superposition processing on output signals of adjacent pixels, and the adjacent pixels correspond to at least two adjacent detection elements in the laser detection unit 1803.
In another possible implementation, the detection apparatus 180 further includes at least one optical element.
A start time of the first detection time window is after a fourth time location or is the same as a fourth time location; and the fourth time location corresponds to a distance of the second laser signal from the laser emitting unit 1802 to a first optical element in the at least one optical element, and the first optical element is an outermost optical element that belongs to the detection apparatus and that is in an emitting optical path of the second laser signal.
In another possible implementation, the laser detection unit 1803 is further configured to obtain a to-be-detected signal based on the first echo signal.
The at least one processing unit 1801 is configured to:
In another possible implementation, the at least one processing unit 1801 is further configured to obtain a detection result of a detection area based on the second echo signal.
The fourth processing unit is configured to control, based on a fourth control signal, the laser detection unit 1803 to receive the first echo signal including the reflected signal corresponding to the first laser signal.
In another possible implementation, the detection apparatus further includes the laser detection unit 1803.
The laser detection unit 1803 is configured to receive the second echo signal in the first time window.
It should be noted herein that division into the foregoing plurality of units is merely logical division based on functions, and is not intended to limit a specific structure of the detection apparatus 180. In a specific implementation, some function modules may be subdivided into more fine function modules, and some function modules may be combined into one function module. However, regardless of whether the function modules are subdivided or combined, general procedures performed by the signal processing apparatus in the signal processing process are the same.
The processing apparatus 190 may include at least one processor 1901 and a communication interface 1902. Further, optionally, the processing apparatus 190 may further include at least one memory 1903. Further, optionally, the processing apparatus 190 may include a bus 1904. The processor 1901, the communication interface 1902, and the memory 1903 are connected by using a bus 1904.
The processor 1901 is a module that performs an arithmetic operation and/or a logical operation. Specifically, one or a combination of a plurality of processing modules may be included, such as a central processing unit (CPU), an AP, a TDC, a filter, a GPU, an MPU, an ASIC, an ISP, a DSP, an FPGA, a CPLD, a coprocessor, an MCU, and an NPU.
The communication interface 1902 may be configured to provide an information input or output for the at least one processor, and/or the communication interface 1902 may be configured to receive data sent from the outside and/or send data to the outside, and may be a wired link interface including an Ethernet cable or the like, or may be a wireless link (Wi-Fi, Bluetooth, universal wireless transmission, a vehicle-mounted short-range communication technology, or another short-range wireless communication technology) interface.
The memory 1903 is configured to provide storage space, and the storage space may store data such as an operating system and a computer program. The memory 1903 may be one or a combination of a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable read-only memory (compact disc read-only memory, CD-ROM), or the like.
The processing apparatus 190 is configured to implement the foregoing detection control method, for example, the detection control method in the embodiment shown in
In a possible design, the at least one processor 1901 may be a processor (referred to as a dedicated processor for ease of differentiation) that is specially configured to perform these methods, or may be a processor that performs these methods by invoking a computer program, for example, a general-purpose processor. Optionally, the at least one processor 1901 may further include both the dedicated processor and the general-purpose processor.
In a possible design, the at least one processor 1901 in the processing apparatus 190 is configured to invoke the computer program stored in the at least one memory 1903, to perform the detection control method, for example, the detection control method described in the embodiment shown in
In a possible design, the processing apparatus 190 may be one or more of apparatuses such as the control apparatus, the controller, or the processor in the foregoing embodiments, or may be a component (e.g., a chip, a software module, or a hardware module) inside the apparatuses such as the control apparatus, the controller, or the processor.
The processing apparatus 190 may control a laser emitter and a detector. Optionally, the processing apparatus 190 belongs to a detection apparatus, and the detection apparatus may further include the laser emitter and the detector, or the processing apparatus 190 may be connected to the laser emitter and the detector.
In a possible implementation, the processor 1901 in the apparatus 190 is configured to perform the following operations:
The first time window is related to the first time location and first duration, the first time window includes the first time location, and the first duration is predefined or preconfigured.
In a possible implementation, the first time location corresponds to a first feature signal, the first feature signal is obtained based on the first echo signal, and the first feature signal includes at least one of a pulse signal, a peak signal, or a rising-edge signal.
In another possible implementation, the first control signal further indicates a second time location, and the first time window further includes the second time location.
In another possible implementation, the first control signal further indicates a second time location, and the at least one processor 1901 is further configured to:
In another possible implementation, the first control signal further indicates a third time location, and the at least one processor 1901 is further configured to:
In another possible implementation, the processing apparatus 190 further includes the detector, and the detector includes at least one single-photon detection element.
In another possible implementation, the processing apparatus 190 further includes the detector, where the detector includes a plurality of detection elements, and one detection element corresponds to an output signal of one pixel.
The first feature signal includes a signal obtained by performing superposition processing on output signals of adjacent pixels, and the adjacent pixels correspond to at least two adjacent detection elements in the detector.
In another possible implementation, the processing apparatus 190 further includes the laser emitter and at least one optical element.
A start time of the first detection time window is after a fourth time location or is the same as a fourth time location; and the fourth time location corresponds to a distance of the second laser signal from the laser emitter to a first optical element in the at least one optical element, and the first optical element is an outermost optical element that belongs to the processing apparatus and that is in an emitting optical path of the second laser signal.
In another possible implementation, the processing apparatus 190 includes the detector, and the detector is further configured to obtain a to-be-detected signal based on the first echo signal.
The processor 1901 is further configured to:
In another possible implementation, the at least one processor 1901 is further configured to obtain a detection result of a detection area based on the second echo signal.
An embodiment of this application further provides a terminal. The terminal is configured to implement the method described in the embodiment shown in
In a possible design, the terminal includes the foregoing detection apparatus, for example, the detection apparatus shown in
Optionally, the terminal may be a terminal like a fusion detection apparatus, a vehicle, an uncrewed aerial vehicle, or a robot.
An embodiment of this application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is run on one or more processors, the method in the embodiment shown in
An embodiment of this application further provides a computer program product.
When the computer program product runs on one or more processors, the method in the embodiment shown in
An embodiment of this application further provides a chip system. The chip system includes a communication interface and at least one processor. The communication interface is configured to provide an information input/output for the at least one processor, and/or the communication interface is configured to send/receive data. The processor is configured to invoke a computer program (or computer instructions), to implement the method in the embodiment shown in
It should be noted that, in this application, terms such as “an example” or “for example” indicate an example, an instance, or an illustration. Any embodiment or design scheme described as “example” or “for example” in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Exactly, use of the word “example”, “for example”, or the like is intended to present a related concept in a specific manner.
In embodiments of this application, “at least one” means one or more, and “a plurality of” means two or more. At least one of the following items (pieces) or a similar expression thereof means any combination of these items, including any combination of singular items (pieces) or plural items (pieces). For example, at least one item (piece) of a, b, or c may represent a, b, c, (a and b), (a and c), (b and c), or (a, b, and c), where a, b, and c may be singular or plural. “And/or” describes an association relationship between associated objects and represents that three relationships may exist. For example, A and/or B may represent the following three cases: Only A exists, both A and B exist, and only B exists, where A and B may be singular or plural. A character “/” generally indicates an “or” relationship between the associated objects.
In embodiments of this application, according to the context, the term “when” may be interpreted as a meaning of “if”, “after”, “in response to determining”, or “in response to detection”.
In addition, unless otherwise specified, ordinal numbers such as “first” and “second” used in embodiments of this application are used to distinguish between a plurality of objects, and are not intended to limit an order, a time sequence, priorities, or importance of the plurality of objects. For example, the first sub-control unit and the second sub-control unit are merely used to distinguish between different control units, but do not indicate differences in structures, principles, importance, and the like of the two control units.
This application is a continuation of International Application No. PCT/CN2021/105496, filed on Jul. 9, 2021, the disclosure of which is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2021/105496 | Jul 2021 | US |
Child | 18405817 | US |