The present invention relates to the field of single-photo avalanche diode (SPAD) detectors and, more particularly, to a method and device for controlling sensitivity of a SPAD macro-cell.
A time-of-flight (ToF) camera employing time-of-flight techniques to determine depth information. ToF cameras are categorized into direct time-of-flight (dToF) cameras and indirect time-of-flight (iToF) cameras. DTOF cameras are based on the technology of time-correlated single-photon counting (TCSPC). Photons are emitted from a laser onto a target scene, and some of them that hit a target in the scene return to the dToF camera. The SPADs comprised in the dToF camera can be arranged in subgroups which are also called macro-cells, each of which is connected to a single data conversion circuit, e.g. a time-to-digital converter (TDC). A TDC detects any signal events in the subgroup or macro-cell connected to it and provides a digital representation of the time they occurred.
The time-of-flight of each returning photon is measured and subsequently stored in a histogram. To achieve an accurate measurement of the distance between the camera and each point of the target, the returning optical pulse stored in the camera histogram should accurately resemble the pulses emitted from the laser. A common problem in TCSPC is that, when the average received signal event rate reaches 10-20% of the laser pulse repetition frequency, the recorded optical pulse becomes distorted due to the dead time, which is the time until next possible detection of SPADs or TDC. This situation occurs at short range, where the laser pulse returned to the camera is strong and the accuracy requirements of the sensing system is high. This distortion can happen at both the SPAD and TDC level but is particularly problematic at the TDC level since the signal events from multiple SPADs are transmitted to a single TDC. The use of structured illumination, e.g. dots, makes this problem more severe as the intensity of the signal per TDC is even higher.
A conventional solution is, correcting the distortion in post-processing using correction algorithms to recover the shape of the emitted pulse. However, such correction algorithms have limitations that severe distortions cannot be corrected. This limits the use of such algorithms in certain situations, e.g. short-range applications.
Another prior solution is disclosed in U.S. Pat. No. 9,786,701B2. The SPAD array is divided into several SPAD sets, each of which have a different sensitivity due to being covered by shields. Sensitivity of the SPAD array is adjusted according to different application requirements to avoid signal distortion. The method of controlling sensitivity of the SPAD array disclosed in U.S. Pat. No. 9,786,701B2 comprises first measuring signal rate and then selectively enabling a set of SPADs in a macro-cell. However, in this way, the probability that the target can be covered by the SPAD array decreases.
The objective of the present invention is to provide a method and device for controlling sensitivity of SPAD macro-cells. The spatial coverage over the entire target scene is maintained.
In accordance with the present invention, there is provided a single-photon avalanche diode (SPAD) macro-cell, comprising an array of SPAD units, each of which comprises a SPAD (S0, S1 . . . S15) and a quenching circuit (Q0, Q1 . . . Q15) for the SPAD (S0, S1 . . . S15), a combination tree to combine output signals from the SPAD units, and a time-to-digital converter TDC operably connected to an output of the combination tree. The SPAD macro-cell is divided to a plurality of sub-cells, the SPAD macro-cell further comprises a control circuit 40 configured to enable at least one or some SPAD units in each sub-cell in a time period and enable another one or some other SPAD units in each sub-cell in the next time period.
Advantageously, the control circuit 40 is configured to enable each SPAD unit at least once after at least two time period. It is also possible that the control circuit is configured to enable some SPAD units more frequently than other SPAD units.
Advantageously, the control circuit 40 is configured to enable a SPAD unit by reducing excess bias across a SPAD comprised in the SPAD unit.
Advantageously, each SPAD unit further comprises a buffer (B0, B1 . . . B15) operably connected to an output of the SPAD and the control circuit 40 is configured to enable the SPAD unit by enabling the buffer comprised in the SPAD unit.
Advantageously, the control circuit 40 comprises a register 41 to store a string of binary bits, each of which represents a starting status of a SPAD, and a barrel shifter 42 to perform a logical shift operation on the string of binary bits and control the buffer B0, B1 . . . B15 based on the shift operation.
Advantageously, the control circuit further comprises a counter 43 operably connected to the barrel shifter 42 to control the shift operation.
Advantageously, the counter 43 is driven by a reference clock which is the same as a laser pulse period.
Advantageously, the control circuit 40 comprises a shift register with the same number of flip-flops as SPADs, the output of which is looped to the input which is initialized with the starting pattern and then clocked every period.
Advantageously, the combination tree is a OR tree or XOR tree. It could also be other trees with similar function.
Advantageously, the time period is a laser pulse period.
The present disclosure describes also a SPAD detector comprises at least one above SPAD macro-cell.
In further embodiments, the SPAD detector comprises a first above SPAD macro-cell and a second above SPAD macro-cell.
In some embodiments, SPADs in the first SPAD macro-cell present a first enable pattern at a time period, and SPADs in the second SPAD macro-cell present a second enable pattern which is different from the first enable pattern at the same time period.
It is also an aim of the present invention to provide a method for controlling sensitivity of a SPAD macro-cell comprising an array of SPAD units, wherein the SPAD macro-cell is divided to a plurality sub-cells, a combination tree to combine output signals from the SPAD units; and a time-to-digital converter (TDC) operably connected to an output of the combination tree; the method comprises enabling at least one or some SPAD units in each sub-cell at a time period, and enabling another one or some other SPAD units in each sub-cell in the next time period.
Advantageously, the method comprises enabling a SPAD by reducing excess bias across it.
Advantageously, the method comprises enabling a SPAD unit by turning on a buffer operably connected to the SPAD.
Advantageously, the method comprises storing in a register a string of binary bits, each of which represents a starting enable status of a SPAD and performing a logical shift operation on the string of binary bits and control the buffers based on the shift operation through a barrel shifter.
Advantageously, the method comprises controlling the shift operation by a counter.
Advantageously, the counter is driven by a reference clock which is the same as reference clock of TDC.
Advantageously, the method comprises determining the number of SPAD units to be enabled by two steps: varying a real ambient event rate, Rra, at a detector and recording a measured ambient event rate, Rma, a pile-up factor Fpa due to the ambient illumination is then decided by Fpa=Rma/Rra; and calculating a real signal rate Rrs according to a measured signal rate Rms and the Pile-up factor Fpa.
Advantageously, the method comprises comparing the real signal rate Rrs and a set limit to decide whether the number SPAD units enabled in a laser pulse cycle is optimal.
Further benefits and advantages of the present invention will become apparent after a careful reading of the detailed description with appropriate reference to the accompanying drawings.
In the figures:
Various embodiments of the disclosed methods and arrangements are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components, configurations, and steps may be used without parting from the spirit and scope of the disclosure.
As mentioned above, in the short-range detection, strong pulse intensity brings signal distortion which degrades accuracy. Our examples shown in
To realize the dynamic enabling as shown in
A preferred embodiment to realize the dynamic enabling is shown in
The sensitivity of the SPAD macro-cell is represented by the number of signal-events present at the input of the TDC, which is determined by the number of SPADs connected to the enabled buffers. Therefore, the sensitivity of the SPAD macro-cell can be controlled by setting the number of buffers enabled by EN=‘1’.
The enable signals (EN0, EN1 . . . EN15) are output from a controlling circuit 40 of the SPAD macro-cell as illustrated in
In the first laser pulse period, according to the enable pattern of “1000100010001000”, buffer 0, buffer 4, buffer 8, and buffer 12 are enabled. Therefore, SPAD 0, SPAD 4, SPAD 8 and SPAD 12 can propagate events to the TDC. Next, in the second laser pulse period, the enable pattern of “0100010001000100” enables SPAD 1, SPAD 5, SPAD 9 and SPAD 13. In the third laser pulse period, the enable pattern of “0010001000100010” enables SPAD 2, SPAD 6, SPAD 10 and SPAD 14. And in the fourth laser pulse period, the enable pattern of “0001000100010001” enables SPAD 3, SPAD 7, SPAD 11 and SPAD 15. In the next four laser pulse periods, the four enable patterns are repeated in sequence. The enabling process continues following this rule. Thus, although the SPAD enable pattern is a sparse pattern at each laser pulse period, a target in a scene can be covered by the complete SPAD macro-cell through time accumulation.
It is known from the above that, the sensitivity of the SPAD macro-cell is decided by the number of SPADs enabled at a laser pulse period. Therefore, the sensitivity of the SPAD macro-cell can be controlled by setting such number. The optimal number of SPADs to be enabled at a laser pulse period is determined to avoid signal distortion and ensure the accuracy of detection.
A common problem in TCSPC is that when the average received signal event rate reaches a certain percentage of the laser repetition frequency, e.g. 10-20%, the measured signal shape becomes distorted and the distance reconstruction loses accuracy. It is also known as pile-up effect, which describes the effects of photons lost at high photon count rates due to the dead time of the TCSPC devices. This 10-20% pile-up limit is taken from the TCSPC Handbook by Becker & Hickl GmbH. This limit is cited for calculating the fluorescence lifetime of a fluorophore in fluorescence lifetime microscopy. However, it also applies for dToF, but the limit may change slightly depending on the implementation and application. The optimal number of SPADs of a macro-cell to be enabled in each laser pulse period can be decided according to such a limit, e.g. 10%. If the signal event rate at the TDC is slightly less than e.g. 10% of the laser repetition frequency, then the number of SPADs enabled in a laser pulse period is optimal.
The signal event rate can be obtained by measuring the number of laser pulse periods required for the highest bin in the histogram, which is the peak of the laser pulse, to reach a given signal level. In the real environment, especially in the case of high ambient light brightness, the real signal event rate Rrs is attenuated by the ambient event rate resulting in a measured signal rate, Rms. Therefore, to calculate an estimate of the real signal event rate Rrs, the measured signal event rate Rms should be corrected by a pile-up factor Fpa, which is a count attenuation factor due to high ambient event rates and is equal for every bin in the histogram. The pile-up factor Fpa can be determined through ambient illumination detection. It requires the event activity at the TDC when the laser is turned off and the SPAD macro-cell only detects light intensity from ambient illumination. The real ambient event rate Rra can be calculated by the formula: Rma=Rra*Fpa, where Rma is the measured ambient event rate. Fpa is related to Rma through the photon transfer curve (PTC), an example of which is shown in
It is important to note that as the signal rate increases, the measured signal rate will deviate more from the real signal rate Rrs due to pile-up of the signal with itself, e.g. when the probability of a signal detection on any given laser pulse period is 50%, Rms will be ≈80% of Rrs. As such, in some instances the calculation of Nspads, on in step S12 may not result in a configuration with less than 10% signal rate in a single step. For this reason, the configuration of Nspads, on is performed in a loop. After S12, the sensor is configured with dynamic enabling configuration consistent with Nspads, on calculated previously and the process continues at S5 to confirm that the signal rate is less than 10%. This process will repeat until the signal rate is less than 10% with the current configuration and the integration finishes as in S9 or the sensor is already configured with the lowest dynamic enabling configuration, 1/16 SPADs enabled as in S10.
As the PTC under ambient conditions is non-monotonic at high values of Rma, the initial configuration of the dynamic enabling should be chosen such that the possible range of incident event rates is within the valid region depicted in
In this example, the limit is set to 10%, however, it may be different according to implementation and application.
In an alternate scheme, a proper setting of the SPAD macro-cell could be done without any measurement of the scene but rather by using a prior knowledge of the system characteristics.
The present invention can be applied in many different situations.
The first situation is when the TDC range covers the entire distance range of interest. The entire range detection can be divided into short range detection and long-range detection. For a target in the long range, all SPADs are enabled. For the targets very close to the SPAD detector, the present invention can be used to mitigate pile-up distortion. Due to the high signal event rate, even if the laser emitting source is covered by a shield, only a short integration time is required to achieve a sufficient signal-to-noise (SNR) to make a reliable short distance measurement. As such, a separate short-range detection with a sparse enable pattern, e.g. 1/16 SPADs enabled per laser pulse cycle, is applied. Therefore, the SNR ratio of the system is maximized.
In the second situation, a full detection range comprises several sub-ranges, each of which is an independent detection range. Compared with the first situation, it requires more separate sub-range detections as the range increases. The sub-ranges can be fixed. Bur preferably, the sub-ranges are not fixed, and the start point of a sub-range will be shifted after the previous sub-range detection is done. In this way, the detection spans the entire range. The TDC and histogram are only applied for one of the sub-ranges at a time, where the sensor is vulnerable to pile-up. For other sub-ranges, TDC and histogram are not used. When the detection for this sub-range is done, the starting point of the next sub-range is determined, and an independent detection will be conducted.
In the third application, the full range of the system could be covered by two TDCs and histograms with a small time overlap region between them. The first TDC covers the region close to the camera which is most vulnerable to pile-up distortion and the second TDC covers the long-range region. In this situation, the TDC and histogram corresponding to the short-range region could take their inputs from quencher outputs which use the enable pattern to reduce the signal event rate. For the longer-range region, the corresponding TDC and histogram will take signal inputs from quencher outputs which bypasses the enable buffers. This scheme enables parallel detections in both short- and long-range regions with a reduced signal event rate for short range only.
Although the invention has been explained in relation to its preferred embodiment(s) as mentioned above, it is to be understood that many other possible modifications and variations can be made without departing from the scope of the present invention. It is, therefore, contemplated that the appended claim or claims will cover such modifications and variations that fall within the true scope of the invention.
Number | Date | Country | Kind |
---|---|---|---|
10 2022 109 747.1 | Apr 2022 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2023/052546 | 2/2/2023 | WO |