The invention concerns time to digital conversion, for example for time of flight (ToF) sensors.
In photo detection, the Time-to-Digital-Converter (TDC) creates time stamps for each detection event, typically from a single photon avalanche diode (SPAD). The time stamps are used to increment corresponding bins in a histogram, showing the number of events detected within each time period.
In 3D ranging systems or lidar, the presence of ambient light or other emitting systems populate the histogram and therefore pollute the signal detection with false detections. Low signal-to-noise ratios at high ambient light levels can significantly limit the performance to detect a signal with a ToF sensor.
The space for histogram memory is limited and is largely responsible for the chip cost. The histogram memory tends to be only filled at short distances and under high noise probabilities. Current implementations requires a lot of memory (depending on how often a detection occurs) to store the number of events in the histogram.
Time-correlated single photon counting (TCSPC) can be used to correlate SPAD detection events of multiple SPADs within their deadtime and to reduce noise. However, TCSPC requires either more complex circuitry before the TDC or post-processing on a powerful CPU after the TDC. The additional post processing can cause a significant increase in the power consumption of the device.
It is an object of the disclosure to solve at least some of the above mentioned problems by proposing an alternative method to TCSPC and providing a circuit for photo detection that comprises an intermediate memory unit for temporarily storing the time stamps between detection cycles so that new time stamps can be compared against those of a previous cycle. Then, the time bins of the histogram for which the time stamps are repeated can be incremented.
“True” signal detections from an object reflection will tend to give rise to multiple consecutive event signals having the same time stamp (e.g. due to the same time delay as the distance to the object remains substantially the same over multiple detection cycles). Spurious light signals and other noise sources, on the other hand, are unrelated to the signal trigger and will tend to provide transient event signals generating time stamps that change randomly from one detection cycle to the next. The proposed solution allows such transient signals to be filtered out by only incrementing the time bins of the histogram corresponding to time stamps that are repeated over two or more consecutive detection cycles. Each detection cycle corresponds to one trigger signal, e.g. electrically triggering a signal emitter or detecting an entangled photon, and setting the start time of the TDC.
According to a first aspect of the present disclosure there is provided a circuit for time to digital conversion (e.g. a part of or connected to the read-out circuit of a photodetector such as a time-of-flight, ToF, sensor). The circuit comprises a time to digital converter (TDC) configured to receive trigger signals and event signals and, for each event signal, provide a time stamp indicative of a time period between the event signal and an associated trigger signal, and a first memory unit for storing a set of time stamps associated with one trigger signal and provided by the TDC The circuit further comprises a processing unit configured to compare the set of time stamps stored in the first memory unit to new time stamps provided by the TDC to determine coincident time stamps.
The circuit may further comprise a second memory unit for storing a histogram comprising a plurality of time bins each representing a number of events, wherein the processing unit is configured to increment the time bins of the histogram corresponding to the coincident time stamps.
Hence, the first memory unit (the intermediate memory) can store the time stamps from the preceding detection cycle (associated with the preceding trigger signal), which can be compared to the “new” time stamps from the TDC to determine if any time stamps are coincident. A time stamp may indicate a time period of the detection cycle of e.g. 10 ps to 10 ns depending on the application. The filtering operation requires a single bit read, bit write, and bit compare operation for each histogram bin. Coincident in this context refers to time stamps that indicate the same time period within their respective detection cycles. Accordingly, embodiments of the disclosure allow the use a time correlated single photon counting (TCSPC) like scheme even when using a single SPAD as receiver.
The circuit is typically configured to repeatedly overwrite the set of stored time stamps in the first memory unit with new sets of time stamps associated with subsequent trigger signals and provided by the TDC. If more than one intermediate memory unit is used to store time stamps over multiple detection cycles, then each memory unit may not be overwritten in every detection cycle.
Advantageously, the first memory unit contains a number of bits equal to the number of time bins in the histogram or a number of bits equal to a multiple of the number of time bins in the histogram. With an equal number of bits and time bins, there is an easy one-to-one correspondence between the set of stored time stamps and the time bins to be incremented. Also, the first memory unit is relatively small compared to the histogram memory and therefore cheaper. Hence, the hardware can directly filter the TDC time stamps with a single bit of intermediate memory per histogram bin before storing the timestamps in the histogram memory, wherein if the intermediate memory registered a detection during the previous repetition (detection cycle), the processing unit “stores” the time stamps in the histogram.
The processing unit may be further configured to determine when the new time stamps differ from the time stamps stored in the first memory unit by one time period (or a predefined multiple of time periods), and in response to such a determination may increment the time bin of the histogram corresponding to the stored time stamp or corresponding to the new time stamp. While the processing unit is configured to at least determine coincident time stamps between consecutive detection cycles, it can be configured to determine when time stamps are “nearly” coincident (e.g. time stamps that differ by one time period of the detection cycle). This configuration can allow a lower level of filtering, which may be advantageous when using a temporally extended or jittered signal, when the signal wavelength fluctuates, or when imaging objects with relatively large velocity.
The circuit may comprise a plurality of said first memory units for storing respective sets of time stamps provided by the TDC, wherein the processing unit is further configured to compare the time stamps in each respective set of time stamps to the new time stamps provided by the TDC to determine the coincident time stamps. The processing unit may thus be configured to determine coincident time stamps over a greater number of consecutive detection cycles. For example, the processing unit may be configured to filter out any events that are not coincident over (all or at least one of) N consecutive detection cycles by using N intermediate memory units. This configuration can provide a greater level of filtering, which may be advantageous when the signal does not temporally fluctuate or temporally move.
The circuit may further comprise a switching unit for switching between coincidence mode wherein the circuit is configured to use the first memory unit (the intermediate memory) to determine the coincident time stamps and a single-event mode wherein the new time stamps are directly transmitted to an external unit or used to increment the corresponding time bins of the histogram. This allows switching between the measurement modes (“single-photon” and “coincidence-photon”), i.e. using the proposed coincidence acquisition and storing the time stamps from the TDC directly in the histogram memory. The switching unit can be configured to switch depending on the history or expected detection probability of arriving signal events onto the TDC. The switching unit may be further configured to also decide on additionally using the conventional TCSPC methods. For example, the switching unit can be configured to switch from the coincidence mode to the single-event mode when a noise detection probability is below a pre-determined threshold value for a given signal detection probability and/or wherein the switching unit is configured to switch from the coincidence mode to the single-event mode when the signal detection probability is below a pre-determined threshold value for a given noise detection probability. A region can be defined in a plot of the noise detection probability against the signal detection probability, and the switching unit can be configured to cause the circuit to operate in one mode when the detection probabilities fall within that region and the other mode when the detection probabilities fall outside that region.
According to a second aspect of the present disclosure, there is provided a photodetector (e.g. a TOF sensor for 3D imaging or ranging). The photodetector comprises a receiver for receiving light and in response provide event signals. The detector further comprises a circuit according to the first aspect, wherein the TDC of the circuit is configured to receive the event signals provided by the receiver. In LiDAR applications, the photodetector typically also comprises an emitter configured to emit pulses of light in response to receiving trigger signals.
The TDC is typically configured to receive the same trigger signals provided to the emitter (e.g. an electrical signal transmitted to both the emitter and the TDC). Alternatively, the TDC can be configured to receive trigger signals generated by an output from the emitter. For example, the circuit may be configured to measure an output from the emitter and in response to detecting a light pulse provide a trigger signal to the TDC.
The emitter may generate a short light pulse such as provided by a vertical cavity surface emitting laser, VCSEL. The emitter is typically configured to emit infrared (IR) laser light. For example, the emitter may be configured emit light with a wavelength in the range of 850 nm to 1600 nm. The emitter can be configured to have an aperiodic repetition rate (i.e. aperiodic trigger signals), which can be useful to reduce or avoid interferences with undesired signal sources, e.g. similar active products/devices. The repetition rate may be, for example, in the range of 1 kHz to 100 MHz.
The receiver may comprise one or more single photon avalanche diodes (SPADs), avalanche photo diodes (APDs), similar detectors, or combinations of such, which may be particularly suitable for ToF applications. Typically, the photodetector comprises an array of pixels, each comprising a light detector such as a SPAD. The or each SPAD can detect a single photon and in response provide a corresponding event signal.
The photodetector may comprise a plurality of said circuits to provide a plurality of histograms. For example, the photodetector may comprise one circuit for each receiver pixel. However, it is also possible to feed the signal from several light detectors into a single TDC. Each pixel then is associated with an event histogram, which can be used to determine the distance to the reflecting object. The photodetector may further comprise an image forming unit configured to process the plurality of histograms and to thereby form an image of the object. The histograms may be used together to form a 3D image of the object. Each pixel may consist of one light detector such as a SPAD or may comprise multiple light detectors.
According to a third aspect of the disclosure, there is provided a method of photo detection using a photodetector according to the second aspect. The method comprises providing trigger signals to the emitter, each trigger signal being associated with a detection cycle, and, in each detection cycle, receiving light with the receiver and in response providing one or more event signals to the TDC, and, at the TDC, for each event signal, providing a time stamp. The method further comprises, at the processing unit, comparing the time stamps to a set of time stamps provided in preceding detection cycles and stored in the first memory unit, determining any coincident time stamps, and incrementing the time bins of the histogram corresponding to the coincident time stamps.
The method may further comprise, in the detection cycle after the step of comparing, overwriting the set of time stamps stored in the first memory unit with the time stamps provided by the TDC. The method steps may then be repeated with time stamps from the present detection cycle compared to those of the previous cycle over any number of detection cycles.
The method may further comprise using the histogram to form an image of the object. Typically, multiple pixels of the receiver are used to provide multiple histograms, which together can be used to form an image of the object. The trigger signals may be aperiodic (e.g. transmitted at fixed intervals with a random or pseudo-random delay).
Embodiments of the disclosure are compatible with conventional TCSPC, and with adaptive coincidence controlling techniques. The embodiments may provide a number of advantages. For example, memory usage can be reduced by up to 50%, due to smaller histograms. The use case can be switched depending on the detection probability. Power consumption can also be reduced, for example due to less post processing. Embodiments may be advantageously used for any kind of correlation detection of repetitive signals and a known relative delay between the signals, for example distance ranging, quantum communication, and other methods using TCSPC like quantum sensing or fluorescence lifetime measurements. Hence, the circuit can be used for 3d-sensing such as LIDAR, biomedical applications such as fluorescence or lifetime measurements and other applications based on photon counting or TSPC. The circuit can provide TCSPC-like coincidence even for a single detector. The circuit can be used as an extension to or replacement of TCSPC.
Specific embodiments of the disclosure are described below with reference to the accompanying drawings, wherein
The TDC 7 uses the trigger signal and the event signals to provide, for each event signal, a time stamp. The time stamp represents the time of arrival (relative to the trigger) of the received light or noise, which gave rise to the event signal. The time stamp indicates a time period within the detection cycle. For example, a detection cycle (corresponding to one trigger signal) may be 12 ns, divided into twelve equal time periods of 1 ns each. Several events can be detected in one detection cycle.
Importantly, the sensor 1 comprises a first memory unit 9 configured to store the time stamps from the TDC 7. For example, the first memory unit 9 may comprise one bit for each time period of the detection cycle. The TDC 7 transmits the time stamps to the first memory unit 9 and to a processing unit 10 (also referred to as “filter unit” herein). The processing unit 10 is configured to update a histogram 11 in a second (larger) memory unit 12 based on the (new) time stamps provided by the TDC 7 and based on the (previous) time stamps stored in the first memory unit 9. The processing unit 10 compares the time stamps from the TDC 7 to those stored in memory 9 and increments corresponding time bins of the histogram 11 for repeated time stamps (i.e. time stamps that appear in consecutive detection cycles). Hence, any events that are not repeated in consecutive detection cycles are filtered out.
In the illustrated example, the first memory unit 9 stores time stamps for the 2nd, 6th and 12th time periods. The processing unit 10 receives new time stamps for the 3rd and 6th time periods from the TDC 7. Only the time stamp for the 6th time period overlaps between the two, and the processing unit increments (only) the 6th time bin of the histogram 11. Hence, the events with time stamp for the 2nd and 12th time periods are filtered out and not recorded in the histogram 11. Afterwards, the new time stamps for the 3rd and 6th time periods are stored in the first memory unit 9, and will be used to increment the histogram 11 if repeated in the next detection cycle. The time stamps in the 2nd and 12th time-period can be purged from the first memory for the next detection cycle.
This process is then repeated for each subsequent detection cycle, wherein the processing unit 10 compares the time stamps between consecutive detection cycles by accessing the first memory unit 9. The first memory unit 9 hence acts as an intermediate memory, which temporarily stores the time stamps between detection cycles before they are added to the histogram 11 in the main memory 12.
The repetition rate of the trigger unit 8 may be in range of 1 kHz to 100 MHz depending on the application. Preferably, the trigger unit 8 is configured to be aperiodic, for example by adding a random or pseudo-random delay (dither) to a periodic signal generator of the trigger unit 8, in order to avoid interferences. Importantly, a fixed period is not required to implement the proposed solution since the TDC 7 receives the trigger signal directly from the trigger unit 8 and can set the start time accordingly.
The receiver 3 may comprise a plurality of “pixels” and each pixel (or subset of pixels) can be associated with a respective first memory unit 9 and histogram 11. The plurality of histograms 11 can then be processed to form a 3D image of the object 5 or equivalently return the temporal information across the field of view of the receiving camera 3.
In other embodiments, the image sensor comprises N intermediate memory units, in order to filter out any events (time stamps) that are not repeated at least one or N times in N consecutive detection cycles. Having further intermediate memory units may be particularly beneficial for applications where the signal is expected to change only slowly.
In some embodiments, the processing unit 10 may be configured to also compare neighbouring bits of the first memory unit 9. For example, the processing unit can be configured to check if the new time stamps correspond to the stored time stamps +/−1 time period/bin. In this embodiment, if the first memory unit 9 stores a time stamp for the 3rd time period and the processing unit 10 receives a new time stamp for the 2nd time period, the processing unit 10 is configured to increment the 3rd time bin of the histogram 11. This can provide a smoothing effect on the histogram 11. In a further embodiment, +/−n time periods/bins may be compared, where n is a whole number.
The described coincidence sampling technique may also be implemented independently with an external reference signal, external optical sensors, and streaming or external histogram generation.
Accordingly, the circuit for time to digital conversion 22 provides general purpose pulse-period induced time-correlated noise suppression, and may be integrated in devices other than TOF sensors.
In the second (consecutive) detection cycle, a new set of time stamps 18 are provided by the TDC. The new set 18 comprises time stamps for the 3rd and 4th time periods. Again, the processing unit compares the time stamps stored in memory to the new time stamp 18 provided by the TDC and determines any coincident time stamps. The time stamp for the 3rd time period is coincident and the processing unit increments the corresponding time bin of the histogram 11. The new time stamps 18 are then stored in the second memory unit 16.
In the third detection cycle, a new set of time stamps 19 are provided by the TDC. The new set 19 comprises time stamps for the 1st and 4th time periods. The processing unit compares the time stamps stored in memory to the new time stamp 18 provided by the TDC and determines any coincident time stamps. There is no coincident time stamp (i.e. no time stamp that is the same in the last three detection cycles). Hence, the processing unit does not increment any time bin of the histogram 11.
The process is then further repeated in subsequent detection cycles.
Although specific embodiments have been described above, the claims are not limited to those embodiments. Each feature disclosed may be incorporated in any of the described embodiments, alone or in an appropriate combination with other features disclosed herein.
Number | Date | Country | Kind |
---|---|---|---|
2113866.4 | Sep 2021 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2022/070083 | 7/18/2022 | WO |