The present disclosure relates to distance measuring and depth sensing techniques and, more particularly, to a time-of-flight based distance measuring method and a related time-of-flight based distance measuring system.
In the time-of-flight (ToF) based distance measuring technology, pulsed modulation (PM) is a relatively straightforward measurement mechanism which measures a distance to a target object according to a time difference between emission of a light pulse and reception of a reflected light pulse. The timing control for the pulsed modulation needs to be highly precise. However, a relationship between intensity and duration of a light pulse and a relationship between light response and exposure time of a pixel are both nonlinear, thus reducing precision of a depth image.
To improve detection precision, continuous-wave (CW) modulation is usually utilized to reduce errors caused by measurement devices or ambient light. However, the CW modulation has to continuously send sinusoidal waves to perform sampling and integration operations multiple times, which not only makes the measurement more time consuming but also causes increased power consumption. It is difficult for a terminal device to satisfy the low power requirement of functional modules.
Thus, there is a need for a novel ToF based light sensing mechanism, which can precisely and rapidly measure a distance to a target object while exhibiting low power consumption.
It is a target objective of the present disclosure to provide a time-of-flight (ToF) based distance measuring method, which performs a signal sampling operation multiple times at a receiver side to obtain a sampling result of a reflected signal related to a single pulse, and a distance measuring system utilizing the distance measuring method, to thereby solve the problems of large measurement errors and low-precision depth images in existing ToF based distance measuring systems.
Some embodiments of the present disclosure provide an exemplary time-of-flight based distance measuring method. The distance measuring method includes: sending a pulse from a transmitter side intermittently, wherein the pulse is reflected by a target object, and a reflected signal is reflected from the target object accordingly; utilizing a receiver side to perform a signal sampling operation multiple times according to a sampling period for a predetermined period of time, and accordingly generate a sampling result of the reflected signal, wherein the predetermined period of time is longer than or equal to two times a pulse period of the pulse; detecting time of flight of the pulse traveling from the transmitter side to the receiver side according to the sampling result; and measuring a distance between the target object and a reference position according to the time of flight.
Some embodiments of the present disclosure provide an exemplary time-of-flight based distance measuring system. The distance measuring system includes a pulse generator unit, a control circuit and a time-of-flight sensor. The control circuit, coupled to the pulse generator unit, is configured to control the pulse generator unit to send a pulse intermittently, wherein the pulse is reflected by a target object and a reflected signal is reflected from the target object accordingly. The time-of-flight sensor, controlled by the control circuit, is configured to perform a signal sampling operation multiple times according to a sampling period for a predetermined period of time, and accordingly generate a sampling result of the reflected signal, wherein the predetermined period of time is longer than or equal to two times a pulse period of the pulse. The time-of-flight sensor is further configured to detect time of flight of the pulse traveling from the pulse generator unit to the time-of-flight sensor according to the sampling result, and measure a distance between the target object and the distance measuring system according to the time of flight.
The proposed time-of-flight based sensing scheme or distance measuring scheme can obtain phase shift information and accordingly measure a distance to a target object by sending a single pulse intermittently and taking at least two pulse periods to perform sampling operations, rather than sending a plurality of light pulses continuously and performing corresponding sampling operations multiple times. Thus, the proposed ToF sensing scheme or distance measuring scheme can achieve low power consumption, measure the distance to the target object rapidly, and maintain good measurement quality.
Certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will appreciate, electronic equipment manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms “include” and “comprise” are used in an open-ended fashion, and thus should be interpreted to mean “include, but not limited to”. Also, the term “couple” and “coupled” are intended to mean either an indirect or direct electrical connection. Accordingly, if a first device is coupled to a second device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
The proposed ToF distance measuring scheme can intermittently send a single pulse from a transmitter side, and perform a signal sampling operation multiple times at a receiver side for a predetermined period of time (e.g. a period of time which is two times a pulse period of the pulse) to obtain a sampling result of a corresponding reflected signal (generated in response to the pulse reflected by a target object), thereby realizing a sensing mechanism which simulates CW modulation based on pulsed modulation. Further description is provided below.
It is worth noting that the distance measuring system 100 can be implemented as various types of ToF based distance measuring systems, such as a ToF based optical distance measuring system, a ToF based acoustic distance measuring system, a ToF based laser distance measuring system, or other types of ToF based distance measuring systems. For the sake of brevity, the proposed ToF based distance measuring scheme is described with reference to the following embodiments where the distance measuring system 100 is implemented as a ToF based optical distance measuring system. However, those skilled in the art will recognize that the proposed ToF based distance measuring scheme can be employed in any types of ToF based distance measuring systems.
The distance measuring system 100 may include, but is not limited to, a pulse generator unit 110, a control circuit 120 and a time-of-flight (ToF) sensor 130. The pulse generator unit 110 is configured to send a single pulse intermittently, wherein the pulse has a pulse period T. For example, after sending a pulse, the pulse generator unit 110 would stop sending pulses for a period of time, which may be longer or much longer than the pulse period T. The pulse generator unit 110 can be activated again to send another pulse after the period of time has elapsed.
In the present embodiment, the distance measuring system 100 may be a ToF based optical distance measuring system, wherein the pulse generator unit 110 may be implemented using a light pulse generator unit and configured to generate a pulsed light signal EL. The pulsed light signal EL may be a single light pulse which is intermittently generated. In other words, the light pulse generator unit can intermittently send a single light pulse, which serves as a single pulse intermittently generated by the pulse generator unit 110. For example, the pulse generator unit 110 may include, but is not limited to, a driver circuit and a light emitting unit (not shown in
It is worth noting that the pulse generator unit 110 can be configured to generate other types of pulses, such as acoustic pulses or electromagnetic pulses. For example, in some embodiments where the distance measuring system 100 is implemented as an acoustic distance measuring system, the pulse generator unit 110 may be implemented using an acoustic generator. The acoustic generator is configured to intermittently send a single acoustic pulse such as an ultrasonic pulse, wherein the acoustic pulse can serve as a single pulse intermittently generated from the pulse generator unit 110. As another example, in some embodiments where the distance measuring system 100 is implemented as a laser distance measuring system, the pulse generator unit 110 may be implemented using an electromagnetic wave generator. The electromagnetic wave generator is configured to intermittently send a single electromagnetic pulse, which can serve as a single pulse intermittently generated from the pulse generator unit 110.
The control circuit 120, coupled to the pulse genitor unit 110, is configured to control the pulse generator unit 110 to generate the pulsed light signal EL. For example, the control circuit 120 can be configured to control the pulse generator unit 110 to send a single light pulse intermittently. As another example, the control circuit 120 can be configured to control the driver circuit included in the pulse generator unit 110 such that the light emitting unit included in the pulse generator unit 110 can send a single light pulse intermittently. The ToF sensor 130, controlled by the control circuit 120, is configured to sample a reflected signal RL to detect a distance between the distance measuring system 100 (or the ToF sensor 130) and the target object 102. The reflected signal RL is reflected from the target object 102 in response to the pulsed light signal EL reflected by the target object 102. In some embodiments, the control circuit 120 may be a main control unit of a terminal device, which may be located outside the distance measuring system 100.
In the present embodiment, the ToF sensor 130 can be configured to perform a signal sampling operation multiple times according to a sampling period for a predetermined period of time TR, and accordingly generate a sampling result of the reflected signal RL. For illustrative purposes, the predetermined period of time TR is represented by a waveform of a duration labeled TR. A period of time during which the reflected signal RL arrives at the ToF sensor 130 may fall within the predetermined period of time TR. In other words, the ToF sensor 130 can capture signal information corresponding to a complete pulse period T, which is generated in response to reflection of a single pulse on the target object 102. The pulse period T as used herein refers to a pulse period of the pulsed light signal EL. For example, the predetermined period of time TR can be set to be longer than or equal to two times the pulse period T. As a result, the sampling result can indicate reflection information corresponding to a complete pulse which is generated from the pulse generator unit 110.
In some embodiments, the control circuit 120 can be configured to, before arrival of the reflected signal RL at the ToF sensor 130, control the ToF sensor 130 to start performing the signal sampling operation according to the sampling period, or according to a sampling frequency which is a reciprocal of the sampling period. For example, before arrival of the reflected signal RL at the ToF sensor 130, the ToF sensor 130 can perform the signal sampling operation once each time the sampling period has elapsed, and stop performing the signal sampling operation when the predetermined period of time TR has elapsed. As the predetermined period of time TR can be set to be longer than or equal to two times the pulse period T, the ToF sensor 130 can capture signal information corresponding to a complete pulse period T within the predetermined period of time TR, wherein the signal information corresponding to the complete pulse period T is generated in response to reflection of a single pulse on the target object 102.
In some embodiments, after a period of time has elapsed since the pulse generator unit 110 sent a pulse, the control circuit 120 can be configured to control the ToF sensor 130 to start performing the signal sampling operation according to the sampling period. The period of time may be shorter than or equal to half the pulse period T. For example, the period of time may be equal to a quarter of the pulse period T, or even equal to zero. In other words, the ToF sensor 130 may start performing the signal sampling operation at a time when the pulse generator unit 110 is sending a pulse. In some examples, after a period of time has elapsed since the pulse generator unit 110 sent a pulse, the ToF sensor 130 may start to perform the signal sampling operation once each time the sampling period has elapsed, and stop performing the signal sampling operation when the predetermined period of time TR has elapsed. In some other examples, while the pulse sent by the pulse generator unit 110 is falling, the control circuit 120 can control the ToF sensor 130 to start performing the signal sampling operation according to the sampling period. Similarly, as the predetermined period of time TR can be set to be longer than or equal to two times the pulse period T, the ToF sensor 130 can capture signal information corresponding to a complete pulse period T within the predetermined period of time TR, wherein the signal information corresponding to the complete pulse period T is generated in response to reflection of the pulse on the target object 102.
In some embodiments, when the pulse generator unit 110 starts to send a pulse, the control circuit 120 may control the ToF sensor 130 to start performing the signal sampling operation according to the sampling period. As a result, even if a distance between the target object 102 and the distance measuring system 100 is very short, the ToF sensor 130 can still capture signal information corresponding to a complete pulse period T within the predetermined period of time TR, wherein the signal information corresponding to the complete pulse period T is generated in response to reflection of the pulse on the target object 102.
Additionally, in some embodiments, a time difference between a time when the pulse generator unit 110 starts sending a pulse and a time when the ToF sensor 130 starts performing the signal sampling operation can be controlled by the control circuit 120 to be shorter than the pulse period T. As a result, in a case where the predetermined period of time TR can be set to be longer than or equal to two times the pulse period T, the ToF sensor 130 can capture signal information corresponding to a complete pulse period T within the predetermined period of time IR, wherein the signal information corresponding to the complete pulse period T is generated in response to reflection of the pulse on the target object 102.
After performing the signal sampling operation multiple times to generate the sampling result, the ToF sensor 130 can be configured to calculate a phase shift between the reflected signal RL and the pulsed light signal EL sent from the pulse generator unit 110 according to the sampling result. For example, the ToF sensor 130 may include, but is not limited to, a pixel array 132 and a processing circuit 134. The pixel array 132 includes a plurality of pixels (not shown in
The processing circuit 134 can be configured to, over the predetermined period of time TR, sample an output of each pixel (e.g. a photo response signal of each pixel) once each time the sampling period has elapsed according to the sample control signal SC, and accordingly generate a sampling result SR. The sample control signal SC can be generated from the control circuit 120. Next, the processing circuit 134 can be configured to perform signal processing, such as mixing operations or discrete Fourier transforms, on the sampling result SR to calculate a phase shift between the reflected signal RL received by each pixel (a receiver side) and the pulsed light signal EL sent from the pulse generator unit 110 (a transmitter side), thereby detecting the time of flight of the pulsed light signal EL. The processing circuit 134 can also calculate a distance between each pixel and the target object 102 according to the time of flight.
For example, a single pulse of the pulsed light signal EL can be represented as a superposition of sinusoidal waves with the use of Fourier series expansion. A reciprocal of the pulse period T of the pulsed light signal EL serves as a fundamental frequency. A distance di between the pixel Pi and the target object 102 can be expressed by Equation (1) as follows:
di=(cΔΦ)/(4πfi) Equation (1)
where c represents speed of light, ΔΦ represents a phase shift between the reflected signal RL and the pulsed light signal EL, fi represents a frequency of a sinusoidal wave such as a fundamental wave or a harmonic wave. In some embodiments where the sampling period is set to a quarter of the pulse period T, the processing circuit 134 can sample an output of each pixel in the pixel array 132 once each time a quarter of the pulse period T has elapsed. As a result, the processing circuit 134 can obtain four sampling results SRi1, SRi2, SRi3, and SRi4 of the reflected signal RL associated with the pixel Pi. When compared with the pulsed light signal EL, the sampling results SRi1, SRi2, SRi3, and SRi4 are respective sampling results of a 0° phase delayed version of the reflected signal RL, a 90° phase delayed version of the reflected signal RL, a 180° phase delayed version of the reflected signal RL, and a 270° phase delayed version of the reflected signal RL. As a result, the phase shift MD, also referred to as a phase difference, between the reflected signal RL and the pulsed light signal EL can be calculated according to Equation (2) as follows:
ΔΦ=arctan((SRi2−SRi4)/(SRi3−SRi1)) Equation (2)
where arctan represents the inverse of the tangent function. By calculating the phase shift ΔΦ, the processing circuit 134 can obtain the distance di between the pixel Pi and the target object 102.
Based on the above operation, the processing circuit 134 can perform a signal sampling operation upon an output of each pixel in the pixel array 132 once each time a quarter of the pulse period T has elapsed, thereby obtaining respective data sets of four output images. The data sets include a sampling result of a 0° phase delayed version, a sampling result of a 90° phase delayed version, a sampling result of a 180° phase delayed version, and a sampling result of a 270° phase delayed version of each pixel, respectively. The processing circuit 134 can obtain depth image information by calculating a distance between each pixel and the target object 102 according to the data sets of the four output images.
It is worth noting that, in some embodiments where the distance measuring system 100 is used to implement other types of TM based distance measuring system, the light sensor described above can be implemented using other types of sensors, such as an acoustic sensor or a radar sensor, to generate a corresponding response signal. Additionally, in the present embodiment, a distance between the pulse generator unit 110 and each pixel may be much shorter than a distance between the pulse generator unit 110 and the target object 102, and much shorter than a distance between each pixel and the target object 102. As a result, regarding a pixel, time of flight of the pulsed light signal EL traveling from the pulse generator unit 110 to the target object 102 may be regarded as equal to time of flight of the reflected signal RL traveling from the target object 102 to the pixel. The processing circuit 134 may therefore measure a distance between the target object 102 and the pixel according to the time of flight and a velocity of the pulsed light signal EL.
A ToF based distance measuring method employed in the distance measuring system 100 may be summarized in
Step 202: Send a pulse from a transmitter side intermittently, wherein the pulse is reflected by a target object, and a reflected signal is reflected from the target object accordingly. For example, the control circuit 120 may control the pulse generator unit 110 to intermittently send a pulse such as the pulsed light signal EL. After the pulse generator unit 110 sends the pulse, the control circuit 120 may control the pulse generator unit 110 to stop sending pulses until a period of time has elapsed. When the period of time has elapsed, the pulse generator unit 110 can be activated again by the control circuit 120 to send another pulse. The period of time may be longer or much longer than the pulse period T of a single pulse. In addition, the target object 102 can reflect the pulsed light signal EL to generate the reflected signal RL.
Step 204: Utilize a receiver side to perform a signal sampling operation multiple times according to a sampling period for a predetermined period of time, and accordingly generate a sampling result of the reflected signal.
As the predetermined period of time is longer than or equal to two times the pulse period of the pulse, the receiver side can sample the reflected signal multiple times within the predetermined period of time. The sampling result can carry signal information which is generated in response to reflection of a complete pulse on the target object. For example, before the reflected signal RL arrives at the ToF sensor 130, the control circuit 120 can control the ToF sensor 130 to start performing the signal sampling operation according to the sampling period, and stop performing the signal sampling operation when the predetermined period of time TR has elapsed. As another example, after a period of time has elapsed since the pulse generator unit 110 sent a pulse, the control circuit 120 can control the ToF sensor 130 to start performing the signal sampling operation according to the sampling period, and stop performing the signal sampling operation when the predetermined period of time TR has elapsed. The period of time may be shorter than or equal to half the pulse period T. As another example, while the pulse generator unit 110 is starting sending a pulse, the ToF sensor 130 can start performing the signal sampling operation according to the sampling period, and stop performing the signal sampling operation when the predetermined period of time TR has elapsed. As another example, the ToF sensor 130 can start performing the signal sampling operation at a time one pulse period T earlier or later than a time when the pulse generator unit 110 is starting sending a pulse. The ToF sensor 130 can stop performing the signal sampling operation when the predetermined period of time TR has elapsed.
Step 206: Detect time of flight of the pulse traveling from the transmitter side to the receiver side according to the sampling result. For example, in a case where the ToF sensor 130 (or the processing circuit 134) performs the signal sampling operation on an output of each pixel in the pixel array 132 once each time a quarter of the pulse period I has elapsed, the ToF sensor 130 (or the processing circuit 134) can obtain respective data sets of four output images. The data sets include a sampling result of a 0° phase delayed version, a sampling result of a 90° phase delayed version, a sampling result of a 180° phase delayed version, and a sampling result of a 270° phase delayed version of the reflected signal RL associated with each pixel, respectively. Next, the processing circuit 134 can calculate a phase shift between the reflected signal RL and the pulsed light signal EL according to the data sets of the four output images, thereby detecting the time of flight of the pulsed light signal EL (a single pulse).
Step 208: Measure a distance between the target object and a reference position according to the time of flight. The reference position may be, but is not limited to, a position of the transmitter side, a position of the receiver side, a position of an electronic device including the transmitter side and the receiver side, or a reference position which can be defined according to a positional relationship between the transmitter side, the receiver side and the target object. For example, in some embodiments where the distance between the pulse generator unit 110 and each pixel of the pixel array 132 is much shorter than the distance between the pulse generator unit 110 and the target object 102, and much shorter than the distance between each pixel and the target object 102, the ToF sensor 130 (or the processing circuit 134) may measure the distance between the target object 102 and each pixel according to the time of flight of the pulsed light signal EL (a single pulse).
In some embodiments, in step 204, the predetermined period of time may be set to N times the pulse period of the pulse, where N is a positive integer greater than or equal to two. However, this is not intended to limit the scope of the present disclosure. In some embodiments, N may be set to a real number, such as 2.5, without departing from the scope of the present disclosure.
In some embodiments, besides a photo response signal generated from a light sensor in response to the reflected signal RL, a sampling result of each pixel may include a reference signal generated without reference to the reflected signal RL. For example, the step of generating the sampling result of the reflected signal (step 204) may include: outputting a reference signal without reference to the reflected signal RL while outputting a photo response signal of a pixel, and subtracting the reference signal from the photo response signal to thereby produce the sampling result of the pixel. Noise and interference in the surroundings imposed on the sampling result can therefore be reduced.
Further, in some embodiments, a photo response signal of a light sensor can be outputted from two transmission paths. Each transmission path is configured to receive and transmit the photo response signal when turned on, and generate a reference signal when turned off. The respective on/off timings of the two transmission paths can be controlled by two control signals having different phases, respectively. As a result, the proposed ToF based distance measuring scheme can simulate a CW modulation sensing mechanism by modulating transmitted light according to consecutive pulses which are sent intermittently.
For illustrative purposes, the proposed ToF based distance measuring scheme is described with reference to some exemplary pixel circuits in the following embodiments. However, this is not meant to be limitations of the present disclosure. Any pixel circuits capable of utilizing the distance measuring method shown in
The first readout circuit 333 can selectively transmit the photo response signal PR generated from the light sensor PD according to a first control signal TX1, thereby generating a first pixel output PO1. The first control signal TX1 may be provided by the control circuit 120 shown in
It is worth noting that, with the use of the first readout circuit 333 and the second readout circuit 334, the photo response signal PR of the light sensor PD can be sent to the processing circuit 134 without interruption for a period of time, i.e. the predetermined period of time TR. As a result, the processing circuit 134 can sample signal information, carried by the reflected signal RL over a complete pulse period T, within the period of time.
For example, the predetermined period of time TR may include a first sampling interval and a second sampling interval adjacent to each other. During each sampling interval of the first sampling interval and the second sampling interval, the first readout circuit 333 can selectively transmit the photo response signal PR according to the first control signal TX1, and the second readout circuit 334 can selectively transmit the photo response signal PR according to the second control signal TX2. At least one of the first readout circuit 333 and the second readout circuit 334 can be utilized for transmitting the photo response signal PR. As a result, in some embodiments where a duration of the sampling interval is equal to the pulse period T, a period of time during which the processing circuit 134 continuously transmits the photo response signal i.e. the predetermined period of time TR, can be longer than or equal to two times the pulse period T. In addition, during the sampling interval, the processing circuit 134 can sample the first pixel output PO1 and the second pixel output PO2 once each time a sampling period has elapsed. At each sampling time point when the first pixel output PO1 and the second pixel output PO2 are sampled, the processing circuit 134 may perform associated signal processing, such as signal subtraction, upon the first pixel output PO1 and the second pixel output PO2 to generate the sampling result SR. When utilized to transmit the photo response signal PR, the first readout circuit 333 can sample the photo response signal PR to generate the first pixel output PO1. When utilized to transmit the photo response signal PR, the second readout circuit 334 can sample the photo response signal PR to generate the second pixel output PO2. As a period of time during which the reflected signal RL arrives at the light sensor PD is equal to substantially equal to the pulse period. T, and may fall within the predetermined period of time TR (longer than or equal to two times the pulse period T), the processing circuit 134 can sample signal information which is carried by the reflected signal RL over a complete pulse period T.
In the present embodiment, the first readout circuit 333 may include, but is not limited to, a first reset transistor MR1, a first transfer transistor MT1, a first output transistor MF1 and a first readout transistor MW1. The second readout circuit 334 may include, but is not limited to, a second reset transistor MR2, a second transfer transistor MT2, a second output transistor MF2 and a second readout transistor MW2. The first reset transistor MR1 and the second reset transistor MR2 are configured to reset a first floating diffusion node FD1 and a second floating diffusion node FD2, respectively, according to a reset signal RST. The reset signal RST may be provided by the control circuit 120 shown in
The first output transistor MF1 and the second output transistor MF2 are configured to amplify respective voltage signals at the first floating diffusion node FD1 and the second floating diffusion node FD2 respectively, thereby generating the first pixel output PO1 and the second pixel output PO2 respectively. The first readout transistor MW1 and the second readout transistor MW2 are configured to selectively output the first pixel output PO1 and the second pixel output PO2, respectively, according to a select signal SEL. The select signal SEL may be provided by the control circuit 120 shown in
In some embodiments, in addition to the photo response signal PR generated in response to the reflected signal RL, one of the first pixel output PO1 and the second pixel output PO2 may include a reference signal generated without reference to the reflected signal RL. Each time the first pixel output PO1 and the second pixel output PO2 are sampled, the processing circuit 134 may subtract one of the first pixel output. PO1 and the second pixel output PO2 from the other to generate the sampling result SR, thereby reducing noise and interference in the surroundings imposed on the sampling result SR. For example, in a sampling operation during arrival of the reflected signal RL at the light sensor PD, the second readout circuit 334 is utilized to transmit the photo response signal PR (e.g. the second transfer transistor MT2 is turned on) to sense the reflected signal RL to thereby generate the second pixel output PO2. The first readout circuit 333 is not utilized to transmit the photo response signal PR (e.g. the first transfer transistor MT1 is turned off). As the first readout transistor MW1 may still be turned on according to the select signal SEL, the first pixel output PO1 can serve as a first reference signal carrying noise information associated with the sampling operation when the first transfer transistor MT1 is turned off. The processing circuit 134 can subtract one of the first pixel output PO1 and the second pixel output PO2 from the other to reduce noise and interference in the surroundings imposed on the sampling result SR.
In other words, during each sampling interval included in the predetermined period of time TR, the first readout circuit 333 may generate the first reference signal when not utilized to transmit the photo response signal PR. The first reference signal can serve as the first pixel output PO1. An output of the second readout circuit 334 is a sampled signal coming from the light sensor PD. During each sampling interval included in the predetermined period of time TR, the second readout circuit 334 may generate a second reference signal when not utilized to transmit the photo response signal PR. The second reference signal can serve as the second pixel output PO2. An output of the first readout circuit 333 is a sampled signal coming from the light sensor PD. Each of the first reference signal and the second reference signal carries noise information associated with the sampling operation. The processing circuit 134 shown in
In the present embodiment, after a period of time tX has elapsed (at time t2) sine the pulse generator unit 110 sent the pulse PE (at time t1), the pixel 332 can start transmitting the photo response signal PR of the light sensor PD to the processing circuit 134 through at least one of the first readout circuit 333 and the second readout circuit 334. The period of time tX can be set to, but is not limited to, half the pulse period For example, while the pulse PE is falling (at time t2), the control circuit 120 can control the pixel 332 to start performing a signal sampling operation according to the sampling period tS. In addition, at time t2, the processing circuit 134 can start sampling the first pixel output PO1 and the second pixel output PO2 once every sampling period tS according to the sampling control signal SC. As a period of time over which the signal sampling operation performed according to the sampling period tS continues (i.e. the predetermined period of time TR) may be set to two times the pulse period T, a period of time during which the reflected signal RL arrives at the pixel 332 (i.e. a period of time between time tA1 and time tB2 which is equivalent to a pulse period T) can fall within the predetermined period of time TR. As a result, during arrival of the reflected signal RL at the pixel 332, the photo response signal PR of the light sensor PD can be continuously transmitted to the processing circuit 134 through the first readout circuit 333 or the second readout circuit 334. This allows the processing circuit 134 to perform the signal sampling operation upon a pixel output multiple times, wherein the pixel output is generated in response to the photo response signal PR. Accordingly, the processing circuit 134 can obtain signal information carried by the reflected signal RL over a complete pulse period T.
For example, the sampling period tS may be a quarter of the pulse period T. During arrival of the reflected signal RL at the pixel 332, the processing circuit 134 may perform the signal sampling operation on the first pixel output PO1 or the second pixel output PO2 four times. These four sampling operations may reflect signal information on four phases (e.g. 0, π2, π and 3 π/2) of the reflected signal RL in a pulse period T.
However, the above examples are not intended to limit the scope of the present disclosure. Different sampling periods may be used for the signal sampling operation. For example, the sampling period tS may be one eighth or one sixteenth of the pulse period T. The corresponding sampling result may include respective results of eight/sixteen sampling operations which are performed at eight/sixteen phases in a pulse period T, respectively. As another example, the sampling period tS may be one 144th of the pulse period T, wherein M is a positive integer greater than one. It is worth noting that the larger the number of phases corresponding to the sampling result is (i.e. the larger the M is), the higher the harmonic order of the sampling result eliminated using mixing operations and discrete Fourier transforms can be. The accuracy of phase shift information or baseband information can be enhanced accordingly. As the phase shift information corresponds to a result of ToF measurement, the accuracy of the ToF measurement can be enhanced.
Referring again to
The processing circuit 134 may generate the sampling result SR of the pixel 332 according to the first pixel output PO1 and the second pixel output PO2. For example, each time the first pixel output. PO1 and the second pixel output PO2 are sampled, the processing circuit 134 may subtract one of the first pixel output PO1 and the second pixel output PO2 from the other and accordingly generate the sampling result SR of the pixel 332. Noise and interference imposed on the sampling result SR can therefore be reduced.
As the pixel 332 may sense the reflected signal RL to generate the photo response signal PR within a period of time during which the reflected signal RL arrives at the pixel 332 (e.g. a period of time equivalent to the pulse period T), and the processing circuit 134 can sample once the first pixel output PO1 or the second pixel output PO2 generated from each pixel each time the sampling period tS (e.g. one eighth of a pulse period, or T/8) has elapsed, the ToF sensor 130 may perform the signal sampling operation multiples times upon an output of the pixel 332 for the predetermined period of time TR, thereby obtaining signal information on the reflected signal RL in a complete pulse period T.
It is worth noting that, by performing associated signal processing (e.g. signal processing including mixing operations and discrete Fourier transforms) on the corresponding sampling result SR during arrival of the reflected signal RL at the pixel 332, the processing circuit 134 may obtain information on a phase shift between the pulsed light signal EL and the reflected signal RL. The information may be identical/similar to that obtained using CW modulation. For example, the processing circuit 134 may generate a mixing result by performing a mixing operation on the pulsed light signal EL and the sampling result SR (e.g. a result of subtraction of the first pixel output PO1 and the second pixel output PO2) corresponding to each signal sampling operation, perform a discrete Fourier transform on the mixing result, and obtain phase shift information (e.g. baseband information) according to a result of the discrete Fourier transform. In this way, by sending a single pulse intermittently, and performing a signal sampling operation multiple times at a receiver side for a predetermined period of time (e.g. a duration equal to two times the pulse period of the single pulse), the proposed ToF based distance measuring scheme can obtain signal information on a reflected signal in a complete pulse period, achieve effects similar to those obtained using CW modulation, and have good measurement quality.
It is worth noting that an existing measurement technique utilizing CW modulation has to send a plurality of light signals continuously and sample a reflected signal during a plurality of consecutive signal periods in order to obtain phase shift information. In contrast, the proposed ToF based distance measuring scheme can obtain phase shift information by sending a single light pulse intermittently and performing sampling operation for at least two pulse periods, rather than sending a plurality of light signal continuously and sampling a reflected signal during a plurality of consecutive signal periods. In addition, as instantaneous power of a light pulse is much higher than energy from ambient light, the proposed ToF based distance measuring scheme can greatly reduce effects of the ambient light upon a detection result. Further, as the proposed ToF based distance measuring scheme sends a single light pulse from a. transmitter side intermittently, a period of time taken to send the single light pulse is quite short when compared with a time interval between two consecutive light pulses. This means that the average power of the proposed ToF based distance measuring scheme is quite low. In other words, the proposed ToF based distance measuring scheme can achieve low power consumption, rapidly measure a distance to a target object, and maintain good measurement quality.
The above is provided for illustrative purposes, and is not intended to limit the scope of the present disclosure. In some embodiments, a time at which the ToF sensor 130 starts performing the signal sampling operation may be equal to, or substantially equal to, a time at which the pulse generator unit 110 starts sending the pulse PE.
In some embodiments, the pixel array 132 shown in
In addition, the pixel 632 may include an anti-blooming transistor MB. The anti-blooming transistor MB is configured to extract photoelectrons, which are generated from the light sensor PD in response to reception of ambient light, to reduce/minimize undesirable effects of the photoelectrons upon the circuit operation. For example, the photoelectrons may be transferred to a power source. The anti-blooming transistor MB may be turned on according to a fourth control signal TX4, which may be provided by the control circuit 120 shown in
Referring to
It is worth noting that the circuit structure shown in
In some embodiments, a phase difference between control signals used f©r the proposed ToF based distance measuring scheme (e.g. the first control signal TX1 and the second control signal TX2 shown in
After reading the above paragraphs directed to
While certain exemplary embodiments have been described and shown in the accompanying drawing, it is to be understood that such embodiments are merely illustrative of and not restrictive on the present disclosure. Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the present disclosure. Those skilled in the art should also realize that such equivalent constructions do not depart from the spirit and scope of the present disclosure, and that they may make various changes, substitutions, and alterations herein without departing from the spirit and scope of the present disclosure.
The present application is a continuation of international application No. PCT/CN2020/081061, filed on Mar. 25, 2020, which is hereby to reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2020/081061 | Mar 2020 | US |
Child | 17468101 | US |