The present invention relates to a ranging device.
In International Publication No. WO2020/022137, a ranging device for measuring a distance to an object based on a flight time of light from when a light source emits light to when a pixel receives reflected light from the object is disclosed. The ranging device of International Publication No. WO2020/022137 includes a time-to-digital converter to which signals from a plurality of pixels are input, and a correction processing unit that corrects a delay time with a correction value corresponding to a position of the pixel.
Japanese Patent Application Laid-Open No. 2020-524258 discloses a ranging device in which a plurality of photodetectors and a plurality of registers corresponding to the photodetectors are arranged. Each of the plurality of registers holds data indicating the position of the register when incident light is detected. The plurality of registers is coupled to form a shift register. Each time a predetermined time elapses, the data in each register is shifted to the register of the address next to the right, thereby reading of the data is performed. The actual photon arrival time is calculated from the difference between the time when the data is moved to the rightmost address and the time when shifting of the data is performed.
A ranging device in which a time counting unit is shared by a plurality of pixels as in International Publication No. WO2020/022137 and Japanese Patent Application Laid-Open No. 2020-524258, information about incident light may be lost in a case where light enters a pixel in the period when the signal is being read. Therefore, reducing loss of information of incident light may be required.
An object of the present invention is to provide a ranging device capable of reducing loss of information of incident light.
According to a disclosure of the present specification, there is provided a ranging device including: a time counting unit configured to output a time count value indicating an elapsed time from a start of time counting; a light receiving unit including a plurality of pixels and configured to output a light reception count value of incident light to each of the plurality of pixels; and a pixel information generation unit configured to output pixel information in which the light reception count value and the time count value are associated with each other for each pixel. The pixel information generation unit acquires the light reception count value of each of the plurality of pixels and outputs the pixel information of each of the plurality of pixels within a period of time equal to or less than a time in which the time count value changes by a predetermined value.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Hereinafter, embodiments of the present invention will be described with reference to the drawings. The same or corresponding elements are denoted by the same reference numerals throughout the several drawings, and the description thereof may be omitted or simplified.
The ranging device 1 is a device that measures a distance to an object 2 to be measured using a technique such as light detection and ranging (LiDAR). The ranging device 1 measures a distance from the ranging device 1 to the object 2 based on a time difference from when the light is emitted from the light emitting device 3 to when the light is reflected by the object 2 and received by the light receiving device 4, that is, a time of flight (ToF) of the light.
One of the measurement methods in LiDAR is the direct time of flight (dToF) method. The dToF method is a method in which, for example, the elapsed time from light emission to light reception is directly measured by a time-to-digital converter or the like, and the distance is calculated from the elapsed time and the speed of light.
As a light emission method used for ranging of the dToF method, there are three methods, namely, a scan method, a sequential flash method, and a flash method. The scan method is a method of repeatedly performing a process of ranging by irradiating one point of a ranging region with light while shifting an irradiation position in the ranging region. The sequential flash method is a method of repeatedly performing a process of ranging by irradiating a part of a ranging region with light while shifting an irradiation area within the ranging region. The flash method is a method of performing ranging by irradiating the entire ranging region with light collectively and receiving reflected light by a pixel array.
The light received by the light receiving device 4 includes ambient light such as sunlight in addition to reflected light from the object 2. Therefore, the ranging device 1 performs ranging in which the influence of ambient light is reduced by using a method of measuring the light incident in each of a plurality of periods (bin periods) and determining that the reflected light is incident in a period in which the amount of light is a peak.
The light emitting device 3 is a device such as a semiconductor laser that emits light such as laser light to the outside of the ranging device 1. When the ranging device 1 operates in the scan method, the light emitting device 3 may be a point light source. When the ranging device 1 operates in the sequential flash method, the light emitting device 3 may be a line light source or a pattern light source. When the ranging device 1 operates in the flash method, the light emitting device 3 may be a surface light source.
The signal processing circuit 5 may include a control circuit, a counter circuit, a processor that performs arithmetic processing of a digital signal, a memory that stores a digital signal, and the like. The memory may be, for example, a semiconductor memory.
The light receiving device 4 generates a pulse signal including a pulse based on the incident light, counts the pulses, and generates a light reception count value. The light receiving device 4 is, for example, a photoelectric conversion device including an avalanche photodiode as a photoelectric conversion element. In this case, when one photon enters the avalanche photodiode and a charge is generated, one pulse is generated by avalanche multiplication. However, the light receiving device 4 may be, for example, a photoelectric conversion element using another photodiode.
In the sequential flash method and the flash method, reflected light is simultaneously detected by a plurality of pixels. In the scan method, the reflected light may be simultaneously detected by a plurality of pixels in order to improve accuracy. The light receiving device 4 of the present embodiment includes a plurality of pixels in order to apply these methods.
The control unit 13 controls the light emission timing of the light emitting unit 11. The control unit 13 has a function of outputting a clock signal to the light receiving unit 12, the time counting unit 14, and the pixel information generation unit 15.
The time counting unit 14 performs time counting under the control of the control unit 13 to generate an elapsed time from the time when the time counting is started as a time count value, and outputs the time count value to the pixel information generation unit 15. The control unit 13 synchronously controls the light emission timing and the start timing of the time counting in the time counting unit 14. Accordingly, the time counting unit 14 can count the elapsed time from the light emission in the light emitting unit 11. The time counting unit 14 includes, for example, a circuit such as a ring oscillator and a counter, and performs the time counting by counting clock signals that oscillate at high speed and in a constant cycle.
In addition, the control unit 13 performs overall control of signal acquisition in one frame period in the ranging device 1. Accordingly, the ranging device 1 is controlled to perform the light emission in the light emitting unit 11 and start the time counting in the time counting unit 14 a plurality of times in one frame period.
The light emitted from the light emitting unit 11 is reflected by the object 2. The light including the reflected light from the object 2 is received by the light receiving unit 12. The light receiving unit 12 converts the received light into pulses of an electrical signal by photoelectric conversion. The pulses are counted in the light receiving unit 12, and a light reception count value is generated.
The pixel information generation unit 15 acquires the light reception count value generated by the light receiving unit 12 and the time count value output from the time counting unit 14. The pixel information generation unit 15 outputs pixel information in which the light reception count value and the time count value are associated with each other for each pixel.
The generated pixel information is accumulated in the form of a frequency distribution in the frequency distribution generation unit 16. The frequency distribution is information in which a class that is set at a predetermined time interval and a frequency of a light reception count value based on incident light within a period corresponding to each class are associated with each other. The frequency distribution generation unit 16 includes a memory that stores a frequency distribution for each pixel. When the frequency distribution for one ranging frame is accumulated in the frequency distribution generation unit 16, the distance calculation unit 17 calculates, from the frequency distribution of each pixel, distance information of the corresponding pixel. The output unit 18 outputs the calculated distance information to the outside.
In the “frame period” of
In the “shot” in
The “time count” in
The “light reception count” in
As illustrated in
As illustrated in
By accumulating the pulse count values of the plurality of shots, it is possible to detect a bin that is more likely to include a pulse count value due to reflected light from the object 2 with higher accuracy even when a pulse count value due to ambient light may be included. Therefore, even when the light emitted from the light emitting unit 11 is weak, the ranging can be performed with high accuracy by adopting a process of repeating a plurality of shots and accumulating the count values.
Next, a method of acquiring the light reception count value from the light receiving unit 12 will be described with reference to
As illustrated in
The configuration and operation of one of the plurality of pixels 120 will be described with reference to
The APD 121 is a photoelectric conversion element that generates a charge according to incident light by photoelectric conversion. A voltage VL (first voltage) is supplied to an anode of the APD 121. A cathode of the APD 121 is connected to a first terminal of the quenching element 122 and an input terminal of the waveform shaping unit 123. A voltage VH (second voltage) higher than the voltage VL supplied to the anode of the APD 121 is supplied to a second terminal of the quenching element 122. Thus, the anode and the cathode of the APD 121 are supplied with a reverse bias voltage that causes the APD 121 to perform an avalanche multiplication operation. In the APD 121 to which the reverse bias voltage is supplied, when a charge is generated by incident light, the charge causes avalanche multiplication, and an avalanche current is generated.
Note that operation modes when the reverse bias voltage is supplied to the APD 121 includes a Geiger mode and a linear mode. The Geiger mode is a mode of operating with a potential difference between the anode and the cathode being larger than the breakdown voltage, and the linear mode is a mode of operating with the potential difference between the anode and the cathode being close to or smaller than the breakdown voltage.
An APD operated in Geiger mode is referred to as a single photon avalanche diode (SPAD). At this time, for example, the voltage VL (first voltage) is −30 V, and the voltage VH (second voltage) is 1 V. The APD 121 may be operated in the linear mode or the Geiger mode. In the case of the SPAD, since the potential difference becomes large and the effect of avalanche multiplication becomes remarkable as compared with the APD of the linear mode, the SPAD is preferable.
The quenching element 122 functions as a load circuit (quenching circuit) at the time of signal multiplication by avalanche multiplication. The quenching element 122 suppresses the avalanche multiplication by suppressing the voltage supplied to the APD 121 (quenching operation). In addition, the quenching element 122 returns the voltage supplied to the APD 121 to the voltage VH by flowing a current corresponding to the voltage drop due to the quenching operation (recharge operation). The quenching element 122 may be, for example, a resistive element or a transistor.
The waveform shaping unit 123 shapes the potential change of the cathode of the APD 121 obtained at the time of photon detection and outputs a pulse signal. As the waveform shaping unit 123, for example, an inverter circuit is used.
The counter circuit 124 counts the pulse signal output from the waveform shaping unit 123 and holds the digital signal. The counter circuit 124 has a function of resetting a signal held when a control signal is supplied from a control circuit such as the control unit 13. The pixel 120-X can output the digital signal held in the counter circuit 124 as the light reception count value PX (any of P0, P1, . . . PN).
As illustrated in
In the above process, the potential of the node B becomes the high level in a period in which the potential of the node A is lower than a certain threshold. In this manner, the waveform of the drop in the potential of the node A caused by the incidence of the photon is shaped by the waveform shaping unit 123 and output as a pulse to the node B. The counter circuit 124 counts the pulses to generate a light reception count value PX. As described above, the ranging device 1 of the present embodiment may include the pixel 120-X using the avalanche photodiode as the photoelectric conversion element.
Referring back to
Output terminals of the pixels 120-0, 120-1, 120-2, . . . 120-N are connected to first input terminals of selectors 125-0, 125-1, 125-2, . . . 125-N, respectively. That is, the pixels 120-0, 120-1, 120-2, . . . 120-N output the light reception count values P0, P1, P2, . . . PN to the first input terminals of the selectors 125-0, 125-1, 125-2, . . . 125-N, respectively.
Each of the registers 126-0, 126-1, 126-2, . . . 126-N has an input terminal, an output terminal, and a control terminal. Each of the registers 126-0, 126-1, 126-2, . . . 126-N is a sequential circuit having a function of holding an input signal and may include a flip-flop circuit.
A low-level signal is input to the second input terminal of the selector 125-0. The output terminal of the selector 125-0 is connected to the input terminal of the register 126-0. The output terminal of the register 126-0 is connected to the second input terminal of the selector 125-1. The output terminal of the selector 125-1 is connected to the input terminal of the register 126-1. The output terminal of the register 126-1 is connected to the second input terminal of the selector 125-2. Similarly, the selector 125 and the register 126 are alternately connected. The output terminal of the register 126-N is connected to the pixel information generation unit 15. An output signal of the register 126-N is referred to as a signal SR_OUT.
The control unit 13 outputs a clock signal SR_CLK to the control terminals of the registers 126-0, 126-1, 126-2, . . . 126-N and the pixel information generation unit 15. The registers 126-0, 126-1, 126-2, . . . 126-N constitute a shift register. When the signal SEL is at the low level (second state), each of the registers 126-0, 126-1, 126-2, . . . 126-N holds a signal input to the input terminal at a timing when the clock signal SR_CLK rises, and continues to output the signal from the output terminal. Thus, every time the clock signal SR_CLK rises, the signal held in the register 126 of each stage is shifted to the register 126 of the next stage.
When the signal SEL is at the high level (first state), the registers 126-0, 126-1, 126-2, . . . 126-N are connected to the pixels 120-0, 120-1, 120-2, . . . 120-N, respectively. In this case, the registers 126-0, 126-1, 126-2, . . . 126-N acquire and hold the light reception count values P0, P1, P2, . . . PN from the pixels 120-0, 120-1, 120-2, . . . 120-N, respectively.
The time counting unit 14 outputs a time count value CNT to the pixel information generation unit 15. The pixel information generation unit 15 associates the signal SR_OUT output from the register 126-N with the time count value CNT at the time when the signal SR_OUT is input, and outputs them to the frequency distribution generation unit 16 as the pixel information OUT.
The time count value CNT is a value of a signal output from the time counting unit 14 to the pixel information generation unit 15, and corresponds to a bin number.
The clock signal SR_CLK indicates a signal input from the control unit 13 to the registers 126-0, 126-1, 126-2, . . . 126-N. The clock signal SR_CLK is also input to the pixel information generation unit 15, and is used for synchronization of timing of signal acquisition and the like.
The signal SR_OUT is an output signal from the register 126-N that is the last stage of the shift register, and is input to the pixel information generation unit 15.
The light reception count value PX is a signal output from the X-th pixel 120-X. The “PX (t+1)” in
The signal SEL is a switching signal input from the pixel information generation unit 15 to the selectors 125-0, 125-1, 125-2, . . . 125-N. When the signal SEL is at the low level (signal value “0”), the output signal of the register 126 in the previous stage is input to each selector 125. When the signal SEL is at the high level (signal value “1”), the light reception count value output from the corresponding pixel 120 is input to each selector 125.
The pixel information OUT is an output signal that is output from the pixel information generation unit 15 to the frequency distribution generation unit 16. The pixel information OUT includes the light reception count value of each pixel and the time count value associated with the light reception count value. In
Next, a temporal change of each signal will be described with reference to
When the rising edge of the clock signal SR_CLK is input to each register 126 while the signal SEL is at the high level, each register 126 holds the light reception count value output from the corresponding pixel 120. Therefore, at the timing of the time TO, each register 126 holds the light reception count value output from the corresponding pixel 120. At this time, the signal SR_OUT, which is the output signal of the N-th register 126-N, is the light reception count value (PN(t)) output from the N-th pixel 120-N.
After the time T0, the signal SEL starts transition from the high level to the low level. When the rising edge of the clock signal SR_CLK is input to each register 126 while the signal SEL is at the low level, each register 126 holds an output signal of the register 126 in the previous stage. Therefore, after the time TO, every time the rising edge of the clock signal SR_CLK is input to the register 126, the shift register performs an operation of shifting the held signals one stage at a time. That is, at the timing when the value of the time count value CNT is incremented from (t-1) to t, the holding of the light reception count value in the shift register is completed, and switching to a state in which the shift register can perform the operation of shifting the light reception count value is performed.
At time T1, the clock signal SR_CLK transitions (falls) from the high level to the low level. The pixel information generation unit 15 sequentially acquires the value of the signal SR_OUT every time the falling edge of the clock signal SR_CLK is input, and generates and outputs the pixel information OUT. At the time T1, the pixel information generation unit 15 acquires PN(t) as the signal SR_OUT and outputs UN(t) as the pixel information OUT.
After the time T1, the shift of the signal held in the shift register and the reading of the signal to the pixel information generation unit 15 are sequentially repeated in accordance with the transition of the clock signal SR_CLK. For example, at time T2, the clock signal SR_CLK rises, and the signal SR_OUT, which is the output signal of the N-th register 126-N, becomes the light reception count value (P2(t)) output from the second pixel 120-2. Thereafter, at time T3, the clock signal SR_CLK falls, and the pixel information generation unit 15 acquires P2(t) as the signal SR_OUT and outputs U2(t) as the pixel information OUT. As another example, at time T4, the clock signal SR_CLK rises, and the signal SR_OUT, which is the output signal of the N-th register 126-N, becomes the light reception count value (P1(t)) output from the first pixel 120-1. Thereafter, at time T5, the clock signal SR_CLK falls, and the pixel information generation unit 15 acquires P1(t) as the signal SR_OUT and outputs U1(t) as the pixel information OUT.
After time T6, the signal SEL starts transition from the low level to the high level. Thereafter, when the rising edge of the clock signal SR_CLK is input to each register 126 at time T7, the registers 126 hold the light reception count values (PN(t+1), . . . . P2 (t+1), P1(t+1), P0(t+1)) output from the corresponding pixels 120. At the time T7, the value of the time count value CNT is incremented from t to (t+1) in response to the rising edge of the clock signal SR_CLK. Therefore, a period from the time T0 to the time T7 is a period in which the time count value CNT is one value (t) (that is, a period required for the time count value to change by one), and this period corresponds to one bin period in the generation of the frequency distribution. This period includes a plurality of cycles of the clock signal SR_CLK, and the clock signal SR_CLK rises a plurality of times. In other words, the period of the pulses of the clock signal SR_CLK is shorter than the period in which the time count value CNT changes. Therefore, the pixel information generation unit 15 can read the light reception count values PX from the plurality of pixels 120 in a period in which the time count value CNT is one value t.
Also in a period from the time T7 to time T9, the same processing as in the period from the time T0 to the time T7 is performed except that the time count value is changed from t to (t+1). In addition, also in a period before the time T0 and a period after the time T9, the same processing as the period from the time T0 to the time T7 is repeatedly performed except that the time count value is different.
As described above, the period required until the time count value changes by one from t to (t+1) is the period from the time T0 to the time T7. The period in which the pixel information generation unit 15 acquires the light reception count value of each of the plurality of pixels 120 and outputs the pixel information OUT is a period from the time T1 to the time T8. Here, the time during which the time count value changes by one is equal to a length of the period in which the pixel information generation unit 15 acquires the light reception count value of each of the plurality of pixels 120 and outputs the pixel information OUT of each of the plurality of pixels 120. Accordingly, it is possible to reduce the loss of the information of the incident light due to the change in the value of the time count value CNT during the readout of the plurality of pixels 120. The same effect can be obtained as long as the length of the period in which the pixel information generation unit 15 acquires the light reception count value of each of the plurality of pixels 120 and outputs the pixel information OUT of each of the plurality of pixels 120 is equal to or less than the time in which the time count value changes by one.
In the present embodiment, the pixel information generation unit 15 outputs the pixel information OUT of each of the plurality of pixels 120 in a period of the same length as the time when the time count value changes by one. However, the time count value may be a predetermined value greater than one, although the effects described above may vary. That is, the pixel information generation unit 15 may be configured to acquire the light reception count value of each of the plurality of pixels 120 and output the pixel information OUT of each of the plurality of pixels 120 within a period of time equal to or less than the time in which the time count value changes by a predetermined value.
As described above, according to the present embodiment, the ranging device 1 capable of reducing loss of information of incident light is provided.
Although
In the first embodiment, the pixel information generation unit 15 sequentially outputs the pixel information OUT of the plurality of pixels 120 in accordance with the clock signal SR_CLK. In the present embodiment, a configuration example in which the pixel information generation unit 15 can output the pixel information OUT of the plurality of pixels 120 in parallel will be described. Description of elements common to those of the first embodiment may be omitted or simplified as appropriate.
The generation processing unit 15a is a circuit that performs the same operation as that of the pixel information generation unit 15 in the first embodiment. The generation processing unit 15a receives the time count value CNT from the time counting unit 14, the signal SR_OUT from the register 126-N, and the clock signal SR_CLK from the control unit 13. The generation processing unit 15a sequentially outputs the pixel information OUT of each pixel 120.
Each of the registers 151-1, 151-2, . . . 151-N has an input terminal, an output terminal, and a control terminal. Each of the registers 151-1, 151-2, . . . 151-N has a function of holding an input signal and may include a flip-flop circuit. The control unit 13 outputs the clock signal SR_CLK to the control terminals of the registers 151 in addition to the registers 126 and the pixel information generation unit 15.
The pixel information OUT output from the generation processing unit 15a is input to the input terminal of the register 151-1. The output terminal of the register 151-1 is connected to the input terminal of the register 151-2. Similarly, the registers 151-1, 151-2, . . . 151-N are cascaded to form a shift register. Each of the registers 151-1, 151-2, . . . 151-N holds a signal input to the input terminal at a timing when the clock signal SR_CLK falls, and continues to output the signal from the output terminal. Thus, every time the clock signal SR_CLK falls, the signal held in the register 151 of each stage is shifted to the register 151 of the next stage.
A node of the output terminal of the generation processing unit 15a and a node of the output terminal of the registers 151-1, 151-2, . . . 151-N are connected to a plurality of output terminals of the pixel information generation unit 15. A signal output from the node of the output terminal of the generation processing unit 15a is referred to as pixel information OUT[0]. Signals output from the nodes of the output terminals of the registers 151-1, 151-2, . . . 151-N are referred to as pixel information OUT[1], OUT[2], . . . OUT[N], respectively. The pixel information OUT[0] is the same as the pixel information OUT. The plurality of output terminals of the pixel information generation unit 15 is connected to the frequency distribution generation unit 16. That is, in the present embodiment, the pixel information generation unit 15 outputs the pixel information OUT[0], OUT[1], OUT[2], . . . OUT[N] to the frequency distribution generation unit 16 in parallel.
Since the registers 151-1, 151-2, . . . 151-N constitute a shift register, as illustrated in
In this way, the signals in the registers 151-1, 151-2, . . . 151-N are shifted. Thereafter, at the time T7, the pixel information OUT[0], OUT[1], OUT[2], . . . OUT[N] become U0(t), U1(t), U2(t), . . . UN(t), respectively, and the pixel information corresponding to each pixel 120 is output in parallel. As described above, the shift register configured by the registers 151-1, 151-2, . . . 151-N functions as a serial-to-parallel conversion circuit that performs serial-to-parallel conversion on the pixel information OUT output from the generation processing unit 15a. Accordingly, the pixel information generation unit 15 can output the pixel information OUT[0], OUT[1], OUT[2], . . . OUT[N] to the frequency distribution generation unit 16 in parallel.
In the configuration in which the pixel information OUT of each pixel 120 is sequentially output as in the first embodiment, the pixel information OUT is input to the frequency distribution generation unit 16 at the same cycle as the clock signal SR_CLK. On the other hand, the pixel information OUT[0], OUT[1], OUT[2], . . . . OUT[N] of each pixel 120 is input to the frequency distribution generation unit 16 of the present embodiment in parallel at the same cycle as the increment cycle of the time count value CNT. Therefore, the processing cycle of the frequency distribution generation unit 16 can be lengthened, and the processing load is reduced.
According to the present embodiment, as in the first embodiment, the ranging device 1 capable of reducing loss of information of incident light is provided. In addition, in the present embodiment, the processing cycle of the frequency distribution generation unit 16 can be lengthened, and the processing load can be reduced.
Although
The output terminal of the register 126-N of the pixel block 12a and the output terminal of the register 126-N of the pixel block 12b are both connected to the common pixel information generation unit 15. That is, the light reception count values from the pixels 120 in the two rows are input to the common pixel information generation unit 15. Therefore, the time counting unit 14 and the pixel information generation unit 15 are shared by two rows.
The pixel information generation unit 15 may sequentially process the light reception count values of two rows one by one, or may process the light reception count values of two rows in parallel. For example, when the ranging device 1 performs ranging by the flash method, signals may be simultaneously output from the registers 126-N of a plurality of rows. Even in such a case, the pixel information generation unit 15 sequentially processes the light reception count values of two rows one by one or processes the light reception count values of two rows in parallel, so that the loss of pixel information can be avoided. Alternatively, the pixel information generation unit 15 may assign identification information to the pixel information and then output the pixel information of the pixels 120 in any one row.
In addition, the pixel information generation unit 15 may calculate the logical sum of the output signals of the two rows for the processing. For example, in the case where the ranging device 1 performs the ranging processing on a row basis as in the sequential flash method, even when the method of calculating the logical sum is employed, the loss of the pixel information due to calculating the logical sum can be avoided.
According to the present embodiment, as in the first embodiment, the ranging device 1 capable of reducing loss of information of incident light is provided. In addition, in the present embodiment, since the pixels 120 in a plurality of rows share the time counting unit 14 and the pixel information generation unit 15 and the scale of the circuit can be reduced, the size of the ranging device 1 can be reduced.
Although
The output terminal of the register 126-N of the pixel block 12c and the output terminal of the register 126-N of the pixel block 12d are connected to different pixel information generation units 15-1 and 15-2, respectively. That is, the light reception count values from the pixels 120 in one row are input to different pixel information generation units 15-1 and 15-2 for each pixel block.
According to the present embodiment, as in the first embodiment, the ranging device 1 capable of reducing loss of information of incident light is provided. Further, in the present embodiment, since the pixels 120 in one row are processed by a plurality of shift registers, the frequency of the clock signal SR_CLK can be lowered, and the signal processing can be facilitated. In addition, in the present embodiment, the plurality of time counting units 14-1 and 14-2 and the plurality of pixel information generation units 15-1 and 15-2, which are different for each pixel block, are arranged for the pixels 120 in one row. This makes it possible to reduce the number of pixels 120 to which one set of the time counting unit 14 and the pixel information generation unit 15 are connected, thereby facilitating signal processing.
The fourth embodiment illustrates an example in which two time counting units 14-1 and 14-2 and two pixel information generation units 15-1 and 15-2 are arranged for one row of pixels 120. However, the number of the time counting units 14 and the number of the pixel information generation units 15 arranged for the pixels 120 in one row are not limited thereto. For example, one time counting unit 14 and one pixel information generation unit 15 may be arranged for pixels 120 of one row. In the present embodiment, a configuration example in which one time counting unit 14 and one pixel information generation unit 15 are arranged for pixels 120 of one row will be described. Description of elements common to the first to fourth embodiments may be omitted or simplified as appropriate.
The output terminal of the register 126-N of the pixel block 12c and the output terminal of the register 126-N of the pixel block 12d are both connected to a common pixel information generation unit 15. That is, the light reception count values from the pixels 120 of the pixel block 12c and the light reception count values from the pixels 120 of the pixel block 12d are input in parallel to the common pixel information generation unit 15. Therefore, one set of the time counting unit 14 and the pixel information generation unit 15 is shared by the two pixel blocks 12c and 12d.
The pixel information generation unit 15 may sequentially process the light reception count values of the two pixel blocks 12c and 12d one by one, or may process the light reception count values in parallel. Signals may be simultaneously output from the registers 126-N of the two pixel blocks 12c and 12d. Even in such a case, the pixel information generation unit 15 sequentially processes the light reception count values of the two pixel blocks 12c and 12d one by one, or processes the light reception count values in parallel, so that the loss of pixel information can be avoided. Alternatively, the pixel information generation unit 15 may assign identification information to the pixel information and then output the pixel information of the pixels 120 of any one of the pixel blocks 12c and 12d.
According to the present embodiment, as in the first embodiment, the ranging device 1 capable of reducing loss of information of incident light is provided. Further, as in the fourth embodiment, since the pixels 120 in one row are processed by a plurality of shift registers, the frequency of the clock signal SR_CLK can be lowered, and the signal processing can be facilitated. Further, in the present embodiment, since the plurality of pixel blocks shares the time counting unit 14 and the pixel information generation unit 15 and the scale of the circuit can be reduced as compared with the fourth embodiment, the size of the ranging device 1 can be reduced.
In the third embodiment, the pixels 120 in a plurality of rows share the time counting unit 14 and the pixel information generation unit 15. In the fourth embodiment, the pixels 120 in one row are processed by the plurality of shift registers, the plurality of time counting units 14-1 and 14-2, and the plurality of pixel information generation units 15-1 and 15-2. In the present embodiment, the configuration of the third embodiment and the configuration of the fourth embodiment are combined. Description of elements common to the first to fifth embodiments may be omitted or simplified as appropriate.
The output terminal of the register 126-N of the pixel block 12c and the output terminal of the register 126-N of the pixel block 12e are both connected to a common pixel information generation unit 15-1. That is, the light reception count values from the pixels 120 in the two rows are input to the common pixel information generation unit 15-1. Therefore, the time counting unit 14-1 and the pixel information generation unit 15-1 are shared by two rows.
The output terminal of the register 126-N of the pixel block 12d and the output terminal of the register 126-N of the pixel block 12f are both connected to a common pixel information generation unit 15-2. The pixel information generation unit 15-2 to which the pixel blocks 12d and 12f are connected is a circuit different from the pixel information generation unit 15-1 to which the pixel blocks 12c and 12e are connected. That is, the light reception count values from the pixels 120 in one row are input to the plurality of pixel information generation units 15-1 and 15-2 that are different for each pixel block.
According to the present embodiment, as in the first embodiment, the ranging device 1 capable of reducing loss of information of incident light is provided. Further, as in the third embodiment, since the pixels 120 in one row are processed by a plurality of shift registers, the frequency of the clock signal SR_CLK can be lowered, and the signal processing can be facilitated. Further, as in the third embodiment, a plurality of time counting units 14-1 and 14-2 and a plurality of pixel information generation units 15-1 and 15-2, which are different for each pixel block, are arranged for each pixel 120 in one row. This makes it possible to reduce the number of pixels 120 to which one set of the time counting unit 14 and the pixel information generation unit 15 are connected, thereby facilitating signal processing. In addition, as in the fourth embodiment, since the pixels 120 in the plurality of rows share the time counting unit 14 and the pixel information generation unit 15 and the scale of the circuit can be reduced, the size of the ranging device 1 can be reduced. Therefore, both the effect of lowering the frequency of the clock signal SR_CLK and reducing the size of the ranging device 1 can be achieved.
The equipment 80 is connected to a vehicle information acquisition device 810, and can obtain vehicle information such as a vehicle speed, a yaw rate, and a steering angle. Further, the equipment 80 is connected to a control ECU 820 which is a control device that outputs a control signal for generating a braking force to the vehicle based on the determination result of the collision determination unit 804. The equipment 80 is also connected to an alert device 830 that issues an alert to the driver based on the determination result of the collision determination unit 804. For example, when the collision possibility is high as the determination result of the collision determination unit 804, the control ECU 820 performs vehicle control to avoid collision or reduce damage by braking, returning an accelerator, suppressing engine output, or the like. The alert device 830 alerts the user by sounding an alarm, displaying alert information on a screen of a car navigation system or the like, or giving vibration to a seat belt or a steering wheel. These devices of the equipment 80 function as a movable body control unit that controls the operation of controlling the vehicle as described above.
In the present embodiment, ranging is performed in an area around the vehicle, for example, a front area or a rear area, by the equipment 80.
Although the example of control for avoiding a collision to another vehicle has been described above, the embodiment is applicable to automatic driving control for following another vehicle, automatic driving control for not going out of a traffic lane, or the like. Furthermore, the equipment is not limited to a vehicle such as an automobile and can be applied to a movable body (movable apparatus) such as a ship, an airplane, a satellite, an industrial robot and a consumer use robot, or the like, for example. In addition, the equipment can be widely applied to equipment which utilizes object recognition or biometric authentication, such as an intelligent transportation system (ITS), a surveillance system, or the like without being limited to movable bodies.
The present invention is not limited to the above embodiments, and various modifications are possible. For example, an example in which some of the configurations of any one of the embodiments are added to other embodiments and an example in which some of the configurations of any one of the embodiments are replaced with some of the configurations of other embodiments are also embodiments of the present invention.
In the second embodiment, an example in which the shift register configured by the registers 151-1, 151-2, . . . 151-N is added to the configuration of the first embodiment is illustrated, but serial-to-parallel conversion using the shift register can also be applied to other embodiments. For example, the configuration of the pixel information generation unit 15 of the third to sixth embodiments may be replaced with the configuration of the pixel information generation unit 15 of the second embodiment.
In the first to sixth embodiments, a configuration in which the plurality of pixels 120 arranged in one row is connected to one shift register is exemplified, but the arrangement of the plurality of pixels 120 is not limited thereto. For example, a plurality of pixels 120 arranged in one column may be connected to one shift register.
The disclosure of this specification includes a complementary set of the concepts described in this specification. That is, for example, if a description of “A is B” (A=B) is provided in this specification, this specification is intended to disclose or suggest that “A is not B” even if a description of “A is not B” (A≠B) is omitted. This is because it is assumed that “A is not B” is considered when “A is B” is described.
Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
It should be noted that any of the embodiments described above is merely an example of an embodiment for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by the embodiments. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.
According to the present invention, it is possible to provide a ranging device capable of reducing loss of information of incident light.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2023-128388, filed Aug. 7, 2023, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2023-128388 | Aug 2023 | JP | national |