The present invention relates to a measuring device, a distance measuring device and a measuring method.
As one of the distance measuring methods for measuring the distance to an object to be measured using light, a distance measuring method called a direct time of flight (ToF) method is known. In the distance measuring process by the direct ToF method, the light receiving element receives the reflected light when the light emitted from the light source is reflected by the object to be measured, and the time from the emission of the light to the reception as the reflected light is measured. A histogram is created based on the measured time, and the distance to the target is calculated based on this histogram. Further, in the direct ToF method, there is known a configuration in which distance measurement is performed using a pixel array in which light receiving elements are disposed in a two-dimensional lattice pattern.
In the distance measurement using a pixel array, when all the light receiving elements included in the pixel array are driven at the same time or the distance measurement result is output, there are restrictions in terms of power consumption, data communication band, circuit scale, and the like. Therefore, a division driving method has been proposed in which the light receiving region of the pixel array is divided into a plurality of regions, and each divided region is sequentially driven to output the distance measurement result.
Patent Literature 1: JP 2017-173298 A
In the above-mentioned division drive, each divided region obtained by dividing the light receiving region of the pixel array represents a unit of resolution. That is, the smaller the area of the divided region, the higher the resolution of distance measurement. On the other hand, by increasing the area of the divided region and increasing the number of light receiving elements included in the divided region, the addition number in the histogram increases and the distance measurement accuracy is high. In this way, in the existing distance measuring method using the direct ToF method, there is a trade-off relationship between the distance measurement resolution and the distance measurement accuracy, and it is difficult to perform distance measurement with high resolution and high accuracy.
An object of the present disclosure is to provide a measuring device, a distance measuring device, and a measuring method capable of measuring a distance with high resolution and high accuracy.
For solving the problem described above, a measuring device according to one aspect of the present disclosure has a light receiving unit having a plurality of light receiving elements that is disposed in a matrix array and that is included in a target region; a controller that designates an addition region including two or more light receiving elements of the plurality of light receiving elements and that controls scanning with the designated addition region as a unit; and a time measurement unit that measures, according to the scanning, a time from light emission timing when a light source emits light to light reception timing when each light receiving element included in the addition region receives the light to acquire a measured value, wherein the controller designates, as the addition region, a first addition region and a second addition region whose part overlaps the first addition region.
Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same parts are designated by the same reference numerals, so that duplicate description will be omitted.
The present disclosure relates to a technique for performing distance measurement using light. Prior to the description of each embodiment of the present disclosure, the techniques applicable to each embodiment will be described for ease of understanding. In each embodiment, the direct time of flight (ToF) method is applied as the distance measuring method. The direct ToF method is a method in which the light receiving element receives the reflected light when the light emitted from the light source is reflected by the object to be measured, and the distance is measured based on the time difference between the light emission timing and the light reception timing.
The direct ToF method of distance measurement will be schematically described with reference to
Here, the time when the light source unit 301 emits light (light emission timing) is time t0, and the time when the light receiving unit 302 receives the reflected light when the light emitted from the light source unit 301 is reflected by the object to be measured 303 (light reception timing) is t1. Assuming that the constant c is the speed of light (2.9979×108 [m/sec]), the distance D between the distance measuring device 300 and the object to be measured 303 is calculated by the following equation (1).
D=(c/2)×(t1−t0) (1)
The distance measuring device 300 repeats the above-mentioned process a plurality of times. The light receiving unit 302 may include a plurality of light receiving elements, and the distance D may be calculated based on each light reception timing when the reflected light is received by each light receiving element. The distance measuring device 300 classifies time tm (called the light receiving time tm) from time t0 at the light emission timing to the light reception timing when the light is received by the light receiving unit 302 based on the class (bins) to generate a histogram.
The light received by the light receiving unit 302 during the light receiving time tm is not limited to the reflected light when the light emitted from the light source unit 301 is reflected by the object to be measured. For example, the ambient light around the distance measuring device 300 (light receiving unit 302) is also received by the light receiving unit 302.
The distance measuring device 300 counts the number of times the light receiving time tm is acquired based on the bin to obtain the frequency 310 for each bin to generate a histogram. Here, the light receiving unit 302 also receives light other than the reflected light reflected when the light emitted from the light source unit 301 is reflected. As an example of such light other than the target reflected light, there is the above-mentioned ambient light. The portion indicated by the range 311 in the histogram includes the ambient light component due to the ambient light. The ambient light is light that is randomly incident on the light receiving unit 302 and is noise with respect to the reflected light of interest.
On the other hand, the target reflected light is light received according to a specific distance and appears as an active light component 312 in the histogram. The bin corresponding to the frequency of the peak in the active light component 312 is the bin corresponding to the distance D of the object to be measured 303. By acquiring the representative time of the bin (for example, the time in the center of the bin) as the time t1 described above, the distance measuring device 300 can calculate the distance D to the object to be measured 303 according to the above equation (1). In this way, by using a plurality of light receiving results, it is possible to perform appropriate distance measurement for random noise.
The light source unit 2 corresponds to the light source unit 301 described above and is a laser diode, and is driven so as to emit the laser beam in a pulsed manner, for example. A vertical cavity surface emitting laser (VCSEL) that emits the laser beam can be applied for the light source unit 2 as a face light source. Not limited to this, the light source unit 2 may have a configuration in which an array in which laser diodes are disposed on a line may be used, and the laser beam emitted from the laser diode array is scanned in a direction perpendicular to the line. Furthermore, it may have a configuration in which a laser diode as a single light source is used and the laser beam emitted from the laser diode is scanned in the horizontal and vertical directions.
The distance measuring device 1 includes a plurality of light receiving elements corresponding to the light receiving unit 302 described above. The plurality of light receiving elements are, for example, disposed in a two-dimensional lattice to form a light receiving face. The optical system 5 guides light incident from the outside to the light receiving face included in the distance measuring device 1.
The controller 4 controls the overall operation of the electronic device 6. For example, the controller 4 supplies the distance measuring device 1 with a light emitting trigger that is a trigger for causing the light source unit 2 to emit light. The distance measuring device 1 causes the light source unit 2 to emit light at timing based on this light emitting trigger to store time to indicating the light emission timing. Further, the controller 4 sets a pattern for distance measurement for the distance measuring device 1 in response to an instruction from the outside, for example.
The distance measuring device 1 counts the number of times that time information (light receiving time tm) indicating the timing at which light is received by the light receiving face is acquired within a predetermined time range to obtain the frequency for each bin to generate the above-mentioned histogram. The distance measuring device 1 further calculates the distance D to the object to be measured based on the generated histogram. The information indicating the calculated distance D is stored in the storage unit 3.
In
The pixel array unit 100 includes a plurality of pixel circuits 10 each including a light receiving element, which are disposed in a two-dimensional lattice pattern. The operation of each pixel circuit 10 is controlled by the pixel controller 102 according to the instruction of the overall controller 103. For example, the pixel controller 102 may control the reading of the pixel signal from each pixel circuit 10 for each block including (pxq) pixel circuits 10 with p pixels in the row direction and q pixels in the column direction. Further, the pixel controller 102 can scan respective pixel circuits 10 in the row direction and further scan them in the column direction with the block as a unit to read a pixel signal from respective pixel circuits 10. Not limited to this, the pixel controller 102 can also control each pixel circuit 10 independently. Further, the pixel controller 102 can set a predetermined region of the pixel array unit 100 as a target region, and can set the pixel circuits 10 included in the target region as the target pixel circuits 10 from which a pixel signal is to be read. Furthermore, the pixel controller 102 can collectively scan a plurality of rows (plurality of lines), further perform scanning in the plurality of rows (plural lines) in the column direction, and read a pixel signal from each pixel circuit 10.
The pixel signal read from each pixel circuit 10 is supplied to the distance measuring processing unit 101. The distance measuring processing unit 101 includes a conversion unit 110, a generation unit 111, and a signal processing unit 112.
The pixel signal read from each pixel circuit 10 to output from the pixel array unit 100 is supplied to the conversion unit 110. Here, the pixel signal is asynchronously read from each pixel circuit 10 and supplied to the conversion unit 110. That is, the pixel signal is read from the light receiving element and is output according to the timing at which light is received by each pixel circuit 10.
The conversion unit 110 converts the pixel signal supplied from the pixel array unit 100 into digital information. That is, the pixel signal supplied from the pixel array unit 100 is output corresponding to the timing when light is received by the light receiving element included in the pixel circuit 10 corresponding to the pixel signal. The conversion unit 110 converts the supplied pixel signal into time information indicating the timing.
The generation unit 111 generates a histogram based on the time information in which the pixel signal is converted by the conversion unit 110. Here, the generation unit 111 counts the time information based on the unit time d set by a setting unit 113 to generate the histogram. The details of the histogram generation process by the generation unit 111 will be described later.
The signal processing unit 112 performs the predetermined arithmetic process based on the data of the histogram generated by the generation unit 111, and calculates, for example, distance information. The signal processing unit 112 creates a curve approximation of the histogram based on, for example, the data of the histogram generated by the generation unit 111. The signal processing unit 112 can detect the peak of the curve to which this histogram approximates and obtain the distance D based on the detected peak.
When the signal processing unit 112 performs a curve approximation of the histogram, the signal processing unit 112 can perform a filter process to the curve to which the histogram approximates. For example, the signal processing unit 112 can suppress a noise component by performing a low pass filter process on a curve to which the histogram approximates.
The distance information obtained by the signal processing unit 112 is supplied to an interface 106. The interface 106 outputs the distance information supplied from the signal processing unit 112 to the outside as output data. For example, a mobile industry processor interface (MIPI) can be used as the interface 106.
In the above description, the distance information obtained by the signal processing unit 112 is output to the outside via the interface 106, but the embodiment is not limited to this example. That is, the histogram data, which is data of the histogram generated by the generation unit 111, may be output from the interface 106 to the outside. In this case, the information indicating the filter coefficient can be omitted from the distance measurement condition information set by the setting unit 113. The histogram data output from the interface 106 is supplied to, for example, an external information processing device, and is appropriately processed.
The light receiving element 1000 converts the incident light into an electrical signal by photoelectric conversion to output the signal. In each embodiment, the light receiving element 1000 converts the incident photon (photon) into an electrical signal by photoelectric conversion to output a pulse corresponding to the entry of the photon. In each embodiment, a single photon avalanche diode is used as the light receiving element 1000. Hereinafter, the single photon avalanche diode is referred to as a single photon avalanche diode (SPAD). The SPAD has the characteristic in which when a large negative voltage that causes avalanche multiplication is applied to the cathode, the electrons generated in response to the entry of one photon cause avalanche multiplication and a large current flows. By utilizing this characteristic of the SPAD, it is possible to detect the entry of one photon with high sensitivity.
In
The transistor 1100 is a current source that outputs a current corresponding to the power supply voltage Vdd and the reference voltage Vref from the drain. With such a configuration, a reverse bias is applied to the light receiving element 1000. When a photon is incident on the light receiving element 1000 with the switch unit 1101 turned on, the avalanche multiplication is started and a current flows from the cathode toward the anode of the light receiving element 1000.
The signal extracted from the connection point between the drain of the transistor 1100 (one end of the switch unit 1101) and the cathode of the light receiving element 1000 is input to the inverter 1104. The inverter 1104 performs, for example, a threshold value determination on the input signal, inverts the signal each time the signal exceeds the threshold value in the positive direction or the negative direction to output the signal as the signal Vpls, which is a pulsed output signal.
The signal Vpls output from the inverter 1104 is input to the first input port of the AND circuit 1110. A signal EN_F is input to the second input port of the AND circuit 1110. The AND circuit 1110 outputs the signal Vpls from the pixel circuit 10 via a terminal 1122 when both the signal Vpls and the signal EN_F are in the high state.
In
The signals XEN_SPAD_V and XEN_SPAD_H are used as vertical and horizontal control signals, respectively, in a two-dimensional lattice pattern in which respective pixel circuits 10 are disposed in the pixel array unit 100. As a result, the on/off state of each pixel circuit 10 included in the pixel array unit 100 can be controlled for each pixel circuit 10. The on state of the pixel circuit 10 is a state in which the signal Vpls can be output, and the off state of the pixel circuit 10 is a state in which the signal Vpls cannot be output.
For example, in the pixel array unit 100, the signal XEN_SPAD_H is set to the state in which the transistor 1103 is turned on for consecutive q columns of the two-dimensional lattice, and the signal XEN_SPAD_V is set to the state in which the transistor 1102 is turned on for consecutive p rows. As a result, the output of each light receiving element 1000 can be enabled in a block of p rows×q columns. In addition, since the signal Vpls is output by the AND circuit 1110 from the pixel circuit 10 by the logical product with the signal EN_F, for example, it is possible to control whether the output of each light receiving element 1000 enabled by the signals XEN_SPAD_V and XEN_SPAD_H is enabled/disabled in more detail.
Further, by supplying the signal EN_PR that turns off the switch unit 1101, for example, to the pixel circuit 10 including the light receiving element 1000 whose output is to be disabled, it is possible to stop the supply of the power supply voltage Vdd to the light receiving element 1000, and the pixel circuit 10 can be turned off. This makes it possible to reduce the power consumption of the pixel array unit 100.
These signals XEN_SPAD_V, XEN_SPAD_H, EN_PR, and EN_F are generated by the overall controller 103 based on the parameters stored in the register of the overall controller 103, for example. The parameters may be stored in the register in advance, or may be stored in the register according to an external input. Each of the signals XEN_SPAD_V, XEN_SPAD_H, EN_PR, and EN_F generated by the overall controller 103 is supplied to the pixel array unit 100 by the pixel controller 102.
The control by the signals EN_PR, XEN_SPAD_V, and XEN_SPAD_H using the switch unit 1101 and the transistors 1102 and 1103 described above is performed by using the analog voltage. On the other hand, the control by the signal EN_F using the AND circuit 1110 is performed by using the logic voltage. Therefore, the control by the signal EN_F can be performed at a lower voltage than the control by the signals EN_PR, XEN_SPAD_V, and XEN_SPAD_H, and is easy to handle.
In the light receiving chip 20, the light receiving elements 1000 included in the plurality of respective pixel circuits 10 are disposed in a two-dimensional lattice pattern in the region of the pixel array unit 100. Further, in the pixel circuit 10, the transistors 1100, 1102, and 1103, the switch unit 1101, the inverter 1104, and the AND circuit 1110 are formed on the logic chip 21. The cathode of the light receiving element 1000 is connected via, for example, the coupling unit 1120 by a copper-copper connection (CCC) or the like between the light receiving chip 20 and the logic chip 21.
The logic chip 21 is provided with a logic array unit 200 including a signal processing unit that processes a signal acquired by the light receiving element 1000. The logic chip 21 can be further provided with a signal processing circuit unit 201 that processes the signal acquired by the light receiving element 1000, and an element controller 203 that controls the operation as the distance measuring device 1 in close proximity to the logic array unit 200.
For example, the signal processing circuit unit 201 can include the distance measuring processing unit 101 described above. Further, the element controller 203 can include the pixel controller 102, the overall controller 103, the clock generation unit 104, the light emission timing controller 105, and the interface 106 described above.
The configuration on the light receiving chip 20 and the logic chip 21 is not limited to this example. Further, the element controller 203 can be disposed for the purpose of the driving and control of another unit, for example, in the vicinity of the light receiving element 1000, in addition to the control of the logic array unit 200. Other than the arrangement illustrated in
In
Further, in each embodiment, respective pixel circuits 10 included in the pixel array unit 100 are controlled on a basis of an element 11 including a total of nine pixel circuits 10, three in the horizontal direction and three in the vertical direction. For example, the signal EN_SPAD_H corresponding to the above-mentioned signal XEN_SPAD_H that controls respective pixel circuits 10 in the row direction (horizontal direction), that is, on a column basis, is output from the overall controller 103 as a 3-bit signal (indicated as [2:0]) with the element 11 as a unit, and is supplied to the horizontal controller 102a. That is, by this one 3-bit signal, the signals EN_SPAD_H[0], EN_SPAD_H[1], and EN_SPAD_H[2] for the three pixel circuits 10 disposed consecutively in the horizontal direction are merged and transmitted.
In the example of
) of each signal EN_SPAD_H#0[2:0], EN_SPAD_H#1[2:0], . . . , and EN_SPAD_H#(x/3) [2:0].
Similarly, for example, the signal EN_SPAD_V corresponding to the above-mentioned signal XEN_SPAD_V that controls respective pixel circuits 10 in the column direction (vertical direction), that is, on a row basis, is output from the overall controller 103 as a 3-bit signal with the element 11 as a unit, and is supplied to the vertical controller 102b. That is, by this one 3-bit signal, the signals EN_SPAD_V[0], EN_SPAD_V[1], and EN_SPAD_V[2] for three pixel circuits 10 disposed consecutively in the vertical direction are merged and transmitted.
In the example of
Although not illustrated, for example, similar to the signal EN_SPAD_V above, the signal EN_PR is output from the overall controller 103 as a 3-bit signal with the element 11 as a unit, and is supplied to the vertical controller 102b. The vertical controller 102b controls each row of the corresponding element according to the 3-bit value of each signal EN_PR.
As illustrated in
The horizontal controller 102a supplies each bit of respective signals EN_F#0[41:0], EN_F#1[41:0], . . . , and EN_F#(x/3) [41:0] to each row of the corresponding control target 130. As illustrated in
That is, by this 42-bit signal EN_F[41:0], the signals EN_F[0], EN_F[1], . . . , and EN_F[41] for 42 sets, of three pixel circuits 10 disposed consecutively in the horizontal direction, which are disposed consecutively in the vertical direction are merged and transmitted.
In this way, it is possible to control the pixel array unit 100 differently for a plurality of columns by the signal EN_F. Further, the plurality of columns of the pixel array unit 100 is supplied with the same signal EN_F for a plurality of rows. Therefore, it is possible to control the respective pixel circuits 10 included in the pixel array unit 100 with the plurality of columns as the minimum unit in the width direction, with the plurality of rows as a cycle.
In each embodiment, a read line for reading the signal Vpls is shared for a predetermined number of pixel circuits 10 in the column direction. In the example of
In the respective groups 12u, 12u+1, 12u+2, . . . , the read lines of the pixel circuits 10 whose positions in the groups correspond are shared. In the example of
For example, for the group 12u, the pixel circuits 1011 to 101v included in group 12u are provided with respective OR circuits 4111, 4112, . . . , and 411v, and the read lines of the pixel circuits 1011 to 101v is connected to respective first input ports. Similarly for the group 12u+1, the pixel circuits 1021 to 102v included in the group 12u+1 are provided with OR circuits 4121 to 412v. Similarly for the group 12u+2, the pixel circuits 1031 to 10v included in the group 12u+2 are provided with OR circuits 4131 to 413v, respectively.
The output of each of the OR circuits 4111 to 411v is input to, for example, the distance measuring processing unit 101.
Taking the pixel circuits 1011, 1021, and 1031 as an example, the read line of the pixel circuit 1011 is connected to the first input port of the OR circuit 4111, and the output of the OR circuit 4121 is connected to the second input port. The read line of pixel circuit 1021 is connected to the first input port of the OR circuit 4121, and the output of the OR circuit 4131 is connected to the second input port. The same applies to the OR circuit 4131 and subsequent circuits.
For the configuration illustrated in
On the other hand, in the configuration illustrated in
Further, when the vertical controller 102b designates simultaneous reading from v pixel circuits 10 disposed continuously in a column, the vertical controller 102b controls so as not to perform reading from the other pixel circuits 10 in the column. Therefore, for example, the output of the OR circuit 4111 is the signal Vpls read from any one pixel circuit 10 of the pixel circuits 1011, 1021, 1031, . . . .
In this way, by connecting the read line of each pixel circuit 10 and performing read control on each pixel circuit 10, it is possible to reduce the number of read lines on a column basis.
Next, prior to the description of the present disclosure, the distance measuring method by the existing technique will be schematically described.
For example, the overall controller 103 performs the process of the pixel 50a1 on the pixels 50a1, . . . , and 50a4 aligned in the row direction of the target region in the pixel array unit 100. In this way, scanning is performed on the scan region in which the height in the column direction matches the height of the pixel 50a1 in the column direction and the width in the row direction matches the width of the target region. As a result, the distance information at the representative positions 51a1, . . . , and 51a4 of the pixels 50a1, . . . , and 50a4, respectively, can be obtained. This scanning is repeatedly performed while changing the position of the scan region in the column direction of the target region on a scan region basis, and the distance information at each representative position in the target region in the pixel array unit 100 is acquired.
In the following, scanning refers to a process in which the light source unit 2 (see
Here, the representative positions 51a1 to 51a4 illustrated in
In the example of
According to this existing technique, the number of pixel circuits 10 included in each pixel 50b11 to 50b27 in the example of
Also, in the example of
Next, the first embodiment will be described.
For example, the overall controller 103 designates a scan region including respective pixels 52a1, 52a2, 52a3, and 52a4 for the pixel array unit 100, and performs scanning on the designated scan region.
For example, the overall controller 103 sets, for example, the above signals EN_SPAD_H and EN_SPAD_V according to the size and position of the scan region (respective pixels 52a1, 52a2, 52a3, and 52a4) to be designated. The overall controller 103 passes the set signals EN_SPAD_H and EN_SPAD_V to the horizontal controller 102a and the vertical controller 102b, respectively.
The horizontal controller 102a generates, according to the passed signal EN_SPAD_H, the signal XEN_SPAD_H that designates, on a column basis, the pixel circuits 10 included in the pixel, of the pixels 52a1, 52a2, 52a3, and 52a4, from which reading is performed to supply it to each pixel circuit 10. Similarly, the vertical controller 102b generates, according to the passed signal EN_SPAD_V, the signal XEN_SPAD_V that designates respective pixel circuits 10 in the height direction (column direction) in the scan region including respective pixels 52a1, 52a2, 52a3, and 52a4 to supply it to each pixel circuit 10.
By this scanning, in the distance measuring processing unit 101, the generation unit 111 generates a histogram for each of the pixels 52a1, 52a2, 52a3, and 52a4. The signal processing unit 112 acquires distance information at the representative positions 53a1, 53a2, 53a3, and 53a4 of the pixels 52a1, 52a2, 52a3, and 52a4, respectively, based on the generated histogram. The acquired distance information is stored in, for example, a memory of the signal processing unit 112 in association with the position information indicating the positions of the representative positions 53a1 to 53a4.
When the scanning of the scan region of the pixels 52a1 to 52a4 is completed, the overall controller 103 designates a new pixel at a position where the position of each of the pixels 52a1 to 52a4 is shifted in the row direction. That is, as illustrated in
That is, the pixels 52b1, 52b2, 52b3, and 52b4 partially overlaps the corresponding pixels 52a1, 52a2, 52a3, and 52a4, respectively, before the positions are shifted.
The overall controller 103 scans the new scan region of the pixels 52b1 to 52b4. By this scanning, the generation unit 111 generates a histogram for each of the pixels 52b1 to 52b4, and the signal processing unit 112 acquires distance information at the representative positions 53b1 to 53b4 of the pixels 52b1 to 52b4, respectively, based on the generated histogram. The representative positions 53b1 to 53b4 are shifted (phase shift) from the above-mentioned representative positions 53a1 to 53a4, respectively, by j/2 pixel circuits 10 in the row direction. The acquired distance information of the representative positions 53b1 to 53b4 is stored in, for example, a memory included in the signal processing unit 112 association with position information indicating the positions of the representative positions 53b1 to 53b4.
In the example of
By the scanning of
That is, the pixels 52c1, 52c2, 52c3, and 52c4 partially overlaps the corresponding pixels 52a1, 52a2, 52a3, and 52a4, respectively, before the positions are shifted.
The overall controller 103 scans the scan region of the pixels 52c1 to 52c4. By this scanning, the generation unit 111 generates a histogram for each of the pixels 52c1 to 52c4, and the signal processing unit 112 acquires distance information at the representative positions 53c1 to 53c4 of the pixels 52c1 to 52c4, respectively, based on the generated histogram. The representative positions 53c1 to 53c4 are shifted (phase shift) from the above-mentioned representative positions 53a1 to 53a4, respectively, by i/2 pixel circuits 10 in the column direction. The acquired distance information of the representative positions 53c1 to 53c4 is stored in, for example, a memory included in the signal processing unit 112 in association with position information indicating the positions of the representative positions 53c1 to 53c4.
With the scan region of the pixels 52c1 to 52c4 as a new scan region of the scan region of the pixels 52c1 to 52c4 in which positions in the row direction correspond, the overall controller 103 performs scanning on the scan region whose position is shifted by j/2 pixel circuits 10 in the row direction as described with reference to
Further, in the first embodiment, distance information at each representative position 53a1 to 53d4, which is represented by the pixel 52a1 in
Further, in one time scan, for example, a histogram is generated and distance information is acquired for four pixels 52a1, 52a2, 52a3, and 52a4. Therefore, the number of pixels to be processed in one time scan can be reduced.
In the above description, scanning is performed on all the pixels included in the scan region, but the embodiment is not limited to this example. For example, it is conceivable to scan respective pixels included in the scan region by thinning and perform the scanning by thinning a plurality of times. In this case, it is possible to further reduce the amount of process and power consumption per scan. Further, in the above description, shift of the pixel amounts is half of the column direction size (height) and half of the row direction size (width) of the pixel in the column direction and the row direction, respectively, but the embodiment is not limited to this example. That is, the amount of pixel shift may be such that part of the pixel after the shift overlaps the pixel before the shift.
Next, the scanning control according to the first embodiment will be described. As described above, the overall controller 103 designates new pixels 52b1 to 52b4 by shifting the pixels 52a1 to 52a4 in the row direction. At this time, the overall controller 103 designates new pixels 52b1 to 52b4 by giving an offset in the row direction to the positions of the pixels 52a1 to 52a4.
In the example of
In the first embodiment, regions 52a and 52b are scanned in the same row. When the scan of regions 52a and 52b in one row is completed, two new regions are designated by shifting the regions 52a and 52b in the column direction by a height lower than the height of the regions 52a and 52b (the number of pixel circuits 10 in the column direction).
The process switching signal is a signal corresponding to a processing unit which is the shortest time to perform the process in one scan region. In the example of
In
The period in the low state of the process switching signal is a period for switching the scan region to the next scan region. During this low state period, the overall controller 103 generates signals EN_SPAD_H and EN_SPAD_V for the next scan region and passes them to the horizontal controller 102a and the vertical controller 102b. During this low state period, the horizontal controller 102a and the vertical controller 102b generates, based on the signals EN_SPAD_H and EN_SPAD_V, the signals XEN_SPAD_H and XEN_SPAD_V to supply them to the pixel array unit 100.
In
In
In the next step S12, the distance measuring processing unit 101 measures the time according to the scanning in step S11 to acquire, based on the measured time, the distance information at respective representative positions 53a1 to 53a4 of the pixels 52a1 to 52a4.
In the next step S13, the overall controller 103 determines whether the processes for all the addition regions have been completed. The overall controller 103 determines that the processes for all the addition regions are completed, for example, when the scanning and the acquisition of the distance information for all the pixels set in the pixel array unit 100 are completed. Not limited to this, the overall controller 103 can also determine whether the process of all the addition regions has been completed, for example, in response to an instruction from the outside. When the overall controller 103 determines that the processes for all the addition regions have been completed (step S13, “Yes”), the overall controller 103 ends a series of processes according to the flowchart of
On the other hand, when the overall controller 103 determines in step S13 that the processes for all the addition regions have not been completed (step S13, “No”), the overall controller 103 advances the process to step S14.
In step S14, the overall controller 103 sets the addition region to be scanned next. For example, the overall controller 103 designates the position and size of the addition region to be scanned next. At this time, the overall controller 103 sets the addition region (second addition region) so that part of the addition region (second addition region) overlaps the addition region (first addition region) that was scanned immediately before (for example, pixels 52b1 to 52b4).
When the addition region to be scanned next is set in step S14, the process returns to step S10. In step S10, the overall controller 103 designates the addition region set in the immediately preceding step S14 as an addition region to be scanned, and executes the process after step S11.
Next, a first modification of the first embodiment will be described. The first modification of the first embodiment is an example in which the height of the scan region (pixel height) and the movement width (movement height) when shifting the scan region in the column direction are variable.
Changing the pixel height means changing the addition number when generating the histogram when the pixel width is fixed. By making the height and the movement width of the scan region independently variable, the resolution of the distance information in the plane direction and the accuracy of the distance information can each be set. By making the pixel height and the movement width variable in this way, it is possible to measure the distance according to the application and the target, for example.
Next, a second modification of the first embodiment will be described. In the above description, the scanning is performed by shifting respective pixels to be scanned in the row direction and the column direction over the entire effective region of the pixel array unit 100, but the embodiment is not limited to this example. In the second modification of the first embodiment, respective pixels to be scanned are shifted in the row direction and the column direction for scanning in a predetermined region of the effective region of the pixel array unit 100, and the pixels to be scanned are fixed in the region other than the predetermined region of the effective region of the pixel array unit 100.
Next, as a second embodiment of the present disclosure, application examples of the first embodiment of the present disclosure and each modification of the first embodiment will be described.
The distance measuring device 1 described above can be used in various cases in which light such as visible light, infrared light, ultraviolet light, and X-ray is sensed as described below.
The technology according to the present disclosure may be further applied to devices mounted on various moving objects such as automobiles, electric vehicles, hybrid electric vehicles, motorcycles, bicycles, personal mobility, airplanes, drones, ships, and robots.
A vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example illustrated in
The drive system control unit 12010 controls the operation of the device related to the drive system of the vehicle according to various programs. For example, the drive system control unit 12010 serves as a driving force generation unit that generates the driving force of the vehicle such as an internal combustion engine or a driving motor, a driving force transmission mechanism that transmits the driving force to the wheels, a steering mechanism for adjusting a steering angle of the vehicle, and a control device such as a braking device that generates a braking force of the vehicle.
The body system control unit 12020 controls the operation of various devices mounted on the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as a head lamp, a back lamp, a brake lamp, a blinker and a fog lamp. In this case, the body system control unit 12020 may receive radio waves transmitted from a portable device that substitutes for the key or signals of various switches. The body system control unit 12020 receives the input of these radio waves or signals and controls a door lock device, a power window device, a lamp, and the like of the vehicle.
The vehicle-exterior information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the vehicle-exterior information detection unit 12030. The vehicle-exterior information detection unit 12030 causes the imaging unit 12031 to capture an image of the outside of the vehicle and receives the picked up image. The vehicle-exterior information detection unit 12030 may perform the object detection process or the distance detection process of detecting a person, a vehicle, an obstacle, a sign, or characters on the road surface based on the received image. The vehicle-exterior information detection unit 12030 performs the image process on the received image, for example, and performs the object detection process and the distance detection process based on the result of the image process.
The imaging unit 12031 is an optical sensor that receives light to output an electrical signal according to the amount of the light received. The imaging unit 12031 can output an electrical signal as an image or can output it as distance measurement information. Further, the light received by the imaging unit 12031 may be visible light or invisible light such as infrared light.
The in-vehicle information detection unit 12040 detects in-vehicle information. For example, a driver state detector 12041 that detects the driver's state is connected to the in-vehicle information detection unit 12040. The driver state detector 12041 includes, for example, a camera that captures the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver, or may determine whether the driver is dozing based on the detection information input from the driver state detector 12041.
The microcomputer 12051 can calculate the control target value of the driving force generation unit, the steering mechanism or the braking device based on the information inside and outside the vehicle acquired by the vehicle-exterior information detection unit 12030 or the in-vehicle information detection unit 12040 to output a control command to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control for the purpose of realizing a function of an advanced driver assistance system (ADAS) including vehicle collision avoidance or impact mitigation, follow-up driving based on inter-vehicle distance, vehicle speed maintenance driving, vehicle collision warning, or vehicle lane deviation warning.
In addition, based on the information around the vehicle acquired by the vehicle-exterior information detection unit 12030 or the in-vehicle information detection unit 12040, the microcomputer 12051 can perform cooperative control for the purpose of automatic driving or the like in which the vehicle travels autonomously without depending on the operation of the driver by controlling the driving force generation unit, the steering mechanism, the braking device, etc.
Further, the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the vehicle-exterior information detection unit 12030. For example, the microcomputer 12051 can control the head lamps according to the position of the preceding vehicle or the oncoming vehicle detected by the vehicle-exterior information detection unit 12030 to perform cooperative control for the purpose of anti-glare such as switching the high beam to the low beam.
The audio image output unit 12052 transmits an output signal of at least one of an audio and an image to an output device capable of visually or audibly notifying the passenger or the outside of the vehicle of information. In the example of
For example, the imaging units 12101, 12102, 12103, 12104, and 12105 are provided at positions such as the front nose, the side mirrors, the rear bumper, the back door, and the upper part of the windshield in the vehicle interior of the vehicle 12100. The imaging unit 12101 provided on the front nose and the imaging unit 12105 provided on the upper part of the windshield in the vehicle interior mainly acquire an image in front of the vehicle 12100. The imaging units 12102 and 12103 provided on the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided on the rear bumper or the back door mainly acquires an image behind the vehicle 12100. The front image acquired by the imaging units 12101 and 12105 is mainly used for detecting a preceding vehicle or a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or the like.
Note that
At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera composed of a plurality of imaging devices, or may be an imaging device having pixels for phase-difference detection.
For example, by finding the distance to each three-dimensional object within the imaging ranges 12111 to 12114, and the temporal change of this distance (relative velocity with respect to the vehicle 12100) based on the distance information obtained from the imaging units 12101 to 12104, the microcomputer 12051 can extract, in particular, a three-dimensional object that is the closest three-dimensional object on the traveling path of the vehicle 12100 and that travels in substantially the same direction as the vehicle 12100 at a predetermined speed (for example, 0 km/h or more) as a preceding vehicle. Further, the microcomputer 12051 can set an inter-vehicle distance to be secured in front of the preceding vehicle in advance, and can perform automatic braking control (including follow-up stop control), automatic acceleration control (including follow-up start control), and the like. In this way, cooperative control can be performed for the purpose of automatic driving or the like in which the vehicle travels autonomously without depending on the driver's operation.
For example, the microcomputer 12051 can sort three-dimensional object data related to a three-dimensional object into a two-wheeled vehicle, an ordinary vehicle, a large vehicle, a pedestrian, and other three-dimensional objects such as a utility pole based on the distance information obtained from the imaging units 12101 to 12104 to extract them, and can use them for automatic avoidance of obstacles. For example, the microcomputer 12051 identifies obstacles around the vehicle 12100 as an obstacle that are visible to the driver of the vehicle 12100 and an obstacle that are difficult to see. The microcomputer 12051 can determine the collision risk, which indicates the risk of collision with each obstacle, and when the collision risk is above the set value and there is a possibility of collision, the microcomputer 12051 can provide a driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration and avoidance steering via the drive system control unit 12010.
At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether the pedestrian is present in the picked up images of the imaging units 12101 to 12104. Such pedestrian recognition includes, for example, a procedure for extracting feature points in picked up images of the imaging units 12101 to 12104 as an infrared camera, and a procedure of performing a pattern matching process on a series of feature points indicating the outline of an object to determine whether the object is a pedestrian. The microcomputer 12051 determines that a pedestrian is present in the picked up images of the imaging units 12101 to 12104, and when the pedestrian is recognized, the audio image output unit 12052 causes the display unit 12062 to superimpose and display a square outline for emphasis on the recognized pedestrian. Further, the audio image output unit 12052 may cause the display unit 12062 to display an icon or the like indicating the pedestrian at a desired position.
An example of the vehicle control system to which the technique according to the present disclosure can be applied is described above. The technique according to the present disclosure can be applied to, for example, the imaging unit 12031 of the configuration described above. Specifically, the distance measuring device 1 according to the first embodiment of the present disclosure described above can be applied to the imaging unit 12031. By applying the technique according to the present disclosure to the imaging unit 12031, it is possible to perform distance measurement from a traveling vehicle by the distance measuring device 1 with higher resolution and higher accuracy.
Further, the effects in each embodiment described in the present specification are merely examples and are not limited, and other effects may be present.
Note that the present technology may also be configured as below.
(1) A measuring device comprising:
a light receiving unit having a plurality of light receiving elements that is disposed in a matrix array and that is included in a target region;
a controller that designates an addition region including two or more light receiving elements of the plurality of light receiving elements and that controls scanning with the designated addition region as a unit; and
a time measurement unit that measures, according to the scanning, a time from light emission timing when a light source emits light to light reception timing when each light receiving element included in the addition region receives the light to acquire a measured value, wherein
the controller
designates, as the addition region, a first addition region and a second addition region whose part overlaps the first addition region.
(2) The measuring device according to the above (1), wherein
the controller
performs scanning of the target region while shifting a position of the first addition region on a basis of the first addition region with respect to a scan region in the target region, and after the scanning, performs scanning of the target region while shifting a position of the second addition region on a basis of the second addition region with respect to the scan region.
(3) The measuring device according to the above (2), wherein
each of the first addition region and the second addition region is a rectangular region including a first number of the light receiving elements disposed continuously in a row direction of the array and a second number of the light receiving elements disposed consecutively in a column direction of the array, and
the controller
performs the scanning while shifting a position of the first addition region in the row direction on a basis of the first addition region with respect to the scan region, of the target region, including the second number of the light receiving elements continuously in the column direction, and
after the scanning, performs the scanning while shifting a position of the second addition region in the row direction on a basis of the second addition region with respect to the scan region.
(4) The measuring device according to the above (3), wherein
after performing scanning with the second addition region in the scan region as a unit, the controller performs the scanning while shifting a position of the first addition region in the row direction on a basis of the first addition region with respect to a new scan region that overlaps the scan region by a third number of the light receiving elements that is less than the second number in the column direction.
(5) The measuring device according to the above (4), wherein
the controller
designates the second number and the third number independently.
(6) The measuring device according to any one of the above (1) to (5), wherein
the controller
designates the second addition region by giving an offset in a row direction to a position of the first addition region in the target region.
(7) The measuring device according to any one of the above (1) to (6), further comprising:
a generation unit that generates a histogram related to the addition region by adding the number of the measured values in each predetermined time range based on the measured values.
(8) A distance measuring device comprising:
a light receiving unit having a plurality of light receiving elements that is disposed in a matrix array and that is included in a target region;
a controller that designates an addition region including two or more light receiving elements of the plurality of light receiving elements and that controls scanning with the designated addition region as a unit;
a time measurement unit that measures, according to the scanning, a time from light emission timing when a light source emits light to light reception timing when each light receiving element included in the addition region receives the light to acquire a measured value;
a generation unit that adds the number of the measured values in each predetermined time range based on the measured values to generate a histogram related to the addition region; and
a calculation unit that calculates a distance to an object to be measured based on the histogram, wherein
the controller
designates, as the addition region, a first addition region and a second addition region having an overlapping portion that partially overlaps the first addition region.
(9) The distance measuring device according to the above (8), wherein
the controller
performs scanning of the target region while shifting a position of the first addition region on a basis of the first addition region with respect to a scan region in the target region, and after the scanning, performs scanning of the target region while shifting a position of the second addition region on a basis of the second addition region with respect to the scan region.
(10) The distance measuring device according to the above (9), wherein
each of the first addition region and the second addition region is a rectangular region including a first number of the light receiving elements disposed continuously in a row direction of the array and a second number of the light receiving elements disposed consecutively in a column direction of the array, and
the controller
performs the scanning while shifting a position of the first addition region in the row direction on a basis of the first addition region with respect to the scan region, of the target region, including the second number of the light receiving elements continuously in the column direction, and
after the scanning, performs the scanning while shifting a position of the second addition region in the row direction on a basis of the second addition region with respect to the scan region.
(11) The distance measuring device according to the above (10), wherein
after performing scanning with the second addition region in the scan region as a unit,
the controller
performs the scanning while shifting a position of the first addition region in the row direction on a basis of the first addition region with respect to a new scan region that overlaps the scan region by a third number of the light receiving elements that is less than the second number in the column direction.
(12) The distance measuring device according to the above (11), wherein
the controller designates the second number and the third number independently.
(13) The distance measuring device according to any one of the above (8) to (12), wherein
the controller designates the second addition region by giving an offset in a row direction to a position of the first addition region in the target region.
(14) A measuring method comprising:
a designation step of designating an addition region including two or more light receiving elements of a plurality of light receiving elements, of a light receiving unit disposed in a matrix array and included in a target region;
a control step of controlling scanning with the designated addition region as a unit; and
a time measurement step of measuring, according to the scanning, a time from light emission timing when a light source emits light to light reception timing when each light receiving element included in the addition region receives the light to acquire a measured value, wherein
the designation step includes designating, as the addition region, a first addition region and a second addition region whose part overlaps the first addition region.
1 DISTANCE MEASURING DEVICE
2 LIGHT SOURCE UNIT
3 STORAGE UNIT
4 CONTROLLER
6 ELECTRONIC DEVICE
10, 1011, 1013, 101v, 1021, 1022, 102v, 1031, 103v PIXEL CIRCUIT
11 ELEMENT
41
11, 411v, 4121, 412v, 4131, 413v OR CIRCUIT
50
a
1, 50a4, 50b11, 50b12, 50b17, 50b21, 50b22, 50b27, 52a1, 52a2, 52a3, 52a4, 52b1, 52b2, 52b3, 52b4, 52c1, 52c2, 52c3, 52c4 PIXEL
51
a
1, 51a4, 51b11, 51b12, 51b17, 51b21, 51b22, 51b27, 53a1, 53a2, 53a3, 53a4, 53b1, 53b2, 53b3, 53b4, 53c1, 53c2, 53c3, 53c4, 53d1, 53d2, 53d3, 53d4 REPRESENTATIVE POSITION
100 PIXEL ARRAY UNIT
102 PIXEL CONTROLLER
102
a HORIZONTAL CONTROLLER
102
b VERTICAL CONTROLLER
103 OVERALL CONTROLLER
| Number | Date | Country | Kind |
|---|---|---|---|
| 2019-010672 | Jan 2019 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2020/001589 | 1/17/2020 | WO | 00 |