The present disclosure relates to a photodetection device and a distance measuring system.
A time of flight (ToF) method is used for measuring the distance to the object. In the ToF method, light emitted from a light source is reflected by an object, and the reflected light is photoelectrically converted. Subsequently, the distance to the object is measured on the basis of the time from the emission of the light to the photoelectric conversion of the reflected light.
A distance measuring system using the ToF method is generally provided with a photodetection device that photoelectrically converts the reflected light described above. Some photodetection devices are provided with a plurality of photoelectric converters in one of pixels. In such a photodetection device, increasing the number of photoelectric converters per pixel widens the dynamic range. On the other hand, it is expected that the chip size and the power consumption increase.
The present disclosure provides a photodetection device and a distance measuring system capable of widening a dynamic range without increasing the number of photoelectric converters.
The photodetection device according to an embodiment of the present disclosure includes a plurality of photoelectric converters arranged in one of pixels and configured to photoelectrically convert incident light. The plurality of photoelectric converters includes at least one first photoelectric converter and at least one second photoelectric converter having a lower sensitivity to the incident light than the first photoelectric converter.
Each sensitivity may be different from others among the plurality of second photoelectric converters.
The number of second photoelectric converters may be smaller than the number of first photoelectric converters.
Each of the first photoelectric converters may include a first avalanche photodiode, and each of the second photoelectric converters may include a second avalanche photodiode.
A first voltage applied to the first avalanche photodiode may be different from a second voltage applied to the second avalanche photodiode.
In a case where the first voltage is applied to a cathode of the first avalanche photodiode and the second voltage is applied to a cathode of the second avalanche photodiode, the second voltage may be lower than the first voltage.
In a case where the first voltage is applied to an anode of the first avalanche photodiode and the second voltage is applied to an anode of the second avalanche photodiode, the second voltage may be higher than the first voltage.
The photodetection device may further include a voltage-adjusting unit that is configured to adjust the first voltage to the second voltage.
Opening ratios of the second photoelectric converters may be smaller than an opening ratio of the first photoelectric converters.
A light-shielding region from the incident light in each of the second photoelectric converters may be wider than a light-shielding region from the incident light in the first photoelectric converters.
The photodetection device may further include a light-shielding film provided in the light-shielding region.
Furthermore, another photodetection device according to an embodiment of the present disclosure includes a plurality of photoelectric converters arranged in one of pixels and configured to photoelectrically convert incident light. Sensitivities of the plurality of photoelectric converters to the incident light are configured to be collectively decreased in a stepwise manner depending on a result of photoelectric conversions at the plurality of photoelectric converters.
In a case where all of the plurality of photoelectric converters photoelectrically convert the incident light, the sensitivities may be configured to be collectively decreased in a stepwise manner.
The photodetection device may further include a switch connected to a plurality of external power supplies having different output voltages from each other, in which
Each of the plurality of photoelectric converters may include an avalanche photodiode, a transistor connected to the avalanche photodiode, and a switch connected in parallel to the transistor, in which
The photodetection device may further include:
The sensitivity of the first photoelectric converters may be 10 times or more higher than the sensitivities of the second photoelectric converters.
A distance measuring system according to an embodiment of the present disclosure includes: a photodetection device including a plurality of photoelectric converters arranged in one of pixels and configured to photoelectrically convert incident light, in which the plurality of photoelectric converters includes: at least one first photoelectric converter; and at least one second photoelectric converter having a lower sensitivity to the incident light than the first photoelectric converter; and a signal processing circuit that processes an output signal of the photodetection device.
Another distance measuring system according to an embodiment of the present disclosure includes:
The light source device 20 includes, for example, a laser driver 21, a laser light source 22, and a diffusion lens 23. The laser driver 21 drives the laser light source 22 under control of the control unit 40. The laser light source 22 includes, for example, a semiconductor laser, and emits laser light by being driven by the laser driver 21. The diffusion lens 23 diffuses the laser light emitted from the laser light source 22, and irradiates the laser light toward the object 10.
The photodetection device 30 includes a light-receiving lens 31, a photosensor 32, and a signal processing circuit 33, and receives, as incident light, reflected laser light that has been irradiated by the light source device 20 and is reflected by the object 10 and returns. The light-receiving lens 31 focuses the reflected laser light from the object 10 on a light-receiving surface of the photosensor 32. Each pixel of the photosensor 32 receives the reflected laser light from the object 10 through the light-receiving lens 31, and performs a photoelectric conversion. The signal processing circuit 33 includes a time to digital converter (TDC) 331 and a histogram generation unit 33b.
The TDC 33A digitally converts time of occurrence of a transition timing of a voltage level of an output signal of the photosensor 32. The histogram generation unit 33b measures the number of acquisitions of a digital value converted by the TDC 33A, that is, the number of reactions of the photosensor 32. Because the digital conversion by the TDC 33A is performed a plurality of times, the histogram generated by the histogram generation unit 33b is obtained by integrating the number of reactions measured a plurality of times by the photosensor 32.
The control unit 40 includes, for example, a central processing unit (CPU) or the like, controls the light source device 20 and the photodetection device 30, and measures a time t from when laser light is irradiated from the light source device 20 toward the object 10 to when the laser light is reflected by the object 10 and returns. A distance L to the object 10 can be determined on the basis of the time t. A method of time measurement includes: starting a timer when pulsed light is irradiated from the light source device 20; stopping the timer when the photodetection device 30 receives the pulsed light; and determining the time t. The time t is determined by detecting a peak of the histogram generated by the histogram generation unit 33b.
Note that, in
In addition, in
The one of the first photoelectric converters 322a illustrated in
The light-receiving element 51 includes, for example, an avalanche photodiode represented by a single photon avalanche diode (SPAD). A cathode of the light-receiving element 51 is connected to a first terminal 61 via the current source 52. A positive voltage VE is applied to the cathode of the light-receiving element 51 via the first terminal 61. An anode of the light-receiving element 51 is connected to a second terminal 62. A negative voltage VA at which avalanche multiplication occurs is applied to the anode of the light-receiving element 51 via the second terminal 62.
The current source 52 is provided between the first terminal 61 and the cathode of the light-receiving element 51. The light-receiving element 51 is charged by the current source 52.
The quench transistor 53 includes, for example, an N-channel MOS transistor. A drain of the quench transistor 53 is connected to the anode of the light-receiving element 51 and the current source 52, and a source is grounded. When a predetermined signal is input to a gate of the quench transistor 53, a cathode voltage of the light-receiving element 51 is forcibly set to a reference voltage of 0 V. In this case, a light detection ability of the light-receiving element 51 is deteriorated. Therefore, it is possible to avoid erroneous detection of an after-pulse or the like in which avalanche multiplication occurs again even though no photons are incident on the light-receiving element 51.
The transistor 54 includes, for example, a P-channel MOS transistor, and the transistor 55 includes, for example, an N-channel MOS transistor. A gate of each transistor is connected to the cathode of the light-receiving element 51. A power supply voltage VDD is applied to a source of the transistor 54. A source of the transistor 55 is grounded. An analog pixel signal generated on the basis of the cathode voltage of the light-receiving element 51 is output from drains of the transistor 54 and the transistor 55.
On a light-receiving surface 311 of the first semiconductor substrate 310, the light-receiving element 51 of each of the respective photoelectric converters is arranged in a two-dimensional array. On the other hand, the second semiconductor substrate 320 includes a readout region 320a on a part of a surface facing the first semiconductor substrate 310. Components except the light-receiving element 51, i.e., the current source 52, the quench transistor 53, the transistor 54, and the transistor 55, of each of the photoelectric converters are arranged in the readout region 320a. Furthermore, the signal processing circuit 33 and the control unit 40 described above are arranged around the readout region 320a.
Note that the layout of the first and second photoelectric converters 322a and 322b is not limited to the example illustrated in
As illustrated in
Fixing the voltage VA while decreasing the voltage VE from, for example, 3 V to 2 V causes the excess bias voltage VEX to become small, and therefore the PDE becomes low. In addition, fixing the voltage VE while increasing the voltage VA, for example, from −20 V to −15 V causes the excess bias voltage VEX to become small. Also, in this case, the PDE becomes low. Thus, the voltage applied to the anode or the cathode of the light-receiving element 51 is adjusted individually, so that the plurality of photoelectric converters 322 having different PDEs can be arranged in the one of the pixels 321.
The voltage-adjusting unit 331 adjusts a voltage that has been supplied from the external power supply 330 such that a PDE becomes 20%. The external power supply 330 is a negative power supply that supplies a voltage VA to an anode or a positive power supply that supplies a voltage VE to a cathode of a corresponding light-receiving element 51. In a case where the external power supply 330 is the negative power supply, the voltage-adjusting unit 331 steps up the voltage VA so that the PDE of the corresponding light-receiving element 51 becomes 20%. On the other hand, in a case where the external power supply 330 is the positive power supply, the voltage-adjusting unit 331 steps down the voltage VE so that the PDE of the corresponding one of the second photoelectric converters 322b becomes 20%. Each of the voltage-adjusting unit 332, the voltage-adjusting unit 333, and the voltage-adjusting unit 334, depending on a value of the PDE of the corresponding one of the second photoelectric converters 322b connected thereto, also steps up the corresponding voltage VA or steps down the corresponding voltage VE.
Each voltage-adjusting unit includes a step-up circuit or a step-down circuit depending on a type of the external power supply 330. Each configuration of the step-up circuit and the step-down circuit is not particularly limited, but a smaller number of elements is desirable in order to prevent the photodetection device 30 from growing in size. For example, the step-down circuit may consist of one resistive element.
The one of the pixels 321 in the comparative example has 16 photoelectric converters 322 arranged in four rows and four columns. In addition, all PDEs of the photoelectric converters 322 are set to 25%. Therefore, as illustrated in
Meanwhile, the one of the pixels 321 in the present embodiment has 16 photoelectric converters 322 arranged in four rows and four columns, as in the comparative example. On the other hand, in the present embodiment, PDEs of the photoelectric converters 322 are set within a range of 5% to 25%. That is, the first and second photoelectric converters 322a and 322b having different PDEs are mixedly arranged in the 16 photoelectric converters 322. Therefore, as illustrated in
Therefore, according to the present embodiment described above, a dynamic range DR can be widened without increasing the number of photoelectric converters 322. Widening the dynamic range DR causes a distance measurable range to be widened, and therefore it becomes possible to improve distance measurement performance.
Also, in the present embodiment, each of the voltage-adjusting units 331 to 334 individually adjusts a PDE of the corresponding one of the photoelectric converters 322. This allows the number and the PDEs of the second photoelectric converters 322b to be set freely.
Compared to the first embodiment (see
Thereafter, when a potential difference between the anode and the cathode of the light-receiving element 51 reaches a breakdown voltage VBD, the avalanche current is shut off. Thereafter, the anode voltage is restored to 0 V, and the light-receiving element 51 returns to the initial state again.
In the present modification, the voltage VA corresponds to a voltage obtained by adding an excess bias voltage VEX and the breakdown voltage VBD. As described in the first embodiment, the excess bias voltage VEX has a correlation with a PDE. A graph illustrated in
The voltage-adjusting unit 331 steps down a voltage VA that has been supplied from an external power supply 330 such that a PDE becomes 20%. Each of the voltage-adjusting unit 332, the voltage-adjusting unit 333, and the voltage-adjusting unit 334, depending on a value of a PDE of a corresponding one of the photoelectric converters 322 connected thereto, also steps down a corresponding voltage VA.
Also, in the present modification described above, as in the first embodiment, the plurality of photoelectric converters 322 has different PDEs. This increases a saturated amount of the reflected light, and therefore dynamic range DR can be widened without increasing the number of photoelectric converters 322.
Furthermore, also in the present modification, each of the voltage-adjusting units 331 to 334 individually adjusts a PDE of the corresponding one of the photoelectric converters 322. This allows the number and the PDEs of the second photoelectric converters 322b to be set freely.
In the present embodiment, as illustrated in
The light-shielding film 340 is provided on the separation film 341. The light-shielding film 340 includes a metal having a light blocking effect, such as, for example, tungsten (W) or aluminum (Al). The light-shielding film 340 is covered with an antireflection film 342. The antireflection film 342 prevents light incident on a light-receiving lens 31 from being reflected.
In the present embodiment, as illustrated in
In addition, the light-shielding region becomes wider, and thus the opening ratio decreases more, as a width w protruding from the separation film 341 becomes longer. Therefore, the light-shielding film 340 is formed such that any of the second photoelectric converters 322b that has a lower PDE has a longer width w described above.
According to the present embodiment described above, the opening ratio of each of the photoelectric converters 322 is adjusted, so that the first and second photoelectric converters 322a and 322b having different PDEs can be formed in the one of the pixels 321. As a result, similar to the first embodiment, a saturated amount of the reflected light increases. Accordingly, a dynamic range DR can be widened without increasing the number of photoelectric converters 322.
In addition, in the present embodiment, the first photoelectric converters 322a and the second photoelectric converters 322b are separately produced in advance depending on a difference in a form of the light-shielding film 340. Therefore, a voltage-adjusting unit described with respect to the first embodiment is not required, resulting in a possible avoidance of growing in size of a device.
A third embodiment will be described. Same components as those of the first embodiment described above are denoted by same reference numerals, and are not described in detail. In the present embodiment, PDEs are collectively changed in a stepwise manner depending on a result of photoelectric conversions at a plurality of photoelectric converters 322 arranged in one of pixels 321. Hereinafter, an operation of a distance measuring system according to the present embodiment will be described.
Each of the photoelectric converters 322 outputs a signal indicating whether or not the photoelectric conversion has been performed (whether or not incident light has been detected) to the signal processing circuit 33 (see
The control unit 40 determines whether or not each of the pixels 321 is saturated on the basis of the measurement result of the signal processing circuit 33. The control unit 40 determines each of the pixels 321 in which all the photoelectric converters 322 have photoelectrically converted the incident light is saturated, and determines that the other pixels are not saturated.
The saturated one of the pixels 321 has the photoelectric converters 322 of which the PDEs may be set higher than necessary for the reflected light. In this case, a saturated amount of the reflected light becomes small, resulting in a reduced dynamic range. Therefore, in the present embodiment, the control unit 40 collectively decreases the PDEs of all the photoelectric converters 322 in the one of the pixels 321. For example, the PDEs are reset to 15%, which is lower than 25%. As a result, the dynamic range of the one of the pixels 321 is widened.
On the other hand, the PDEs of the unsaturated one of the pixels 321 are considered appropriate. Therefore, the control unit 40 maintains the PDEs of all the photoelectric converters 322 in the one of the pixels 321.
The light reflected by the object 10 enters the plurality of photoelectric converters 322 arranged in the one of the pixels 321. Each of the photoelectric converters 322 again outputs a signal indicating whether or not the photoelectric conversion has been performed to the signal processing circuit 33. The signal processing circuit 33 also again measures the number of photoelectric converters 322 that have photoelectrically converted the incident light, and outputs a measurement result to the control unit 40. The control unit 40 again determines whether or not each of the pixels 321 is saturated on the basis of the measurement result of the signal processing circuit 33.
The dynamic range of the one of the pixels 321 widens from a dynamic range DR1 (see
On the other hand, the PDEs of the unsaturated one of the pixels 321 are considered appropriate. Therefore, the control unit 40 maintains the PDEs of all the photoelectric converters 322 in the one of the pixels 321.
The light reflected by the object 10 enters the plurality of photoelectric converters 322 arranged in the one of the pixels 321. Each of the photoelectric converters 322 again outputs a signal indicating whether or not the photoelectric conversion has been performed to the signal processing circuit 33. The signal processing circuit 33 also again measures the number of photoelectric converters 322 that have photoelectrically converted the incident light, and outputs a measurement result to the control unit 40. The control unit 40 again determines whether or not each of the pixels 321 is saturated on the basis of the measurement result of the signal processing circuit 33.
The dynamic range of the one of the pixels 321 further widens from a dynamic range DR2 (see
On the other hand, the PDEs of the unsaturated one of the pixels 321 are considered appropriate. Therefore, the control unit 40 maintains the PDEs of all the photoelectric converters 322 in the one of the pixels 321.
Thus, in the present embodiment, the PDEs of all the photoelectric converters 322 in the one of the pixels 321 are collectively adjusted in conjunction with the irradiation of the laser light until the one of the pixels 321 becomes unsaturated. Hereinafter, a method for collectively adjusting PDEs according to the present embodiment will be described.
One end of the switch 400 is connected to each of a plurality of external power supplies 410a to 410c. Output voltages of the external power supplies 410a to 410c are different from each other. The other end of the switch 400 is connected to each of the plurality of photoelectric converters 322. An output voltage from the external power supplies 410a to 410c is applied to an anode or a cathode of each light-receiving element 51 via the switch 400. The switch 400 switches a voltage to be applied to a light-receiving element 51 of each of the photoelectric converters 322 from an output voltage of an external power supply of the external power supplies 410a to 410c to an output voltage of another external power supply on the basis of a control signal S from the control unit 40.
For example, let's suppose that each of the photoelectric converters 322 has the circuit configuration illustrated in
In addition, let's suppose that it is determined that one of the pixels 321 is saturated when the second laser light L2 is irradiated while the voltage is applied from the external power supply 410b to the cathode of the light-receiving element 51. In this case, the switch 400 switches the connection of the photoelectric converters 322 from the external power supply 410b to the external power supply 410c. The output voltage of the external power supply 410c is lower than the output voltage of the external power supply 410b. Therefore, the voltage applied to the cathode of the light-receiving element 51 further decreases, so that the PDEs also further decrease. Note that a method for adjusting the PDEs is not limited to the method illustrated in
The transistor 500 is, for example, an N-channel MOS transistor, and is provided between a cathode of a light-receiving element 51 and a current source 52. A drain of the transistor 500 is connected to the current source 52, and a source is connected to the cathode of the light-receiving element 51. A voltage VB is applied to the gate of the transistor 500. The switch 501 is connected in parallel to the transistor 500. The switch 501 is turned on and off on the basis of a control signal S input from a control unit 40.
When the photoelectric converters 322 are in an initial state, the switch 501 is turned on. In this case, the excess bias voltage VEX is a voltage VE applied to the cathode of the light-receiving element via a first terminal 61. In a case where, while the switch 501 is turned on, it is determined that a corresponding one of the pixels 321 is saturated, the switch 501 is turned from on to off on the basis of the control signal S from the control unit 40.
When the switch 501 is turned off, the excess bias voltage VEX becomes a voltage obtained by subtracting a voltage VGS from the voltage VB. Here, the voltage VB is a voltage applied to the gate of the transistor 500 as described above. The voltage VGS is a voltage between the gate and the source of the transistor 500. The voltage obtained by subtracting the voltage VGS from the voltage VB is lower than the voltage VE. Therefore, the excess bias voltage VEX decreases compared to the case where the switch 501 is turned on. As a result, the PDEs also decrease.
Note that, in a case where the photoelectric converters 322 have the circuit configuration illustrated in
In the present embodiment described above, the control unit 40 determines whether or not each of the pixels 321 is saturated every time a laser light is irradiated. In a case where it is determined that one of the resulting pixels 321 is saturated, the PDEs of all the photoelectric converters 322 in the one of the pixels 321 are collectively decreased. Actively changing the PDEs in this manner allows the dynamic range DR to be widened without increasing the number of photoelectric converters 322.
In the present embodiment, an optical filter 34 is provided on a surface of a light-receiving lens 31. The optical filter 34 includes a neutral density (ND) filter, which attenuates incident light. In
Furthermore, a transmittance of the optical filter 34 may be changed depending on the set value of the corresponding one of the PDEs. For example, a transmittance of an optical filter 34 of the second photoelectric converters 322b that has a PDE set to 2% is higher than a transmittance of an optical filter 34 of the second photoelectric converters 322b that has a PDE set to 0.2%. This allows the second photoelectric converters 322b to form photoelectric conversions having different PDEs.
Note that, in
According to the present embodiment described above, by means of each optical filter 34, the first and second photoelectric converters 322a and 322b having different PDEs can be formed in the one of the pixels 321. As a result, similar to the first embodiment, a saturated amount of the reflected light increases. Accordingly, a dynamic range DR can be widened without increasing the number of photoelectric converters 322.
In particular, in the present embodiment, the difference in PDE between the first photoelectric converters 322a and the second photoelectric converters 322b is 10 times or more. Thus, a dynamic range DR can be further widened compared to the other embodiments described above.
Technology (present technology) according to the present disclosure is applicable to various products. For example, the technology according to the present disclosure may be achieved in a form of an apparatus to be mounted to a mobile body of any kind such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility, an airplane, a drone, a vessel, and a robot.
The vehicle control system 12000 includes a plurality of electronic control units connected to each other via a communication network 12001. In the example illustrated in
The driving system control unit 12010 controls the operation of devices related to the driving system of the vehicle in accordance with various kinds of programs. For example, the driving system control unit 12010 functions as a control device for a driving force generating device for generating a driving force of a vehicle, such as a steering mechanism internal combustion engine, a driving motor, or the like, a driving force transmitting mechanism for transmitting the driving force to wheels, a steering mechanism for adjusting the steering angle of the vehicle, a braking device for generating the braking force of the vehicle, and the like.
The body system control unit 12020 controls the operation of various kinds of devices provided to a vehicle body in accordance with various kinds of programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various kinds of lamps such as a headlamp, a backup lamp, a brake lamp, a turn signal, a fog lamp, or the like. In this case, radio waves transmitted from a mobile device as an alternative to a key or signals of various kinds of switches can be input to the body system control unit 12020. The body system control unit 12020 receives these input radio waves or signals, and controls a door lock device, the power window device, the lamps, or the like of the vehicle.
The outside-vehicle information detecting unit 12030 detects information about the outside of the vehicle including the vehicle control system 12000. For example, the outside-vehicle information detecting unit 12030 is connected with an imaging section 12031. The outside-vehicle information detecting unit 12030 makes the imaging section 12031 image an image of the outside of the vehicle, and receives the imaged image. On the basis of the received image, the outside-vehicle information detecting unit 12030 may perform processing of detecting an object such as a human, a vehicle, an obstacle, a sign, a character on a road surface, or the like, or processing of detecting a distance thereto.
The imaging section 12031 is an optical sensor that receives light, and which outputs an electric signal corresponding to a received light amount of the light. The imaging section 12031 can output the electric signal as an image, or can output the electric signal as information about a measured distance. In addition, the light received by the imaging section 12031 may be visible light, or may be invisible light such as infrared rays or the like.
The in-vehicle information detecting unit 12040 detects information about the inside of the vehicle. The in-vehicle information detecting unit 12040 is, for example, connected with a driver state detecting section 12041 that detects the state of a driver. The driver state detecting section 12041, for example, includes a camera that images the driver. On the basis of detection information input from the driver state detecting section 12041, the in-vehicle information detecting unit 12040 may calculate a degree of fatigue of the driver or a degree of concentration of the driver, or may determine whether the driver is dozing.
The microcomputer 12051 can calculate a control target value for the driving force generating device, the steering mechanism, or the braking device on the basis of the information about the inside or outside of the vehicle which information is obtained by the outside-vehicle information detecting unit 12030 or the in-vehicle information detecting unit 12040, and output a control command to the driving system control unit 12010. For example, the microcomputer 12051 can perform cooperative control intended to implement functions of an advanced driver assistance system (ADAS) which functions include collision avoidance or shock mitigation for the vehicle, following driving based on a following distance, vehicle speed maintaining driving, a warning of collision of the vehicle, a warning of deviation of the vehicle from a lane, or the like.
In addition, the microcomputer 12051 can perform cooperative control intended for automated driving, which makes the vehicle to travel automatedly without depending on the operation of the driver, or the like, by controlling the driving force generating device, the steering mechanism, the braking device, or the like on the basis of the information about the outside or inside of the vehicle which information is obtained by the outside-vehicle information detecting unit 12030 or the in-vehicle information detecting unit 12040.
In addition, the microcomputer 12051 can output a control command to the body system control unit 12020 on the basis of the information about the outside of the vehicle which information is obtained by the outside-vehicle information detecting unit 12030. For example, the microcomputer 12051 can perform cooperative control intended to prevent a glare by controlling the headlamp so as to change from a high beam to a low beam, for example, in accordance with the position of a preceding vehicle or an oncoming vehicle detected by the outside-vehicle information detecting unit 12030.
The sound/image output section 12052 transmits an output signal of at least one of a sound or an image to an output device capable of visually or auditorily notifying information to an occupant of the vehicle or the outside of the vehicle. In an example in
In
The imaging sections 12101, 12102, 12103, 12104, and 12105 are, for example, provided at positions on a front nose, sideview mirrors, a rear bumper, and a hatchback door of the vehicle 12100 as well as a position on an upper portion of a windshield within the interior of the vehicle and the like. The imaging section 12101 provided at the front nose and the imaging section 12105 provided at the upper portion of the windshield within the interior of the vehicle acquire mainly an image in front of the vehicle 12100. The imaging sections 12102 and 12103 provided to the sideview mirrors obtain mainly an image of the sides of the vehicle 12100. The imaging section 12104 provided to the rear bumper or the back door obtains mainly an image of the rear of the vehicle 12100. The imaging section 12105 provided to the upper portion of the windshield within the interior of the vehicle is used mainly to detect a preceding vehicle, a pedestrian, an obstacle, a signal, a traffic sign, a lane, or the like.
Note that,
At least one of the imaging sections 12101 to 12104 may have a function of obtaining distance information. For example, at least one of the imaging sections 12101 to 12104 may be a stereo camera constituted of a plurality of imaging elements, or may be an imaging element having pixels for phase difference detection.
For example, the microcomputer 12051 can determine a distance to each three-dimensional object within the imaging ranges 12111 to 12114 and a temporal change in the distance (relative speed with respect to the vehicle 12100) on the basis of the distance information obtained from the imaging sections 12101 to 12104, and thereby extract, as a preceding vehicle, a nearest three-dimensional object in particular that is present on a traveling path of the vehicle 12100 and which travels in substantially the same direction as the vehicle 12100 at a predetermined speed (for example, equal to or more than 0 km/hour). Further, the microcomputer 12051 can set a following distance to be maintained in front of a preceding vehicle in advance, and perform automatic brake control (including following stop control), automatic acceleration control (including following start control), or the like. It is thus possible to perform cooperative control intended for automated driving that makes the vehicle travel automatedly without depending on the operation of the driver or the like.
For example, the microcomputer 12051 can classify three-dimensional object data on three-dimensional objects into three-dimensional object data of a two-wheeled vehicle, a standard-sized vehicle, a large-sized vehicle, a pedestrian, a utility pole, and other three-dimensional objects on the basis of the distance information obtained from the imaging sections 12101 to 12104, extract the classified three-dimensional object data, and use the extracted three-dimensional object data for automatic avoidance of an obstacle. For example, the microcomputer 12051 identifies obstacles around the vehicle 12100 as obstacles that the driver of the vehicle 12100 can recognize visually and obstacles that are difficult for the driver of the vehicle 12100 to recognize visually. Then, the microcomputer 12051 determines a collision risk indicating a risk of collision with each obstacle. In a situation in which the collision risk is equal to or higher than a set value and there is thus a possibility of collision, the microcomputer 12051 outputs a warning to the driver via the audio speaker 12061 or the display section 12062, and performs forced deceleration or avoidance steering via the driving system control unit 12010. The microcomputer 12051 can thereby assist in driving to avoid collision.
At least one of the imaging sections 12101 to 12104 may be an infrared camera that detects infrared rays. The microcomputer 12051 can, for example, recognize a pedestrian by determining whether or not there is a pedestrian in imaged images of the imaging sections 12101 to 12104. Such recognition of a pedestrian is, for example, performed by a procedure of extracting characteristic points in the imaged images of the imaging sections 12101 to 12104 as infrared cameras and a procedure of determining whether or not it is the pedestrian by performing pattern matching processing on a series of characteristic points representing the contour of the object. When the microcomputer 12051 determines that there is a pedestrian in the imaged images of the imaging sections 12101 to 12104, and thus recognizes the pedestrian, the sound/image output section 12052 controls the display section 12062 so that a square contour line for emphasis is displayed so as to be superimposed on the recognized pedestrian. The sound/image output section 12052 may also control the display section 12062 so that an icon or the like representing the pedestrian is displayed at a desired position.
An example of the vehicle control system to which the technology according to the present disclosure can be applied has been described above. The technology according to the present disclosure can be applied to, for example, the imaging section 12031 of the configurations described above. Specifically, the photodetection device 30 can be applied to the imaging section 12031. By applying the technology according to the present disclosure, a captured image with higher distance measurement performance can be obtained, whereby safety can be improved.
Note that the present technology can have the following configurations.
(1) A photodetection device including a plurality of photoelectric converters arranged in one of pixels and configured to photoelectrically convert incident light, in which
(2) The photodetection device according to (1), in which each sensitivity is different from others among the plurality of second photoelectric converters.
(3) The photodetection device according to (1) or (2), in which a number of the second photoelectric converters is smaller than a number of the first photoelectric converters.
(4) The photodetection device according to any one of (1) to (3), in which
(5) The photodetection device according to (4), in which a first voltage applied to the first avalanche photodiode is different from a second voltage applied to the second avalanche photodiode.
(6) The photodetection device according to (5), in which in a case where the first voltage is applied to a cathode of the first avalanche photodiode and the second voltage is applied to a cathode of the second avalanche photodiode, the second voltage is lower than the first voltage.
(7) The photodetection device according to (5), in which in a case where the first voltage is applied to an anode of the first avalanche photodiode and the second voltage is applied to an anode of the second avalanche photodiode, the second voltage is higher than the first voltage.
(8) The photodetection device according to any one of (5) to (8), further including a voltage-adjusting unit that is configured to adjust the first voltage to the second voltage.
(9) The photodetection device according to any one of (1) to (3), in which opening ratios of the second photoelectric converters are smaller than an opening ratio of the first photoelectric converters.
(10) The photodetection device according to (9), in which a light-shielding region from the incident light in each of the second photoelectric converters is wider than a light-shielding region from the incident light in the first photoelectric converters.
(11) The photodetection device according to (10), further including a light-shielding film provided in the light-shielding region.
(12) A photodetection device including
(13) The photodetection device according to (12), in which in a case where all of the plurality of photoelectric converters photoelectrically convert the incident light, the sensitivities are configured to be collectively decreased in a stepwise manner.
(14) The photodetection device according to (12) or (13), further including a switch connected to a plurality of external power supplies having different output voltages from each other, in which
(15) The photodetection device according to (12) or (13), in which each of the plurality of photoelectric converters includes an avalanche photodiode, a transistor connected to the avalanche photodiode, and a switch connected in parallel to the transistor, in which
(16) The photodetection device according to (1) or (2), further including:
(17) The photodetection device according to (16) or (17), in which the sensitivity of the first photoelectric converters is 10 times or more higher than the sensitivities of the second photoelectric converters.
(18) A distance measuring system including:
(19) A distance measuring system including:
Number | Date | Country | Kind |
---|---|---|---|
2021-115209 | Jul 2021 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2022/016794 | 3/31/2022 | WO |