This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2019-162247, filed on Sep. 5, 2019, the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a photo detection device, an electronic device, and a photo detection method.
Photo detection devices such as light receiving elements are widely used in automatic driving technology and the like. In the automatic driving technology, reflected light from an object is received by a photo detection device, a distance to the object is measured, and a distance image is generated. To increase the resolution of the distance image, it is necessary to increase the number of light receiving elements per unit area included in the photo detection device. However, when the distance between the light receiving elements is shortened, crosstalk occurs between the light receiving elements, causing blurring of the distance image and noises.
Further, as the number of light receiving elements in the photo detection device increases, it becomes difficult to secure a place for arranging the output wire of each light receiving element. In addition, there is a limit to the total number of light receiving elements that can be placed because of a need to secure a place for arranging the output wire.
A photo detection device according to one embodiment has an array of light detectors that can be switched to an ON state to enable output of a signal based on reception light or an OFF state to disable output of the signal based on reception light, and control circuitry configured to set one or more first light detectors inside a region specified according to overlapping of a region irradiated with light from a first direction and a region capable of detecting light to the ON state among the array of light detectors, when the light from the first direction is received by the array; and set second light detectors outside of the specified region to the OFF state among the array of light detectors, when light from a first direction is received by the array.
At least a part of the electronic apparatus 2 of
The light projecting unit 3 projects the first light. The first light is, for example, a laser light in a predetermined frequency band. The laser light is a coherent light having the same phase and frequency. The light projecting unit 3 intermittently projects the pulsed first light at a predetermined period. The period in which the light projecting unit 3 projects the first light is a time interval that is equal to or more than a time required to measure a distance by the distance measuring apparatus 8 based on one pulse of the first light.
The light projecting unit 3 includes an oscillator 11, a light projecting control unit 12, a light source 13, a first drive unit 14, and a second drive unit 15. The oscillator 11 generates an oscillation signal corresponding to the cycle of projecting the first light. The first drive unit 14 intermittently supplies power to the light source 13 in synchronization with the oscillation signal. The light source 13 intermittently emits the first light based on the power from the first drive unit 14. The light source 13 may be a laser element that emits a single laser light or a laser unit that emits a plurality of laser light simultaneously. The light projecting control unit 12 controls the second drive unit 15 in synchronization with the oscillation signal. The second drive unit 15 supplies a drive signal synchronized with the oscillation signal to the light control unit 4 in response to an instruction from the light projecting control unit 12.
The light control unit 4 controls a traveling direction of the first light emitted from the light source 13. In addition, the light control unit 4 controls the traveling direction of the received second light.
The light control unit 4 includes a first lens 21, a beam splitter 22, a second lens 23, and a scanning mirror 24.
The first lens 21 condenses the first light emitted from the light projecting unit 3 and guides the light to the beam splitter 22. The beam splitter 22 branches the first light from the first lens 21 in two directions and guides the light to the second lens 23 and the scanning mirror 24. The second lens 23 guides the branched light from the beam splitter 22 to the light receiving unit 5. The reason for guiding the first light to the light receiving unit 5 is to detect a light projection timing in the light receiving unit 5.
The scanning mirror 24 rotates and drives a mirror surface in synchronization with the drive signal from the second drive unit 15 in the light projecting unit 3. With this configuration, the reflection direction of the branched light (first light) that has passed through the beam splitter 22 and entered the mirror surface of the scanning mirror 24 is controlled. By rotating and driving the mirror surface of the scanning mirror 24 at a constant cycle, scanning can be performed by the first light emitted from the light control unit 4 in at least a one-dimensional direction within a predetermined range. By providing the axis for rotationally driving the mirror surface in two directions, scanning can be performed by the first light emitted from the light control unit 4 in a two-dimensional direction within a predetermined range.
In a case where the object 20 exists within a scanning range of the first light projected from the electronic apparatus 2, the first light is reflected by the object 20. At least part of the reflected light reflected by the object 20 is received by the light receiving unit 5.
The light receiving unit 5 includes a photodetector 31, an amplifier 32, a third lens 33, a light receiving sensor 34, and an A/D converter 35. The photodetector 31 receives the light branched by the beam splitter 22 and converts it into an electrical signal. The photodetector 31 can detect the light projection timing of the first light. The amplifier 32 amplifies the electrical signal output from the photodetector 31.
The third lens 33 focuses the laser light reflected by the object 20 on the light receiving sensor 34. The light receiving sensor 34 is the photo detection apparatus 1 according to this embodiment, and details thereof will be described below. The light receiving sensor 34 receives the laser light and converts the light into an electrical signal.
The A/D converter 35 samples the electrical signal output from the light receiving sensor 34 at a predetermined sampling rate, performs A/D conversion, and generates a digital signal. Instead of the A/D converter 35, a time digital converter (TDC) can be used.
The signal processing unit 6 includes a storage unit 41, a distance measurement unit (processor) 42, and a control unit 43. The signal processing unit 6 measures a distance to the object 20 that reflects the first light, and stores a digital signal corresponding to the second light received by the light receiving sensor 34 in the storage unit 41.
The distance measurement unit 42 measures the distance to the object 20 based on the first light and the reflected light from the object 20. More specifically, the distance measurement unit 42 measures the distance to the object 20 on the basis of a time difference between the light projection timing of the first light and the light reception timing of the reflected light included in the second light received by the light receiving sensor 34. In other words, the distance measurement unit 42 measures the distance to the object 20 on the basis of the following Expression (1).
Distance=Light Speed×(Light Reception Timing of Reflected Light−Light Projection Timing of First Light)/2 (1)
The “Light Reception Timing of Reflected Light” in Expression (1) is more accurately a light reception timing of a peak position of the reflected light. The distance measurement unit 42 detects the peak position of the reflected light included in the second light on the basis of the digital signal generated by the A/D converter 35.
The light receiving array 51 includes a plurality of light receiving elements (light detectors) 53 that can be individually switched to an ON state in which light is received or an OFF state in which light is not received. In the example of
In this embodiment, a Silicon Photon Avalanche Diode (SPAD) is used as the light receiving element 53. The SPAD is an Avalanche Photo-Diode (APD) operated in a Geiger mode, and can output an electrical signal by receiving a single photon. In the example of
When light is incident on a SPAD with a reverse bias voltage exceeding a breakdown voltage, an avalanche current is generated, and a large current is output. At that time, light is emitted from a place where the avalanche current is generated. There is a concern that other light receiving elements 53 in the vicinity sense this light and output an electrical signal by photoelectric conversion. This electrical signal is a noise, and also called crosstalk.
In a case where the control unit 52 receives light from a first direction by the light receiving array, the control unit controls such that one or more light receiving elements 53 which are determined as those that the region irradiated with light from the first direction and the region capable of receiving light are at least partially overlapped, among the plurality of light receiving elements 53, are set to the ON state, and the other light receiving elements 53 are set to the OFF state. That is, the control unit 52 set one or more first light receiving elements 53 inside a region specified according to overlapping of a region irradiated with light from a first direction and a region capable of detecting light to the ON state among the array of light receiving elements 53, when the light from the first direction is received by the array, and set second light detectors outside of the specified region to the OFF state among the array of light receiving elements 53, when light from a first direction is received by the array.
In this manner, the control unit 52 turns on only some of the light receiving elements 53 and acquires the electrical signal received by the turned-on light receiving elements 53 via the output wire 54. Here, the light from the first direction is the light that is obtained when the projected light is reflected by the object 20. The first direction is a direction in which the reflected light obtained when the projected light is reflected by the object 20 arrives. The control unit 52 controls one or more light receiving elements 53 that are determined as those that the region irradiated with the reflected light from the first direction and the region capable of receiving light are at least partially overlapped to be turned on. More specifically, the control unit 52 controls one or more light receiving elements 53 to be the ON state among the plurality of light receiving elements 53 on the basis of the light receiving position and the beam spot diameter of the light from the first direction on the light receiving surface of the light receiving array 51.
The light control unit 4 performs scanning by the light projected by the light projecting unit 3. Therefore, the direction of light changes with time, and the direction reflected by the object 20 also changes according to a scanning direction of light. The control unit 52 dynamically controls one or more light receiving elements 53 to be turned on among the plurality of light receiving elements 53 in accordance with the direction (first direction) of reflected light from the object 20.
In the light receiving array 51, the light projected from the light projecting unit 3 is reflected by the object 20, and not only the reflected light but also ambient light such as sunlight is incident. In addition, the ambient light may be reflected by the object 20 and the reflected light may enter the light receiving array 51. Among these lights, the light used for distance measurement is the light that is projected from the light projecting unit 3 and reflected by the object 20 and is incident on the light receiving array 51. In the following, the light will be referred to as a desired reflected light. The desired reflected light is projected from the light projecting unit 3, travels according to the direction of the light used for scanning by the light control unit 4, is reflected by the object 20, and enters a specific position on the light receiving array 51.
In
The light projecting unit 3 intermittently projects light, and the light control unit 4 continuously performs scanning by the light projected by the light projecting unit 3 within a predetermined range. Therefore, the direction of the light emitted from the light control unit 4 continuously changes, and the direction of the desired reflected light reflected by the object 20 also changes continuously. The control unit 52 switches the light receiving element 53 to be turned on by following a continuous change in the desired reflected light.
The light projected from the light projecting unit 3 and used for scanning by the light control unit 4 is reflected by the object 20. However, the time until the desired light reflected on the object 20 reaches the light receiving array 51 changes depending on the distance from the light projecting unit 3 to the object 20. However, the position and the diameter of the beam spot bp of the desired reflected light on the light receiving array 51 hardly depend on the distance from the object 20 to the light receiving array 51.
On the other hand,
As can be seen by comparing
Therefore, the control unit 52 does not necessarily consider the distance from the light receiving array 51 to the object 20 when setting the light receiving element 53 to be turned on. However, since the beam position on the light receiving surface may be slightly shifted depending on the distance to the object 20, the control unit 52 may set the light receiving element 53 to be turned on when the light is projected by the light projecting unit 3 using the result of measuring the distance to the object 20. For example, the light receiving element 53 to be turned on may be shifted in at least one of the second direction X and the third direction Y in a case where the object 20 is at a short distance or at a long distance. The shift amount may be changed according to the distance to the object 20, or it may be set whether the object 20 is shifted by a predetermined amount by two options of a short distance or a long distance.
The light control unit 4 performs scanning by the light from the light projecting unit 3 in a one-dimensional direction or a two-dimensional direction. The control unit 52 may dynamically control the light receiving element 53 to be turned on based on the scanning direction and the scanning speed of the light by the light control unit 4.
As described above, the control unit 52 according to this embodiment turns on only the light receiving elements 53 that may receive the desired reflected light, and turns off the other light receiving elements 53 in the light receiving array 51. The output signal of the light receiving element 53 in the OFF state is always zero, and there is no possibility that the light receiving element 53 in the OFF state outputs noises. Therefore, the distance measurement unit 42 can measure the distance on the basis of the timing when the light receiving element 53 in the ON state receives light, and can reduce the crosstalk without being affected by the noises of the surrounding pixels. Thus, it is possible to improve the accuracy in distance measurement, and a burden of distance measurement processing can be reduced. In addition, since the number of light receiving elements 53 to be turned on can be reduced, power consumption can be reduced.
In the second embodiment, the number of output wires 54 connected to the plurality of light receiving elements 53 is reduced. As described above, in order to increase the resolution of the distance image, it is necessary to increase the number of light receiving elements 53 per unit area in the light receiving array 51. However, each light receiving element 53 is connected to an output wire 54 for transferring the photoelectrically converted electrical signal. Therefore, if the number of light receiving elements 53 in the light receiving array 51 is increased, it is not possible to secure a region where the output wire 54 is disposed. The second embodiment is provided to solve this problem.
The light receiving array 51 of
Each of the n light receiving elements 53 arranged adjacent to the second direction X is connected to a different output wire 54. In the case of
In
The switch array 55 includes n switches 56 for selecting any one of the n output wires 54 for each light receiving element array 53a. Similarly to the first embodiment, the control unit 52 according to this embodiment turns on only one or more light receiving elements 53, and turns on the switch 56 linked to the output wire 54 connected to the light receiving elements 53 that are turned on.
In
The beam spot diameter of the desired reflected light on the light receiving surface of the light receiving array 51 does not depend on the distance from the light receiving array 51 to the object 20 as described in
In this way, in the second embodiment, for each light receiving element array 53a, the photoelectrically converted electrical signal from each light receiving element 53 in the light receiving element array 53a is transferred through the output wires 54, the number of which is smaller than the number of light receiving elements 53. Therefore, the total number of output wires 54 can be greatly reduced compared to the number of light receiving elements 53. In addition, in the present embodiment, the connection between each light receiving element 53 and the output wire 54 are connected in accordance with the beam spot diameter of the desired reflected light on the light receiving surface of the light receiving array 51. Therefore, the number of output wires 54 can be reduced within a range that does not hinder the extraction of the light reception signal of the light receiving element 53 in the ON state.
At least a part of the electronic apparatus 2 according to the first and second embodiments can be implemented by a System in Package (SiP).
In the layout diagram of
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2019-162247 | Sep 2019 | JP | national |