This application is based upon and claims the benefit of priority from prior Japanese Patent Application No. 2022-125591, filed Aug. 5, 2022, the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a signal processing device, a light detector, and a distance measuring device.
A distance measuring device called “LiDAR (Light Detection and Ranging)” is known. A LiDAR irradiates a target object with laser light and detects the intensity of reflected light reflected from the target object by a sensor (light detector). Then, the LiDAR measures the distance from itself to the target object based on a light intensity signal output from the sensor.
In general, according to one embodiment, a signal processing device configured to process a plurality of intermittently input signals. The signal processing device includes a plurality of input ends, first to Nth output ends, and a control circuit. The plurality of input ends is configured to input the plurality of signals, respectively. The first to Nth output ends are respectively associated with first to Nth groups (N is an integer of not less than two). Each of the first to Nth groups includes M (M is an integer of not less than two) consecutive input ends. The control circuit is configured to output, to the kth output end, a signal based on a signal obtained by adding a plurality of signals respectively input to the M consecutive input ends of the kth group (k an integer of not less than 1 and not more than N). The control circuit is configured to switch combinations of input ends as the M input ends to set different combinations at the first setting to the Mth setting.
Hereinafter, embodiments will be described with reference to the drawings. Each embodiment exemplifies a device and a method for embodying a technical idea of the invention. The drawings are schematic or conceptual, and the dimensions and ratios, etc. in the drawings are not always the same as those of the actual products. In the drawings to be referred to below, an “X direction” and a “Y direction” correspond to directions intersecting each other. For example, the X and Y directions respectively correspond to the horizontal and vertical directions. The technical idea of the present invention is not specified by the shapes, structures, arrangements, etc. of the structural elements.
In the following descriptions, structural elements having approximately the same function and configuration will be denoted by the same reference sign. The numbers after the letters that make up the reference signs are used to distinguish between elements referenced by reference signs containing the same characters and that have a similar configuration. When there is no need to distinguish components denoted by reference signs containing the same letters from each other, such components may be referred to by a reference sign containing the letters only.
A distance measuring device 1 according to a first embodiment is, for example, a type of LiDAR (Light Detection and Ranging) capable of measuring the distance between the distance measuring device 1 and a target object. The distance measuring device 1 according to the first embodiment will be described in detail below.
The controller 10 controls an overall operation of the distance measuring device 1. The controller 10 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and an oscillator, all of which are not shown. The ROM stores a program and the like used for an operation of the distance measuring device 1. The CPU controls the emission section the light receiver 30, the measurement section 40, and the image processor 50 according to the program stored in the ROM. The RAM is used as a working area of the CPU. The oscillator is used for generating an intermittent pulse signal. The controller 10 may also be configured to be capable of executing various data processing and arithmetic processing.
The emission section 20 intermittently generates and emits laser light. Intermittently generated laser light is referred to as “pulse laser” hereinafter. Pulse laser is emitted with a predetermined pulse width and a predetermined period. The pulse laser is used for measuring the distance between the distance measuring device 1 and the target object TG. In the present specification, the laser light emitted from the emission section 20 is referred to as “outgoing light L1”. The outgoing light L1 reflected by the outside of the distance measuring device 1 is referred to as “reflected light L2”.
The light receiver 30 detects light incident on the distance measuring device 1 and transfers a light reception result to the measurement section 40. In other words, the light receiver 30 converts the light incident on the distance measuring device 1 into an electric signal and transfers the converted electric signal to the measurement section 40. The light receiver 30 is used for detecting the reflected light L2 intermittently incident on the distance measuring device 1. The light receiver 30 receives environmental light and stray light (light generated inside the device) in addition to the reflected light L2. The environmental light and stray light correspond to noise. For the sake of simplicity, a description of noise such as environmental light will be omitted as appropriate.
The measurement section 40 measures the time at which the light receiver 30 detects the reflected light L2 based on the light reception result transferred from the light receiver 30. Then, the measurement section 40 measures the distance between the distance measuring device 1 and the target object TG based on the time at which the outgoing light L1 is emitted from the emission section 20 and the time at which the light receiver 30 detects the reflected light L2. The time at which the outgoing light L1 is emitted from the emission section 20 is, for example, reported from the controller 10. Further, the measurement section 40 may input a part of a result of processing an electric signal that is input from the light receiver 30 to the controller 10.
The image processor 50 acquires the measurement result obtained by the measurement section 40 and generates an image including distance information by using the acquired measurement result. The image generated by the image processor 50 includes distance information between the distance measuring device 1 and the target object TG. In addition, the image generated by the image processor 50 is referred to by, for example, a control program in a vehicle including the distance measuring device 1. Note that the image processor 50 may be coupled to the outside of the distance measuring device 1.
In the distance measuring device 1 according to the first embodiment, the controller 10 is described as one block independent of the emission section 20 and the light receiver 30. The present invention is not limited to this, and some of the functions of the controller 10 may be implemented in the light receiver 30 and the measurement section 40. Thereby, the distance measuring device 1 can perform fine manipulations in a timely manner. Controls that are not particularly clearly described in the following descriptions are assumed to be executed by the controller 10 for the sake of simplicity.
The measurement section 40 calculates a time of flight (ToF) of the outgoing light L1 based on a difference between an emission time at which the outgoing light L1 is emitted from the emission section 20 and a light-receiving time at which the light receiver 30 detects the reflected light L2. Then, the measurement section 40 measures (ranges) the distance between the distance measuring device 1 and the target object TG based on the time of flight of the outgoing light L1 and the velocity of the laser light. Such a ranging method of the distance measuring device 1 may also be called a “ToF method”. The measurement section outputs a ranging result for each set of the outgoing light L1 and the reflected light L2 that the distance measuring device 1 emits and receives.
It suffices that the measurement section 40 decides the emission time based at least on the time relating to emission of the outgoing light L1 and decides the light-receiving time based on the time relating to light reception of the reflected light L2. For example, the measurement section 40 may decide the emission time and the light-receiving time based on the rise time of a signal or based on the peak time of a signal. Processing of the measurement section 40 may be performed by the controller
The driver 21 generates a drive current according to a pulse signal input from the oscillator of the controller 10. Then, the driver 21 supplies the generated drive current to the light source 23. That is, the driver 21 functions as a current supply source of the light source 23.
The driver 22 generates a drive current under the control of the controller 10. Then, the driver 22 supplies the generated drive current to the mirror 25. That is, the driver 22 functions as a power supply circuit of the mirror 25.
The light source 23 is a laser light source, such as a laser diode. The light source 23 intermittently emits laser light (outgoing light L1) based on the intermittent drive current (pulse signal) supplied from the driver 21. The laser light (pulse laser) emitted by the light source 23 is incident on the optical system 24.
The optical system 24 can include a plurality of lenses and optical elements. The optical system 24 is arranged on an optical path of the outgoing light L1 emitted by the light source 23. The optical system 24 collimates the incident outgoing light L1 and guides the collimated outgoing light L1 to the mirror 25. In addition, the optical system 24 includes a beam splitter BS. The outgoing light L1 emitted from the light source 23 passes through the beam splitter BS and is applied to the mirror The beam splitter BS further reflects the reflected light L2 applied from the mirror 25 toward the light receiver 30.
The mirror 25 is driven based on the drive current supplied from the driver 22 and reflects the outgoing light L1 incident on the mirror 25. The outgoing light L1 reflected by the mirror 25 is emitted outside of the distance measuring device 1. In addition, the mirror 25 reflects the reflected light L2 from the outside and guides the reflected light L2 to the optical system 24. The reflecting surface of the mirror 25 is, for example, configured to be rotatable or swingable around two axes intersecting each other. It is conceivable to use a polygon mirror, a revolving mirror, or a single-axis MEMS mirror, as the mirror 25. The present specification describes a case in which the mirror 25 is a revolving mirror (two-sided mirror) having two reflecting surfaces.
The distance measuring device 1 changes the emitting direction of the outgoing light L1 by controlling the mirror 25 so as to scan an area to be ranged. The distance measuring device 1 measures the various distances from the target object TG by executing measurement at a plurality of points in an area to be scanned (to be referred to as a scan area SA hereinafter). The distance measuring device 1 can sequentially acquire the distances from the target object TG in front of the distance measuring device 1 by continuously executing scanning. A set of ranging results at a plurality of points corresponding to single scanning is referred to as a “frame” hereinafter. It suffices that the emission section has a configuration capable of scanning using laser light. For example, the emission section 20 may further include an optical system arranged on the optical path of laser light reflected by the mirror 25.
The distance measuring device 1 generates a plurality of distance data corresponding to a detection area DA smaller than the scan area SA for each measurement period. The detection area DA includes, for example, n (n is an integer of two or more) pixels PX (PX1, PX2, PX3, . . . , and PXn) arrayed one-dimensionally. One distance data is generated for each pixel PX. The n pixels PX are arrayed along, for example, the Q-axis. The distance measuring device 1 repeatedly executes the above processing for each measurement period while one-dimensionally shifting the detection area DA along the P-axis. The consecutive detection areas DA may overlap each other or be separated from each other. This allows the distance measuring device 1 to generate distance data concerning an area corresponding to a first row S1 in the scan area SA.
The distance measuring device 1 then also executes processing similar to the processing executed for the first row S1 to a second row S2 in the scan area SA. If a revolving mirror having two reflecting surfaces is used as the mirror 25, two-row distance data constituted by the first row S1 and the second row S2 is generated. This allows the distance measuring device 1 to map, in the scan area SA, the distance data from an object present in the PQR space, thereby recognizing the distance from the target object TG within the space PQR. The number of pixels along the Q-axis of one-frame ranging result increases with an increase in the number of rows assigned to measurement in the scan area SA.
Note that the above scanning method is called “multi-channel raster scanning”. As a means for implementing multi-channel raster scanning, the outgoing light L1 having an irradiation surface elongated in the longitudinal direction is used. In this case, the emission section 20 includes, for example, an anisotropic aspherical collimator lens. In addition, as the mirror 25, a polygon mirror, revolving mirror, biaxial mirror, or the like which has a plurality of reflecting surfaces having different tilt angles is used. The distance measuring device 1 may use an OPA (Optical Phased Array) method as another scanning method. The number of rows and the scanning direction in single scanning may be set to other settings. The operations and effects provided by the distance measuring device 1 according to the first embodiment do not depend on the scanning method of the outgoing light L1.
The specific configuration of the light receiver included in the distance measuring device 1 according to the first embodiment will be described again with reference to
The optical system 31 collects the reflected light L2 incident on the distance measuring device 1 in the sensor array 32 of the light detector PD. The optical system 31 includes at least one lens. For example, the optical system 31 has a microlens array provided so as to overlap the sensor array 32.
The sensor array 32 converts the light incident via the optical system 31 into an electric signal. The sensor array 32 includes for example, a photomultiplier element. As the photomultiplier element, for example, a single-photon avalanche diode (SPAD), which is a type of avalanche photodiode, is used. The electric signal (light reception result) converted by the sensor array 32 is output to the signal processing device 34 via the column selector 33.
The column selector 33 selects any one of sets of a plurality of SPADs included in the sensor array 32 under the control of the control circuit 35. The selected set of the plurality of SPADs is electrically coupled to the signal processing device 34.
The signal processing device 34 adjusts the output level of the electric signal transferred from the sensor array 32 and outputs the resultant signal to the measurement section 40. The signal processing device 34 has a function of switching combinations of input signals. The specific configuration of the signal processing device 34 will be described later.
The control circuit 35 controls the overall operation of the light detector PD under the control of the controller 10. Processing of the control circuit 35 may be performed by the controller 10.
The respective components of the light detector PD may be formed on the same substrate (chip) or on different substrates. The signal processing device 34 may be externally coupled to the light detector PD. The measurement section 40 may have the function of the signal processing device 34.
Each channel unit CHU includes a plurality of SPADs and corresponds to a sub-pixel. Each sub-pixel may be simply called a “pixel”. The plurality of channel units CHU1 to CHU(n+1) of the sensor array 32 are respectively coupled to the plurality of selection-and-adder circuits XFR1 to XFR(n+1) via output node sets OUT1 to OUT(n+1). Each output node set OUT includes a plurality of output nodes. The output nodes will be described in detail later.
Each selection-and-adder circuit XFR selectively activates a plurality of SPADs included in the associated channel unit CHU. Each SPAD in the active state can detect the reflected light L2. The plurality of selection-and-adder circuits XFR1 to XFR(n+1) of the column selector 33 are coupled to the signal processing device 34 via sub-channels SCH1 to SCH(n+1), respectively. This allows the selection-and-adder circuit XFRi (1≤i≤(n+1)) to adde the electric signals input via the output node set OUTi from the SPADs in the active state and transfer the resultant signal to the signal processing device 34 by using the sub-channel SCHi.
The signal processing device 34 adds electric signals from the two consecutive sub-channels SCH and outputs the resultant signal to a channel CH associated with the two consecutive sub-channels SCH. In other words, the signal processing device 34 adds the electric signals transferred from two adjacent sub-pixels and outputs the resultant signal to the measurement section 40. In this specification, the number of signal lines used for the transfer of electric signals between the signal processing device 34 and the measurement section 40 corresponds to a channel count N.
Note that in the light detector PD according to the first embodiment, the number of channel units CHU and the number of selection-and-adder circuits XFR are designed based on the channel count N. In the first embodiment, N=n/2. More specifically, in the case of channel count N=80 (that is, the light detector PD having 80-channel outputs), the column selector 33 is coupled to the signal processing device 34 via 161 sub-channels SCH.
For the sake of simplicity, the following will describe a case in which N=4, that is, n=8, and the light detector PD includes the four channels CH1 to CH4, the nine sub-channels SCH1 to SCH9, the nine selection-and-adder circuits XFR1 to XFR9, the nine output node sets OUT1 to OUT9, and the nine channel units CHU1 to CHU9.
The diode APD is, for example, a SPAD. The diode APD has an input end coupled to a bias power supply and an output end coupled to the first end of the quench resistor Rq. The quench resistor Rq functions as a quench resistor. The second ends of the plurality of quench resistors Rq included in the same cell unit CU are coupled to each other. That is, the output of each cell unit CU is coupled to the outputs of the plurality of light detection elements DC so as to add output currents (current signals). The same voltage is applied to the input ends (cathodes) of all the diodes APD in the light detector PD. The output end (anode) of each diode APD is biased to a breakdown voltage (for example, about −30 V) equal to or more than the avalanche breakdown voltage. This allows the diode APD to undergo avalanche breakdown based on the reception of the reflected light L2 and generate Geiger discharge.
The quench resistor Rq suppresses the voltage difference between the two ends of the diode APD that has undergone avalanche breakdown (quenching). The diode APD can stop Geiger discharge owing to the quench resistor Rq and the like. The diode APD can then generate Geiger discharge again by receiving the reflected light L2 after the lapse of a predetermined time since Geiger discharge is stopped. The time interval from the instant the diode APD generates Geiger discharge to the instant the diode APD can generate Geiger discharge again is very short as compared with the pulse period of the outgoing light L1. For this reason, the diode APD can periodically perform measurement. A set of the output nodes of each of the plurality of cell units CU1 to CUm included in the channel unit CHUi corresponds to the output node set OUTi shown in
The protection resistor Rs is coupled between the diode APD and the quench resistor Rq. The output end (anode) of the diode RD is coupled to the node between the diode APD and the quench resistor Rq. The input end (cathode) of the diode RD is coupled to a node DOUT. The input ends of the respective diodes RD are commonly coupled to the node DOUT. That is, the input ends of the respective diodes RD may be coupled to each other. The node DOUT is coupled to a potential slightly lower (>a threshold voltage Vth of the diode APD) than the breakdown voltage of the diode APD. With this configuration, if the potential of the non-selected output node set OUT drops, carriers are discharged to the node DOUT to protect the associated transistors T1 to Tm.
The cell unit CU is used as the minimum unit of an area where the sensor array 32 can detect light. The cell unit CU may be called a sub-pixel or may be simply called a pixel. The number of light detection elements DC (diodes APD) constituting the cell unit CU may be at least one or more. The cell unit CU including the plurality of diodes APD may be called a silicon photomultiplier (SiPM). The dynamic range of light that can be detected by the sensor array 32 can change in accordance with the number of diodes APD included in one cell unit CU. In addition, the direction of an output current from the diode APD can change in accordance with the polarity of the diode APD.
A column address is assigned to each cell unit CU. Each cell unit CU can be specified by a column address. The diode APD is configured to be set in an active state or an inactive state by the control circuit 35. The diode APD in the active state can detect the light incident on the diode APD and outputs an optical signal indicating a detection result to the output end. The diode APD in the inactive state is generally in a power saving state and detects no light. Note that a row address may be assigned to each cell unit CU.
The plurality of transistors T1 to Tm included in the selection-and-adder circuit XFRi (1≤i≤(n+1)) are respectively coupled to the plurality of cell units CU1 to CUm included in the channel unit CHUi. More specifically, the first end of a transistor Tj (1≤j≤m) of the selection-and-adder circuit XFRi is coupled to the second end of each of the plurality of quench resistors Rq included in the cell unit CUj of the channel unit CHUi. Each of the plurality of transistors T1 to Tm is, for example, a p-type metal-oxide-semiconductor (MOS) transistor.
The second end of each of the plurality of transistors T1 to Tm included in the selection-and-adder circuit XFRi is coupled to the sub-channel SCHi. The current signals input to the sub-channel SCH are added by coupling the plurality of transistors T1 to Tm in parallel. That is, the selection-and-adder circuit XFR constitutes a circuit equivalent to an adder circuit. Control signals CS1 to CSm are respectively input to the gate ends of the plurality of transistors T1 to Tm included in the selection-and-adder circuit XFRi. That is, the transistors Tj of the selection-and-adder circuits XFR1 to XFR9 are controlled by the common control signal CS.
The control circuit 35 can set at least one cell unit CU of the cell units CU arrayed in the X direction to an active state or an inactive state via the column selector 33. More specifically, the control circuit 35 selects at least one cell unit CU of the channel unit CHUi by using the control signals CS1 to CSm. In other words, the control circuit 35 selectively turns on at least one of the transistors T1 to Tm of each channel unit CHU by using the control signals CS1 to CSm. In other words, the column selector 33 is configured to selectively couple at least one of the plurality of cell units CU respectively associated with the plurality of sub-channels SCH.
The control circuit 35 sets the voltage of each sub-channel SCH to, for example, about 0 V to several V. This allows the control circuit 35 to apply a reverse bias to each diode APD of the light detection element DC corresponding to at least one transistor T in an ON state. This reverse bias is a potential difference that can cause avalanche breakdown in the diode APD. As a result, the channel unit CHUi in the light detector PD can output the sum of currents generated in the plurality of light detection elements DC in the selected cell unit CVj to the sub-channel SCHi for each measurement period.
Note that as elements corresponding to the transistors T1 to Tm, other types of switch elements may be used as long as they can execute the operation to be described later. In addition, the sensor array 32 may include an active quench circuit in place of the single quench resistor Rq. The active quench circuit executes quenching under the control of the control circuit 35 and can execute quenching at high speed as compared with the case in which the quench resistor Rq is used. In the following description, the quench resistor Rq may be replaced with an active quench circuit, and the output end of the quench resistor Rq may be replaced with the output end of the active quench circuit. An output signal from the channel unit CHU can be an analog current signal in a case in which the quench resistor Rq is used and can be a digital signal in a case in which the active quench circuit is used. In the case of the use of the active quench circuit, an adder is used to add output signals.
Note that an n-type MOS transistor may be provided in place of the diode RD and the protection resistor Rs. One and the other of the source and the drain of this n-type MOS transistor may be respectively coupled to an output node included in the associated output node set OUT and to a power supply node VSS or the node DOUT, and the control signal CSm may be input to the gate end.
In the area of the sensor array 32, in the case of N=4, the channel units CHU1 to CHU9 provided such that each extends in the X direction (row direction) are arranged in the Y direction (column direction). In the area of each channel unit CHU, the plurality of cell units CU1 to CUm are arranged in the X direction. In the area of each cell unit CU, the light detection elements DC1 to DC3 are arranged in the Y direction. With this arrangement, the cell unit CU has a width corresponding to one light detection element DC along the X direction and a width corresponding to the number of light detection elements DC along the Y direction. The channel unit CHU has a width corresponding to m cell units CU along the X direction and a width corresponding to one cell unit CU along the Y direction. The area of the sensor array 32 has a width corresponding to about one channel unit CHU along the X direction and a width corresponding to about (n+1) channel units CHU along the Y direction.
In the area of the column selector 33, the selection-and-adder circuits XFR are arranged adjacent to the associated channel units CHU. More specifically, in the case of N=4, the selection-and-adder circuits XFR1 to XFR9 are respectively arranged adjacent to the channel units CHU1 to CHU9. The width of the area of one channel unit CHU along the Y direction is designed to be, for example, almost equal to the width of one selection-and-adder circuit XFR along the Y direction. With this arrangement, the area of the column selector 33 has a width corresponding to about one selection-and-adder circuit XFR along the X direction and a width corresponding to, for example, (n+1) selection-and-adder circuits XFR along the X direction. Note that the shape of the area of the column selector 33 is not physically and optically limited unlike the sensor array 32. This makes the circuit design of the area of the column selector 33 have a higher degree of freedom than the sensor array 32.
Although the first embodiment has exemplified the case in which the channel units CHU1 to CHU9 are used in each of the first and second rows S1 and S2 in scanning, the present invention is not limited to this. The light detector PD may have circuits similar to the sensor array 32 and the column selector 33 described in correspondence with each row in scanning. In this case, for example, the sub-channels SCH associated with each other are coupled to each other between the plurality of column selectors 33. Scans on a plurality of rows in the measurement of the scan area SA need not overlap each other or be rectangular. In general, in one measurement, the fixed number (for example, a plurality) of light detection elements DC in each of the Y and X directions are set to an active state. The Y-direction position of the fixed number of light detection elements DC set to the active state can be changed for every measurement.
Each switch SW is a three-way switch and has an input end IT and output ends OT1 and OT2. Each switch SW electrically couples between the input end IT and the output end OT1 or between the input end IT and the output end OT2 based on a control signal GS. The control signal GS is a signal generated by the control circuit 35. Each output circuit OC can adjust the output level of the signal input to the input end and output the resultant signal to the channel CH coupled to the output end. Each output circuit OC can also adjust the voltage applied to the output end of the diode APD by adjusting the voltage of a node NG coupled to the input end.
The input end IT of the switch SW is coupled to the sub-channel SCH1. The output ends OT1 and OT2 of the switch SW1 are respectively coupled to a ground node GND and a node NG1. The node NG1 is coupled to the sub-channel SCH2 and the input end of the output circuit OC1. The output end of the output circuit OC1 is coupled to the channel CH1.
The input end IT of the switch SW2 is coupled to the sub-channel SCH3. The output ends OT1 and OT2 of the switch SW2 are respectively coupled to the node NG1 and a node NG2. The node NG2 is coupled to the sub-channel SCH4 and the input end of the output circuit OC2. The output end of the output circuit OC2 is coupled to the channel CH2.
The input end IT of the switch SW3 is coupled to the sub-channel SCH5. The output ends OT1 and OT2 of the switch SW3 are respectively coupled to the node NG2 and a node NG3. The node NG3 is coupled to the sub-channel SCH6 and the input end of the output circuit OC3. The output end of the output circuit OC3 is coupled to the channel CH3. The input end IT of the switch SW4 is coupled to the sub-channel SCH7. The output ends OT1 and OT2 of the switch SW4 are respectively coupled to the node NG3 and a node NG4. The node NG4 is coupled to the sub-channel SCH8 and the input end of the output circuit OC4. The output end of the output circuit OC4 is coupled to the channel CH4.
The input end IT of the switch SW5 is coupled to the sub-channel SCH9. The output ends OT1 and OT2 of the switch SW5 are respectively coupled to the node NG4 and the ground node GND.
That is, in the switch part 341, a switch SWk (2≤k≤N+1) is configured such that the input end IT is coupled to a sub-channel SCH(2×k−1), the output end OT1 is coupled to a node NG(k−1), and the output end OT2 is coupled to a node NGk. In the switch part 341, the output end OT1 of the switch SW (for example, the switch SW1) assigned to one end portion and the output end OT2 of the switch SW (for example, the switch SW5) assigned to the other end portion are, for example, grounded.
The signal processing circuit 41 performs processing such as amplification of a signal input to the associated channel CH and outputs the processed signal to the AD converter 42. The amplifier used in the signal processing circuit 41 is, for example, a transimpedance amplifier (TIA).
The AD converter 42 converts an analog signal input from the signal processing circuit 41 into a digital signal and outputs the converted digital signal to the measurement circuit 43. The measurement section 40 may include a time-to-digital (TD) converter instead of the AD converter 42 or may include both an AD converter and a TD converter.
The measurement circuit 43 measures the distance between the target object TG and the distance measuring device 1 based on the digital signal input from the AD converter 42 and outputs the measurement result to the outside. In the present example, the measurement blocks MB1 to MB4 process the signals input to the channels CH1 to CH4, respectively, and output measurement results R1 to R4, respectively.
A method of controlling the column selector 33 and the operation of the signal processing device 34 will be sequentially described in association with the ranging operation of the distance measuring device 1 according to the first embodiment.
As shown in
With this arrangement, current paths are formed between the cell units CU3 to CU5 of the channel unit CHUi (1≤i≤n+1) and the sub-channel SCHi, and the current paths between the remaining cell units CU and the sub-channel SCHi are cut off. In other words, the light detection elements DC (that is, the SPADs) included in the cell unit CU at the irradiation position of the reflected light L2 are set to the active state so as to be set to a state in which light can be detected. In contrast to this, the light detection elements DC included in the cell unit CU at a position where no reflected light L2 is applied are set to the non-active state so as to exclude noise components other than the reflected light L2 detected by the light detection elements DC in the cell units CU other than the selected cell units CU. The light detector PD can detect the reflected light L2 at a high S/N ratio by selectively setting an active area in this manner, thereby improving the measurement accuracy.
In the first embodiment, the switch part 341 of the signal processing device 34 can switch two types of combinations of the adjacent sub-channels SCH. In the first embodiment, such two types of combinations will be referred to as input groups IG1 and IG2. The following sequentially describes the operations of the signal processing device 34 (switch part 341) at the first time and the second time respectively associated with the input groups IG1 and IG2 in the ranging operation of the distance measuring device 1.
More specifically, the sub-channel SCH1 is coupled to the node NG1. The current obtained by adding output currents from the sub-channels SCH1 and SCH2 is input to the input end of the output circuit OC1. The sub-channel SCH3 is coupled to the node NG2. The current obtained by adding output currents from the sub-channels SCH3 and SCH4 is input to the input end of the output circuit OC2. The sub-channel SCH5 is coupled to the node NG3. The current obtained by adding output currents from the sub-channels SCH5 and SCH6 is input to the input end of the output circuit OC3. The sub-channel SCH7 is coupled to the node NG4. The current obtained by adding output currents from the sub-channels SCH7 and SCH8 is input to the input end of the output circuit OC4.
As described above, the signal processing device 34 according to the first embodiment inputs, to the output circuit OCk, the signal obtained by combining an output current from the sub-channel SCH(2×k−1) (1≤k≤N) and an output current from the sub-channel SCH(2×k) in accordance with the input group IG1 at the first time. The output circuit OCk outputs, to the channel CHk, a signal based on the signal obtained by adding an output current from the sub-channel SCH(2×k−1) and an output current from the sub-channel SCH(2×k) in accordance with the first time.
More specifically, the sub-channel SCH3 is coupled to the node NG1. The current obtained by adding output currents from the sub-channels SCH2 and SCH3 is input to the input end of the output circuit OC1. The sub-channel SCH5 is coupled to the node NG2. The current obtained by adding output currents from the sub-channels SCH4 and SCH5 is input to the input end of the output circuit OC2. The sub-channel SCH7 is coupled to the node NG3. The current obtained by adding output currents from the sub-channels SCH6 and SCH7 is input to the input end of the output circuit OC3. The sub-channel SCH9 is coupled to the node NG4. The current obtained by adding output currents from the sub-channels SCH8 and SCH9 is input to the input end of the output circuit OC4.
As described above, the signal processing device 34 according to the first embodiment inputs, to the output circuit OCk, the signal obtained by combining an output current from the sub-channel SCH(2×k) (1≤k≤N) and an output current from the sub-channel SCH(2×k+1) in accordance with the input group IG1 at the second time. The output circuit OCk then outputs, to the channel CHk, a signal based on the signal obtained by adding an output current from the sub-channel SCH(2×k) and an output current from the sub-channel SCH(2×k+1) in accordance with the second time.
As shown in
The measurement section 40 then generates measurement results R1 to R4 respectively corresponding to the channels CH1 to CH4 based on the light reception result corresponding to the input group IG1 which is received from the light receiver 30. Likewise, the measurement section 40 generates the measurement results R1 to R4 respectively corresponding to the channels CH1 to CH4 based on the light reception result corresponding to the input group IG2 which is received from the light receiver 30. The measurement section 40 then packetizes the measurement results R1 to R4 corresponding to the input group IG1 and the measurement results R1 to R4 corresponding to the input group IG2. The measurement section 40 transfers, to the image processor a packet P1 including the measurement results R1 to R4 corresponding to the input group IG1 and a packet P2 including the measurement results R1 to R4 corresponding to the input group IG2. In this manner, in the distance measuring device 1, data is transmitted between the measurement section 40 and the image processor 50 for each channel (for each input group IG) instead of for each frame. In addition, in the distance measuring device 1, a pair of the packets P1 and P2 is associated with each detection area DA.
The image processor 50 then generates a plurality of pixels PX associated with the detection area DA by executing rearrangement with respect to the pair of the packets P1 and P2 received from the measurement section 40. More specifically, the image processor 50 inserts data such that two data corresponding to the same channel CH are consecutively arranged. More specifically, the image processor 50 inserts the measurement result R1 of the packet P2 next to the measurement result R1 of the packet P1, inserts the measurement result R2 of the packet P1 next to the measurement result R1 of the pixel P2, inserts the measurement result R2 of the pixel P2 next to the measurement result R2 of the packet P1, . . . , and inserts the measurement result R4 of the packet P2 next to the measurement result R4 of the packet P1. That is, the image processor 50 alternately arranges the measurement results of the packet P1 and the measurement results of the packet P2 in the vertical direction. These measurement results alternately arranged are associated with each other such that the combinations of the measurement results corresponding to the adjacent sub-channels SCH are shifted one by one.
The image processor 50 then generates the plurality of pixels PX based on a plurality of rearranged measurement results. In the present example, the groups of the measurement results R1 to R4 of the rearranged packets P1 and P2 respectively correspond to the pixels PX1 to PX8 of the associated detection area DA. That is, the number of pixels PX arrayed in each detection area DA corresponds to channel count N×number of input groups IG. For example, if the light detector PD is constituted by 40 ch (N=40), 40×2=80 pixels PX are arrayed along the Q-axis in correspondence with each detection area DA. In addition, if a revolving mirror having two reflecting surfaces is used, an image mapped by the scan area SA has 80×2=160 pixels PX arrayed along the Q-axis.
As shown in
The measurement position of each pixel PX is decided based on the arrangement of the cell unit CU selected at each time. In the present example, the grid indicated by the solid lines is shown in association with the pixels PX corresponding to the input group IG1, and the grid indicated by the broken lines is shown in association with the pixels PX corresponding to the input group IG2. More specifically, the odd-numbered pixels PX generated at times t1, t3, and t5 are constituted by sub-pixels corresponding to the channel units CHU(2×k−1) (1≤k≤N) and sub-pixels corresponding to the channel units CHU(2×k). The even-numbered pixels PX generated at times t2, t4, and t6 are constituted by sub-pixels corresponding to the channel units CHU(2×k) (1≤k≤N) and sub-pixels corresponding to the channel units CHU(2×k+1).
Accordingly, the center of gravity of each measurement position in the sets of the odd-numbered pixels PX is shifted from the center of gravity of a corresponding one of the measurement positions in the sets of the even-numbered pixels PX by, for example, one channel unit CHU (sub-pixel) in the Y direction. In other words, the center of gravity of each measurement position in the sets of the odd-numbered pixels PX is shifted from the center of gravity of a corresponding one of the measurement positions in the sets of the even-numbered pixels PX by half (half pixel) of the pixel PX in the Y direction. Each detection area DA includes the pixels PX of the input groups IG1 and IG2 measured at the positions shifted in the X direction. Note that in the example shown in
In the distance measuring device 1 according to the first embodiment, the measurement section 40 executes an averaging process using an averaging algorithm based on reliability. In the averaging process, when calculating a distance value at a given measurement point (pixel PX) of a target, the measurement section 40 uses a measurement result at at least one measurement point near the given measurement point. For example, the measurement section 40 weighs the measurement result at a measurement point near a target based on the reliability and accumulates the measurement result to the measurement result at a measurement point of the target. The measurement section 40 then detects at least one peak of a signal included in the accumulated measurement result and decides a distance value at the measurement point from at least one detected peak.
As shown in
Referring to
As described above, the measurement section 40 according to the first embodiment switches, in one scan, between an averaging range corresponding to an odd-numbered measurement result and an averaging range corresponding to an even-numbered measurement result. The measurement section 40 then generates each pixel PX in the input group IG1 and each pixel PX in the input group IG2 by the above averaging process. As a result, the measurement section 40 can transfer, to the image processor 50, measurement results corresponding to the pixels PX equal in number to channel N×2, that is, the number of sub-channels SCH used for the measurement of each input group IG before averaging, for each detection area DA.
The number of cell units CU of the sensor array 32 according to the first embodiment is about twice that in the conventional example. On the other hand, the number of output channels according to the first embodiment is the same as that in the conventional example. For this reason, the numbers and types of signal processing circuits 41 and AD converters 42 used in the first embodiment are the same as those in the conventional example. Since the number of channels remains the same between the first embodiment and the conventional example, the first embodiment can use the same measurement circuits and averaging circuits as those used by the conventional example.
As shown in
Although
According to the distance measuring device 1 according to the first embodiment described above, it is possible to suppress the manufacturing cost of the distance measuring device 1 and improve the ranging performance. The advantageous effect of the first embodiment will be described in detail below.
If the distance measuring device 1 is mounted in a vehicle, specifications required for forward monitoring place importance on the resolution in the vertical direction in particular. Methods of improving the resolution in the vertical direction may include a method of increasing the number of rows to be scanned and a method of increasing the number of pixels in the vertical direction which can be simultaneously ranged (that is, the number of pixels PX arranged in the vertical direction in correspondence with the single detection area DA). For example, increasing the number of channel units CHU of the sensor array 32 can increase the number of pixels PX in the vertical direction which can be simultaneously ranged.
A measurement IC for processing the light reception result output from the light detector includes a circuit for measuring a distance value for each channel. Since the circuit area increases with an increase in channel count, increasing the channel count becomes a factor that increases the size of the measurement IC and the manufacturing cost. That is, the number of channels of the measurement IC used in the distance measuring device 1 has its upper limit due to manufacturing cost. For this reason, considering the simultaneous pursuit of manufacturing cost reduction and performance improvement makes it also difficult to increase the number of channels of the light detector to increase the number of pixels in the vertical direction.
If the number of channels is increased, the number of wires between the light detector and the measurement IC increases. The design of the number of wires has its own limit in terms of cost and technique. For this reason, it is practically difficult to provide too many wires between the light detector and the measurement IC.
On the other hand, increasing the number of rows to be scanned makes it possible to increase the number of pixels in the vertical direction without increasing the number of channels of the measurement IC. For example, using a multifaceted polygon mirror can increase the number of rows to be scanned. However, it is more difficult to increase the surface accuracy and working accuracy of a polygon mirror than those of a revolving mirror (two-sided mirror), and the polygon mirror requires a larger installation area than the removing mirror. For this reason, in order to implement the compact, low-cost distance measuring device 1, a revolving mirror is preferably used.
As another method of increasing the number of pixels in the vertical direction, it is conceivable to selectively couple the even-numbered channel unit CHU and the odd-numbered channel unit CHU to each channel. Such a method is also called an interlace method. However, simply switching coupling between the channel units CHU will reduce the number or area of diodes APD used for the detection of light per channel. This leads to a reduction in the S/N ratio of an output current from the light detector and a reduction in detection performance. That is, this method does not use half of the light applied to the light detector PD and hence is not preferable for the distance measuring device 1 for long distance. In addition, the method may lack in dynamic range. The lack in dynamic range may become a factor that causes a ranging failure and also a factor that reduces the ranging accuracy. In addition, the method does not use half of the light applied to the light detector and hence is not preferable for the distance measuring device 1 for long distance.
In contrast to this, the distance measuring device 1 according to the first embodiment includes the signal processing device 34 that can switch signals to be input to each channel CH by using the input groups IG1 and IG2. In a ranging operation, the signal processing device 34 executes measurement of light reception results by alternately switching the input groups IG1 and IG2. That is, combinations of two consecutive sub-pixels are switched for each measurement timing and used for the calculation of distance value at each pixel PX. In addition, the measurement section 40 sets an averaging range shifted by half the pixel PX (that is, sub-pixel) in the vertical direction and executes an averaging process based on different combinations of the pixels PX between the input groups IG1 and IG2. The image processor 50 then generates the plurality of pixels PX in the detection area DA by rearranging measurement results of the set of the input groups IG1 and IG2.
This allows the distance measuring device 1 according to the first embodiment to maintain the number or area of the diodes APD used for the detection of light per channel and increase the number of pixels in the vertical direction as in the interlace method. That is, the distance measuring device 1 can use the interlace method, maintain the S/N ratio of a signal, and suppress a reduction in dynamic range. Since the switch part 341 of the signal processing device 34 is formed from a simple switching circuit, it is possible to suppress an increase in circuit area more than a case in which the number of channels of the measurement IC (measurement section 40) is increased. In addition, the distance measuring device 1 according to the first embodiment executes an averaging process described with reference to
The characteristics of the distance measuring device 1 according to the first embodiment will be described below with reference to a comparative example.
As shown in
As shown in
As shown in
As shown in
That is, this indicates that the interlace method according to the first embodiment has improved the effective vertical resolution by about 1.4 times as compared with the first comparative example. The interlace method obtains one measurement result by two times of laser emission including one emission for each of the input groups IG1 and IG2. Accordingly, in the interlace method, the horizontal resolution becomes 0.5 times. In summary, the resolution in the horizontal direction becomes 0.5 times×1.4 times to 1/1.4, and the number of pixels in the horizontal direction decreases. In contrast to this, the specification associated with the number of pixels in the horizontal direction in LiDAR is less strict than the specification associated with the number of pixels in the vertical direction. That is, even if the interlace method is used and the number of pixels in the horizontal direction decreases, LiDAR can satisfy required specifications. Accordingly, if the distance measuring device 1 according to the first embodiment is used in a vehicle with priority placed on the resolution in the vertical direction, the device can satisfy both the specifications in the vertical and horizontal directions.
As shown in
A distance measuring device 1 according to the second embodiment includes a light detector PDa that can switch between combinations of three consecutive sub-channels SCH associated with three consecutive channels CH. The distance measuring device 1 according to the second embodiment will be described in detail below.
The plurality of channel units CHU1 to CHU(n+2) of the sensor array 32a are respectively coupled to a plurality of selection-and-adder circuits XFR1 to XFR(n+2) via output node sets OUT1 to OUT(n+2). The plurality of selection-and-adder circuits XFR1 to XFR(n+2) of the column selector 33a are coupled to the signal processing device 34a via sub-channels SCH1 to SCH(n+2), respectively. This allows each selection-and-adder circuit XFR according to the second embodiment to transfer electric signals output from active SPADs included in the associated channel unit CHU to the signal processing device 34a.
The signal processing device 34a adds signals from the three consecutive sub-channels SCH and outputs the resultant signal to the corresponding channel CH. In the second embodiment, the electric signals transferred from the three consecutive sub-pixels (channel units CHU) are used to generate distance data corresponding to one pixel PX. The signal processing device 34a will be described in detail later.
In the light detector PDa according to the second embodiment, the number of channel units CHU and the number of selection-and-adder circuits XFR are designed based on a channel count N. In the second embodiment, N=n/3. More specifically, in the case of channel count N=80 (that is, a light detector PD having 80-channel outputs), the column selector 33a is coupled to the signal processing device 34a via 242 sub-channels SCH.
For the sake of simplicity, the following will describe a case in which N=4, that is, n=12, and the light detector PD includes four channels CH1 to CH4, the 14 sub-channels SCH1 to SCH4, the 14 selection-and-adder circuits XFR1 to XFR14, the 14 output node sets OUT1 to OUT14, and the 14 channel units CHU1 to CHU14.
Each of the switches SWa and SWb is a three-way switch and has an input end IT and output ends OT1 and OT2. Each switch SWa electrically couples between the input end IT and the output end OT1 or between the input end IT and the output end OT2 based on a control signal GSa. Each switch SWb electrically couples between the input end IT and the output end OT1 or between the input end IT and the output end OT2 based on a control signal GSb. The control signal GSa and GSb are signals generated by the control circuit 35.
The input end IT of the switch SWa1 is coupled to the sub-channel SCH1. The output ends OT1 and OT2 of the switch SWa1 are respectively coupled to a ground node GND and a node NGa1. The input end IT of the switch SWb1 is coupled to the sub-channel SCH2. The output ends OT1 and OT2 of the switch SWb1 are respectively coupled to the ground node GND and the node NGb1. The nodes NGa1 and NGb1 (to be also referred to as nodes NG1 hereinafter) are respectively coupled to the sub-channel SCH3 and the input end of the output circuit OC1.
The input end IT of the switch SWa2 is coupled to the sub-channel SCH4. The output ends OT1 and OT2 of the switch SWa2 are respectively coupled to the node NGa1 and a node NGa2. The input end IT of the switch SWb2 is coupled to the sub-channel SCH5. The output ends OT1 and OT2 of the switch SWb2 are respectively coupled to the node NGb1 and a node NGb2. The nodes NGa2 and NGb2 (to be also referred to as nodes NG2 hereinafter) are respectively coupled to the sub-channel SCH6 and the input end of the output circuit OC2.
The input end IT of the switch SWa3 is coupled to the sub-channel SCH7. The output ends OT1 and OT2 of the switch SWa3 are respectively coupled to the node NGa2 and a node NGa3. The input end IT of the switch SWb3 is coupled to the sub-channel SCH8. The output ends OT1 and OT2 of the switch SWb3 are respectively coupled to the node NGb2 and a node NGb3. The nodes NGa3 and NGb3 (to be also referred to as nodes NG3 hereinafter) are respectively coupled to the sub-channel SCH9 and an output circuit OC3.
The input end IT of the switch SWa4 is coupled to the sub-channel SCH10. The output ends OT1 and OT2 of the switch SWa4 are respectively coupled to the node NGa3 and a node NGa4. The input end IT of the switch SWb4 is coupled to the sub-channel SCH11. The output ends OT1 and OT2 of the switch SWb4 are respectively coupled to the node NGb3 and a node NGb4. The nodes NGa4 and NGb4 (to be also referred to as nodes NG4 hereinafter) are respectively coupled to the sub-channel SCH12 and the input end of an output circuit OC4.
The input end IT of the switch SWa5 is coupled to the sub-channel SCH13. The output ends OT1 and OT2 of the switch SWa5 are respectively coupled to a node NGa4 and the ground node GND. The input end IT of the switch SWb5 is coupled to the sub-channel SCH14. The output ends OT1 and OT2 of the switch SWb5 are respectively coupled to the node NGb4 and the ground node GND.
That is, in the switch part 341a, a switch SWak′ (2≤k′≤N+1) is configured such that the input end IT is coupled to a sub-channel SCH(3×k′−2), the output end OT1 is coupled to a node NG(k′−1), and the output end OT2 is coupled to a node NGk′. In the switch part 341a, a switch SWbk′ is configured such that the input end IT is coupled to a sub-channel SCH(3×M−1), the output end OT1 is coupled to the node NG(k′−1), and the output end OT2 is coupled to the node NGk′. In the switch part 341a, the output ends OT1 of the switches SWa and SWb (the switches SWa1 and SWb1) assigned to one end portion and the output ends OT2 of the switches SWa and SWb (for example, the switches SWa5 and SWb5) assigned to the other end portion are, for example, grounded.
The remaining configurations of the distance measuring device 1 according to the second embodiment are the same as those of the first embodiment.
In the second embodiment, the switch part 341a of the signal processing device 34a forms three types of combinations of adjacent sub-channels SCH. In the second embodiment, these three types of combinations are respectively called input groups IG1 to IG3. The following sequentially describes the operations of the signal processing device 34a (switch part 341a) at the first time to the third time respectively associated with the input groups IG1, IG2, and IG3 in the ranging operation of the distance measuring device 1.
More specifically, the sub-channels SCH1 and SCH2 are coupled to nodes NG1 (NGa1 and NGb1). The current obtained by adding output currents from the sub-channels SCH1 to SCH3 is input to the input end of the output circuit OC1. The sub-channels SCH4 and SCH5 are coupled to nodes NG2 (NGa2 and NGb2). The current obtained by adding output currents from the sub-channels SCH4 to SCH6 is input to the input end of the output circuit OC2. The sub-channels SCH7 and SCH8 are coupled to nodes NG3 (NGa3 and NGb3). The current obtained by adding output currents from the sub-channels SCH7 to SCH9 is input to the input end of the output circuit OC3. The sub-channels SCH10 and SCH11 are coupled to nodes NG4 (NGa4 and NGb4). The current obtained by adding output currents from the sub-channels SCH10 to SCH12 is input to the input end of the output circuit OC4.
Note that in the second embodiment, at the first time, the switch SWa5 couples between the sub-channel SCH13 and the ground node GND, and the switch SWb5 couples between the sub-channel SCH14 and the ground node GND. Accordingly, the channel unit CHU13 corresponding to the sub-channel SCH13 and the channel unit CHU14 corresponding to the sub-channel SCH14 are not used for the detection of light at the first time.
As described above, the signal processing device 34a according to the second embodiment inputs, to the output circuit OCk, the signal obtained by combining an output current from the sub-channel SCH(3×k−2) (1≤k≤N), an output current from the sub-channel SCH(3×k−1), and an output current from the sub-channel SCH(3×k) in accordance with the input group IG1 at the first time. The output circuit OCk outputs, to the channel CHk, a signal based on the signal obtained by adding an output current from the sub-channel SCH(3×k−2), an output current from the sub-channel SCH(3×k−1), and an output current from the sub-channel SCH(3×k) in accordance with the first time.
More specifically, the sub-channels SCH2 and SCH4 are coupled to nodes NG1 (NGa1 and NGb1). The current obtained by adding output currents from the sub-channels SCH2 to SCH4 is input to the input end of the output circuit OC1. The sub-channels SCH5 and SCH7 are coupled to nodes NG2 (NGa2 and NGb2). The current obtained by adding output currents from the sub-channels SCH5 to SCH7 is input to the input end of the output circuit OC2. The sub-channels SCH8 and SCH10 are coupled to nodes NG3 (NGa3 and NGb3). The current obtained by adding output currents from the sub-channels SCH8 to SCH10 is input to the input end of the output circuit OC3. The sub-channels SCH11 and SCH13 are coupled to nodes NG4 (NGa4 and NGb4). The current obtained by adding output currents from the sub-channels SCH11 to SCH13 is input to the input end of the output circuit OC4.
Note that in the second embodiment, at the second time, the switch SWa1 couples between the sub-channel SCH1 and the ground node GND, and the switch SWb5 couples between the sub-channel SCH14 and the ground node GND. Accordingly, the channel unit CHU1 corresponding to the sub-channel SCH1 and the channel unit CHU14 corresponding to the sub-channel SCH14 are not used for the detection of light at the second time.
As described above, the signal processing device 34a according to the second embodiment inputs, to the output circuit OCk, the signal obtained by combining an output current from the sub-channel SCH(3×k−1) (1≤k≤N), an output current from the sub-channel SCH(3×k), and an output current from the sub-channel SCH(3×k+1) in accordance with the input group IG2 at the second time. The output circuit OCk outputs, to the channel CHk, a signal based on the signal obtained by adding an output current from the sub-channel SCH(3×k−1), an output current from the sub-channel SCH(3×k), and an output current from the sub-channel SCH(3×k+1) in accordance with the second time.
More specifically, the sub-channels SCH4 and SCH5 are coupled to nodes NG1 (NGa1 and NGb1). The current obtained by adding output currents from the sub-channels SCH3 to SCH5 is input to the input end of the output circuit OC1. The sub-channels SCH7 and SCH8 are coupled to nodes NG2 (NGa2 and NGb2). The current obtained by adding output currents from the sub-channels SCH6 to SCH8 is input to the input end of the output circuit OC2. The sub-channels SCH10 and SCH11 are coupled to nodes NG3 (NGa3 and NGb3). The current obtained by adding output currents from the sub-channels SCH5 to SCH11 is input to the input end of the output circuit OC3. The sub-channels SCH13 and SCH14 are coupled to nodes NG4 (NGa4 and NGb4). The current obtained by adding output currents from the sub-channels SCH12 to SCH14 is input to the input end of the output circuit OC4.
Note that in the second embodiment, at the third time, the switch SWa1 couples between the sub-channel SCH1 and the ground node GND, and the switch SWb1 couples between the sub-channel SCH2 and the ground node GND. Accordingly, the channel unit CHU1 corresponding to the sub-channel SCH1 and the channel unit CHU2 corresponding to the sub-channel SCH2 are not used for the detection of light at the third time.
As described above, the signal processing device 34a according to the second embodiment inputs, to the output circuit OCk, the signal obtained by combining an output current from the sub-channel SCH(3×k) (1≤k≤N), an output current from the sub-channel SCH(3×k+1), and an output current from the sub-channel SCH(3×k+2) in accordance with the input group IG3 at the third time. The output circuit OCk outputs, to the channel CHk, a signal based on the signal obtained by adding an output current from the sub-channel SCH(3×k), an output current from the sub-channel SCH(3×k+1), and an output current from the sub-channel SCH(3×k+2) in accordance with the third time.
As shown in
The measurement section 40 then generates measurement results R1 to R4 respectively corresponding to the channels CH1 to CH4 based on the light reception result corresponding to the input group IG1 which is received from the light receiver 30a. Likewise, the measurement section generates the measurement results R1 to R4 respectively corresponding to the channels CH1 to CH4 based on the light reception result corresponding to the input group IG2 which is received from the light receiver 30. The measurement section 40 generates the measurement results R1 to R4 respectively corresponding to the channels CH1 to CH4 based on the light reception result corresponding to the input group IG3 which is received from the light receiver 30. The measurement section 40 then packetizes the measurement results R1 to R4 corresponding to the input group IG1, the measurement results R1 to R4 corresponding to the input group IG2, and the measurement results R1 to R4 corresponding to the input group IG3. The measurement section 40 transfers, to the image processor 50, a packet P1 including the measurement results R1 to R4 corresponding to the input group IG1, a packet P2 including the measurement results R1 to R4 corresponding to the input group IG3, and a packet P3 including the measurement results R1 to R4 corresponding to the input group IG3. In the distance measuring device 1 according to the second embodiment, a set of the packets P1 to P3 is associated with each detection area DA.
The image processor 50 then generates a plurality of pixels PX associated with the detection area DA by executing rearrangement with respect to the set of the packets P1 to P3 received from the measurement section 40. More specifically, the image processor 50 inserts data such that three data corresponding to the same channel CH are consecutively arranged. More specifically, the image processor 50 inserts the measurement result R1 of the packet P2 next to the measurement result R1 of the packet P1, inserts the measurement result R1 of the packet P3 next to the measurement result R1 of the pixel P2, inserts the measurement result R2 of the pixel P1 next to the measurement result R1 of the packet P3, . . . , and inserts the measurement result R4 of the packet P3 next to the measurement result R4 of the packet P2. That is, the image processor 50 rearranges the measurement results of the packet P1, the measurement results of the packet P2, and the measurement results of the packet P3 such that the measurement results of the packets P1 to P3 are arranged side by side. These rearranged measurement results are associated with each other such that the combinations of the measurement results corresponding to the adjacent sub-channels SCH are shifted one by one.
The image processor 50 according to the second embodiment then generates a plurality of pixel PX based on a plurality of rearranged measurement results. In the present example, the groups of the measurement results R1 to R4 of the rearranged packets P1 to P3 respectively correspond to pixels PX1 to PX12 of the associated detection area DA. That is, the number of pixels PX arrayed in each detection area DA corresponds to channel count N×number of input groups IG. For example, in the second embodiment, if the light detector PD is constituted by 40 ch (N=40), 40×3=120 pixels PX are arrayed along the Q-axis in correspondence with each detection area DA. In addition, if a revolving mirror having two reflecting surfaces is used, an image mapped by a scan area SA has 120×2=240 pixels PX arrayed along the Q-axis.
The other operations of the distance measuring device 1 according to the second embodiment are the same as those of the first embodiment.
The distance measuring device 1 according to the second embodiment can apparently increase the number of pixels in the vertical direction by three times. The distance measuring device 1 according to the second embodiment can improve the effective resolution without increasing the channel count by using an averaging process similar to that in the first embodiment. According to the distance measuring device 1 according to the second embodiment described above, it is possible to suppress the manufacturing cost of the distance measuring device 1 and improve the performance.
A distance measuring device 1 according to the third embodiment includes a light detector PDb having a signal processing device 34 obtained by adding the functions of a switch part 341 and a column selector 33. The distance measuring device 1 according to the third embodiment will be described in detail below.
The plurality of channel units CHU1 to CHU(n+1) of the sensor array 32b are coupled to the signal processing device 34b via output node sets OUT1 to OUT(n+1), respectively. The signal processing device 34b has a function similar to that of a combination of the column selector 33 and the signal processing device 34 described in the first embodiment. That is, under the control of the control circuit 35, the signal processing device 34b selectively activates a plurality of SPADs included in each channel unit CHU. A signal processing device 34a adds signals output from the active output nodes of three consecutive output node sets OUT and outputs the resultant signal to a corresponding channel CH. In the third embodiment, as in the first embodiment, the electric signals transferred from the two adjacent sub-pixels (channel units CHU) are used to generate distance data corresponding to one pixel PX. The signal processing device 34b will be described in detail later.
In the light detector PDb according to the third embodiment, the number of channel units CHU is designed based on a channel count N. In the third embodiment, as in the first embodiment, N=n/2. For the sake of simplicity, the following will describe a case in which N=4, that is, n=8, and the light detector PD includes four channels CH1 to CH4, the nine sub-channels SCH1 to SCH9, the nine output node sets OUT1 to OUT9, and the nine channel units CHU1 to CHU9.
The functions and configurations of the selection-and-adder circuits XFRa, XFRb, and XFRc each are similar to the selection-and-adder circuit XFR described in the first embodiment. The function and configuration of the output circuit OC are similar to those of the output circuit OC described in the first embodiment. In the following description, coupling the output node sets OUTi (1≤i≤(n+1)) to the input end of the selection-and-adder circuit XFR is equivalent to coupling the output nodes of a plurality of cell units CU1 to CUm included in the channel unit CHUi to the first ends of a plurality of transistors T1 to Tm included in the selection-and-adder circuit XFR. Coupling the output end of the selection-and-adder circuit XFR to a predetermined node is equivalent to coupling the second ends of the plurality of transistors T1 to Tm included in the selection-and-adder circuit XFR to the predetermined node.
The input end and output end of the selection-and-adder circuit XFRa1 are respectively coupled to the output node set OUT1 and the ground node GND. The input end and output end of the selection-and-adder circuit XFRb1 are respectively coupled to an output node set OUT1 and a node NGb1. The input end and output end of the selection-and-adder circuit XFRc1 are respectively coupled to an output node set OUT2 and a node NGa1. The nodes NGa1 and NGb1 are coupled to the input end of an output circuit OC1. The output end of the output circuit OC1 is coupled to the channel CH1.
The input end and output end of the selection-and-adder circuit XFRa2 are respectively coupled to the output node set OUT3 and the node NGa1. The input end and output end of the selection-and-adder circuit XFRb2 are respectively coupled to the output node set OUT3 and the node NGa2. The input end and output end of the selection-and-adder circuit XFRc2 are respectively coupled to the output node set OUT4 and the node NGa2. The nodes NGa2 and NGb2 are coupled to the input end of the output circuit OC2. The output end of the output circuit OC2 is coupled to the channel CH2.
The input end and output end of the selection-and-adder circuit XFRa3 are respectively coupled to the output node set OUT5 and the node NGa2. The input end and output end of the selection-and-adder circuit XFRb3 are respectively coupled to the output node set OUT5 and the node NGa3. The input end and output end of the selection-and-adder circuit XFRc3 are respectively coupled to the output node set OUT6 and the node NGa3. The nodes NGa3 and NGb3 are coupled to the input end of the output circuit OC3. The output end of the output circuit OC3 is coupled to the channel CH.
The input end and output end of the selection-and-adder circuit XFRa4 are respectively coupled to the output node set OUT7 and the node NGa3. The input end and output end of the selection-and-adder circuit XFRb4 are respectively coupled to the output node set OUT7 and the node NGa4. The input end and output end of the selection-and-adder circuit XFRc4 are respectively coupled to the output node set OUT8 and the node NGa4. The nodes NGa4 and NGb4 are coupled to the input end of the output circuit OC4. The output end of the output circuit OC4 is coupled to the channel CH4.
The input end and output end of the selection-and-adder circuit XFRa5 are respectively coupled to the output node set OUT9 and the node NGa4. The input end and output end of the selection-and-adder circuit XFRb5 are respectively coupled to the output node set OUT9 and the ground node GND.
Each of the transistors T1 to Tm of the selection-and-adder circuits XFRa1 to XFRa5 is controlled based on an output signal from an AND circuit set A1. More specifically, the AND circuit set A1 includes m AND circuits having output ends respectively coupled to the gate ends of the transistors T1 to Tm of the selection-and-adder circuit XFRa. Control signals CS1 to CSm are respectively input to the first input ends of the m AND circuits of the AND circuit set A1. A control signal GS is input to the second input end of each of the AND circuits of the m AND circuit set A1.
Each of the transistors T1 to Tm of the selection-and-adder circuits XFRb1 to XFRb5 is controlled based on an output signal from an AND circuit set A2. More specifically, the AND circuit set A2 includes m AND circuits having output ends respectively coupled to the gate ends of the transistors T1 to Tm of each selection-and-adder circuit XFRb. The control signals CS1 to CSm are respectively input to the first input ends of the m AND circuits of the AND circuit set A2. An inversion signal of the control signal GS is input to the second input end of each of the m AND circuits of the AND circuit set A2. The inversion signal of the control signal GS is generated by causing the control signal GS to be output via a logical NOT circuit NC.
Each of the transistors T1 to Tm of the selection-and-adder circuits XFRc1 to XFRc4 is controlled based on the control signal CS. More specifically, the control signals CS1 to CSm are respectively input to the gate ends of the transistors T1 to Tm of each selection-and-adder circuit XFRc as in the first embodiment.
As described above, the switch part 341b includes (N+1) selection-and-adder circuits XFRa, (N+1) selection-and-adder circuits XFRb, and N selection-and-adder circuits XFRc. In the switch part 341b, the input ends of the selection-and-adder circuits XFRak and XFRbk (k is an integer of two or more) are coupled to an output node set OUT(2×k−1). The output end of a selection-and-adder circuit XFRak is coupled to a node NGa(k−1). The output end of a selection-and-adder circuit XFRbk is coupled to a node NGbk. The input end of a selection-and-adder circuit XFRck is coupled to an output node set OUT(2×k). The output end of the selection-and-adder circuit XFRck is coupled to a node NGak. In the switch part 341b, the output end of the selection-and-adder circuit XFRa (selection-and-adder circuit XFRa1) assigned to one end portion and the output end of the selection-and-adder circuit XFRb (for example, the selection-and-adder circuit XFRb5) assigned to the other end portion are, for example, grounded.
The other configurations of the distance measuring device 1 according to the third embodiment are similar to those of the first embodiment.
In the third embodiment, the switch part 341b of the signal processing device 34b forms two types of combinations of the adjacent sub-channels SCH. In the third embodiment, these two types of combinations will be referred to as input groups IG1 and IG2. The following sequentially describes the operations of the signal processing device 34b (switch part 341b) at the first time and the second time respectively associated with the input groups IG1 and IG2 in the ranging operation of the distance measuring device 1.
More specifically, the output node set OUT1 is coupled to the node NGb1, and the output node set OUT2 is coupled to the node NGa1. The current obtained by adding output currents from the sub-channels SCH1 and SCH2 is input to the input end of the output circuit OC1. The output node set OUT3 is coupled to the node NGb2, and the output node set OUT4 is coupled to the node NGa2. The current obtained by adding output currents from the sub-channels SCH3 and SCH4 is input to the input end of the output circuit OC2. The output node set OUT5 is coupled to the node NGb3, and the output node set OUT6 is coupled to the node NGa3. The current obtained by adding output currents from the sub-channels SCH5 and SCH6 is input to the input end of the output circuit OC3. The output node set OUT7 is coupled to the node NGb4, and the output node set OUT8 is coupled to the node NGa4. The current obtained by adding output currents from the sub-channels SCH7 and SCH8 is input to the input end of the output circuit OC4.
Note that at the first time in the third embodiment, the selection-and-adder circuit XFRa1 couples between the output node set OUT1 and the ground node GND. Accordingly, the channel unit CHU1 corresponding to the output node set OUT1 is not used for the detection of light at the first time.
As described above, the signal processing device 34a according to the third embodiment inputs, to the output circuit OCk, the signal obtained by combining an output current from the output node set OUT(2×k−1) (1≤k≤N) and an output current from the output node set OUT(2×k) in accordance with the input group IG1 at the first time. The output circuit OCk outputs a signal based on the signal obtained by adding the output current from the output node set OUT(2×k−1) and the output current from the output node set OUT(2×k) in accordance with the first time.
More specifically, the output node set OUT2 is coupled to the node NGa1, and the output node set OUT3 is coupled to the node NGa1. The current obtained by adding output currents from the sub-channels SCH1 and SCH2 is input to the input end of the output circuit OC1. The output node set OUT4 is coupled to the node NGa2, and the output node set OUT5 is coupled to the node NGa2. The current obtained by adding output currents from the sub-channels SCH4 and SCH5 is input to the input end of the output circuit OC2. The output node set OUT6 is coupled to the node NGa3, and the output node set OUT7 is coupled to the node NGa3. The current obtained by adding output currents from the sub-channels SCH5 and SCH6 is input to the input end of the output circuit OC3. The output node set OUT8 is coupled to the node NGa4, and the output node set OUT9 is coupled to the node NGa4. The current obtained by adding output currents from the sub-channels SCH8 and SCH9 is input to the input end of the output circuit OC4.
Note that at the second time in the third embodiment, the selection-and-adder circuit XFRa5 couples between the output node set OUT1 and the ground node GND. Accordingly, the channel unit CHU9 corresponding to the output node set OUT9 is not used for the detection of light at the second time.
As described above, the signal processing device 34a according to the third embodiment inputs, to the output circuit OCk, the signal obtained by combining an output current from the output node set OUT(2×k) (1≤k≤N) and an output current from the output node set OUT(2×k+1) in accordance with the input group IG2 at the second time. The output circuit OCk outputs a signal based on the signal obtained by adding the output current from the output node set OUT(2×k) and the output current from the output node set OUT(2×k+1) in accordance with the first time.
The other operations of the distance measuring device 1 according to the third embodiment are similar to those of the first embodiment.
The distance measuring device 1 according to the third embodiment has an advantageous effect similar to that of the first embodiment. The distance measuring device 1 according to the third embodiment can reduce the number of switches via which a signal output from the channel CH is transmitted by adding the functions of the column selector 33 and the switch part 341 than the first embodiment. As a result, the distance measuring device 1 according to the third embodiment can suppress a deterioration in the characteristic of a signal output to the channel CH and improve the ranging accuracy.
Note that although the third embodiment has exemplified the case in which the signal processing device 34 has the function of the column selector 33, the present invention is not limited to this. In the distance measuring device 1 according to the third embodiment, the column selector 33 may be regarded as having the function of the switch part 341 of the signal processing device 34.
The distance measuring device according to the embodiment processes a plurality of intermittently input signals. The distance measuring device includes a plurality of input ends (SCH), first to Nth output ends (CH), and a control circuit. The plurality of input ends are configured such that a plurality of signals can be respectively input. The first to Nth output ends (N is an integer of two or more) are respectively associated with first to Nth groups each including M (M is an integer of two or more) consecutive input ends. The control circuit outputs the signal obtained by adding a plurality of signals respectively input to the M consecutive input ends of a kth groups (k is an integer of one or more and N or less) to the kth output end and switches combinations of input ends assigned as M input ends so as to set different combinations at the first time to the Mth time. When calculating a distance value at a measurement point of a target at the first time, the measurement section 40 uses measurement results at a plurality of measurement points included in the first range (AA1) including measurement points. When calculating a distance value at the measurement point of the target at the second time, the measurement section 40 uses at least measurement results at a plurality of measurement points included in the second range (AA2) shifted from the first range (AA1) by half of the pixel in the vertical direction. In addition, the measurement section 40 accumulates the measurement results at the plurality of measurement points included in the first range, detects at least one peak of a signal included in the accumulated measurement results, and decides a distance value at the measurement point of the target from at least one detected peak based on reliability information. The measurement section 40 transmit a first packet (P1) including the data of a plurality of distance values corresponding to the first time and a second packet (P2) including the data of a plurality of distance values corresponding to the second time to an image processing circuit (image processor 50). The image processing circuit then rearranges the data included in the first packet P1 and the data included in the second packet P2 such that the data output from the same output end (channel CH) are consecutively arranged. With this operation, the image processing circuit generates N×M pixels based on the data of the plurality of distance values corresponding to the first time to the Mth time.
Each embodiment described above can be variously modified. The first and second embodiments have respectively exemplified the cases where there are two and three types of combinations of sub-channels SCH in the input group IG. However, the present invention is not limited to this. For example, there may be four or more types of combinations of sub-channels SCH in the input group IG, and the signal processing device 34 may be configured to switch the four types of combinations of sub-channels SCH in the input group IG. The third embodiment has exemplified the case in which there are two types of combinations of output node sets OUT in the input group IG. However, the present invention is not limited to this. For example, there may be three or more types of combinations of output node sets OUT in the input group IG, and the signal processing device 34 may be configured to switch the three types of combinations of output node sets OUT in the input group IG.
The configuration described in the above embodiment may be rephrased as follows. In the distance measuring device 1 according to the above embodiment, the pixel PX is vertically divided into n′ (n′ is an integer of two or more), and n′ consecutive outputs are added for every measurement. If, for example, the pixel PX is divided into two parts, an output from an even-numbered sub-channel SCH is switched and added with an output from an adjacent sub-channel SCH. In other words, the distance measuring device 1 is configured to alternately adde an output from the sub-channel SCH between the two consecutive even-numbered sub-channels SCH with an output from one of the two even-numbered sub-channels SCH and the other output. This makes it possible to design the distance measuring device 1 such that the number of channels CH coupling between the light detector PD and the measurement section 40 (measurement IC) is less than the number of sub-channels SCH and output the number of pixels in the vertical direction equal to the number of sub-channels SCH used for one measurement.
The above embodiment has exemplified the case in which a two-sided mirror is used as the mirror 25 to suppress the manufacturing cost. However, the present invention is not limited to this. If a higher importance is placed on the ranging accuracy than on the manufacturing cost, another type of mirror such as a polygon mirror may be used as the mirror 25.
The above embodiment has exemplified the case in which the signal processing device 34 includes the output part 342 (the output circuit OC, that is, the amplification circuit). However, the present invention is not limited to this. If the output of the sub-channel SCH is large (that is, the output current from the SPAD is large), the output part 342 may be omitted from the signal processing device 34. In other words, if there is no need to amplify the output of the sub-channel SCH, the amplification circuit may be omitted from the signal processing device 34.
More specifically, the channel unit CHU1 includes a plurality of light detection elements DC arranged in the X direction and a plurality of light detection elements DC2 arranged in the X direction. The channel unit CHU2 includes the plurality of light detection elements DC1 arranged in the X direction and the plurality of light detection elements DC2 arranged in the X direction. The adjacent portion between the channel units CHU1 and CHU2 is provided with a plurality of light detection elements DCx arranged in the X direction. The odd-numbered light detection elements DCx along the X direction are included in the odd-numbered cell unit CUa. The even-numbered light detection elements DCx along the X direction are included in the even-numbered cell unit CUb.
In this manner, if the layout of the light detection elements DC is asymmetric at the adjacent channel units CHU, the light detection elements DCx in the boundary portion are preferably assigned to the adjacent channel units CHU such that the number of light detection elements DC assigned to one of the adjacent channel units CHU is almost equal to the number of light detection elements DC assigned to the other. The light detection elements DCx in the boundary portion need not be alternately assigned to the adjacent channel units CHU and can be freely designed. The layout of the sensor array 32c can be designed in a similar manner as in the case in which the signal processing device 34 is configured to switch combinations of three or more input groups IG.
The category of each configuration of the distance measuring device 1 may be other categories. The measurement section 40 may be other categories as long as it can realize the operations described in the above embodiments. The CPU included in the controller 10 may be other circuits. For example, in place of the CPU, a micro processing unit (MPU), etc. may be used. In addition, each of the processing described in each embodiment may be realized by dedicated hardware. Processing executed by software and processing executed by hardware may be mixed, or either one of them may exist. The controller 10 may be referred to as a control circuit. The measurement section may be referred to as a measurement circuit. The image processor 50 may be referred to as an image processing circuit.
The logic level setting of each control signal used in the description of the operation may be other settings. Assume that the transistor T is a MOS (metal-oxide-semiconductor) having a p-type polarity. In this case, if an “H” level control signal is input to the gate end, the transistor T is turned on. Each of the switches SW, SWa, and SWb may operate in a similar manner as in the above embodiment based on a signal with a logic level inverse to the above embodiment.
In the present specification, the term “couple” refers to electrical coupling, and does not exclude, for example, intervention of another element. An “ON state” refers to a state in which the gate of a relevant transistor has a voltage equal to or greater than a threshold voltage of that transistor being applied. An “OFF state” refers to a state in which the gate of a relevant transistor has a voltage below a threshold voltage of that transistor being applied, and does not exclude, for example, a state in which a minute electric current such as a leakage current of the transistor flows. Each of “first end and the second end of a transistor” corresponds to the drain or source of the transistor. A “pixel PX” may be referred to as a sensor circuit. An “avalanche photodiode APD” may be referred to as a sensor. In the signal processing device 34, the sub-channel SCH may be referred to as an “input end”, and the channel CH may be referred to as an “output end”.
In the above embodiment, the operation of the signal processing device 34 at a plurality of times associated with the input groups IG may be rephrased as the operation of the signal processing device 34 at a plurality of settings associated with the input groups IG. That is, the operation at each time of the signal processing device 34 described in the above arrangement may be treated as a type of setting of the signal processing device 34. In this case, the signal processing device 34 is configured to operate, for example, based on information including a setting and a timing instructed from the outside of the photodetector PD (for example, the controller 10).
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodiment in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2022-125591 | Aug 2022 | JP | national |