The present disclosure relates to a solid-state imaging device that obtains a distance image of a subject.
Solid-state imaging devices that obtain distance images of subjects using a time of flight (TOF) method are conventionally known (for example, see Japanese Unexamined Patent Application Publication No. 2015-215181).
With conventional solid-state imaging devices, motion blur may occur when obtaining a distance image of a moving subject.
The present disclosure therefore has an object of providing a solid-state imaging device that can suppress motion blur when obtaining a distance image of a subject as compared with conventional techniques, and an imaging apparatus including the same.
A solid-state imaging device according to one aspect of the present disclosure is a solid-state imaging device including: a plurality of pixels arranged in a matrix on a semiconductor substrate, wherein each of the plurality of pixels includes: a photoelectric converter that converts received light into a signal charge; at least one read gate that reads the signal charge from the photoelectric converter; a plurality of charge accumulators that each accumulate the signal charge read by the at least one read gate; and a charge holder that receives, from one of the plurality of charge accumulators, transfer of the signal charge accumulated in the charge accumulator, holds the signal charge, and transfers, to one of the plurality of charge accumulators, the signal charge held, each of the plurality of charge accumulators includes a part of a transfer channel for transferring the signal charge and a part of a transfer electrode overlapping with the part of the transfer channel in a planar view of the semiconductor substrate, and the transfer channel per one pixel comprises a plurality of transfer channels.
An imaging apparatus according to another aspect of the present disclosure includes: the solid-state imaging device described above; a light source that emits infrared light in a pulse form at a plurality of timings, in each exposure period in one frame period; and a processor that generates a distance image based on an output signal of the solid-state imaging device.
The above-described solid-state imaging device and imaging apparatus can suppress motion blur when obtaining a distance image of a subject as compared with conventional techniques.
These and other objects, advantages and features of the disclosure will become apparent from the following description thereof taken in conjunction with the accompanying drawings that illustrate a specific embodiment of the present disclosure.
(Circumstances Leading to Attainment of One Aspect of the Present Disclosure)
Of a plurality of methods for detecting the distance to an object, a TOF method that measures a distance using a time of flight during which light travels to and from a measurement object is known.
The conventional technique described in Japanese Unexamined Patent Application Publication No. 2015-215181 suppresses differences in leakage (crosstalk) of charges from neighboring pixels as illustrated in (b) in
With the conventional technique, however, there is a time difference in exposure period between frames, because the read timings are changed between the frames. Hence, motion blur tends to occur. Two frames need to be read in order to obtain added distance signals. This causes a decrease in effective frame rate, and requires frame memory outside.
Moreover, the conventional technique fails to take into account background light components and dark current components, and accordingly has significant distance measuring errors in environments in which such signals not including distance information are not negligible.
In view of the above, the inventors conducted repeatedly study, and conceived a solid-state imaging device that achieves high distance measuring accuracy without motion blur and a considerable decrease in frame rate.
Embodiments of the present disclosure will be described below, with reference to the drawings. Although the attached drawings are referred to in the description, they are provided for illustrative purposes, and do not limit the present disclosure. Elements indicating substantially same structures, operations, and effects in the drawings are given the same reference marks.
Modes forming basis of the present disclosure will be described first.
(Basic Mode 1 of the Present Disclosure)
Timing generator 103 generates a light emission signal instructing light source 500 to irradiate object 600 with light (e.g. near-infrared light) and drives light source 500 via light source driver 200, and generates an exposure signal instructing imager 101 to perform exposure to reflected light from object 600.
Imager 101 includes a plurality of pixels arranged in a matrix on a semiconductor substrate. Imager 101 performs, for a region including object 600, exposure a plurality of times in one frame period according to timing indicated by the exposure signal generated by timing generator 103, and obtains a signal corresponding to the total sum of the exposure amounts of the exposure performed the plurality of times.
Processor 300 calculates the distance to object 600, based on a signal received from solid-state imaging device 100.
As illustrated in
Solid-state imaging device 100 is, for example, a CMOS image sensor.
In a typical pulse TOF method, a first exposure period starting from a rise time of irradiation light with pulse width Tp is denoted by T1, a second exposure period starting from a fall time of the irradiation light is denoted by T2, and exposure periods T1 and T2 are set to the same length as pulse width Tp. When the signal amount obtained by imager 101 in first exposure period T1 is denoted by A0, the signal amount obtained by the camera in second exposure period T2 is denoted by A1, and the light speed (299, 792, 458 m/s) is denoted by c, distance d is given by the following formula.
d=c×Tp/2×A1/(A0+A1).
A solid-state imaging device used in a distance measuring camera of the TOF method performs sampling for one cycle of irradiation light, a plurality of times.
D=c×Tp/2, where D denotes a distance measuring range.
In a TOF method (pulse TOF method, distance measuring method) used in Basic Mode 2, background light components and dark current components are taken into account. A first exposure period starting from a rise time of irradiation light with pulse width Tp of a light emission pulse is denoted by T1, a second exposure period starting from a fall time of the irradiation light is denoted by T2, the signal amount obtained by the camera in first exposure period T1 is denoted by A0, the signal amount obtained by the camera in second exposure period T2 is denoted by A1, and the light speed (299,792,458 m/s) is denoted by c. In an environment in which a signal contains a background light component from a light source (e.g. the sun) other than irradiation light or a dark current component of a charge accumulator, a third exposure period in which the near-infrared light source is off, denoted by T3, is set to the same length as pulse width Tp, and the signal amount obtained in third exposure period T3 is calculated as A2. When calculating distance d, A2 is subtracted in order to extract only distance information from each of A0 and A1. That is,
d=c×Tp/2×{(A1−A2)/(A0−A2+A1−A2)}.
As a pixel structure of solid-state imaging device 100, there is a method of allocating signal charges generated by a photoelectric converter to charge accumulators by a plurality of read gates.
Examples of charge accumulators include floating diffusion layers and charge coupled device memories (CCD memories). In a structure using a plurality of read gates, differences in read characteristics are caused by variations in the manufacturing process, bias of condensed light to a specific read gate, and the like. Moreover, crosstalk between pixels may occur, causing distance measuring errors.
A plurality of pixels 20 are arranged in a matrix in a pixel region of the semiconductor substrate. Each pixel 20 includes photoelectric converter 1, a plurality of charge accumulators 2 (e.g. first charge accumulator 2a and second charge accumulator 2b), a plurality of read gates 6 (e.g. first read gate 6a and second read gate 6b), output control gate 13, floating diffusion layer 14, reset gate 15, reset drain 16, read circuit 17, a plurality of exposure control gates 8 (e.g. exposure control gates 8a and 8b), a plurality of overflow drains 9 (e.g. overflow drains 9a and 9b), and charge holder 10.
Photoelectric converter 1 converts received light into a signal charge.
Read gate 6 reads the signal charge from photoelectric converter 1.
Charge accumulator 2 accumulates the signal charge read by read gate 6. Charge accumulator 2 is composed of transfer channel (CCD channel) 4 located under a gate insulator and for transferring a signal charge, and transfer electrode 5 (e.g. any of transfer electrodes 5a, 5b, 5c, 5d, and 5e) located above the gate insulator. In detail, charge accumulator 2 includes a part of transfer channel 4 and a part of transfer electrode 5 that overlaps with the part of transfer channel 4 in a planar view of the semiconductor substrate, as illustrated in
Voltages applied to transfer electrodes 5a, 5b, 5c, 5d, and 5e are hereafter denoted by VG1, VG2, VG3, VG4, and VG5, respectively.
First charge accumulator 2a and second charge accumulator 2b perform 5-phase drive. For example, first charge accumulator 2a and second charge accumulator 2b are formed adjacent to first read gate 6a and second read gate 6b respectively, under transfer electrodes 5 (under transfer electrodes 5a and 5c in this example) to which VG1 and VG3 that are high voltage during exposure are applied.
Overflow drain 9 discharges at least a part of the signal charge from photoelectric converter 1.
Exposure control gate 8 controls the discharge to overflow drain 9.
Charge holder 10 receives, from one of the plurality of charge accumulators 2 (first charge accumulator 2a and second charge accumulator 2b in this example), transfer of a signal charge accumulated in charge accumulator 2 and holds the signal charge, and transfers the held signal charge to one of the plurality of charge accumulators 2 (first charge accumulator 2a and second charge accumulator 2b in this example). As illustrated in
Floating diffusion layer 14 receives, from one of the plurality of charge accumulators 2 (first charge accumulator 2a and second charge accumulator 2b in this example), transfer of a signal charge accumulated in charge accumulator 2, and holds the signal charge.
Output control gate 13 controls transfer to floating diffusion layer 14.
Read circuit 17 converts the signal charge held in floating diffusion layer 14 into a voltage, and reads it out of pixel 20. For example, read circuit 17 includes a source follower transistor having a gate connected to floating diffusion layer 14, and a selection transistor connected in series to the source follower transistor. For example, as a result of the selection transistor selecting read circuit 17, the signal charge held in floating diffusion layer 14 is read out to AD converter 102 by read circuit 17.
First read gate 6a and second read gate 6b are vertically symmetric with respect to a center line dividing photoelectric converter 1 in the vertical direction (the column direction of the plurality of pixels 20 arranged in a matrix, i.e. the up-down direction in
Likewise, exposure control gates 8a and 8b are vertically symmetric with respect to the center line dividing photoelectric converter 1 in the vertical direction (the column direction of the plurality of pixels 20 arranged in a matrix, i.e. the up-down direction in
The vertically symmetric positional relationship between first read gate 6a and second read gate 6b and the vertically symmetric positional relationship between exposure control gates 8a and 8b are intended to match by design the characteristics of reading performed using two pairs of read gate 6 and exposure control gate 8.
Operation during exposure will be described below, with reference to
Drive pulse ODG is applied to each of exposure control gates 8a and 8b, and drive pulses TG1 and TG2 are applied respectively to first read gate 6a and second read gate 6b. Drive pulses VG1 to VG5 are applied respectively to transfer electrodes 5a to 5e, although not illustrated in
In an initial state, ODG is in high state, and photoelectric converter 1 is in reset state. Moreover, first read gate 6a and second read gate 6b are in low state, and first charge accumulator 2a and second charge accumulator 2b in which transfer electrodes 5a and 5c are held in high state and photoelectric converter 1 are electrically disconnected. In this state, the signal charge generated in photoelectric converter 1 is discharged to overflow drain 9 via exposure control gate 8, without being accumulated in photoelectric converter 1.
Next, at time t1 at which the irradiation pulse light is turned on, ODG is driven to low state, and the discharge of the charge from photoelectric converter 1 to overflow drain 9 is stopped. At this time, first read gate 6a transitions from low state to high state. The transfer of the signal charge generated as a result of the incidence of the reflected pulse light to first charge accumulator 2a via first read gate 6a is started, and a preceding component (A0) of the reflected pulse light is held in first charge accumulator 2a.
Next, second read gate 6b transitions from low state to high state. The transfer of the signal charge generated as a result of the incidence of the reflected pulse light to second charge accumulator 2b via second read gate 6b is started, and a succeeding component (A1) of the reflected pulse light is held in second charge accumulator 2b.
Thus, first read gate 6a and second read gate 6b respectively read a first signal charge (the preceding component (A0) of the reflected pulse light) and a second signal charge (the succeeding component (A1) of the reflected pulse light) with a first phase difference, in the exposure period in one frame period.
With the foregoing conventional technique, the pulse timings of TG1 and TG2 are interchanged for each frame. In Basic Mode 1, pixel 20 includes charge holder 10. Hence, by interchanging distance-measuring signals A0 and A1 in position during exposure and, after the interchange, interchanging pulses TG1 and TG2, differences in characteristics depending on the read position and the position of charge accumulator 2 can be suppressed in one frame.
The operation will be described below.
In
Here, drive pulses VG1 to VG5 applied to transfer electrodes 5a to 5e, drive pulse VS applied to charge holding gate 11, and drive pulse VB applied to transfer control gate 12 are output from timing generator 103.
tt1 is a timing (i.e. t3) at which the exposure illustrated in
Next, at tt2, VG2 and VG5 are driven to high voltage, and signal charges are accumulated under respective transfer electrodes 5 to which VG2 and VG5 are applied. Following this, VS is driven to high voltage and then VB is driven to high voltage as illustrated in
Next, signal A1 located below signal A0 under charge holding gate 11 at tt3 is transferred upward by 5-phase drive over charge holding gate 11, and accumulated under transfer electrode 5 to which VG3 is applied (tt4).
Subsequently, VG5 and VB are driven to high voltage again, to form a transfer path between charge holder 10 and charge accumulator 2 of transfer electrode 5 to which VG5 is applied. After this, low voltage is applied in the order of VS and VB, to transfer signal A0 to under transfer electrode 5 to which VG5 that is high voltage is applied (tt5). Timing generator 103 thus generates a second signal for transferring, from charge holder 10, the held signal charge to one of the plurality of charge accumulators 2.
Next, transfer is performed by 5-phase drive in the downward direction, to create a state in which A0 and A1 are interchanged in vertical position (tt6). This series of operation is hereafter referred to as “interchange operation”. Thus, by outputting a plurality of signals including the first signal and the second signal, timing generator 103 interchanges the position of first charge accumulator 2a that accumulates the first signal charge (A0) and the position of second charge accumulator 2b that accumulates the second signal charge (A1) in the case where the first signal charge (A0) is read by first read gate 6a and the second signal charge (A1) is read by second read gate 6b.
After this interchange operation, signal A1 is located beside first read gate 6a to which TG1 is applied, and signal A0 is located beside second read gate 6b to which TG2 is applied, as illustrated in
In the exposure before the interchange,
A0=A0(TG1)
A1=A1(TG2)
where (TG1) and (TG2) respectively denote that the signals are read by first read gate 6a and second read gate 6b to which TG1 and TG2 are applied.
In the exposure after the interchange,
A0=A0(TG2)
A1=A1(TG1).
Addition of each of A0 and A1 yields
A0=A0(TG1)+A0(TG2)
A1=A1(TG1)+A1(TG2).
Each of A0 and A1 evenly includes the components read by first read gate 6a and second read gate 6b to which TG1 and TG2 are applied, and also the charge accumulation positions are evenly separated. Therefore, even in the case where two read gates 6 and charge accumulators 2 are provided, signal differences due to differences in read location and charge accumulation position in the exposure period in one frame can be canceled out.
Performing the interchange operation illustrated in
As described in detail above, according to Basic Mode 1, differences in characteristics due to the positions of read gates 6 and charge accumulators 2 can be suppressed without using a plurality of frames, so that a distance-measuring solid-state imaging device having excellent distance measuring accuracy can be provided.
(Basic Mode 2 of the Present Disclosure)
A solid-state imaging device according to Mode 2 (Basic Mode 2) forming basis of the present disclosure and a drive method of the solid-state imaging device will be described below, mainly focusing on differences from Basic Mode 1.
In solid-state imaging device 100 according to Basic Mode 1, the number of charge accumulators 2 is two.
In Basic Mode 2, on the other hand, one charge accumulator 2 for independently obtaining a signal not including distance information, such as background light and dark current and parasitic sensitivity components generated in charge accumulator 2, is added. While suppressing differences in characteristics between distance-measuring signals (signal charges) obtained via two read gates in one frame as in Basic Mode 1, distance measuring errors are reduced by removing, in distance calculation, a background light component (hereafter, BG) and a dark current component (hereafter, DS) and a parasitic sensitivity component (hereafter, Sm) generated in charge accumulator 2. To do so, seven electrodes (transfer electrodes 5a to 5g) forming charge coupled devices are provided to enable 7-phase drive as illustrated in
The operation will be described below.
After performing interchange operation during exposure, the timings of pulses applied to TG1 and TG2 are interchanged to suppress differences in read characteristics, as in Basic Mode 1. In addition, given that dark current component DS and parasitic sensitivity Sm differ among the plurality of charge accumulators 2, the dark current component and parasitic sensitivity of first charge accumulator 2a are denoted by DS1 and Sm1, the dark current component and parasitic sensitivity of second charge accumulator 2b are denoted by DS2 and Sm2, and the dark current component and parasitic sensitivity of third charge accumulator 2c are denoted by DS3 and Sm3, to distinguish them.
Moreover, signal charges by dark current and parasitic sensitivity also occur in charge holder 10, as in charge accumulator 2. These components are accordingly denoted by DSX and SmX. In signal charge interchange operation, charges by dark current DSX and parasitic sensitivity SmX mix into the signal charge that is transferred to charge holder 10 first. Hence, in the case where there are three signals A0, A1, and A2, the three signals need to be equal in the number of times the charge is transferred to charge holder 10 first among the three signals.
Furthermore, the times during which A0, A1, and A2 remain in respective three charge accumulators 2 need to be equal.
In Basic Mode 2, to evenly distribute, among signals, differences in read characteristics, dark current differences and parasitic sensitivity differences of charge accumulators 2, and dark current and parasitic sensitivity of charge holder 10 mixed in each signal in interchange operation, an exposure period is made up of exposures (1) to (6) and interchange operations (1) to (6), as illustrated in
In first exposure (1), components A0, A1, and A2 are expressed by the following formulas.
A0=A0(TG1)+DS1+Sm1
A1=A1(TG2)+DS2+Sm2
A2=DS3+Sm3
where (TG1) and (TG2) respectively denote that the signals are read by first read gate 6a to which TG1 is applied and second read gate 6b to which TG2 is applied, as in Basic Mode 1.
Between interchange operation (1) and exposure (2), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A0 because signal A0 is transferred to charge holder 10 in interchange operation (1), as follows:
A0=A0(TG2)+DS2+Sm2+DSX+SmX
A1=A1(TG1)+DS1+Sm1
A2=DS3+Sm3.
Between interchange operation (2) and exposure (3), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A2 because signal A2 is transferred to charge holder 10 in interchange operation (2). Moreover, in exposure (3), light emission by light source 500 is not performed, and the only read pulse is TG2 and background light component (BG) is read. Accordingly,
A0=DS3+Sm3
A1=DS1+Sm1
A2=BG(TG2)+DS2+Sm2+DSX+SmX.
Between interchange operation (3) and exposure (4), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A1 because signal A1 is transferred to charge holder 10 in interchange operation (3). Moreover, in exposure (4), light emission by light source 500 is not performed, and the only read pulse is TG1 and background light component (BG) is read. Accordingly,
A0=DS3+Sm3
A1=DS2+Sm2+DSX+SmX
A2=BG(TG1)+DS1+Sm1.
Between interchange operation (4) and exposure (5), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A0 because signal A0 is transferred to charge holder 10 in interchange operation (4). Moreover, in exposure (5), light emission by light source 500 is not performed, and no read pulse is applied. Accordingly,
A0=DS2+Sm2+DSX+SmX
A1=DS3+Sm3
A2=DS1+Sm1.
Between interchange operation (5) and exposure (6), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A2 because signal A2 is transferred to charge holder 10 in interchange operation (5). Moreover, in exposure (6), light emission by light source 500 is not performed, and no read pulse is applied. Accordingly,
A0=DS1+Sm1
A1=DS3+Sm3
A2=DS2+Sm2+DSX+SmX.
After interchange operation (6), dark current DSX and parasitic sensitivity SmX of the charge holder are added to A1 because signal A1 is transferred to charge holder 10 in interchange operation (6). Moreover, exposure is not performed, so that other parasitic sensitivity and dark current are substantially negligible, and are taken to be 0. Accordingly,
A0=0
A1=DSX+SmX
A2=0
are accumulated in A0, A1, and A2.
Adding the foregoing for each of A0, A1, and A2 yields
A0=A0(TG1)+A0(TG2)+2×DS1+2×Sm1+2×DS2+2×Sm2+2×DS3+2×Sm3+2×DSX+2×SmX
A1=A1(TG1)+A1(TG2)+2×DS1+2×Sm1+2×DS2+2×Sm2+2×DS3+2×Sm3+2×DSX+2×SmX.
A2=BG(TG1)+BG(TG2)+2×DS1+2×Sm1+2×DS2+2×Sm2+2×DS3+2×Sm3+2×DSX+2×SmX.
Since signals A0, A1, and BG read by two different read gates 6 are included in A0, A1, and A2 in an added state, differences in read characteristics are canceled out.
Moreover, since dark current and parasitic sensitivity for three charge accumulators 2 and charge holder 10, such as DS1, Sm1, DS2, Sm2, DS3, Sm3, DSX, and SmX, are evenly included in A0, A1, and A2, these signals not related to distance information are not included in calculated differences A0−A2 and A1−A2. Further, given that each exposure time is set to be equal, the background light component included in each of A0(TG1)+A0(TG2) and A1(TG1)+A1(TG2) is equal to BG(TG1)+BG(TG2), and, after calculating the differences, only distance information is obtained. Distance measuring errors can thus be suppressed.
To reduce dark current of charge holder 10, it is desirable to apply a negative voltage to charge holding gate 11 and transfer control gate 12 forming charge holder 10 to cause pinning of the interface of the transfer channel, except when transferring and accumulating a signal charge in interchange operation. In detail, it is desirable that charge holder 10 includes at least a part of a charge holding channel (not illustrated) and at least a part of charge holding gate 11 overlapping with the at least a part of the charge holding channel in a planar view of the semiconductor substrate, and a negative voltage is applied to charge holding gate 11 to cause pinning of the interface between the charge holding channel and charge holding gate 11 in at least a part of a period except a period in which charge holder 10 holds the signal charge.
Moreover, to reduce parasitic sensitivity, it is desirable to provide a light shielding film to cover the whole or part of the periphery of charge holding gate 11 and transfer control gate 12, via an insulating film. In detail, it is desirable to cover at least a part of charge holder 10 with a light shielding film. In an MOS process, wiring is provided at a high position from a gate electrode. Therefore, parasitic sensitivity can be reduced by shielding light by W (tungsten) or the like at a low position separate from the wiring.
Although charge holder 10 is provided within one pixel in
By performing interchange operations (1) to (6) in the signal read period as in the exposure period, dark current and parasitic sensitivity differences which occur in different charge accumulators during this period can also be made equal.
In this case, since only signal reading is performed, read pulses TG1 and TG2 in
As described in detail above, according to Basic Mode 2, differences in characteristics due to the positions of read gates 6 can be suppressed without using a plurality of frames, and differences in background light, dark current, and parasitic sensitivity among signals can be suppressed and subtracted, so that a distance-measuring solid-state imaging device having excellent distance measuring accuracy can be provided.
(Basic Mode 3 of the Present Disclosure)
In both Basic Mode 1 and Basic Mode 2, it is desirable to set the amount of charge handled by charge holder 10 to be larger than the amount of charge handled by charge accumulator 2, to prevent overflow. However, for example in the case where parasitic sensitivity (SmX) and dark current (DSX) in charge holder 10 are large, it is desirable to add charge holder reset gate 18 and charge holder reset drain 19 that are adjacent to charge holder 10 and control charge accumulation in charge holder 10 and discharge to the drain, that is, charge holder reset drain 19 that discharges at least a part of the signal charge from charge holder 10 and charge holder reset gate 18 that controls the discharge to charge holder reset drain 19, to suppress overflow of charge holder 10.
In addition, by turning on charge holder reset gate 18 before interchange operation to discharge components DSX and SmX accumulated during the exposure period or the signal read period to charge holder reset drain 19, mixing of components DSX and SmX into signals such as A0, A1, and BG transferred to charge holder 10 in the interchange operation can be reduced. This suppresses an increase of shot noise in the subtraction process, and reduces distance measuring variations.
Further, by setting the channel potential when applying low voltage to transfer control gate 12 to be deeper by a predetermined amount than the channel potential when applying low voltage to transfer electrode 5 on transfer channel 4 and setting high voltage to charge holder 10 and charge holder reset gate 18, overflow of charge accumulator 2 formed by a charge coupled device can be reduced, too.
As described in detail above, mixing of dark current and parasitic sensitivity of charge holder 10 into signals necessary for distance calculation can be suppressed, in addition to the effects of Basic Mode 2. A distance-measuring solid-state imaging device having more excellent distance measuring accuracy can thus be provided.
As illustrated in
To isolate transfer channels 4a and 4b from each other, impurities are injected in high concentration to form channel stop region 21, or shallow trench isolation (STI) is used, as illustrated in
It is therefore desirable to reduce the overlap between channel stop region 21 and transfer electrode 5. For example, it is desirable to employ layout in which the transfer electrode length on channel stop region 21 is shorter than the transfer electrode length on transfer channel 4. An example achieving such layout is transfer electrode 5 of a dumbbell shape illustrated in
The solid-state imaging device according to Basic Mode 2 can handle three signals, one of which is a signal for subtracting background light (BG), dark current (DS), and parasitic sensitivity (Sm) from distance signals A0 and A1.
In this embodiment, on the other hand, a plurality of (e.g. two) transfer channels 4 are provided to enable 5-phase drive, so that four distance measuring signals can be handled per one pixel. Hence, the distance measuring range can be extended three times, with narrow pulse width. Further, while the parasitic sensitivity and dark current component of charge holder 10 mix in a state of being divided among three signals in Basic Mode 2, the parasitic sensitivity and dark current component of charge holder 10 mix in a state of being divided among four signals in this embodiment. This is advantageous in that their influence is reduced.
The operation will be described below.
The exposure operation will be described in detail below, with reference to
In an initial state, drive pulse signal ODG applied to exposure control gates 8a and 8b is in high state, and a signal charge generated in photoelectric converter 1 is discharged to overflow drains 9a and 9b via exposure control gates 8a and 8b respectively, without being accumulated in photoelectric converter 1. Drive pulse signals TG1 and TG2 are in low state. Moreover, drive pulse signals VG1 and VG4 applied to transfer electrodes 5 adjacent to read gates 6a and 6b are in high state, forming charge accumulators 2 (not illustrated in
In the first sequence, at time t1 at which the irradiation pulse light is turned on, drive pulse signal ODG is driven to low state, and the discharge of the charge from photoelectric converter 1 to overflow drain 9 is stopped. At this time, drive pulse signal TG1 transitions from low state to high state, (Tp/2) earlier than drive pulse signal ODG. The transfer of the signal charge generated as a result of the incidence of light to charge accumulator 2 via first read gate 6a to which TG1 is applied is started.
Next, at time t2, drive pulse signal ODG is driven to high state again, and the signal charge generated in photoelectric converter 1 is discharged to overflow drain 9. As a result of this series of operation, signal A0 illustrated in
In the second sequence, at time t2, drive pulse signal ODG is driven to low state, and the discharge of the charge from photoelectric converter 1 to overflow drain 9 is stopped. At this time, drive pulse signal TG1 transitions from low state to high state, (Tp/2) earlier than drive pulse signal ODG. The transfer of the signal charge generated as a result of the incidence of light to charge accumulator 2 via first read gate 6a to which TG1 is applied is started. Next, at time t3, drive pulse signal ODG is driven to high state, and the signal charge generated in photoelectric converter 1 is discharged to overflow drain 9. As a result of this operation, signal A1 illustrated in
As a result of the foregoing operation, signals A0, A1, A2, and A3 are accumulated in first charge accumulator 2a to fourth charge accumulator 2d illustrated in
The case of distance measuring range 1 in
Preceding component A0 of the reflected pulse light including background light is read by high voltage of TG1 in the first sequence, whereas background light component BG is read by high voltage of TG2. On the other hand, succeeding component A1 of the reflected pulse light including background light is read by high voltage of TG1 in the second sequence, whereas background light component BG is read by high voltage of TG2.
Delay amount Td=Tp×((A1−BG)/(A0+A1−2×BG)) of the reflected pulse light is calculated based on these signals, and the distance to the object is calculated.
In distance measuring range 1, A0>A2, and A1>A3, and distance d is calculated according to the following Formula 1. In this case, for background light exposure amount BG, it is desirable to use A3 for the numerator part and, for the denominator part, A2 for A0 and A3 for A1. This is intended to match dark current and parasitic sensitivity between A0 and A2 and between A1 and A3 in this embodiment (described later).
Since the delay amount of the reflected pulse light is different, at which of A0 to A4 each of the signals including distance information and the signal including only background light is located is as illustrated in the table in
In distance measuring range 2, A2>A0, and A1>A3, and distance d is calculated according to the following Formula 2. In this case, for background light exposure amount BG, it is desirable to use A0 for the numerator part and, for the denominator part, A3 for A1 and A0 for A2. The reason is as described with regard to distance measuring range 1.
In distance measuring range 3, A2>A0, and A3>A1, and distance d is calculated according to the following Formula 3. In this case, for background light exposure amount BG, it is desirable to use A1 for the numerator part and, for the denominator part, A0 for A2 and A1 for A3. The reason is as described with regard to distance measuring range 1.
Signal interchange operation will be described below, with reference to
In
In
In
Next, signal A0 located below signal A2 under charge holding gate 11 at tt3 is transferred upward by 5-phase drive over charge holding gate 11, and accumulated under transfer electrode 5 to which VG3 is applied (tt4).
Subsequently, VG5B and VB are driven to high voltage again, to form a transfer path between charge holder 10 and charge accumulator 2 of transfer electrode 5 to which VG5B is applied. After this, low voltage is applied in the order of VS and VB, to transfer signal A2 to under transfer electrode 5 to which high voltage of VG5B is applied (tt5).
Next, transfer is performed by 5-phase drive indicated by drive B in the downward direction, to create a state in which A0 and A2 are interchanged in vertical position (tt6).
After this interchange operation, signal A0 is located beside read gate 6b to which TG2 is applied, and signal A2 is located beside read gate 6a to which TG1 is applied, as illustrated in
In this embodiment, to evenly distribute, among signals, differences in read characteristics, dark current differences and parasitic sensitivity differences of charge accumulators 2, and dark current and parasitic sensitivity of charge holder 10 mixed in each signal in interchange operation, an exposure period is made up of exposures (1) to (8) and interchange operations (1) to (4), as illustrated in
As illustrated in
In first exposure (1), signals A0, A1, A2, and A3 are expressed by the following formulas.
A0=A0(TG1)+DS2+Sm2
A2=A2(TG2)+DS1+Sm1
A1=DSU2+SmU2
A3=DSU1+SmU1.
Likewise, in exposure (2),
A0=DSD2+SmD2
A2=DSD1+SmD1
A1=A1(TG1)+DS2+Sm2
A3=A3(TG2)+DS1+Sm1.
In exposure (3) after interchange operation (1), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A2 because signal A2 is transferred to charge holder 10 in interchange operation (1). Accordingly,
A0=A0(TG2)+DS1+Sm1
A2=A2(TG1)+DS2+Sm2+DSX+SmX
A1=DSU2+SmU2
A3=DSU1+SmU1.
In exposure (4),
A0=DSD1+SmD1
A2=DSD2+SmD2
A1=A1(TG1)+DS2+Sm2
A3=A3(TG2)+DS1+Sm 1.
In exposure (5) after interchange operation (2), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A3 because signal A3 is transferred to charge holder 10 in interchange operation (2). Accordingly,
A0=A0(TG2)+DS1+Sm1
A2=A2(TG1)+DS2+Sm2
A1=DSU1+SmU1
A3=DSU2+SmU2+DSX+SmX.
In exposure (6),
A0=DSD1+SmD1
A2=DSD2+SmD2
A1=A1(TG2)+DS1+Sm1
A3=A3(TG1)+DS2+Sm2.
In exposure (7) after interchange operation (3), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A0 because signal A0 is transferred to charge holder 10 in interchange operation (3). Accordingly,
A0=A0(TG1)+DS2+Sm2+DSX+SmX
A2=A2(TG2)+DS1+Sm1
A1=DSU1+SmU1
A3=DSD2+SmU2.
In exposure (8),
A0=DSD2+SmD2
A2=DSD1+SmD1
A1=A1(TG2)+DS1+Sm1
A3=A3(TG1)+DS2+Sm2.
After interchange operation (4), dark current DSX and parasitic sensitivity SmX of charge holder 10 are added to A1 because signal A1 is transferred to charge holder 10. Since there is no exposure subsequently, other parasitic sensitivity and dark current are substantially negligible, and are taken to be 0. Accordingly,
A0=0
A2=0
A1=DSX+SmX
A3=0.
Adding the foregoing for each of A0, A1, A2, and A3 yields
A0=2×A0(TG1)+2×A0(TG2)+2×DS1+2×Sm1+2×DS2+2×Sm2+2×DSD1+2×SmD1+2×DSD2+2×SmD2+DSX+SmX
A2=2×A2(TG1)+2×A2(TG2)+2×DS1+2×Sm1+2×DS2+2×Sm2+2×DSD1+2×SmD1+2×DSD2+2×SmD2+DSX+SmX
A1=2×A1(TG1)+2×A1(TG2)+2×DS1+2×Sm1+2×DS2+2×Sm2+2×DSU1+2×SmU1+2×DSU2+2×SmU2+DSX+SmX
A3=2×A3(TG1)+2×A3(TG2)+2×DS1+2×Sm1+2×DS2+2×Sm2+2×DSU1+2×SmU1+2×DSU2+2×SmU2+DSX+SmX.
Thus, by reading, for each of components A0 and A2, A0 or A2 by two different read gates 6 and adding them, differences in read characteristics are canceled out. Moreover, dark current and parasitic sensitivity are evenly included in each of A0 and A2. The same applies to A1 and A3. In the exposure method according to this embodiment, one of A0 and A2 reads only the background light component not including distance information from photoelectric converter 1, as illustrated in
In this embodiment, since respective signals are accumulated in charge accumulators 2 during a signal read period, dark current differences and parasitic sensitivity differences occur in this period, too, as described in Basic Mode 2. Therefore, interchange operation of signal charges between charge accumulators 2 needs to be performed in the signal read period, too.
By performing interchange operations (1) to (4) in the signal read period, too, dark current differences and parasitic sensitivity differences which occur in different charge accumulators 2 during this period can also be made equal between A0 and A2 and between A1 and A3. It is desirable to perform interchange operations (1) to (4) at least four times in the signal read period.
Although not illustrated in
Although the solid-state imaging device according to Embodiment 1 is described as having a structure in which a plurality of read gates 6 read signal charges from photoelectric converter 1 as an example, the solid-state imaging device is not limited to having a plurality of read gates 6. For example, the solid-state imaging device according to Embodiment 1 may have a structure in which one read gate reads a signal charge from photoelectric converter 1.
As described in detail above, according to this embodiment, the distance measuring range is wide and the influence of parasitic sensitivity and dark current of charge holder 10 can be reduced, as compared with Basic Mode 2. A distance-measuring solid-state imaging device having excellent distance measuring accuracy can thus be provided.
A solid-state imaging device according to Embodiment 2 of the present disclosure will be described below with reference to drawings, mainly focusing on differences from the foregoing basic modes and embodiment.
The solid-state imaging device according to this embodiment differs from Embodiment 1 in that output control gate 13, floating diffusion layer 14, reset gate 15, reset drain 16, read circuit 17, and charge holder 10 are shared by four pixels in the vertical direction. The structural elements are the same as above, and accordingly their description is omitted as already described.
This embodiment has the following advantage over Embodiment 1: Since the output portion (output control gate 13, floating diffusion layer 14, reset gate 15, reset drain 16, and read circuit 17) and charge holder 10 are shared by four pixels in the vertical direction, any one of charge holder 10 and the output portion is located in a separate region between photoelectric converters 1 adjacent in the column direction of the plurality of pixels 20 arranged in a matrix, i.e. the up-down direction in
Thus, the solid-state imaging device according to Embodiment 2 includes two types of pixels 20: first pixel 20d including charge holder 10; and second pixel 20e including the output portion that includes floating diffusion layer 14 and read circuit 17. First pixel 20e shares floating diffusion layer 14 with at least one of second pixels 20d arranged with first pixel 20d in the column direction in the matrix arrangement of plurality of pixels 20, and second pixel 20d shares charge holder 10 with at least one of first pixels 20e arranged with second pixel 20d in the column direction.
Operation of the solid-state imaging device according to Embodiment 2 will be described below.
Operation during exposure is the same as in Embodiment 1. As illustrated in
In this embodiment, to evenly distribute, among signals, differences in read characteristics, dark current differences and parasitic sensitivity differences of charge accumulators 2, and dark current and parasitic sensitivity of charge holder 10 mixed in each signal in interchange operation, an exposure period is made up of exposures (1) to (16) and interchange operations (1) to (8), as illustrated in
Detailed operation will be described below, with reference to
In this embodiment, charge holder 10 and the output portion are shared by four pixels in the vertical direction, and accordingly eight signals need to be considered. As illustrated in
The operation illustrated in
In
VG5C is applied at different timing from VG5A and VG5B, only in the case of transferring a signal charge to output control gate 13. In interchange operation and vertical transfer using normal 5-phase drive, VG5C is applied at the same timing as VG5A.
As illustrated in
Interchange operation of other signals can be equally performed by vertical transfer and input/output of a signal charge to/from charge holder 10.
In this embodiment, since respective signals are accumulated in different charge accumulators 2 during a signal read period, dark current differences and parasitic sensitivity differences occur in this period, too. Therefore, interchange operation of signal charges between charge accumulators 2 needs to be performed in the signal read period, too.
Although not illustrated in
As described in detail above, according to this embodiment, the influence of parasitic sensitivity and dark current of charge holder 10 can be reduced and the amount of charge handled by charge holder 10 can be increased, as compared with Embodiment 1. A distance-measuring solid-state imaging device having excellent distance measuring accuracy can thus be provided.
A solid-state imaging device according to Embodiment 3 of the present disclosure will be described below with reference to drawings, mainly focusing on differences from the foregoing embodiments.
The layout structure of a pixel included in the solid-state imaging device according to Embodiment 3 may be any of those in Embodiments 1 and 2, and accordingly its description is omitted. The basic concept of signal interchange operation is the same as those in Embodiments 1 and 2, and accordingly its description is omitted.
This embodiment differs from Embodiments 1 and 2 in the operation timing during exposure, while using the same pixel layout structure. Specifically, while four signals A0, A1, A2, and A3 are used as in Embodiments 1 and 2, the number of light emissions of the light source is 1/2, and only A0 and A1 obtain signals including distance information from photoelectric converter 1 whereas A2 and A3 obtains background light components.
Operation of the solid-state imaging device according to Embodiment 3 will be described below.
As illustrated in
The distance measuring range is 1/3 of that in Embodiments 1 and 2, but the number of light emissions can be reduced to 1/2 as compared with the exposure timing illustrated in
As described in detail above, according to this embodiment, the number of light emissions can be reduced to 1/2 as compared with Embodiments 1 and 2, so that a distance-measuring solid-state imaging device suitable for applications for which near field and low power consumption are required can be provided.
Although only some exemplary embodiments of the present disclosure have been described in detail above, those skilled in the art will readily appreciate that many modifications are possible in the exemplary embodiments without materially departing from the novel teachings and advantages of the present disclosure. Accordingly, all such modifications are intended to be included within the scope of the present disclosure.
The present disclosure is widely applicable to solid-state imaging devices and imaging apparatuses for obtaining distance images of subjects.
Number | Date | Country | Kind |
---|---|---|---|
JP2017-176995 | Sep 2017 | JP | national |
This application is a U.S. continuation application of PCT International Patent Application Number PCT/JP2018/029872 filed on Aug. 9, 2018, claiming the benefit of priority of Japanese Patent Application Number 2017-176995 filed on Sep. 14, 2017, the entire contents of which are hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
20080122933 | Murayama | May 2008 | A1 |
20150341573 | Matsuo | Nov 2015 | A1 |
20160344967 | Barnes et al. | Nov 2016 | A1 |
20170045618 | Mase et al. | Feb 2017 | A1 |
20170187968 | Kobayashi | Jun 2017 | A1 |
20180156898 | Suzuki et al. | Jun 2018 | A1 |
20190280025 | Sakakibara | Sep 2019 | A1 |
Number | Date | Country |
---|---|---|
3 141 930 | Mar 2017 | EP |
2015-215181 | Dec 2015 | JP |
2017022220 | Feb 2017 | WO |
WO-2017022220 | Feb 2017 | WO |
Entry |
---|
Partial Supplementary European Search Report dated Oct. 15, 2020, issued in the corresponding European Patent Application No. 18857258.0. |
Extended European Search Report dated on Feb. 2, 2021 issued in the corresponding European patent application No. 18857258.0. |
International Search Report and Written Opinion dated Oct. 30, 2018 in International Application No. PCT/JP2018/029872; with partial English translation. |
Number | Date | Country | |
---|---|---|---|
20200213539 A1 | Jul 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2018/029872 | Aug 2018 | US |
Child | 16817145 | US |