CMOS image sensors that can detect very low light levels are now available. Improvements in noise rejection have resulted in detectors that have noise levels that are a fraction of an electron; thus making individual photon counting possible. While such sensors can provide images in extremely low light, the photodiodes saturate at high light levels. Hence, such sensors have a limited dynamic range.
Pixel sensors with multiple photodiodes have been proposed to extend the dynamic range. In such sensors, one photodiode is sensitive to low light levels and another has a much lower light conversion rate, and hence, can be used to provide a light measurement when the low light photodiode saturates. However, the use of multiple photodiodes presents other challenges, since the photodiodes are not identical, and hence, can have different spectral responses.
The present invention includes an apparatus and method for using the same. The apparatus includes a plurality of pixel sensors connected to a bit line, each pixel sensor includes a photodetector that includes a photodiode, a floating diffusion node, and a buffer connected to the floating diffusion node that produces a pixel output signal having a voltage that is a monotonic function of a voltage on the floating diffusion node. Each pixel sensor also includes a bit line gate that connects the pixel output signal to the bit line in response to a row select signal, a reset gate that connects the floating diffusion node to a first reset voltage source in response to a reset signal, a first transfer gate that connects the photodiode to the floating diffusion node in response to a first transfer signal, an overflow capacitor connected to the floating diffusion node via a second transfer gate that connects the overflow capacitor to the floating diffusion node in response to a second transfer signal, and an overflow transfer gate that connects the photodiode to the overflow capacitor in response to a overflow transfer gate signal.
In one aspect of the invention, the overflow transfer gate signal is adjusted to a level that causes charge to flow to the overflow capacitor rather than the floating diffusion node when a charge generated by the photodiode exceeds an overflow threshold value.
In another aspect of the invention, the buffer includes a source follower having a gate connected to the floating diffusion node.
In another aspect of the invention, the apparatus includes a controller that generates the first and second sampling signals, the reset signal, the first and second transfer signals, and the overflow transfer gate signal. In another aspect of the invention, the controller causes the photodiode and the overflow capacitor in each of the pixel sensors to be reset to a reset voltage.
In another aspect of the invention, the controller isolates the photodiodes from the floating diffusion nodes in each of the pixel sensors such that a photocharge generated by light striking the photodiode is first accumulated on the photodiode until the photodiode reaches a predetermined level of stored photocharge, any excess photocharge beyond this predetermined level is stored on the overflow capacitor.
In another aspect of the invention, the controller determines a first photocharge stored on the overflow capacitor and a second photocharge stored on the photodiode after an exposure period for each of the pixel sensors, the controller combining the first and second photocharge to provide a measure of an amount of light received by each pixel sensor during an exposure.
The present invention also includes a method of operating an imaging array which includes a plurality of pixels sensors in which each pixel sensor includes a photodiode that measures an intensity of light incident on the photodiode in that pixel sensor during an exposure, the photodiodes being characterized by a maximum photocharge that can be stored in each photodiode during an exposure. The method includes providing an overflow path in each of the pixel sensors, the overflow path collecting photocharge in excess of the maximum photocharge, measuring the collected charge that passed through the overflow path during the exposure and measuring the photocharge stored on the photodiode after the exposure, and combining the measured collected charge and the photocharge stored on the photodiode after the exposure to arrive at measurement of a pixel intensity for the exposure corresponding to the pixel sensor.
In another aspect of the invention, measuring the overflow path in each of the pixel sensors includes a capacitor in each of the pixel sensors that has been precharged to a reset voltage prior to the exposure and connected to the photodiode by an overflow gate that passes charge when a voltage on the photodiode is less than a threshold value and wherein measuring the collected charge after the exposure includes measuring a voltage on the capacitor after the exposure.
Refer now to
Each of the bit lines terminates in a column processing circuit 44 that typically includes sense amplifiers and column decoders. The bit lines are a parallel array of conductors that run vertically in the metal layers over the substrate in which the photodiode and interface circuitry are constructed. Each sense amplifier reads the signal produced by the pixel that is currently connected to the bit line processed by that sense amplifier. The sense amplifiers may generate a digital output signal by utilizing an analog-to-digital converter (ADC). At any given time, a single pixel sensor is read out from the imaging array. The specific column that is read out is determined by a column address that is utilized by a column decoder to connect the sense amplifier/ADC output from that column to circuitry that is external to the imaging array. The sequencing of the control signals and other functions are performed by a controller 30. To simplify the drawings, the connections between controller 30 and the various control lines have been omitted from the drawing.
Refer now to
A reset gate 16 is used to set the voltage on floating diffusion node 13 prior to the charge being transferred, or to reset photodiode 11 prior to an exposure. The voltage on floating diffusion node 13 is amplified by a source follower transistor 17. When pixel 60 is to be read out, a signal on gate transistor 18 connects the output of source follower transistor 17 to a bit line 19 that is shared by all of the pixel sensors in a given column. For the purposes of the present discussion, a bit line is defined to be a conductor that is shared by a plurality of columns of pixel sensors and carries a voltage signal indicative of the voltage at the floating diffusion node in a pixel sensor that is connected to the hit line through a transfer gate.
Each bit line terminates in a column processing circuit 55. Column processing circuit 55 includes a bit-line amplifier 50 and two sample and hold circuits whose functions will be described in more detail below. The first sample and hold circuit comprises gate 22 and capacitor 23, and the second sample and hold circuit comprises gate 24 and capacitor 25. The outputs of these sample and hold circuits are processed by ADC 51 to provide the output value for the pixel sensor currently connected to bit line 19. The manner in which the sample and hold circuits are used will be discussed in more detail below.
Pixel 60 also includes an overflow capacitor 61 that collects the photocharge generated by photodiode 11 after photodiode 11 saturates. At the beginning of an exposure, photodiode 11 and overflow capacitor 61 are set to a reset voltage determined by Vr. As photocharge accumulates on photodiode 11, the voltage on photodiode 11 decreases until photodiode 11 saturates. At a voltage determined by the gate voltage on gate 15, the excess charge flows through gate 15 and onto the combination of overflow capacitor 61, capacitor 14 (i.e., the parasitic capacitance of floating diffusion node 13), and the parasitic capacitances of gate 62, which remains in a conducting state throughout the exposure. Hence, at the end of the exposure any overflow charge can be determined by measuring the decrease in voltage at floating diffusion node 13 from the reset voltage.
After the overflow charge has been measured, floating diffusion node 13 is again reset and gate 62 placed in a non-conducting state. The reset voltage on floating diffusion node 13 is then measured to provide a reference value. The photocharge that remains on photodiode 11 is then determined by opening gate 12 and measuring the decrease in voltage at floating diffusion node 13 resulting from the transfer of charge to floating diffusion node 13.
The output voltage from hit-line amplifier 50 on node 26 will be denoted by Vout in the following discussion. This output voltage is stored at various times on sample and hold capacitors 23 and 25. The stored voltages are used by controller 30 shown in
The manner in which a pixel exposure is measured will now be discussed in more detail. An exposure can be viewed as consisting of three phases. The first phase is a reset and integration phase in which floating diffusion node 13 and node 66 are reset to a reset voltage determined by Vr. During the reset, gates 12, 16, and 62 are placed in a conducting state. After the reset, gate 12 is set to a non-conducting state, thereby isolating photodiode 11 from floating diffusion node 13. As charge is integrated on photodiode 11 during the exposure, which starts when photodiode 11 is isolated from floating diffusion node 13, the photocharge is first isolated on photodiode 11. However, as photodiode 11 saturates, the voltage on photodiode 11 decreases to the point at which charge will flow through gate 15. The voltage at which charge flows through gate 15 is determined by the potential of signal Tx2 which remains constant throughout the exposure and readout phases.
During the exposure period, gate 62 remains in a conducting state, and hence, the overflow charge is distributed between capacitor 61, capacitor 14, and the parasitic capacitance associated with gate 62, these three capacitors being effectively connected in parallel between floating diffusion node 13 and ground. At the end of the exposure period, the photocharge from the exposure is split between photodiode 11 and these parallel-connected capacitors for pixel sensors in which the photodiode has saturated. In the first phase of the readout, referred to as the overflow charge phase, the voltage on floating diffusion node is measured and compared to the reset voltage at the beginning of the exposure phase.
Once the overflow charge is measured, the second phase of the readout, referred to as the photodiode charge phase, begins. In this phase, gate 62 is placed in a non-conducting state and floating diffusion node is reset. The voltage on floating diffusion node 13 is read and then gate 12 is opened to allow the photocharge stored on photodiode 11 to be transferred to floating diffusion node 13. The voltage on floating diffusion node 13 is then read again to determine the amount of photocharge that was transferred to floating diffusion node 13.
Refer now to
The readout phase can be viewed as consisting of two sub-phases, referred to as the overflow charge phase and the photodiode charge phase. During the overflow charge phase, the overflow charge that accumulated during the exposure is measured. After the overflow charge phase, the charge that was stored on the photodiode is measured during the photodiode charge phase. Each charge is measured by computing the difference between the voltage at floating diffusion node 13 after floating diffusion node 13 is reset and the voltage at floating diffusion node 13 after the relevant charge has been transferred to floating diffusion node 13. The readout phase commences when the pixel in question is connected to bit line 19 by setting Rs high as shown in
The photodiode charge phase begins by isolating floating diffusion node 13 and measuring the reset potential on floating diffusion node 13 after the reset. The reset potential is stored on sample and hold capacitor 23. Then, gate 12 is placed in a conducting state and the charge from photodiode 11 is transferred to floating diffusion node 13, which lowers the voltage on floating diffusion node 13. This voltage is then stored on sample and hold capacitor 25. The difference between the voltages on sample and hold capacitors 23 and 25 is then digitized by an ADC that is part of controller 30 to provide a measure of the charge accumulated on photodiode 11 during the exposure. The sum of these charges is used to provide the pixel signal corresponding to the pixel sensor that is connected to the bit line.
It should be noted that the exposure does not stop until the charge stored on the photodiode is transferred to the floating diffusion node. However, the overflow charge is measured prior to this point in time. Hence, any charge that overflows in the period between measuring the overflow charge and the transfer of charge to the floating diffusion node from the photodiode is lost. This lost charge, however, is small, as the time period is typically less than 4 μsec, while the typical exposure in a moving picture is approximately 17 msec.
As noted above, the voltages stored on the sample and hold capacitors must be digitized and subtracted from one another. Typically, there is one ADC for each bit line to reduce the readout time. The number of columns of pixel sensors in an imaging array is in the thousands. Hence, it is advantageous to reduce the complexity of the column readout circuitry. One method for reducing the complexity of the readout circuitry is to combine the subtraction hardware with the ADC function. One simple form of ADC that can be used is a count up ADC which includes a register that drives a digital-to-analog converter (DAC). The counter counts clock pulses until the output of the DAC exceeds the input voltage. Normally, the initial value in the register is zero.
In one aspect of the invention, the counter counts clock pulses starting from an initial counter value of zero only after the DAC output exceeds a first analog input, and the counting stops after the DAC output exceeds a second analog input. This embodiment provides both the subtraction function and the digitization function in the same time needed to perform digitization of the second analog input. To utilize such an ADC, the values to be digitized must be routed to the ADC inputs such that the lower voltage is always at a specified input and the higher voltage is at the other input. For example, in the embodiment shown in
The problem in such an implementation arises from the order in which signal and reset voltages are generated in the two phases discussed above. For the purposes of this discussion, the reset voltage will be referred to as the reference voltage, and the depleted reset voltage obtained by transferring charge to the floating diffusion node after the floating diffusion node has been set to the reference voltage will be referred to as the signal voltage. As noted above, the signal voltage for the overflow charge phase is generated before the reference voltage for that charge. However, in the photodiode charge phase, the reference voltage is generated before the signal voltage.
Refer now to
To provide a significant expansion in the dynamic range of the pixel sensor, the sum of the capacitances of capacitor 61 and the parasitic capacitance of gate 62 must be significantly greater than the capacitance of floating diffusion node 13. The price for providing such large capacitances is an increase in the noise at the exposure range in which the exposure is close to the maximum storage of the well in photodiode 11. Denote the sum of capacitances of capacitor 61 and the parasitic capacitance of gate 62 by C′. In one exemplary embodiment, CFD=4 fF, C′=28 fF, and the floating diffusion node has a full voltage swing of 1.2 V. The readout noise in this exemplary embodiment in the photodiode charge phase is 0.7 e−. It can be shown that the noise at an exposure at which the photodiode just saturates is increased by about 16 percent. However, the dynamic range of the pixel sensor is increased by 18 dB. Increasing the capacitance of capacitor 61 further increases the dynamic range.
The above-described embodiments utilize a source follower in each pixel to buffer the floating diffusion node from the bit line while generating a signal that varies with the voltage on the floating diffusion node. Embodiments in which the source follower is replaced by an amplifier or other circuit that generates a pixel output signal that is a monotonic function of the voltage on the floating diffusion node could also be utilized provided the increase in the size of the pixel is acceptable. For the purposes of the present discussion, the term buffer will be defined to include such an amplifier or other circuit as well as a source follower.
The above-described embodiments of the present invention have been provided to illustrate various aspects of the invention. However, it is to be understood that different aspects of the present invention that are shown in different specific embodiments can be combined to provide other embodiments of the present invention. In addition, various modifications to the present invention will become apparent from the foregoing description and accompanying drawings. Accordingly, the present invention is to be limited solely by the scope of the following claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2017/014976 | 1/25/2017 | WO | 00 |