This application is related to U.S. application Ser. No. 14/224,264, filed Mar. 25, 2014, entitled “Methods of Calibrating Knee-Point and Logarithmic Slope in Linear-Logarithmic Image Sensors,” the disclosure of which is hereby incorporated herein by reference.
The present invention relates to integrated circuit devices and, more particularly, to image sensor devices and methods of operating same.
Conventional CMOS image sensors can have a linear response to relatively low illumination and a logarithmic response to relatively high illumination, with a transition between the linear and logarithmic responses being referred to as a knee point (KNPT). As will be understood by those skilled in the art, an image sensor may be fully characterized when its linear sensitivity, logarithmic sensitivity (LOGS) and KNPT voltage are known. Because these parameters vary with process, transistor mismatch and temperature, etc., calibration is required. Without accurate calibration, a linear-logarithmic image sensor may introduce very large fixed pattern noise (FPN), which is typically not suitable for commercially viable applications. One conventional technique to inhibit FPN uses an external frame memory to store a sensor characteristic response. Based on this technique, a correction of the sensor readout for each pixel is performed after a full frame of image data is captured by an image signal processing (ISP) circuit and then modified by the sensor data stored in the external frame memory, which may have a relatively large capacity. Moreover, relatively complex ISP algorithms may be required to perform image sensor correction, which can be computationally expensive and time consuming.
A conventional linear-logarithmic image sensing apparatus is disclosed in U.S. Pat. No. 8,233,059 to Kamon et al., entitled “Image Sensing Apparatus.” In this apparatus, an image sensor is disclosed that generates an electrical signal commensurate with an amount of incident light. The sensor has a photoelectric conversion characteristic defined by a linear characteristic area where an electrical signal is outputted after being linearly converted in relation to the amount of incident light, and a logarithmic characteristic area where the electrical signal is outputted after being logarithmically converted in relation to the amount of incident light. An exposure evaluation value detector (EEVD) is also included, which detects an exposure evaluation value based on luminance information acquired from a subject in sensing an image of the subject. An exposure controller is further provided, which acquires a setting value for exposure based on the exposure evaluation value detected by the EEVD to thereby control exposure of the image sensing apparatus.
Methods of calibrating a linear-logarithmic image sensor pixel according to embodiments of the invention may utilize on-the-fly calibration operations, which can avoid the need for a large frame “calibration” memory and extensive image signal processing (ISP) algorithms. These calibration operations can measure a voltage at a pixel floating diffusion (FD) region after at least one sub-threshold current is enabled to flow from a photodiode (PD) to the FD region via a transfer transistor, which is responsive to a transfer gate (TG) voltage. Because the direction of the sub-threshold current(s) is inverse to the one used during pixel integration, the resulting calibration process can be photocurrent-independent.
According to some of the embodiments of the invention, the methods of calibrating include at least partially depleting a photodiode within the pixel prior to supplying a floating diffusion (FD) region within the pixel with a first subthreshold current. This first subthreshold current is achieved by passing charge carriers of first conductivity type from the at least partially depleted photodiode to the floating diffusion (FD) region. A first voltage of the floating diffusion region may then be read through a totem pole arrangement of a source follower transistor and a selection transistor within the pixel (e.g., within a four transistor (4T) cell). A calibration operation may then performed to use the first voltage to determine a knee-point (KNPT) voltage associated with a transition from a linear to logarithmic response of the pixel. The step of at least partially depleting the photodiode may include establishing a reverse bias across anode and cathode regions of the photodiode by shorting the floating diffusion region to the cathode region concurrently with supplying the floating diffusion region with a pull-up current. This supplying the floating diffusion region with a pull-up current may include turning on a reset transistor within the pixel. This reset transistor may have a first current carrying terminal electrically connected to the floating diffusion region and a second current carrying terminal responsive to a positive reset voltage (VR), which may be controlled to have an adjustable magnitude. In some embodiments of the invention, the reset transistor may be an NMOS transistor having a source terminal electrically connected to the floating diffusion region and a drain terminal responsive to the positive reset voltage.
According to still further embodiments of the invention, the step of supplying the floating diffusion (FD) region within the pixel with a first subthreshold current is preceded by discharging the floating diffusion region, after the step of at least partially depleting the photodiode. The step of discharging the floating diffusion region may include discharging the floating diffusion region through the reset transistor within the pixel. In this manner, the reset transistor may be used to provide a pull-up current to deplete the photodiode and thereafter sink a pull-down current from the floating diffusion region.
According to additional embodiments of the invention, the reading step is followed by supplying the floating diffusion region with a second subthreshold current by passing charge carriers of first conductivity type from the at least partially depleted photodiode to the floating diffusion region. Thereafter, an operation is performed to read a second voltage of the floating diffusion region and estimate a logarithmic sensitivity of the pixel based at least in part on the value of the second voltage. In these embodiments, the duration of supplying the floating diffusion region with a second subthreshold current may be greater than a duration of supplying the floating diffusion region with the first subthreshold current, so that a quantity of charge transferred during supplying the floating diffusion region with a second subthreshold current is greater than a quantity of charge transferred during supplying the floating diffusion region with the first subthreshold current.
Still further embodiments of the invention include methods of performing two point calibration of a linear-logarithmic image sensor pixel by, among other things, measuring voltages of a floating diffusion region of the pixel after establishing a plurality of unequal sub-threshold currents through a transfer transistor of the pixel. These methods include at least partially depleting a photodiode within the pixel by driving a cathode of the photodiode with a pull-up current. Thereafter, a floating diffusion region of the pixel is supplied with a first subthreshold current by passing charge carriers of first conductivity type from the at least partially depleted photodiode to the floating diffusion region. A first voltage of the floating diffusion region is then read and used for calibration. The floating diffusion region is further supplied with a second subthreshold current by passing charge carriers of first conductivity type from the at least partially depleted photodiode to the floating diffusion region. A second voltage of the floating diffusion region is then read and used for calibration.
According to some of these two-point calibration methods, the step of driving the cathode of the photodiode with the pull-up current includes shorting the cathode of the photodiode to the floating diffusion region. Moreover, in the event the pixel includes a totem-pole arrangement of a reset transistor and a transfer transistor, a source terminal of the reset transistor may be electrically connected to the floating diffusion region and to a drain terminal of the transfer transistor and the driving the cathode of the photodiode with the pull-up current may include turning on the reset and transfer transistors. In this manner, the step of driving the cathode of the photodiode with the pull-up current may include pulling-up the cathode of the photodiode to a relatively high voltage, which may be equivalent to a voltage of a drain terminal of the reset transistor (assuming the voltages of the gate terminals of the transfer and reset transistors are sufficiently high). In addition, the step of supplying a floating diffusion region within the pixel with a first subthreshold current can be preceded by a step of discharging the floating diffusion region by driving the drain terminal of the reset transistor high-to-low while a gate terminal of the reset transistor is maintained at a high voltage level.
Methods of calibrating linear-logarithmic image sensors according to still further embodiments of the invention include performing a reset of an image sensor pixel (e.g., to a low voltage) in advance of establishing a subthreshold leakage current between a photodiode and a floating diffusion region of the pixel. A first voltage of the floating diffusion region is then read after terminating the leakage current. Charge is then transferred between the photodiode and the floating diffusion region of the pixel by driving up a gate voltage of the transfer transistor so that a voltage of a cathode of the photodiode is increased. A second voltage of the floating diffusion region is then read after terminating the transfer of charge. These first and second unequal voltages are then used to perform calibration. The step of performing the reset includes turning on a totem pole arrangement of a reset transistor and a transfer transistor so that the cathode of the photodiode can be pulled-down to a voltage of the floating diffusion region. In particular, in the event a source terminal of the transfer transistor is electrically connected to the cathode of the photodiode and a source terminal of the reset transistor is electrically connected to the floating diffusion region, then the step of performing a reset includes turning on the reset and transfer transistors so that the cathode of the photodiode can be pulled-down to a voltage of a drain terminal of reset transistor.
In addition, the step of establishing a leakage current can be performed while the transfer transistor is operating in subthreshold and the reset transistor is sourcing current to the floating diffusion region, whereas the step of reading the first voltage is performed while the reset and transfer transistors are turned off. Moreover, the step of reading the first voltage can be followed by turning on the transfer transistor during the step of transferring charge between the photodiode and the floating diffusion region and then turning off the transfer transistor during the step of reading the second voltage.
Additional embodiments of the invention include calibrating a linear-logarithmic image sensor pixel by, among other things, performing a reset of the pixel by equilibrating a voltage of a cathode of a photodiode therein with a voltage of a floating diffusion region. This step is performed in advance of resetting the floating diffusion region by pulling-up a voltage of the floating diffusion region after isolating the floating diffusion region from the cathode of the photodiode. A first voltage of the floating diffusion region is then read in advance of establishing a first subthreshold leakage current between the floating diffusion region and the cathode of the photodiode for a first duration. Thereafter, a second voltage of the floating diffusion region is read after isolating the floating diffusion region from the cathode of the photodiode.
These calibration operations further include performing another reset of the pixel by equilibrating a voltage of the cathode of the photodiode therein with a voltage of the floating diffusion region, and then resetting the floating diffusion region by pulling-up a voltage of the floating diffusion region after isolating the floating diffusion region from the cathode of the photodiode. A third voltage of the floating diffusion region is then read in advance of establishing a second subthreshold leakage current between the floating diffusion region and the cathode of the photodiode for a second duration. A fourth voltage of the floating diffusion region is then read after isolating the floating diffusion region from the cathode of the photodiode.
According to preferred aspects of these embodiments of the invention, the second duration is greater than the first duration and/or the second subthreshold leakage current is greater than the first subthreshold leakage current. Alternatively, the vice versa conditions may apply, which means the second duration can be shorter than the first duration and/or the second subthreshold leakage current can be less than the first subthreshold leakage current. Moreover, the steps of establishing first and second subthreshold leakage currents can be performed while a reset transistor of the pixel is turned off. This reset transistor within a 4T pixel includes a source terminal electrically connected to the floating diffusion region. In particular, the step of performing a reset may include turning on a totem pole arrangement of a reset transistor and a transfer transistor so that a pull-down force can be applied simultaneously to the cathode of the photodiode and the floating diffusion region.
The present invention now will be described more fully with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like reference numerals refer to like elements throughout.
It will be understood that when an element or layer is referred to as being “on,” “connected to” or “coupled to” another element or layer (and variants thereof), it can be directly on, connected or coupled to the other element or layer or intervening elements or layers may be present. In contrast, when an element is referred to as being “directly on,” “directly connected to” or “directly coupled to” another element or layer (and variants thereof), there are no intervening elements or layers present. Like reference numerals refer to like elements throughout.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms are only used to distinguish one element, component, region, layer or section from another region, layer or section. Thus, a first element, component, region, layer or section discussed below could be termed a second element, component, region, layer or section without departing from the teachings of the present invention.
Spatially relative terms, such as “beneath,” “below,” “lower,” “above,” “upper” and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features would then be oriented “above” the other elements or features. Thus, the term “below” can encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present invention. As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprising”, “including”, “having” and variants thereof, when used in this specification, specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof. In contrast, the term “consisting of” when used in this specification, specifies the stated features, steps, operations, elements, and/or components, and precludes additional features, steps, operations, elements and/or components.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As shown by
Linear-logarithmic operation of the pixel 100 can be enabled by setting the TG voltage to a medium voltage. At low illumination, no current flows through the transfer transistor 20 during photocurrent integration and the response of the pixel is linear. However, when the illumination increases, a subthreshold current flows through the transfer transistor 20 in a direction opposite to the photocurrent and causes a logarithmic response of the pixel 100. Because of the large variation of the subthreshold current, the logarithmic response becomes highly variable in response to process variation, device (e.g., transistor) mismatch and temperature. The variable reset voltage (VR) shown in
As will be understood by those skilled in the art, the pixel signal can be read as in a linear pixel in two steps following a Correlated Double Sampling (CDS) procedure. The first measure of the CDS is the FD reset voltage and the second measure of the CDS is the FD voltage after transferring the accumulated photodiode (PD) charge. The CDS pixel signal is the difference between the second and first measurements. Moreover, as will now be described, following the two-step pixel read operations, which enable the determination of the CDS pixel signal, on-the-fly calibration measurements may be performed that are independent of photocurrent and adjacent-in-time to the pixel signal determination. In particular, as shown by the well-potential sequence of
As shown by initial step (a) in
Thereafter, as shown by step (b), the TG voltage is lowered to thereby isolate the photodiode while the photocurrent begins to integrate at the diode capacitance. Then, in step (c), the voltage of the floating diffusion (FD) region is reset to a low voltage level by driving the variable reset voltage (VR) high-to-low before the FD region is electrically isolated at step (d) by switching the reset gate voltage RG high-to-low. Next, as shown by step (e), the transfer gate voltage TG is increased to a medium voltage (mid TG) to thereby establish a first subthreshold current, which flows from the photodiode (PD) to the floating diffusion (FD) region for a relatively short duration (e.g., tshort). Then, as shown by step (f), the transfer gate voltage TG is lowered to thereby isolate the FD region and enable read-out of a first FD calibration voltage via the second totem pole arrangement of the NMOS source follower (SF) 30 and the NMOS select transistor 40. Next, as shown by steps (g)-(h), to support two-point calibration, the transfer gate voltage TG is again increased to the medium voltage (mid TG) for a somewhat longer duration (e.g., tlong) before it is lowered to isolate the FD region and enable read-out of a second FD calibration voltage.
As will be understood by those skilled in the art, the calibration operations highlighted by
As determined by the inventors herein, to achieve one-point calibration, the FD voltage can be read after a fixed time duration and its value can be used for KNPT determination and LOGS correction. Moreover, for two-point calibration, two sub-threshold currents of different duration (or achieved in response to unequal TG voltages) may be established by setting the correct lengths of tshort and tlong at steps (e) and (g). The duration of tshort should be long enough to obtain a proper value of the subthreshold current, but not too long to fully charge the FD region or fully discharge the PD. In addition, because the subthreshold current may decrease exponentially with time, the time required for tlong should be significantly greater than tshort but nonetheless short enough to avoid fully discharging the PD.
Precise subthreshold currents through the transfer transistor 20 may not be necessary, but adequate timing and voltages must be chosen in order to support operation of the transfer transistor 20 in subthreshold. In two-point calibration, the time windows can be adjusted to provide approximately one order of magnitude difference between the subthreshold currents generated during steps (e) and (g) or an approximately 100 mV voltage difference between the TG voltages during these steps (where the differences between tlong and tshort may no longer apply). During one-point calibration, the duration of the subthreshold current should be short enough to maintain operation in subthreshold but long enough to provide adequate sensitivity to subthreshold variations so that the calibration voltage can be used to provide correction of both KNPT and LOGS variation. In contrast, during two-point calibration, one of the calibration voltages is used to calibrate the KNPT while the difference between the first and second calibration voltages provides an estimate of the LOGS. The timing for the calibration sequence of
Embodiments of the calibration methods described hereinabove have been simulated using MOSFET transistors from a 65 nm fabrication process. Temperature, transistor and device mismatch and process variations are included in the simulation by proper setting of device corners and running Monte-Carlo simulations. The reset transistor 10 and transfer transistor 20 are included in the simulation and proper values of the PD and FD capacitances were adjusted by adding ideal capacitors, which adjust the pixel response to the one measured from fabricated pixels. The simulated linear-logarithmic pixel response before calibration for different temperatures and process variations is highlighted by the graph of
Accordingly, as hereinabove described with respect to
Thereafter, as shown by steps (b)-(c), during time intervals t2, t3, a mid-level “sub-threshold” gate voltage (mid-TG) is applied to the transfer gate TG in advance of driving the variable reset voltage VR low-to-high to thereby apply a strong pull-up force to the floating diffusion region (FD) and a weaker pull-up force to the cathode of the photodiode 50 (via the transfer transistor 20). In particular, as shown by
Then, in step (d), during time interval t4, the leakage current is terminated by turning off the transfer transistor 20. In step (e), during time interval t5, the reset transistor 10 is turned off by driving RG high-to-low, which enables a “first” voltage of the floating diffusion (FD) region to be isolated and then read via the source follower (SF) transistor 30 and the select transistor 40. Thereafter, in steps (f)-(g), during time intervals t6-t7, relatively substantial charge is transferred between the photodiode (PD) 50 and the floating diffusion (FD) region. This charge transfer during time interval t6, which occurs in response to turning on the transfer transistor 20 (e.g., by driving TG low-to-high) causes a voltage of the cathode of the photodiode 50 to be increased as a voltage of the FD region is decreased. Then, at the commencement of time interval t7, the transfer gate voltage TG is switched low to turn-off the transfer transistor 20 and isolate the floating diffusion FD region so that a “second” voltage of the FD region may be read (step (g)). These first and second read voltages can then be used to support on-the-fly calibration operations as described more fully hereinabove.
Moreover, to achieve complete linear and logarithmic calibration of the pixel (KNPT, LOGS), the steps (a)-(g) illustrated by
In the drawings and specification, there have been disclosed typical preferred embodiments of the invention and, although specific terms are employed, they are used in a generic and descriptive sense only and not for purposes of limitation, the scope of the invention being set forth in the following claims.
Number | Name | Date | Kind |
---|---|---|---|
5086343 | Cook et al. | Feb 1992 | A |
6069377 | Prentice et al. | May 2000 | A |
6642503 | Kummaraguntla et al. | Nov 2003 | B2 |
7224848 | Hofflinger et al. | May 2007 | B2 |
7663683 | Miyatake | Feb 2010 | B2 |
7755690 | Suzuki et al. | Jul 2010 | B2 |
7800673 | Sugawa et al. | Sep 2010 | B2 |
7804537 | Storm et al. | Sep 2010 | B2 |
7920193 | Ladd et al. | Apr 2011 | B2 |
7924332 | Gruev et al. | Apr 2011 | B2 |
7995125 | Blessinger | Aug 2011 | B2 |
8130298 | Corson et al. | Mar 2012 | B2 |
8130302 | Johnson | Mar 2012 | B2 |
8146820 | Wang et al. | Apr 2012 | B2 |
8150201 | Kasai | Apr 2012 | B2 |
8233059 | Kamon et al. | Jul 2012 | B2 |
8368002 | Hosier et al. | Feb 2013 | B2 |
8593550 | Lee et al. | Nov 2013 | B2 |
8615132 | Nikula et al. | Dec 2013 | B2 |
20080259178 | Oike | Oct 2008 | A1 |
20080303928 | Kusuda | Dec 2008 | A1 |
20090046180 | Shibano et al. | Feb 2009 | A1 |
20100025569 | Matsumoto | Feb 2010 | A1 |
20100045650 | Fish et al. | Feb 2010 | A1 |
20100289932 | Hashimoto | Nov 2010 | A1 |
20110032403 | Mabuchi | Feb 2011 | A1 |
20110316839 | Minowa et al. | Dec 2011 | A1 |
20120002090 | Aoki et al. | Jan 2012 | A1 |
20120211642 | Iwamoto | Aug 2012 | A1 |
Number | Date | Country |
---|---|---|
2006303768 | Nov 2006 | JP |
2008099158 | Apr 2008 | JP |
2012119775 | Jun 2012 | JP |
2012124835 | Jun 2012 | JP |
Entry |
---|
Jiwon Lee et al. “New FPN Correction Method for PD-Storage Dual-capture CMOS Image Sensor using a Nonfully Depleted Pinned Photodiode” Proc. IEEE Int. Symp. Circuits Syst., pp. 1620-1623 (2012). |
Joseph et al., “Modeling and Calibration of logarithmic CMOS image sensors”, Sep. 30, 2002; University of Oxford, 188 pages. |
Joseph, Dileepan, “Logarithmic CMOS image sensors”, 2003, University of Oxford, http://www.ece.ualberta.ca/˜djoseph/presentations/Research—2003.ppt, 24 pages. |
Liu, Yang, “The Design of a High Dynamic Range CMOS Image Sensor in 110nm Technology”, Aug. 2012, Delft University of Technology, 93 pages. |
York, Timothy, “Fundamentals of Image Sensor Performance”, May 5, 2011, http://www.cse.wustl.edu/˜jain/cse567-11/ftp/imgsens/index.html, 8 pages. |
Number | Date | Country | |
---|---|---|---|
20150281683 A1 | Oct 2015 | US |