The following U.S. patent applications, all assigned to the assignee hereof, are hereby incorporated by reference: 5,081,536; 5,105,277; and 5,148,268.
The present invention relates to image sensor devices, such as used in, for example, digital cameras or document scanning devices, and in particular to apparatus having an array of photodiodes outputting to an output line through CMOS circuitry.
Image sensor arrays, such as found in digital document scanners and digital cameras, typically comprise a linear array of photosites which raster scan a focused image, or an image bearing document, and convert the set of microscopic image areas viewed by each photosite to image signal charges. Following an integration period the image signal charges are amplified and transferred to a common output line or bus through successively actuated multiplexing transistors.
Currently there are two generally accepted basic technologies for creating such linear arrays of photosites: Charge-coupled devices, or CCD's, and CMOS. In CMOS, the photosensors are in the form of photodiodes, which output a charge in response to light impinging thereon. In the scanning process, bias and reset charges are applied in a predetermined time sequence during each scan cycle. Certain prior art patents, such as U.S. Pat. No. 5,081,536 assigned to the assignee hereof, disclose two-stage transfer circuits for transferring image signal charges from the photosites in CMOS image sensors.
In designing photosensitive devices using photodiodes, it is desirable to use signals from the photodiodes which are created toward the middle portion of the photodiodes'response, where the response function is highly linear. In other words, light-responsive signals from the lower portion of a photodiode's response tend not to be linear, and thus unreliable as a reflection of the amount of light integrated by the photodiode at a particular time. In order to exploit the more linear middle portion of a photodiode's response, one technique, which is used in the patents incorporated by reference above, is to inject a predetermined bias charge, or “fat zero,” onto the photodiode with each cycle of operation wherein light energy is integrated as a charge on the photodiode and then transferred through a transfer circuit. The fat zero bias in effect “primes the pump” of charge within the photodiode so that the nonlinear portions of the photodiode response are not used.
In practical applications of photosensitive devices using fat zero bias, two key sources of noise, which can affect the integrity of the output image signals, are “fixed pattern noise” and “thermal noise.” The first of these types of noise relates to the fact that, within any device, individual photodiodes and sets of circuitry associated with the various photodiodes will have some variation in performance, and the variation in performance among the different sets of circuitry will result in a fixed pattern of noise effecting the signals, resulting in a consistent pattern of distortions in the output signals, depending on which specific set of circuitry a particular subset of the video signals passes through. Thermal noise is created by the fact that the output of a particular set of circuitry is likely to change over time, due to the random thermal movement of electrons in conductors.
It is an object of the present invention to overcome these customary sources of noise by sampling actual values of charge placed on photodiodes during the course of operation of an apparatus, and then using these actual sampled values to correct subsequent video signals.
U.S. Pat. No. 5,081,536 discloses the basic architecture of a transfer circuit which injects a bias charge onto a photodiode in a CMOS-based image sensor array. U.S. Pat. No. 5,105,277 represents an improvement to the '536 patent, in which split clock transistor actuating pulses are applied to the transfer circuit, to cancel variations among a large number of photodiodes.
U.S. Pat. No. 5,812,703 discloses an imaging apparatus, such as a digital camera, in which the fixed-pattern noise inherent to a particular apparatus in taken into account by storing in a non-volatile memory noise data for every photosensor of the apparatus.
According to one aspect of the present invention, there is provided a method of operating a photosensitive apparatus having at least one photodiode. A first bias charge is injected onto the photodiode. The first bias charge on the photodiode is then sampled, yielding a sampled signal. A second bias charge is injected onto the photodiode, and then a light signal is integrated on the photodiode. The light signal and the second bias charge are transferred from the photodiode, and the sampled signal is subtracted from the light signal and the second bias charge.
According to another aspect of the present invention, there is provided a method of operating a photosensitive apparatus having at least one photodiode and a capacitor associated with the photodiode. A first bias charge is injected onto the photodiode, and then transferred from the photodiode to the capacitor. A second bias charge is injected onto the photodiode. The second bias charge is transferred in combination with a light signal from the photodiode to the capacitor.
According to another aspect of the present invention, there is provided a photosensitive imaging apparatus, comprising a plurality of cells, each cell corresponding to a small area of an image to be recorded. Each cell includes at least one photodiode, a sampling capacitor associated with the photodiode, means for injecting a bias charge onto the photodiode, and means for transferring charge from the photodiode onto the sampling capacitor.
In the convention of this specification, an element in
In the following description, certain conventions will be used. In the following schematic diagrams and timing diagrams, the same index will apply both to an indicated circuit element in the schematic and to the potential or other signal in the timing diagram associated with the indicated circuit element.
Although the basic operation of the transfer circuit is given in detail in the patent incorporated by reference, in brief, the middle node 12 serves as a location in which a “fat zero” bias charge injection, such as indicated as VFZ in the Figure, can be injected onto a photodiode 10. As described in the patents incorporated by reference, the purpose of this bias charge injection is to cause the photodiode to output a signal in a linear range. Downstream of the middle node 12, the reset node 14 and its associated circuitry allows a reset voltage VR1 to be placed on the transfer circuit, VR1 being of such a magnitude as to draw a signal from the photodiode 10 through the transfer circuit, ultimately through amplifier 16 and onto output line 18.
With particular reference to the Figure, there are further provided circuit elements which facilitate the present invention in this embodiment. These circuit elements are indicated by the signals which operate them, as will be described below. The basic fat-zero transfer circuit is characterized by transistors T1 and T2, while the fat zero voltage VFZ is injected onto the photodiode by activation of the transistor FZ. The basic transfer circuit is reset, as described in the above-referenced patents, by voltage VR1 when the transistor R1 is activated.
The circuit elements for sampling and temporarily storing fat-zero bias charge injections are capacitor CFZ, corresponding to what is in some claims below called a sampling capacitor, which is attached at a first side thereof by a sample and hold transistor SH, and on the second side thereof by a second reset voltage VR2, activated by transistor R2. There are also parasitic capacitances on either side of capacitor CFZ, which have to be taken into account to obtain desirable performance. The sample and hold capacitor, CH, is used to minimize the effect of the coupling of charge from the SH transistor's parasitic gate to drain capacitance. This coupling could be nonlinear with signal and also cut into signal range, and therefore is undesirable.
The operation of the various circuit elements at predetermined times is carried out by a clocking means (not shown) ultimately connected to each contact in
The overall operation of the circuit of
During period A, the photodiode 10 has an initial fat zero charge from source VFZ placed thereon by the operation of transistors FZ and T1. This fat zero charge is used to “prime the pump” of the photodiode, or in other words cause the photodiode to operate in the linear middle section of its response curve, as described in the patents referenced above.
In period B, the other nodes in the cell are reset, and fat zero charge from the photodiode is transferred out to the reset node 14, causing a total voltage VR1+VFZ to be buffered by the low-power amplifier 15 and stored on the capacitor CFZ as what can be called a “sampled signal.” At the same time, a reference voltage from source VR2 is applied to the other side of CFZ. At period C, a fat zero bias is again placed in the photodiode 10, and at this point the integration period, that is the portion of the cycle of operation wherein light impinging on the photodiode 10 is integrated as a usable light signal, can begin.
After the integration time, at period D, the intermediate nodes in the cell are reset to cause the transfer of the resulting integrated light signal (Vsig) to the reset node. The total voltage on the reset node at this point, VR1+VFZ+Vsig, is buffered to the CFZ capacitor, but at this point in the cycle of operation, the other side of CFZ is left floating, or in other words the transistor R2 is not active. The resulting signal at the pixel amplifier 16 will be VR2+Vsig, since the previously stored charge on capacitor CFZ subtracts VR1+VFZ from VR1+VFZ+Vsig. The sampled signal, which is equal to the original fat zero charge, is thus removed with every cycle of operation.
Put in more basic terms, the operation of the above described embodiment is as follows. With each cycle of operation, the fat zero charge is injected onto the photodiode and then sampled, in this case, on CFZ. Another fat zero is placed on the photodiode prior to integrating of a signal charge. The sampled fat zero charge is thus held and subtracted from the combined fat zero plus signal output within the same cycle. Because the first, sampled fat zero and second, actually-used fat zero are experienced by the same set of circuit elements, fixed-pattern noise associated with the particular set of circuit elements is obviated: the initial fat zero sampling can be considered an “experimental control.” Because the two fat zero injections occur very closely in time, some components of thermal noise are obviated. However, the photodiode kT/C noise component in the final signal is increased by approximately the square root of two.
To clarify the structure and function of the illustrated embodiment with regard to the claims below, when a charge is read through amplifier 15 and stored on the capacitor CFZ, in this embodiment, strictly speaking the output of amplifier 15 is not the charge directly from the photodiode 10 but rather an output related to, or representative of, the charge from the photodiode which is retained on reset node 14 and input to amplifier 15. Nonetheless, the effect of reading charge through amplifier 15 and storing it on CFZ is that the charge on photodiode 10 is sampled and stored, such as for future use when subtracting the stored charge value in a later readout process.
In a practical design, overall responsivity of the cell will depend on several factors. The collected charge will be converted to a voltage that will be determined by the reset node capacitance, CR, and that voltage will see the gain of the low power amplifier, the FZ subtraction circuit (CFZ/(CFZ+CP)) and the pixel amplifier. The gain of the amplifiers 15 and 16 can be easily kept near 0.98-0.99, and if CFZ is made 0.5 pF the parasitic capacitance CP at the amplifier 16 (about 20-25 fF) in the subtraction circuit will not lower the gain of the subtraction circuit below 0.95. The linearity of the transferred signal and the total linear range of the sensor will depend on the amount of fat zero charge injected and the other clocking levels. The power of the low power amp 15 should be kept low enough so that when all amplifiers are “on” the total chip power is not too high, but also high enough for the settling of voltage on the CFZ capacitor.
There are many possible variations of this illustrated embodiment. The photodiode 10 and transistor T1 can be replicated in a single cell for color, or multi-pixel, operation, such as by having three different diodes 10 (each diode filtered to receive a single primary color) and transistors T1 share a single middle node 12. If flexibility with integration time is not needed, the T2 and R1 devices can be removed, and fat zero injection and reset can be done by the FZ device. If one is not very concerned with the coupling of the sample and hold switch (the SH transistor), the holding capacitor, CH, can be removed. If one is very concerned with coupling of the SH transistor, a capacitor equal to CH can be put on the other side of the switch and a dummy out-of-phase canceling transistor can be attached to the CH node. A dummy canceling transistor, matching the R2 transistor, could also be added to the CP node. The amplifiers can be any type, including a simple source follower. The pixel amplifier 16 could be of a sophisticated design to remove its own offset.
Cross-reference is hereby made to the following patent application, assigned to the assignee hereof and filed simultaneously herewith: “Photosensitive Apparatus in which an Initial Charge on a Photodiode is Sampled and then Retransferred to the Photodiode,” now U.S. Pat. No. 6,646,247.
Number | Name | Date | Kind |
---|---|---|---|
5081536 | Tandon et al. | Jan 1992 | A |
5105277 | Hayes et al. | Apr 1992 | A |
5148268 | Tandon et al. | Sep 1992 | A |
5742047 | Buhler et al. | Apr 1998 | A |
6201270 | Chen | Mar 2001 | B1 |
6459077 | Hynecek | Oct 2002 | B1 |
6646247 | Hosier et al. | Nov 2003 | B2 |
Number | Date | Country | |
---|---|---|---|
20020135826 A1 | Sep 2002 | US |