This disclosure relates generally to image sensors, and in particular but not exclusively, relates to sample and hold circuitry for use in reading out image data from an image sensor.
Image sensors have become ubiquitous. They are widely used in digital still cameras, cellular phones, security cameras, as well as medical, automobile, and other applications. The technology used to manufacture image sensors has continued to advance at a great pace. For example, the demands of higher resolution and lower power consumption have encouraged the further miniaturization and integration of these devices.
Image sensors conventionally receive light on an array of pixels, which generates charge in the pixels. The intensity of the light may influence the amount of charge generated in each pixel, with higher intensity generating higher amounts of charge. Correlated double sampling (CDS) is a technique that is used with CMOS image sensors (CIS) to reduce noise from images read out from image sensors by sampling image data from the image sensors and removing undesired offsets sampled from reset value readings from the image sensors. In global shutter CIS design, sample and hold switches are used to sample and hold signal (SHS) readings, as well as sample and hold reset (SHR) readings from the image sensors. The SHR and SHS switches in the sample and hold circuitry are controlled to sample the reset levels and the signal levels from the image sensor respectively. Ideally, during a global sampling phase, all sample and hold switches toggle at the same time to sample the whole frame from the image sensor into storage capacitors. After the global sampling is completed, a row-by-row read out from the image sensor is performed to digitize the sampled reset and signal levels. The digitized difference between the reset and signal levels are used in the CDS calculation to recover the true image signals. To further reduce random noise, correlated multiple sampling (CMS) may be performed.
Implementing CDS reduces the fixed pattern noise (FPN) and other temporal noise, such as kT/C thermal noise, from the image data. Correlated double sampling (CDS) and correlated multiple sampling (CMS) may be done in either analog domain or digital domain.
Voltage domain global shutter (VDGS) pixel array normally uses at least two storage capacitors as memories for the reset voltage value RESET and signal voltage value SIGNAL for CDS, three or more storage capacitors as memories for equal or more than one RESET value and equal or more than one SIGNAL for CMS. To satisfy small kT/C thermal noise requirement, the two storage capacitors need to maintain large enough layout size for a typical capacitance value of 20˜30 pF.
Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified.
Corresponding reference characters indicate corresponding components throughout the several views of the drawings. Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of various embodiments of the present invention. Also, common but well-understood elements that are useful or necessary in a commercially feasible embodiment are often not depicted in order to facilitate a less obstructed view of these various embodiments of the present invention.
Examples directed to a sample and hold circuit for use in an image sensor are described herein. In the following description, numerous specific details are set forth to provide a thorough understanding of the examples. One skilled in the relevant art will recognize, however, that the techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects.
Reference throughout this specification to “one example” or “one embodiment” means that a particular feature, structure, or characteristic described in connection with the example is included in at least one example of the present invention. Thus, the appearances of the phrases “in one example” or “in one embodiment” in various places throughout this specification are not necessarily all referring to the same example. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more examples.
Throughout this specification, several terms of art are used. These terms are to take on their ordinary meaning in the art from which they come, unless specifically defined herein or the context of their use would clearly suggest otherwise. It should be noted that element names and symbols may be used interchangeably through this document (e.g., Si vs. silicon); however, both have identical meaning.
In one example, readout circuitry 108 may be coupled to read out image data from the plurality of photodiodes 104 in pixel array 102 through the sample and hold circuitry 167. As will be described in greater detail below, in one example, the sample and hold circuitry 167 includes a plurality of sample and hold circuits that are coupled to the pixel cells 104 at the pixel level to sample and hold reset values as well as signal values from pixel array 102 through pixel level connections 106. The image data that is readout by readout circuitry 108 may then be transferred to function logic 112. In various examples, readout circuitry 108 may also include amplification circuitry, analog to digital conversion (ADC) circuitry coupled to bitlines, or otherwise.
In one example, function logic 112 may simply store the image data or even manipulate the image data by applying post image effects (e.g., crop, rotate, remove red eye, adjust brightness, adjust contrast, or otherwise). In one example, readout circuitry 108 may readout a row of image data at a time along readout column lines (illustrated) (i.e., bitlines between the sample and hold circuitry 167 and the readout circuit 108) or may readout the image data using a variety of other techniques (not illustrated), such as a serial readout or a full parallel readout of all pixels 104 simultaneously.
In one example, control circuitry 110 is coupled to pixel array 102 to control operation of the plurality of photodiodes in pixel array 102. As will also be described in greater detail below, control circuitry 110 also includes a switch driver 168 that is coupled to generate the control signals to control the sample and hold circuitry 167 to sample and hold the reset voltage values and signal voltage values in the voltage domain (VD) from pixel array 102. In the depicted example, the control circuitry 110 is also coupled to generate a global shutter signal for controlling image acquisition of all pixel values from the pixel array at substantially the same time, which may also be referred to as a voltage domain global shutter (VDGS). In one example, the shutter signal is a global shutter signal for simultaneously enabling all pixel cells 104 within pixel array 102 to simultaneously capture their respective image data during a single acquisition window. In one example, image acquisition is synchronized with lighting effects such as a flash.
In one example, imaging system 100 may be included in a digital camera, cell phone, laptop computer, or the like. Additionally, imaging system 100 may be coupled to other pieces of hardware such as a processor (general purpose or otherwise), memory elements, output (USB port, wireless transmitter, HDMI port, etc.), lighting/flash, electrical input (keyboard, touch display, track pad, mouse, microphone, etc.), and/or display. Other pieces of hardware may deliver instructions to imaging system 100, extract image data from imaging system 100, or manipulate image data supplied by imaging system 100.
In an imaging system that utilizes CDS, the charge on the floating diffusion 220 is also read out through the pixel level connection 206 after a floating diffusion reset operation, in response to both RST and DFD signals simultaneously, to obtain a reset level, and the charge on the FD 220 is also read out through the pixel level connection 206 after the image charge is transferred to the FD 220 to obtain a signal voltage.
Continuing with the depicted example, the sample and hold circuit 267 includes a first storage transistor 232 that is coupled to the pixel level connection 206 to sample and hold a first reset voltage from pixel cell 204 into a first storage device C1234 in response to a first reset storage signal SW1252. In the example, the first storage device C1234 of the sample and hold circuit 267 is a capacitor. In addition, the sample and hold circuit 267 also includes a second storage transistor 236 that is coupled to the pixel level connection 206 to sample and hold a first signal voltage from pixel cell 204 into a second storage device C2238 in response to a first signal storage signal SW2256. In the example, the second storage device C2238 of the sample and hold circuit 267 is a capacitor. To further the expansion of the storage device to store another pair of reset and signal levels, as in the correlated multiple sampling (CMS) to reduce read noise even more, the sample and hold circuit 267 includes a third storage transistor 240 that is coupled to the pixel level connection 206 to sample and hold a second reset voltage from pixel cell 204 into a third storage device C3242 in response to a second reset storage signal SW3260. In the example, the third storage device C3242 of the sample and hold circuit 267 is a capacitor. In the said expansion above, the sample and hold circuit 267 also includes a fourth storage transistor 244 that is coupled to the pixel level connection 206 to sample and hold a second signal voltage from pixel cell 204 into a fourth storage device C4246 in response to a second signal storage signal SW4264. In the example, the fourth storage device C4246 of the sample and hold circuit 267 is a capacitor.
As will be discussed below, the first reset storage signal SW1252, the first signal storage signal SW2256, the second reset storage signal SW3260 due to the said expansion, and the second signal storage signal SW4264 due to the said expansion are generated by a sample and hold switch driver circuitry 168 of the control circuitry 110.
A reset row transistor 254 is coupled between a supply voltage SVD and the pixel level connection 206. The reset row transistor 254 is responsive to a reset row signal RST_ROW. In the depicted example, a source follower row transistor 270 having a gate is coupled to the pixel level connection 206. A row select row transistor 272 is coupled between the source follower row transistor 270 and a bitline 280. The row select row transistor 272 is responsive to a row select row signal RS_ROW. In the depicted example, a bias transistor 274 that is biased with a bias voltage VB is coupled between the pixel level connection 206 and ground. The bias transistor 274 serves as a sample and hold (SH) current source. The SH current source provides current to the SF transistor 224 and the pixel level connection 206 with a typical value of ˜20 nA.
In the example, the first terminals of the first, second, third, and fourth storage devices C1234, C2238, C3242, and C4246 are made of metal-insulator-metal (MiM) capacitors (which have high capacitance per unit area with the lowest parasitics) and are connected to their respective storage transistors 232, 236, 240, and 244, and the second terminals of the first, second, third, and fourth storage devices C1234, C2238, C3242, and C4246 are connected to a low supply voltage DOVDD. DOVDD is lower in value than SVD. DOVDD may also be connected to ground. To preserve the stored charge values of the first, second, third, and fourth storage devices C1234, C2238, C3242, and C4246, it is beneficial to reduce static leakage currents of storage transistors 232, 236, 240, and 244 when their respective storage signals SW1252, SW2256, SW3260, and SW4264 are low. In one example, the values of supply voltages DOVDD and SVD may be tuned to minimize the static leakage currents of storage transistors 232, 236, 240, and 244. The static leakage currents may increase when the length (L) of the storage transistor decreases. The L will get shorter while the size of the storage transistor further shrinks.
In other examples, branches that include each of the storage devices C1-C4 and their respectively coupled storage transistors may also be expanded to a plurality of j branches, where j=5, 6, . . . , 16. The jth branch consists of a respective storage device Cj and its coupled corresponding storage transistor. The plurality of j branches may serve the purpose of CMS.
As will be described in the example readouts depicted in
Beginning specifically with the example depicted in
Next, the reset signal RST and the DFD signal are both pulsed simultaneously (not shown), which pulse the reset transistor 222 and the DFD transistor 221, and resets the pixel cell 204. The first reset level of the pixel cell 204 that appears on the pixel level connection 206 or V_PIX 306 is R1.
The first reset storage signal SW1352 is pulsed as shown, which pulses the first storage transistor 232 in the sample and hold circuit 267, and therefore stores the first reset image charge value of the PD 216 (and/or LOFIC) into the first storage device C1234, which is indicated in
Next, the signal TX is pulsed (not shown), which pulses the transfer transistor 218 in pixel cell 204, which transfers the image charge from the PD 216 to the floating diffusion FD 220. This image charge is amplified by the SF transistor 224 and appears on V_PIX 306 as the first image level S1 of the pixel cell 204.
The first signal storage signal SW2356 is pulsed as shown, which pulses the second storage transistor 236 in the sample and hold circuit 267, and therefore stores the first signal image charge value of the PD 216 (and/or LOFIC) into the second storage device C2238, which is indicated in
In a case where correlated multiple sampling (CMS) is performed, the additional reset and signal levels are generated and stored. Thus, in the depicted example, the reset signal RST and the DFD signal are both pulsed simultaneously (not shown) again, which pulses the reset transistor 222 and the DFD transistor 221, and resets the pixel cell 204. A second reset level of the pixel cell 204 appears on V_PIX 306 as R2.
The second reset storage signal SW3360 is pulsed as shown, which pulses the third storage transistor 240 in the sample and hold circuit 267, and therefore stores the second reset image charge value of the PD 216 (and/or LOFIC) into the third storage device C3242, which is indicated in
Again next, the signal TX is pulsed (not shown), which pulses the transfer transistor 218 in pixel cell 204, which transfers the image charge from the PD 216 to the floating diffusion FD 220. This image charge is amplified by the SF transistor 224 and appears on V_PIX 306 as a second image level S2 of the pixel cell 204.
The second signal storage signal SW4364 is pulsed as shown, which pulses the fourth storage transistor 244 in the sample and hold circuit 267, and therefore stores the second signal image charge value of the PD 216 (and/or LOFIC) into the fourth storage device C4246, which is indicated in
When it comes time to read stored image data from the memories (storage devices), the row select row signal RS_ROW is transitions to a high value to turn on the row select row transistor 272. Thereafter, the reset row signal RST_ROW is pulsed, which resets the sample and hold circuit 367 as indicated in
After the first ADC conversion above on the previously stored first reset image charge value R1 of the PD stored in storage device C1234 is complete, the reset row signal RST_ROW is pulsed, which resets the sample and hold circuit 367 as indicated in
Once both ADC operations have been conducted, for a pair of signals, the two digital values of the first reset analog voltage r_R1 and the first signal analog voltage r_S1 may be subtracted from each other, normally done in function logic 112, to recover a true image signal based on the CDS calculation.
Subsequently, to further read stored image data from the memories, the row select row signal RS_ROW remains high value and the row select row transistor 272 remains on. The reset row signal RST_ROW is pulsed, which resets the sample and hold circuit 367 again as indicated in
After the third ADC conversion above on the previously stored second reset image charge value of the PD stored in storage device C3242 is complete, the reset row signal RST_ROW is pulsed, which repeatedly resets the sample and hold circuit 367 as indicated in
Once both ADC operations have been conducted, for a second pair of signals, the two digital values of the second reset analog voltage r_R2 and the second signal analog voltage S2 may be subtracted from each other in digital domain, normally in function logic 112, to recover another true image signal based on the CDS calculation.
Given the four digital values of the first reset analog voltage R1, the second reset analog voltage R2, the first signal analog voltage S1 and the second signal analog voltage S2 achieved above, if both S1 and S2 are taken from two exposures of the same object sequentially as shown in
With further added pair of Ri/Si, where i=3, 4, . . . , 8, for N pairs of Ri/Si to be used, CMS measurement can be achieved with:
And random noise of image:
Equations (1) and (2) are characteristics of CMS that shows a clear benefit in reducing random noise.
As shown in
Also as shown in
High dynamic range and/or range differentiation like motion detections may benefit from the use of the disclosed highly expandable memory unit.
The above description of illustrated examples of the invention is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific examples of the invention are described herein for illustrative purposes, various modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.
These modifications can be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific examples disclosed in the specification. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.
This application claims the benefit of U.S. Provisional Patent Application No. 63/125,246 filed on Dec. 14, 2020. U.S. Provisional Patent Application No. 63/125,246 is hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
63125246 | Dec 2020 | US |