This relates generally to imaging devices and systems, and more particularly, to image sensors that include shared readout circuitry (e.g., shared amplifier circuitry).
Image sensors are commonly used in electronic devices such as cellular telephones, cameras, and computers to capture images. In a typical arrangement, an image sensor includes an array of image pixels arranged in pixel rows and pixel columns. Column readout circuits are each typically coupled to a corresponding pixel column for reading out image signals from each of the image pixels in that corresponding pixel column.
However, in large image pixel arrays such as stitched pixel arrays, issues can arise when trying to perform readout operations using this per-column readout circuit configuration. In particular, column line (or path) settling is one of the dominant factors in determining the efficiency of the readout operations (e.g., the frame rate of the image sensor). With a dramatic increase in the number of pixel rows in these large image pixel arrays, column line settling time will also dramatically increase (e.g., a doubling of pixel rows may lead to a quadratic increase of the settling time). This will undesirably reduce the frame rate of the image sensor. Additionally, given the length of the column lines, each of which spans the large number of pixel rows, the resistive drops across the column lines spanning the array can further contribute to gradient-like image artifacts.
In some instances, additional power can be supplied to the column lines to improve settling time. However, this undesirably increases power consumption, and in some cases, require different power supply implementations. Increased current can also increase adversely impact the dynamic range of signals received at the column amplifier. In other instances, the large arrays can be split into smaller subarrays, which have separate readout paths (e.g., a single column of the large array can have two sets of readout circuits, each associated with a portion of a corresponding smaller subarray). However, this increases the number of readout circuits and the amount of digital processing required for processing the signals from each of the readout circuits.
It would therefore be desirable to provide imaging devices and systems with improved image sensors that take into account the above issues.
Embodiments of the present invention relate to image sensors, and more particularly, to image sensors that include shared readout circuitry (e.g., shared amplifier circuitry) and to the operations of the image sensors including the shared readout circuitry. It will be recognized by one skilled in the art that the present exemplary embodiments may be practiced without some or all of these specific details. In other instances, well known operations have not been described in detail in order to not unnecessarily obscure the present embodiments.
Imaging systems having camera modules are widely used in electronic devices such as digital cameras, computers, cellular telephones, and other electronic devices and systems. A camera module may include one or more image sensors that gather incoming light to capture images. Image sensors may include arrays of image pixels (i.e., image pixel arrays). The pixels in the image sensors may include photosensitive elements such as photodiodes that each convert the incoming light into electric charge. Image sensors may have any number of pixels (e.g., hundreds or thousands, or more). A typical image sensor may, for example, have hundreds, thousands, or millions of pixels (e.g., megapixels). Image sensors may include control circuitry such as circuitry for operating the image pixels and readout circuitry for reading out image signals corresponding to the respective electric charges generated by the photosensitive elements.
The image sensor pixels in different columns of the image pixel array may be coupled to shared readout circuitry (e.g., shared amplifier circuitry or shared column amplifier circuitry) to enable improved readout efficiency, especially for large image sensor arrays. In particular, by sharing the readout circuitry between different columns of the image sensor array, some readout circuitry (on a per-column basis) may be omitted while still achieving a satisfactory frame rate for the image sensor. Additionally, by sharing the readout circuitry between the different columns of the array, the number of reset level voltage readout operations for corresponding pixels sharing the readout circuitry may be reduced.
Storage and processing circuitry 108 may include one or more integrated circuits (e.g., image processing circuits, microprocessors, storage devices such as random-access memory and non-volatile memory, etc.) and may be implemented using components that are separate from camera module 102 and/or that form part of camera module 102 (e.g., circuits that form part of an integrated circuit that includes one or more image sensors 106 or an integrated circuit within module 102 that is associated with one or more image sensors 106). Image data that has been captured by camera module 102 may be processed and stored using storage and processing circuitry 108 (e.g., using an image processing engine on processing circuitry 108, using an imaging mode selection engine on processing circuitry 108, etc.). Processed image data may, if desired, be provided to external equipment (e.g., a computer, external display, or other devices) using wired and/or wireless communications paths coupled to processing circuitry 108.
As shown in
Readout circuitry 208 may receive image signals (e.g., analog image signals generated by pixels 204) and other pixel signals (e.g., reset level signals, reference level signals, etc.) over column lines 214. Readout circuitry 208 may include sample-and-hold circuitry for sampling and temporarily storing image signals read out from array 202, amplifier circuitry (sometimes referred to herein as column amplifier circuitry), analog-to-digital converter (ADC) circuitry, bias circuitry, column memory circuitry (e.g., a line buffer), latch circuitry for selectively enabling or disabling one or more portions of readout circuitry 208, or other circuitry that is coupled to one or more columns of pixel array 202 for operating pixels 204 and/or for reading out image signals from pixels 204. Sample-and-hold circuitry in readout circuitry 208 may be used to read out charge generated by image pixels 204 and a reset level voltage for performing correlated double sampling operations. ADC circuitry in readout circuitry 208 may convert analog image signals received from array 202 into corresponding digital pixel data (sometimes referred to herein as digital image data or simply image data). Readout circuitry 208 may supply digital pixel data to control and processing circuitry 210 and/or storage and processing circuitry 108 (
If desired, image pixels 204 may include one or more photosensitive regions for generating charge in response to image light (sometimes referred to herein as incident or incoming light). Photosensitive regions within image pixels 204 may be arranged in rows and columns on array 202. Pixel array 202 may be provided with a color filter array having multiple color filter elements, thereby allowing a single image sensor to sample light of different colors. As an example, image sensor pixels such as image pixels 204 in array 202 may be provided with a color filter array, which allows a single image sensor to sample red, green, and blue (RGB) light using corresponding red, green, and blue image sensor pixels (e.g., corresponding image pixels, over which red, green, and blue filter elements are formed) arranged in a Bayer mosaic pattern. The Bayer mosaic pattern consists of a repeating unit cell of two-by-two image pixels, with two green image pixels diagonally opposite one another and adjacent to a red image pixel diagonally opposite to a blue image pixel. In another suitable example, the green pixels in a Bayer mosaic pattern may be replaced by broadband image pixels having broadband color filter elements (e.g., clear color filter elements, yellow color filter elements, etc.) formed over the corresponding image pixels. These examples are merely illustrative and, in general, color filter elements of any desired color or filter elements for one or more wavelengths, and in any desired pattern may be formed over any desired number of image pixels 204.
In some applications (e.g., applications utilizing image sensors with large image pixel arrays), it may be desirable to split a pixel array such as pixel array 202 into multiple sections for operational efficiency (e.g., for readout efficiency).
In the example of
While, in the example of
By separating array 202 in
In other words, pixels 204 in a single column in array 202 (include a column portion 306 and a column portion 308) may be read out either upward or downward (in the orientation of
Because separate readout circuitries are provided for different portions of pixels along the same column, and the length of corresponding column lines in the upper and lower portions are shortened (relative to an unsplit array 202 as shown in
To mitigate these issues, two or more upper or lower column portions of array 202 (e.g., two or more columns of each of portions 302 and 304) may share readout circuitry. As shown in
Likewise for sub-array 304, pixels 204 in every two columns of sub-array 304 may be coupled to shared readout circuitry. In particular, as shown in
The exemplary configuration in
In particular, floating diffusion region 408 may be coupled to a gate terminal of source follower transistor 410. Source follower transistor 410 may include a first source-drain terminal (i.e., one of a source terminal or a drain terminal) coupled to supply voltage terminal 420 (e.g., supplying voltage Vdd) and a second source-drain terminal (the other one of the source terminal or the drain terminal) coupled to pixel output path 414. Row select transistor 412 may be interposed between source follower transistor 410 and pixel output path 414. During readout operations, row select transistor 412 may be activated (e.g., turned on) by asserting control signal RS. Pixel output path 414 may be coupled to column line 416 shared by a column of pixels or shared by a column portion of pixels (e.g., a column of pixels in portion 302 or portion 304 in the split array configuration in
Pixel 204 may also include reset transistor 418 coupled between supply voltage terminal 420 and floating diffusion region 408. Reset transistor 418 may be activated by asserting control signal RST. Activating transistor 418 may reset floating diffusion region 408 to a reset level voltage (e.g., voltage at supply voltage terminal 420 such as voltage Vdd). This may occur before transistor 406 transfers the charge generated by photodiode 402 to floating diffusion region 408, and may reset any noise and/or previously stored signals on floating diffusion region 408. The reset level voltage may also be conveyed onto column line 416 via transistor 410 and 412 during a readout operation as a reset level signal. By reading out (e.g., sampling) the reset level signal before reading out (e.g., sampling) the image level signal, the corresponding readout circuitry coupled to pixel 204 may perform a correlated double sampling (CDS) readout operation of the image level signal based on the reset level signal. If desired, transistor 418 may be used (in combination with transistor 406) to reset photosensitive element 402.
The configuration of pixel 204 in
In order to provide image sensor 106 (e.g., in
In particular, readout circuitry 310 in
As shown in
Similarly, pixel 204-2 may include source follower transistor 410-2 and row select switch 412-2 (e.g., implemented as a row select transistor in
As shown in
As shown in
Amplifier circuitry 510 may have an output terminal that supplies amplifier output signal VOUT. The second input terminal of amplifier circuitry 510 may be coupled to the output terminal of amplifier circuitry 510 via multiple parallel paths. Reset switch 516 may couple the second input terminal of amplifier circuitry 510 to the output terminal of amplifier circuitry 510 via a first one of the parallel paths. Feedback capacitor 512-1 and feedback switch 514-1, which are connected in series, may couple the second input terminal of amplifier circuitry 510 to the output terminal of amplifier circuitry 510 via a second one of the parallel paths. Feedback capacitor 512-2 and feedback switch 514-2, which are connected in series, may couple the second input terminal of amplifier circuitry 510 to the output terminal of amplifier circuitry 510 via a third one of the parallel paths.
Similar to the analog memory circuits formed from the input capacitor and switch combination, analog memory circuits may also be formed from the feedback capacitor and switch combination. In particular, switch 514-1 and capacitor 512-1 may serve as a feedback analog memory circuit for pixel 204-1 and other pixels in the same column or array portion coupled to column line 416-1. As an example, for providing feedback capacitor 512-1 to amplify the input signals from pixel 204-1 and from these other pixels coupled to column line 416-1, switch 512-1 may be closed while switch 512-2 may be opened. Switch 514-2 and capacitor 512-2 may serve as a feedback analog memory circuit for pixel 204-2 and other pixels in the same column or array portion coupled to column line 416-2. As an example, for providing feedback capacitor 512-2 to amplify the input signals from pixel 204-2 and from these other pixels coupled to column line 416-2, switch 512-2 may be closed while switch 512-1 may be opened.
In the example of
At step 602, the control circuitry may control the readout circuitry to perform a readout operation for a shared reset level voltage from two or more pixels in corresponding different columns of an array (or sub-array). In particular, step 602 may further include exemplary steps 604, 606, and 608.
At step 604, the control circuitry may control the readout circuitry to close all input switches, a reset switch, and all feedback switches for amplifier circuitry in the readout circuitry. As an example, the control circuitry may assert control signals Sel1, Sel2, Sres, Sfb1, and Sfb2 to close switches 506-1, 506-2, 516, 514-1, and 514-2 for amplifier circuitry 510 of
At step 606, the readout circuitry to receive reset level signals from the two or more pixels over corresponding column lines. As an example, the control circuitry (e.g., row control circuitry 206 in
At step 608, the control circuitry may control the readout circuitry to open the reset switch, and downstream circuitry (e.g., analog-to-digital converter (ADC) circuitry) may sample an output of the amplifier circuitry as a reset level signal for the two or more pixels. As an example, the control circuitry may deassert control signal Sres to open switch 516 for amplifier circuitry 510 in
At step 610, the control circuitry may control the readout circuitry to perform a correlated double sampling readout operation for a first pixel in the two or more pixels (based on the shared reset level voltage read out in step 602). In particular, step 610 may further include exemplary steps 612, 614, and 616.
At step 612, the control circuitry may control the readout circuitry to keep the reset switch opened, to open all the input switches, and to keep the feedback switch for the first pixel closed and open any other feedback switches. As an example, the control circuitry may deassert control signals Sres, Sel1, Sel2, and Sfb2 to keep reset switch 516 in an open state and to open switches 506-1, 506-2, and 514-2 for amplifier circuitry 510 in
At step 614, the control circuitry may control the readout circuitry to close the input switch for the first pixel, and the readout circuitry may receive an image level signal from the first pixel over a first column line. As an example, the control circuitry (e.g., row control circuitry 206 in
At step 616, downstream circuitry (e.g., ADC circuitry) may sample the output of the amplifier circuitry as an image level signal for the first pixel. As an example, the output signal VOUT for amplifier circuitry 510 in
At step 618, the control circuitry may control the readout circuitry to perform a correlated double sampling readout operation for a second pixel in the two or more pixels (based on the shared reset level voltage read out in step 602). In particular, step 618 may further include exemplary steps 620, 622, 624, and 626.
At step 620, the control circuitry may control the readout circuitry to open the input and feedback switches for the first pixel, and close and subsequently (re-)open the reset switch. As an example, the control circuitry may deassert control signals Sel1 and Sfb1 to open input switch 506-1 and feedback switch 514-1 for pixel 204-1. The control circuitry may then assert signal Sres to briefly close reset switch 516 and subsequently deassert signal Sres to re-open reset switch 516, thereby resetting the input and output terminals of amplifier circuitry 510 in
At step 622, the control circuitry may control the readout circuitry to keep the reset switch opened, to open all the input switches, and to close the feedback switch for the second pixel and open any other feedback switches. As an example, the control circuitry may deassert control signals Sres, Sel1, Sel2, and Sfb1 to keep reset switch 516 in an open state and to open switches 506-1, 506-2, and 514-1 for amplifier circuitry 510 in
At step 624, the control circuitry may control the readout circuitry to close the input switch for the second pixel, and the readout circuitry may receive an image level signal from the second pixel over a second column line. As an example, the control circuitry may assert control signal Sel2 to close switch 506-2 for pixel 204-2 in
At step 626, downstream circuitry (e.g., ADC circuitry) may sample the output of the amplifier circuitry as an image level signal for the second pixel. As an example, the output signal VOUT for amplifier circuitry 510 in
Optionally, at step 628, the control circuitry may control the readout circuitry to perform any additional correlated double sampling readout operations for any additional pixels in the two or more pixels (e.g., in scenarios where three or more column lines are coupled to the same shared readout circuitry or to the same shared amplifier circuitry). In the exemplary configuration of
Various embodiments have been described illustrating image sensors having column readout circuitry shared between different pixel columns.
In various embodiments of the present invention, an image sensor may include image sensor pixels arranged in columns and rows, a first set of image sensor pixels being coupled to a first column line and a second set of image sensor pixels being coupled to a second column line. The image sensor may also include column readout circuitry having amplifier circuitry. The first column line may be coupled to an input terminal of the amplifier circuitry and the second column line may be coupled the input terminal of the amplifier circuitry. The first column line may be coupled to the input terminal of the amplifier circuitry via a first analog memory circuit, and the second column line may be coupled to the input terminal of the amplifier circuitry via a second analog memory circuit. The first analog memory circuit may include a first switch connected in series with a first input capacitor for the amplifier circuitry, and the second analog memory circuit may include a second switch connected in series with a second input capacitor for the amplifier circuitry. The amplifier circuitry may include an output terminal, and a feedback capacitor couples the input terminal of the amplifier circuitry to the output terminal of the amplifier circuitry. The feedback capacitor and a switch may be connected in series to form a third analog memory circuit coupling the input terminal of the amplifier circuitry to the output terminal of the amplifier circuitry. An additional feedback capacitor and an additional switch may be connected in series to form a fourth analog memory circuit coupling the input terminal of the amplifier circuitry to the output terminal of the amplifier circuitry. The amplifier circuitry may include an additional input terminal configured to receive a reference voltage. A reset switch may couple the input terminal of the amplifier circuitry to the output terminal of the amplifier circuitry. The reset switch, the third analog memory circuit, and the fourth memory analog circuit may be connected in parallel along three different paths between the input terminal of the amplifier circuitry and the output terminal of the amplifier circuitry. The first and third analog memory circuits may be configured to store and amplify signals associated with the first set of image sensor pixels, and the second and fourth analog memory circuits may be configured to store and amplify signals associated with the second set of image sensor pixels.
In various embodiments of the present invention, an image sensor may include an image sensor pixel array having a first column of pixels coupled to a first readout path and a second column of pixels coupled to a second readout path, amplifier circuitry having an input terminal, and first and second capacitors coupled to the input terminal of the amplifier circuitry. The first readout path may be coupled to the input terminal of the amplifier circuitry via the first capacitor and a first switch, and the second readout path may be coupled to input terminal of the amplifier circuitry via the second capacitor and a second switch. The amplifier circuitry may have an output terminal, the input terminal of the amplifier circuitry may be coupled to the output terminal of the amplifier circuitry via a third capacitor and a third switch along a first path, and the input terminal of the amplifier circuitry may be coupled to the output terminal of the amplifier circuitry via a fourth capacitor and a fourth switch along a second path. The image sensor pixel array may include additional columns of pixels, each coupled to a corresponding readout path, and every pair of columns in the additional columns of pixels may be coupled to corresponding shared amplifier circuitry.
In some embodiments, the image sensor pixel array may be split into upper and lower sub-arrays, and the first and second columns of pixels are formed in the upper sub-array.
In some embodiments, the image sensor pixel array may be split into upper and lower sub-arrays, and the first and second columns of pixels are formed in the lower sub-array. Third and fourth columns of pixels in the upper sub-array may be coupled to an input terminal at additional amplifier circuitry via third and fourth respective readout paths.
In various embodiments of the present invention, an imaging system may include an array of image sensor pixels, shared readout circuitry coupled to a first pixel in a first column of the array and coupled to a second pixel in a second column of the array, and control circuitry configured to control the shared readout circuitry to perform a shared reset level readout operation for the first and second pixels. the control circuitry may be configured to control the readout circuitry to perform a correlated double sampling readout operation for the first pixel and to control the readout circuitry to perform a correlated double sampling readout operation for the second pixel. The shared readout circuitry may include amplifier circuitry coupled to the first pixel via a first analog memory circuit and coupled to the second pixel via a second analog memory circuit. The first and second analog memory circuits may be configured to store a reset level voltage during the shared reset level readout operation. The second analog memory circuit may be configured to store the reset level voltage while the readout circuitry performs the correlated double sampling readout operation for the first pixel. The readout circuitry may include first and second feedback capacitors for the amplifier circuitry. The first feedback capacitor may be useable during the correlated double sampling readout operation for the first pixel, and the second feedback capacitor may be useable during the correlated double sampling readout operation for the second pixel.
The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.