FOCAL PLANE AVERAGING IMPLEMENTATION FOR CMOS IMAGING ARRAYS USING A SPLIT PHOTODIODE ARCHITECTURE

Abstract

A photosensor structure including pixel areas. Each pixel area represents an electrical pixel. The photosensor structure also has a predetermined number of quadrants. Each is positioned in a corner of one of the pixel areas. Each quadrant belongs to different optical pixels.

Description

BACKGROUND OF THE INVENTION

[0001] (1) Field of the Invention

[0002] The present invention is related to complementary metal oxide semiconductor (CMOS) photodiodes and photogates, more specifically, the method and apparatus of the present invention is related to a focal plane averaging implementation for CMOS imaging arrays.

[0003] (2) Background

[0004] The capture of image data using CMOS imaging devices is typically achieved with arrays of picture sensing elements or pixels, where each pixel consists of a photodiode or a photogate, a charge storage capacitance, exposure time control elements and read out devices. A photodiode (or a photogate) is a semiconductor device that produces significant photocurrent when illuminated. A photocurrent is an electric current produced in a device by the effect of incident electromagnetic radiation in the visual frequencies. An image focused on an array of pixels excites the photosensors within pixels of the array differently resulting in different charge and corresponding signal values directly related to the quantum of energy incident upon the pixels.

[0005] The registration of images through a semiconductor imaging array is associated with numerous noise components, such as reset noise, read noise, shot noise and fixed pattern noise, many of which are eliminated by known architectural and circuit techniques, such as correlated double sampling and delta double sampling. Noise may also be eliminated by using system level solutions such as dark frame subtraction.

[0006] Noise includes undesired electrical signals that occur within electronic or electrical devices, circuits, or apparatus and that result in changes in the values obtained. Noise components in electronic image capture which are not eliminated despite the implementation of the techniques mentioned, include flicker or 1/f noise in an output chain, thermal (kT/C) noise, A/D (analog-to-digital) quantization noise and photon/dark shot noise.

[0007] Flicker noise, also known as low frequency or excess noise, is a noise component with a spectral density which increases as frequency decreases, and is in excess of the thermal and the shot noise components within semiconductor components. Flicker noise has a Gaussian Probability Density Function (PDF) and its spectral density is known to be proportional to the electrical current passing through the device in consideration and inversely proportional to the frequency.

[0008] Thermal noise, also known as Johnson or Nyquist noise, induces a fluctuating potential difference across the ends of any conductor that is caused by the random, thermally induced motion of electrons within the conductor. The spectral density of this noise component, which also has a Gaussian PDF as anticipated for a phenomenon that results from a large number of random events, is proportional to the electrical resistance and the bandwidth of the conductor.

[0009] Shot noise in semiconductor devices results from the passage of charged carriers across a semiconductor junction associated with a potential barrier. Shot noise, by definition, is noise caused by the random passage of carriers across a potential barrier and the spectral density of the shot noise is directly proportional to the average electrical current flowing through the potential barrier. Shot noise exhibits itself as a fluctuating emf whose mean square value is proportional to the average current flow.

[0010] All noise sources in a CMOS imaging array results in a significant pixel to pixel variation in the value registered when the imaging array is exposed to a uniform field of elimination. At very low light levels dark shot noise is seen to be the dominant noise component that results in a grainy resultant image, particularly in imaging arrays where dark current is a significant value within the pixels. Dark shot noise is the random component associated with dark current, which is the leakage current from the pixel storage node in the dark.

[0011] Other noise components not eliminated by traditional architectural techniques act incrementally to reduce the signal to noise ratio (SNR) in low light imaging using CMOS sensors. Examples of effects that degrade SNR and are not removed despite minimization architectures include reset noise and photo response non-uniformity on a photosensor layer. More specifically, reset noise is a random variation in the “RESET” value within a pixel that is not removed due to the implementation of a time uncorrelated reset operation between the full array reset and the readout reset phases. Photo response non-uniformity is the non-uniformity in the response of the pixels of the imaging array to a uniform field of illumination and is a consequence of processing/manufacturing imperfections.

[0012] A typical photodiode-based pixel layout on a standard CMOS process has the advantage that space within the pixel is optimally utilized. However, the structure has disadvantages in that each pixel's photodiode is placed right next to circuitry within adjacent pixels and hence is susceptible to cross-talk, which could be signal dependent, as well as of a fixed nature. The photodiodes are also separated from each other by the pixel pitch and are therefore susceptible in terms of adjacent pixel variability in dark/photo response. The photodiodes are also susceptible to semi-conductor processing related variations, which could have spatial frequencies comparable to the pixel pitch.

[0013] It is desirable to have a method and apparatus on CMOS photodiode/photogate based imaging integrated circuits with multiple metal layers for achieving focal plane averaging, which has associated advantages in the signal to noise ratio (SNR).

BRIEF SUMMARY OF THE INVENTION

[0014] A photosensor structure including pixel areas. Each pixel area represents an electrical pixel. The photosensor structure also has a predetermined number of quadrants. Each is positioned in a corner of one of the pixel areas. Each quadrant belongs to different optical pixels.

BRIEF DESCRIPTION OF THE DRAWINGS

[0015] FIG. 1 a is an exemplary block diagram with a CMOS imaging device implemented with the present invention's split photo-diode architecture.

[0016] FIG. 1 b illustrates an embodiment of the split-photodiode pixel structure of the present invention.

[0017] FIG. 2 illustrates an exemplary schematic of a split photodiode pixel.

[0018] FIG. 3 illustrates an exemplary SNR improvement estimate.

DETAILED DESCRIPTION OF THE INVENTION

[0019] The present invention is a novel method for use with semiconductor photodiode/photogate based imaging integrated circuits with multiple metal layers for achieving focal plane averaging, which has associated advantages in signal to noise ratio (SNR). The present invention realizes fragmentation of pixel structure and interconnection of fragmented pieces in a fashion which achieves focal plane averaging.

[0020] FIG. 1 a is an exemplary system block diagram with a CMOS imaging device implemented with the present invention's split photo diode architecture. An exemplary CMOS imaging device 11 residing in a digital image capture device such as a digital camera 10 is implemented with CMOS imaging arrays 12.

[0021] The CMOS imaging arrays 12 is implemented in the present invention's split photo diode architecture and is configured to read images in response to a collection of light reflected off photosensors (photodiodes) 14 located on the CMOS imaging arrays 12. The image read off the CMOS imaging arrays 12 cause electrons on the photosensors (photodiodes) 14 to be converted to a series of analog charges which are then converted to digital values by an analog-to-digital converter 16. An averaging logic 17 generates pixel values by performing focal plane averaging on the photo response of predetermined optical pixels. The resulting digital values are then interpolated into full color values by an interpolater 18 and compressed by a compression unit 20.

[0022] The compressed data may then be decompressed by a decompression unit 22 on a computer 24 and the image captured may then be caused to display on a display device (not shown) through a rendering unit 26.

[0023] The CMOS imaging arrays 12 is implemented with the present invention's split photo diode architecture with multiple metal layers for achieving focal plane averaging which has associated advantages in the signal to noise ratio (SNR).

[0024] FIG. 1 b illustrates an exemplary split-photodiode (photosensor) pixel structure of the present invention. The split-photodiode structure of the present invention segments a single large photodiode 100 into four pieces with each piece positioned in a corner of a corresponding pixel area 101. Such configuration allows for the placement of all the circuitry associated with the pixel in the central space between the photodiodes, and positions the quadrants 104 of the photodiodes of the adjacent pixels very close to each other.

[0025] The connectivity to the devices that are located within the pixels are achieved through metal lines 102 which lie along the central axes of the pixels, hence forming optical windows which optically separate the four quadrants 104 of an electrical pixel. The optical array 110 (array of windows formed of the spaces separated by the metal lines) is therefore shifted spatially, both along the horizontal axis 107 and the vertical axis 108 of the imaging array 12, by a distance of approximately half the pixel pitch with respect to the electrical pixels. The electrical pixels are formed by the four quadrants (e.g. quadrants 104) located in the four corners of the pixel area (e.g. pixel area 101) connected electrically to each other.

[0026] The dotted lines bound electrical pixels or structures electrically connected to one another, forming a single circuit. Namely, quadrant one (Q1), quadrant two (Q2), quadrant three (Q3), and quadrant four (Q4) are the four quadrants 104 of the photodiode 100 of one electrical pixel 106, but belong to different optical pixels, as determined by the metal lines 102 that pass between them. More specifically, in the illustrated embodiment, the “optical” pixels are shifted spatially with regard to the “electrical” pixels. Quadrants Q1, Q2, Q3,and Q4 form the “electrical” pixel, whereas Quadrants Q4, Q11, Q6, and Q13 form an “optical” pixel in the invention. This is in contrast to prior art designs where the “optical” and “electrical” pixels are one and the same.

[0027] Assuming that the quadrants Q1, Q2, Q3 and Q4 belong to pixel P(x,y), where “x” and “y” are the horizontal and vertical indices, the value of pixel P(x,y) is provided by P(x,y)=[P(x−½, y−½)+P(x−½, y+½)+P(x+½, y+½)+P(x+½, y−½)]/4). P(x−½, y−½) here represents the photo-response of the optical pixel that quadrant Q3 of P(x,y) belongs to. P(x−½, y+½) represents the photo-response of the optical pixel that quadrant Q1 belongs to. P(x+½, y+½) represents the photo-response of the optical pixel that Q2 belongs to. P(x+½, y−½)] represents the photo-response of the optical pixel (namely Q4, Q11, Q6 and Q13) that quadrant Q4 belongs to P(x,y) is therefore the average value of the photo-response of the four “optical” pixels to which each of the quadrants Q1, Q2, Q3 and Q4 belongs to.

[0028] If there is noise, the noise introduces a variance between the values registered by the “optical” pixels despite a uniform field of incident illumination. This noise is minimized by the separation of the optical and electrical pixels in the illustrated split-photodiode pixel structure of the present invention, and by the averaging of the four optical pixel values as represented by P(x,y) as was described above.

[0029] FIG. 2 illustrates one embodiment of a split photodiode (photosensor) pixel design based on the present invention's split-photodiode pixel structure illustrated in FIG. 1a. In FIG. 2, an active pixel with a photodiode based architecture is illustrated with an array of photodiodes 200 representing the split photodiode of the present invention. Each photodiode in the array of photodiodes 200 corresponds to one of the four quadrants (e.g. Q1-Q2-Q3-Q4 quadrants 104) referenced in FIG. 1a in a photo-sensing device inside a pixel.

[0030] A device which connects to the VCC 210 is referred to as a source follower 211. The source follower 211 is an amplifier configuration and allows the development of a voltage on the bit line 208 corresponding to the voltage on the storage node 203. The storage node 203 is the gate of a device capacitance 204. “Sample” (signal) 212 is an electronic shutter control that bridges the photodiodes 200 and the storage node 203. “Row” (signal) 213 enables the read-out of the signal through the bit line 208.

[0031] In the exemplary embodiment, a certain amount of charge is stored inside a pixel which is transmitted into the pixel through a reset transistor 202. The charge stored is stored both on a photodiode capacitor and a gate capacitance 204. Photons 206 representing illumination striking the photodiodes 200, discharge each node together and therefore reduce the voltage on the storage node 203, which connects to the gate of the source follower device 211 which in turn connects to the bit line 208. Further, the photodiode quadrants connect electrically to each other to discharge the same storage node during photo exposure.

[0032] Although FIG. 2 is illustrated with four photodiodes 200, given the detailed description herein, a person skilled in the art may appreciate that any number of photodiodes may be added, and that the selected number of photodiodes are for illustration purposes only.

[0033] FIG. 3 illustrates exemplary SNR improvement estimates gained by the design of the present invention. For illustration, it is assumed here that all pixels are illuminated uniformly by light, the true signal level obtained is s volts and the noise content is n volts due to various sources. nr volts is the total noise content contributed by an effect dependent upon the spatial position of the pixels. In a typical pixel structure, this would result in a reduction in the total SNR.

[0034] Assuming that nr is the contribution of two adjacent rows, and that the rows on either side of the affected rows are connected to pixels and row circuitry of nominal behavior, and do not contribute to a row to row differential, the split photodiode pixel structure of the present invention reduces nr to half its value, due to averaging.

[0035] Thus, if nr were to be equal to n, and the original SNR were, for example 40 dB, the gain is approximately 2.5 dB. Further, with photoresponse variability, which has a granularity of the size of a typical pixel based on local variations of the photosensor, the split photodiode averaging effect of the present invention may reduce the photo-response variation to one-fourth the original value.

[0036] The first table 300 illustrates numbers derived from exposure of an imaging chip to a uniform field of light. The numbers as illustrated are different from each other, and this is referred to as a response non-uniformity. Some of the numbers have been removed, they are not needed for calculation in the modeling.

[0037] In the illustration, predetermined numbers are selected, for example three to four numbers, which are bracketed. The table illustrates how the numbers would be generated given the present invention's split photodiode pixel structure design. The result is the generation of numbers which are an average of their neighboring numbers. For example, given the 176 in the first table, with the present invention's photosensor design, the result would not be 176, but the average of 198, 198, 246 and 255, which are the numbers surrounding 176. The four quadrants which are closer to the four corners of the pixel senses a signal corresponding to the actual signal present in the four corners.

[0038] Thus, the bracketed numbers are raw numbers. The raw numbers are then replaced with the four quadrant averages, which is the average of the numbers surrounding the raw numbers. The process is repeated over the complete field of numbers. The result of the conversion is illustrated in the second table 301, which illustrates the signal to noise ratio (SNR) differences.

[0039] More specifically, table 301 is an embodiment of an aggregation of the results of the analysis conducted on a typical CMOS photosensor illustrating the benefits of the present invention's split photodiode pixel (fragmented photosensor) design. The analysis is conducted on a square array of pixel values at various operational settings for a given pixel (or photosensor), such as exposure (“int time”), temperature and signal amplification (“gain”). For the various operational settings, the SNR is calculated as the ratio of the mean value of the pixels in the square array to the variance, expressed in decibels.

[0040] Each number in table 301 under heading “Fragmented Pixel” (split photodiode pixel) corresponds to the SNR computed for a set of operating conditions such as gain, temperature and exposure. The numbers under the heading “SNR Advantage” are the corresponding differences in SNR, indicating improvement seen in SNR for a simulation model of the present invention's split photodiode pixel design.

[0041] What has been described is a method and apparatus for focal plane averaging implementation for CMOS imaging arrays using a split photodiode/sensor architecture. The advantages of the present invention are many, including noise reduction through simple averaging implementable at the focal plane, and reducing the computational overhead associated with software-based implementation.

[0042] Additionally, in a modified embodiment, the present invention's architecture may be utilized in the reduction of pixel to pixel non-uniformity in photosensitivity, which relates to the minimization of process-based variations, as well as minimization of architecture and timing-based differentials, which are not removed by traditional designs. Further, electrical cross-talk due to coupling effects from adjacent pixels may be reduced, since the readout circuitry is located at the center of the pixel. This improves the signal to noise ratio (SNR) of a photosensor.

[0043] While certain exemplary embodiments have been described in detail and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention is not to be limited to the specific arrangements and constructions shown and described, since various other modifications may occur to those with ordinary skill in the art.

Claims

1. A photosensor structure comprising: v a plurality of pixel areas, each said plurality of pixel areas representing one of a plurality of electrical pixels; and a set of a predetermined number of quadrants, each quadrant positioned in a corner of one of said plurality of pixel areas and belonging to different one of a plurality of optical pixels.

2. The apparatus of claim 1 further comprising a plurality of metal lines configured to lie along a central axes of a given one of said plurality of pixel areas, said plurality of metal lines forming optical windows representing said optical pixels which optically separate a given set of a predetermined number of quadrants of a given one of said plurality of pixel areas.

3. The apparatus of claim 2 wherein each said plurality of pixel areas further comprises an array of windows formed of spaces separated by said plurality of metal lines shifted spatially, both along a horizontal and a vertical axis of each said plurality of pixel area by a distance of approximately half a pixel pitch with respect to each said plurality of electrical pixels.

4. The apparatus of claim 3 wherein each said predetermined number of quadrants of each said plurality of electrical pixels belong to different one of said optical pixels as separated by said plurality of metal lines.

5. The apparatus of claim 4 comprising an averaging logic configured to average a photo-response of each of said set of a predetermined number of quadrants to generate an average value to reduce photo-response variability and noise.

6. The apparatus of claim 5 wherein said averaging logic generates said average value from averaging the photo-response of each said plurality of optical pixels to which each of said set of a predetermined number of quadrants belongs to.

7. A photosensor structure comprising: means for representing a single one of a plurality of electrical pixels; and means for positioning a set of a predetermined number of quadrants of photodiodes of adjacent one of said means for representing adjacent to each other, each quadrant in said set of predetermined number of quadrants belonging to different one of a plurality of optical pixels, said means for positioning positioned in a corner of one of a corresponding one of said means for representing.

8. The apparatus of claim 7 further comprising means configured to lie along a central axes of a given one of said means for representing, said means configured to lie along a central axes forming optical windows representing optical pixels which optically separate a given set of a predetermined number of quadrants of a given one of said means for representing.

9. The apparatus of claim 8 wherein each said means for representing further comprises an array of windows formed of the spaces separated by said means configured to lie along a central axes shifted spatially, both along the horizontal and a vertical axis of each said means for representing by a distance of approximately half a pixel pitch with respect to each said plurality of electrical pixels.

10. The apparatus of claim 9 wherein each said predetermined number of quadrants of each said plurality of electrical pixels belong to different said optical pixels as separated by said means configured to lie along a central axes.

11. The apparatus of claim 10 wherein a photo-response of each of said set of a predetermined number of quadrants is averaged to generate an average value to reduce photo-response variability and noise.

12. The apparatus of claim 11 wherein said average value is generated from averaging the photo-response of each said plurality of optical pixels to which each of said set number of quadrants belongs to.

13. An apparatus comprising: an array of photodiodes, each photodiode in said array of photodiodes corresponding with one of a predetermined number of quadrants inside a pixel; a storage node coupled to said array of photodiodes, said predetermined number of quadrants connect electrically to each other to discharge the same storage node during photo exposure; a source follower coupled to said storage node, said source follower is an amplifier configuration and allows the development of a voltage on a bit line corresponding to the voltage on said storage node; and a voltage source coupled to said source follower.

14. A system comprising: an imaging array configured to read an image and generate a plurality of analog charge values in response to said image; and an analog-to-digital converter coupled to said imaging array and configured to convert said plurality of analog charge values to corresponding digital values to be later rendered into said image for display.

15. The system of claim 14 wherein said imaging array further comprises: a plurality of pixel areas, each said plurality of pixel areas representing one of a plurality of electrical pixels; and a set of a predetermined number of quadrants, each quadrant positioned in a corner of one of said plurality of pixel areas, said set of a predetermined number of quadrants of photodiodes positioned adjacent one of said plurality of pixel areas, each quadrant belonging to different one of a plurality of optical pixels.

16. The system of claim 15 further comprising a plurality of metal lines configured to lie along a central axes of a given one of said plurality of pixel areas, said plurality of metal lines forming optical windows representing said optical pixels which optically separate a given set of a predetermined number of quadrants of a given one of said plurality of pixel areas.

17. The system of claim 16 wherein each said plurality of pixel areas further comprises an array of windows formed of spaces separated by said plurality of metal lines shifted spatially along a horizontal and a vertical axis of each said plurality of pixel area by a distance of approximately half a pixel pitch with respect to each said plurality of electrical pixels.

18. The system of claim 17 wherein each said predetermined number of quadrants of each said plurality of electrical pixels belong to different one of said optical pixels as separated by said plurality of metal lines.

19. The system of claim 18 comprising an averaging logic configured to average a photo-response of each of said set of a predetermined number of quadrants to generate an average value to reduce photo-response variability and noise.

20. The system of claim 19 wherein said averaging logic generates said average value from averaging the photo-response of each said plurality of optical pixels to which each of said set of a predetermined number of quadrants belongs to.