1. Field of the Invention
The subject matter disclosed generally relates to structures and methods for fabricating solid state image sensors.
2. Background Information
Photographic equipment such as digital cameras and digital camcorders contain electronic image sensors that capture light for processing into a still or video image, respectively. There are two primary types of electronic image sensors, charge coupled devices (CCDs) and complimentary metal oxide semiconductor (CMOS) sensors. CCD image sensors have relatively high signal to noise ratios (SNR) that provide quality images. Additionally, CCDs can be fabricated to have pixel arrays that are relatively small while conforming with most camera and video resolution requirements. A pixel is the smallest discrete element of an image. For these reasons, CCDs are used in most commercially available cameras and camcorders.
CMOS image sensors are faster and consume less power than CCD devices. Additionally, CMOS fabrication processes are used to make many types of integrated circuits. Consequently, there is a greater abundance of manufacturing capacity for CMOS image sensors than CCD sensors. A conventional drawback of CMOS image sensors is the reset noise in image signals from the pixel. The reset noise is caused by thermal noise in a reset transistor being switched off, thus instantaneously sampling the thermal noise onto an internal sensing node of the pixel. Conventional approaches to attenuate the reset noise in CMOS image sensor pixel introduces more devices such as transistors and/or capacitors into each pixel, which makes the pixel larger and therefore is not suitable for multi-millions of pixels.
An image sensor that has one or more pixels within a pixel array coupled to a control circuit and to one or more subtraction circuits. The control circuit may cause each pixel to provide a first reference output signal and a reset output signal and may then cause each pixel to provide a light response output signal and a second reference output signal. The light response output signal corresponds to the image that is to be captured by the sensor. The subtraction circuit may provide a difference between the reset output signal and the first reference output signal to create a noise signal, and may provide a difference between the second reference output signal and the light response output signal to create a normalized light response output signal. The noise signal may then be subtracted from the normalized light response output signal to generate the a image signal having reset noise cancelled therefrom.
The second reference signal may be different from the first reference signal. In particular, the second reference signal may differ from the first reference signal in the same direction as the reset output signal is from the first reference output signal. This has a beneficial effect of reducing a DC offset in the normalized light response signal.
The subtraction circuit may employ an analog DC cancellation to remove a DC offset in the noise signal. The analog DC cancellation may comprise one or more of the following: (a) a difference of voltage level in a GND1 signal between when the subtraction circuit receives the first reference output signal and when the subtraction circuit receives the reset output signal, (b) a pair of feedback capacitors (between differential inputs and outputs of an amplifier) being charged to a differential voltage level that corresponds to a negative value, and (c) a pair of capacitors precharged to a non-zero differential voltage and subsequently discharged into the pair of feedback capacitors. Other conventional analog DC cancellation methods may be employed.
The control circuit may cause a sensing node of each pixel to have a change in its voltage level to a springboard level after the pixel outputs the first reference output signal and immediately before the pixel outputs the reset output signal, the change being of such direction and magnitude that a DC offset between the first reference output signal and the reset output signal becomes less. In particular, the change may be an increase if the reset transistor is an NFET. Furthermore, the magnitude is preferably such that the difference between the first reference output signal and the reset output signal has a magnitude less than 50 mV.
Disclosed is an image sensor within a pixel array. The pixel array may be coupled to a control circuit and subtraction circuits. The control circuit may cause each pixel to provide a first reference output signal and a reset output signal. The control circuit may then cause each pixel to provide a light response output signal and a second reference output signal. The light response output signal corresponds to the image that is to be captured by the sensor.
The subtraction circuit may provide a difference between the reset output signal and the first reference output signal to create a noise signal that is stored in an external memory. The subtraction circuit may also provide a difference between the light response output signal and the second reference output signal to create a normalized light response output signal. The noise signal is retrieved from memory and combined with the normalized light response output signal to generate the output data of the sensor. The image sensor contains image buffers that allow the noise signal to be stored and then retrieved from memory for the subtraction process. The image sensor may further have a memory controller and/or a data interface that transfers the data to an external device in an interleaving manner.
The pixel may be a three transistor structure that minimizes the pixel pitch of the image sensor. The entire image sensor is preferably constructed with CMOS fabrication processes and circuits. The CMOS image sensor has the characteristics of being high speed, low power consumption, small pixel pitch and a high SNR.
Referring to the drawings more particularly by reference numbers,
The pixel array 12 is coupled to a light reader circuit 16 by a bus 18 and to a row decoder 20 by control lines 22. The row decoder 20 can select an individual row of the pixel array 12. The light reader 16 can then read specific discrete columns within the selected row. Together, the row decoder 20 and the light reader 16 allow for the reading of an individual pixel 14 in the array 12.
The light reader 16 may be coupled to an analog to digital converter 24 (ADC) by output line(s) 26. The ADC 24 generates a digital bit string that corresponds to the amplitude of the signal provided by the light reader 16 and the selected pixels 14.
The ADC 24 is coupled to a pair of first image buffers 28 and 30, and a pair of second image buffers 32 and 34 by lines 36 and switches 38, 40 and 42 . The first image buffers 28 and 30 are coupled to a memory controller 44 by lines 46 and a switch 48. The memory controller 44 can more generally be referred to as a data interface. The second image buffers 32 and 34 are coupled to a data combiner 50 by lines 52 and a switch 54. The memory controller 44 and data combiner 50 are connected to a read back buffer 56 by lines 58 and 60, respectively. The output of the read back buffer 56 is connected to the controller 44 by line 62. The data combiner 50 is connected to the memory controller 44 by line 64. Additionally, the controller 44 is connected to the ADC 24 by line 66.
The memory controller 44 is coupled to an external bus 68 by a controller bus 70. The external bus 68 is coupled to an external processor 72 and external memory 74. The bus 70, processor 72 and memory 74 are typically found in existing digital cameras, cameras and cell phones.
To capture a still picture image, the light reader 16 retrieves a first image of the picture from the pixel array 12 line by line. The switch 38 is in a state that connects the ADC 24 to the first image buffers 28 and 30. Switches 40 and 48 are set so that data is entering one buffer 28 or 30 and being retrieved from the other buffer 30 or 28 by the memory controller 44. For example, the second line of the pixel may be stored in buffer 30 while the first line of pixel data is being retrieved from buffer 28 by the memory controller 44 and stored in the external memory 74.
When the first line of the second image of the picture is available the switch 38 is selected to alternately store first image data and second image data in the first 28 and 30, and second 32 and 34 image buffers, respectively. Switches 48 and 54 may be selected to alternatively store first and second image data into the external memory 74 in an interleaving manner. This process is depicted in
There are multiple methods for retrieving and combining the first and second image data. As shown in
In the event the processor data rate is the same as the memory data rate the processor 72 may directly retrieve the pixel data rate from the external memory 74 in either an interleaving or concatenating manner as shown in
To capture a video picture, the lines of pixel data of the first image of the picture may be stored in the external memory 74. When the first line of the second image of the picture is available, the first line of the first image is retrieved from memory 74 at the memory data rate and combined in the data combiner 50 as shown in
For video capture the buffers 28, 30, 32 and 34 may perform a resolution conversion of the incoming pixel data.
There are two common video standards NTSC and PAL. NTSC requires 480 horizontal lines. PAL requires 590 horizontal lines. To provide high still image resolution the pixel array 12 may contain up to 1500 horizontal lines. The image sensor converts the output data into a standard format.
Converting resolution onboard the image sensor reduces the overhead on the processor 72.
To conserve energy the memory controller 44 may power down the external memory 74 when memory is not receiving or transmitting data. To achieve this function the controller 44 may have a power control pin 76 connected to the CKE pin of a SDRAM (see
The gate of reset transistor 112 may be connected to a RST line 118. The drain node of the transistor 112 may be connected to IN line 120. The gate of select transistor 114 may be connected to a SEL line 122. The source node of transistor 114 may be connected to an OUT line 124. The RST 118 and SEL lines 122 may be common for an entire row of pixels in the pixel array 12. Likewise, the IN 120 and OUT 124 lines may be common for an entire column of pixels in the pixel array 12. The RST line 118 and SEL line 122 are connected to the row decoder 20 and are part of the control lines 22.
The IN line 120 may be driven by a supply driver 17. Supply driver 17 can be programmed to drive one of a number of voltage levels. By way of example, the supply driver 17 may drive up to four difference voltage levels, in increasing order, 0 volt, VPH2, VPH1 and VPH0, selectable by signal DIN(1:0) value of 00, 01, 10 and 11, respectively. For example, VPH2 may be 2.3 volts, VPH1 2.5 volts and VPH0 2.7 volts.
The double sampling circuits 150 are connected to an operational amplifier 180 by a plurality of first switches 182 and a plurality of second switches 184. The amplifier 180 has a negative terminal−coupled to the first capacitors 152 by the first switches 182 and a positive terminal+coupled to the second capacitors 154 by the second switches 184. The operational amplifier 180 has a positive output+connected to an output line OP 188 and a negative output−connected to an output line OM 186. The output lines 186 and 188 are connected to the ADC 24 (see
The operational amplifier 180 provides an amplified signal that is the difference between the voltage stored in the first capacitor 152 and the voltage stored in the second capacitor 154 of a sampling circuit 150 connected to the amplifier 180. The gain of the amplifier 180 can be varied by adjusting the variable capacitors 190. The variable capacitors 190 may be discharged by closing a pair of switches 192. The switches 192 may be connected to a corresponding control line (not shown). Although a single amplifier is shown and described, it is to be understood that more than one amplifier can be used in the light reader circuit 16.
The RST line 118 may be connected to a tri-state buffer (not shown) that is switched to a tri-state when the IN line 120 is switched to a high state. This allows the gate voltage to float to a value that is higher than the voltage on the IN line 120. This maintains the reset transistor 112 in the triode region. Generating a higher gate voltage allows the photodetector to be reset at a level close to a supply voltage on the image sensor.
The SEL line 122 is also switched to a high voltage level which turns on select transistor 114. The voltage of the photodiode 100 is provided to the OUT line 124 through level shifter transistor 116 and select transistor 114. The SAM1 control line 166 of the light reader 16 (see
Referring to
The SAM2 line 168 is driven high, the SEL line 122 is driven low and then high again, so that a level-shifted voltage of the photodiode 100 is stored as a reset output signal in the second capacitor 154 of the light reader circuit 16. Process blocks 300 and 302 are repeated for each pixel 14 in the array 12.
Referring to
Referring to
Referring to
Referring to
Referring to
The process described is performed in a sequence across the various rows of the pixels in the pixel array 12. As shown in
The various control signals RST, SEL, DIN(1:0), SAM1, SAM2 and SUB can be generated in the circuit generally referred to as the row decoder 20.
The comparators 350 are connected to plurality of AND gates 356 and OR gates 358. The OR gates 358 are connected to latches 360. The latches 360 provide the corresponding DIN(1:0), SEL, SAM1, SAM2 and RST signals. The AND gates 356 are also connected to a mode line 364. To operate in accordance with the timing diagram shown in
The latches 360 switch between a logic 0 and a logic 1 in accordance with the logic established by the AND gates 356, OR gates 358, comparators 350 and the present count of the counter 352. For example, the hardwired signals for the comparator coupled to the DIN(1) latch may contain a count values of 6 and a count value of 1024. If the count from the counter is greater or equal to 6 but less than 1024 the comparator 350 will provide a logic 1 that will cause the DIN(1) latch 360 to output a logic 1. The lower and upper count values establish the sequence and duration of the pulses shown in
The sensor 10 may have a plurality of reset RST(n) drivers 370, each driver 370 being connected to a row of pixels.
The third method essentially uses a technique of analog offset cancellation in the light reader 16. Different variations on analog offset cancellation are possible, as is known in the art. In one alternative, instead of varying the GND1 signal 156, a pair of cancelling capacitors (not shown) may be connected to the “+” and “−” inputs of the amplifier 180 to perform the analog offset cancellation. These cancelling capacitors can be charged to given voltages, their capacitances may be the same as sampling capacitors 152, 154 or different. Each time a sampling circuit 150 of the light reader 16 is connected to the amplifier 180 to transfer charges, the cancelling capacitors are also charged to the given voltages and subsequently connected to transfer charges to the feedback capacitors 190 to effect the offset cancellation.
Yet another technique is to precharge the feedback capacitors 190 to a suitable differential voltage (hereinafter “precharge voltage”) prior to each transfer of charges from a sampling circuit 150. The precharge voltage has an opposite direction than the reset offset in the sense that the precharge voltage partially cancels an output change of the amplifier 180 due to the reset offset. The precharge voltage may be increased in magnitude for an increase in gain of the amplifier 270 (i.e. the amplifier 180 together with the feedback capacitors 190) when the feedback capacitors 190 take a smaller capacitance value.
It is the intention of the inventor that only claims which contain the term “means” shall be construed under 35 U.S.C. §112, sixth paragraph.
While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention not be limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art.
For example, one or more of the first, second and third methods may be used in conjunction to achieve lesser DC offset in the noise signal and/or in the normalized light response output signal.
For example, to reduce DC offset in the normalized light response output signal, the second reference level is different than the first reference level and/or the GND1 level upon sampling the second reference output signal is different from the GND1 level upon sampling the light response output signal level (or any analog offset cancellation method deployed in the light reader 16) and/or the springboard level is driven onto the photodiode between the first reference level and the reset level. Preferably, one of these alone or two or more of these together are selected to be such that the differential output of the amplifier 270 changes less than 200 mV at a gain above 4 under a condition that the pixel is not exposed to light and exposure time is less than 10 ms. Alternatively, the voltage across the capacitor that samples and stores the light response output signal should be within 50 mV of the voltage across the capacitor that samples and stores the second reference output signal under this condition.
For example, although interleaving techniques involving entire lines of an image are shown and described, it is to be understood that the data may be interleaved in a manner that involves less than a full line, or more than one line. By way of example, one-half of the first line of image A may be transferred, followed by one-half of the first line of image B, followed by the second-half of the first line of image A, and so forth and so on. Likewise, the first two lines of image A may be transferred, followed by the first two lines of image B, followed by the third and fourth lines of image A, and so forth and so on.
This application claims priority to U.S. Provisional Patent Application No. 61/260,609 filed on Nov. 12, 2009. This application is also a continuation-in-part of U.S. patent application Ser. No. 12/534,874 filed on Aug. 4, 2009, which is a continuation of U.S. patent application Ser. No. 10/868,407 filed on Jun. 14, 2004, now U.S. Pat. No. 7,612,817, which is a continuation of U.S. patent application Ser. No. 10/183,218 filed on Jun. 26, 2002, now U.S. Pat. No. 6,795,117, which claims priority to U.S. Provisional Patent Application No. 60/345,672 filed on Jan. 5, 2002, to U.S. Provisional Patent Application No. 60/338,465 filed on Dec. 3, 2001, and to U.S. Provisional Patent Application No. 60/333,216 filed on Nov. 6, 2001. This application is also a continuation-in-part of U.S. patent application Ser. No. 11/800,346 filed on May 4, 2007, which is a division of U.S. patent application Ser. No. 10/236,515 filed on Sep. 6, 2002, now U.S. Pat. No. 7,233,350, which claims priority to U.S. Provisional Patent Application No. 60/345,672 filed on Jan. 5, 2002 and to U.S. Provisional Patent Application No. 60/358,611 filed on Feb. 21, 2002.
Number | Date | Country | |
---|---|---|---|
61260609 | Nov 2009 | US | |
60345672 | Jan 2002 | US | |
60338465 | Dec 2001 | US | |
60333216 | Nov 2001 | US | |
60345672 | Jan 2002 | US | |
60358611 | Feb 2002 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10236515 | Sep 2002 | US |
Child | 11800346 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10868407 | Jun 2004 | US |
Child | 12534874 | US | |
Parent | 10183218 | Jun 2002 | US |
Child | 10868407 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12534874 | Aug 2009 | US |
Child | 12945182 | US | |
Parent | 11800346 | May 2007 | US |
Child | 10183218 | US |