1. Field of the Invention
The present invention relates to digital cameras employing solid-state pixel sensors. More particularly, the present invention relates to improved sensitivity and autoexposure detection apparatus and methods for use in digital cameras.
2. The Prior Art
Storage pixel sensors are known in the art. These devices sense photo-integrated charge stored on a capacitor. A limitation of these prior pixels storage sensors is the tradeoff that results from the desire for the capacitor to be small to achieve high sensitivity and the competing desire for the capacitor to be large to provide low noise and good storage time.
Prior art exposure control techniques known to the inventors that use the actual image sensors during the actual exposure interval are of two types. Some prior art techniques integrate the total photocurrent by a common back-side electrode (anode) of a group of photodiodes—i.e., they integrate the substrate current to get an average light reading on the whole array. Other prior art techniques use nondestructive readout to sample selected pixels during the exposure interval, looking for an indication that some pixels are reaching a full-scale exposure. Another prior-art technique senses a total overflow charge from the pixel sensors.
The first technique is tricky and difficult to implement, since the photocurrents are small and the substrate is large and noisy. In addition, it responds strictly to the average light level across the image plane rather than to those pixels that are reaching a full-scale charge accumulation. The second technique requires a sequential polling, so is limited to either a very slow operation or to sensing only a very small subset of the pixels. The second technique is therefore not good for detecting the exact time when a small percentage of pixels are reaching a full-scale exposure. The third technique requires sensing of charges against a background of the total leakage of the full area of pixel sensors.
Other prior art techniques for exposure control typically measure the light either at a different time, e.g. just before the actual exposure, or with a different sensor device that needs to be calibrated relative to the sensor that is picking up the actual image. Such techniques typically sample the image plane at selected fixed points rather than adapting to the lighting conditions of the entire image.
One such prior art technique uses an imager first to estimate a light level and thereby to calculate an optimum exposure duration for a second cycle of the imager. This technique is obviously not as fast, and particularly is unsuited to controlling the exposure time rapidly during a dynamic lighting event, provided for example from a strobe flash.
Another such prior art technique employs a separate overall light sensor to measure an average light level and to react to a sufficient quantity of light by closing a shutter or quenching a strobe flash. Mechanical shutters and non-frame-storage electronic sensors cannot be shuttered rapidly enough to use this technique during a flash, which is why the detector is sometimes used to turn off the light source instead of closing a shutter. These techniques require an awkward coordination between the camera, the light sensor, and the light source, and do not necessarily track automatically the sensitivity (or film speed) and lens aperture of the camera.
Another type of prior art technique relates to use of an adjustable overflow drain for dynamic range enhancement. These techniques have not been integrated with the use of the overflow current for terminating the exposure time. Variations on this technique employ either a moving overflow barrier or a dual exposure interval to increase dynamic range.
According to a first aspect of the present invention, a MOS active storage pixel sensor disposed on a semiconductor substrate comprises a photodiode having a first terminal coupled to a first potential (ground) and a second terminal. A barrier transistor has a first terminal coupled to the second terminal of the photodiode and a second terminal coupled to a photocharge integration node comprising the control element of a first source-follower transistor. A semiconductor reset switch has a first terminal coupled to the second terminal of the barrier transistor and a second terminal coupled to a reset reference potential that reverse biases the photodiode. The first source-follower transistor is coupled to a bias current source and has an output. A bias transistor has its drain coupled to the output of the first source-follower transistor, its gate coupled to a fixed potential to establish the saturation level along with the fixed voltage on the gate of the saturation level transistor and a source coupled to a fixed voltage such as ground. A semiconductor transfer transistor has a first terminal coupled to the output of the first source-follower transistor and a second terminal connected to a capacitive storage node comprising the control element of a second source-follower transistor having an output. A row-select transistor has a first terminal coupled to the output of the second source-follower transistor, a second main terminal coupled to a column output line and a control element coupled to a row-select line. The reset transistor and the transfer transistor each have a control element coupled to a control circuit for selectively activating the reset transistor and the transfer transistor.
The separation of the photodiode from the charge integration node by the barrier transistor allows high sensitivity, and the separation of the storage node from the charge integration node by the first source-follower transistor allows low noise storage and readout by providing a smaller capacitance for the charge integration node and a larger capacitance for the storage node.
According to a second aspect of the present invention an auto-exposure circuit for use with pixel sensors is disclosed. A saturation level transistor has its source coupled to the output of the first source-follower amplifier, its gate coupled to a fixed potential chosen to turn the transistor on at a preselected pixel voltage representing a saturation level, and a common (global) current summing drain node. A bias transistor has its drain coupled to the output of the first source-follower amplifier, its gate coupled to a fixed potential to establish the saturation current and a source coupled to a fixed voltage such as ground. The global current summing node is coupled to a current comparator to compare the current flowing from the common drain node with a reference current. When the current from the global drain node exceeds the reference current, indicating that a preselected number of pixels in the array have saturated, the output of the comparator produces a TERMINATE EXPOSURE signal.
Persons of ordinary skill in the art will realize that the following description of the present invention is illustrative only and not in any way limiting. Other embodiments of the invention will readily suggest themselves to such skilled persons having the benefit of this disclosure. For example, the illustrative embodiments of the present invention are disclosed using all N-Channel MOS transistor switches, but persons of ordinary skill in the art will appreciate that other technologies could be employed as well. Such skilled persons will readily understand how to adjust the polarities of the various potentials applied to the circuits disclosed herein to implement an embodiment of the present invention employing such other technologies.
The present invention encompasses various combinations of elements in storage pixel sensors. Different embodiments of storage pixel sensors according the present invention include one or more of the following elements in combination incorporated into the pixel sensor: a barrier transistor, a bias transistor for the source-follower transistor, a saturation level transistor, and a transfer transistor. The present invention is disclosed herein with reference to
Referring first to
The cathode of photodiode 12 is coupled to a photocharge integration node 16 (represented in
The photocharge integration node 16 comprises the inherent gate capacitance of first MOS N-Channel source-follower transistor 20, having a drain connected to a voltage potential VSFD1. The voltage potential VSFD1 may be held fixed at a supply voltage V+ (which may be, for example, about 3-5 volts depending on the technology) or may be pulsed as will be disclosed further herein. The source of MOS N-Channel source-follower transistor 20 forms the output node 22 of the source-follower transistor and is coupled to the drain of MOS N-Channel bias transistor 24 operating as a current source. The source of MOS N-Channel bias transistor 24 is coupled to a fixed voltage potential such as ground. The gate of MOS N-Channel source-follower bias transistor 24 is connected to a bias voltage node. The voltage presented to the bias voltage node sets the bias current flowing through MOS N-Channel source-follower bias transistor 24. This voltage may be fixed, or, as will be disclosed further herein, may be pulsed to conserve power. The use of MOS N-Channel source-follower bias transistor 24 is optional in the present invention. As will be disclosed herein, this device is used in combination with a saturation level transistor to implement an auto-exposure detection function.
The output node 22 of the source-follower transistor is coupled to a capacitive storage node 26 (represented in
The capacitive storage node 26 comprises the inherent gate capacitance of second MOS N-Channel source-follower transistor 30, having a drain connected to a source-follower drain (SFD) potential and a source. The source of second MOS N-Channel source-follower transistor 30 is coupled to COLUMN OUTPUT line 32 through MOS N-Channel row select transistor 34. The gate of MOS N-Channel row select transistor 34 is coupled to a ROW SELECT line 36.
Second MOS N-Channel source-follower transistor 30 is preferably a large device, having its gate sized at 10 to 100 times the area of first MOS N-Channel source-follower transistor 20. The other transistors in the circuit, first MOS N-Channel source-follower transistor 20, are preferably sized to near minimum length and width.
Use of a bias transistor 24 in the storage pixel sensor of the present invention can change the operating characteristics of the pixel sensor in a beneficial way. The first source-follower is working against a controlled current source, which may be more well controlled than when working against only the capacitive load of the storage node capacitance of the second source follower transistor 30.
To increase the input-to-output voltage gain of either source follower transistor 20 or 30, it is possible to pulse its drain terminal (as disclosed in FOV-013 for the readout follower). If the drain of the first source follower transistor 20 is pulsed, current will flow only when it is high, so the pixel saturation disclosed with reference to auto-exposure circuit 40 can be monitored only while it is high. It may be advantageous to pulse drain of the first source follower transistor 20 with a low duty cycle to save power during exposure. Pulsing drain of the first source follower transistor 20 also keeps the photodiode and barrier source/drain voltages lower during the time the drain is low, which can beneficially reduce voltage-dependent leakage at those nodes. If the BARRIER and VR voltages are adjusted for proper barrier operation with the drain low, then the barrier transistor 14 will tend to turn off while the drain of the first source follower transistor 20 is pulsed, so the charge on the photodiode 12 will not be disturbed. The exposure needs to end with the drain high to capture the final state on the storage node.
Referring now to
According to a particularly advantageous operation of the storage pixels sensor of the present invention, the barrier transistor 14 and the reset transistor 18 are identically sized so as to exhibit identical voltage thresholds (Vth). The active level of the RESET signal is chosen such that VRESET<VR+Vth, to achieve better tracking of nonlinearities.
When the RESET signal is de-asserted and photointegration begins, charge accumulates on the photocharge integration node 16. Because MOS N-Channel barrier transistor 14 is barely conducting, photoinduced charge trickles across its channel and charges photocharge integration node 16 (by lowering its voltage) without lowering the voltage on the cathode of the photodiode 12. This is advantageous because it minimizes the capacitance charged by the photocurrent, thereby maximizing the sensitivity (volts per photon).
Persons of ordinary skill in the art will appreciate that the MOS N-Channel reset transistor 18 can be coupled directly to the cathode of the photodiode 12, but such an arrangement requires that the voltage VR be set precisely relative to the barrier voltage and threshold. This is not preferred since the thresholds can vary.
The voltage at the source of first MOS N-Channel source-follower transistor 20, and hence its output node 22, follows the voltage on its gate (the photocharge integration node 16). In embodiments of the present invention that employ MOS N-Channel transfer transistor 28, the XFR signal is asserted throughout the reset period and the integration period and is de-asserted to end the integration period as illustrated in FIG. 2A. The low level of the XFR signal is preferrably set to zero or a slightly negative voltage, such as about −0.2 volts, to thoroughly turn off transfer transistor 28.
To read out a pixel sensor, the SFD node at the drain of the second MOS N-Channel source-follower transistor (labeled VSFD2 in
Referring now to
In
Also shown in
Second MOS N-Channel source-follower transistor 30 is larger than first MOS N-Channel source-follower transistor 20, and its gate capacitance (the capacitive storage node 26) is therefore correspondingly larger. This provides the advantage of additional noise immunity for the pixel sensor 10 because more charge needs to be transferred to or from the capacitive storage node 26 to cause a given voltage change than is the case with the photocharge integration node 16.
The control signals depicted in
Referring again to
A saturation level transistor 42 can be used, only if the bias transistor 24 is present, to divert the bias current from saturated pixel sensors onto a global current summing line that can be monitored during exposure to determine how many pixels have reached the saturation level. External circuits can control the threshold for what is deemed saturation, and can measure the current instead of just comparing it to a threshold, so it is possible through this added transistor and global current summing line to measure how many pixel sensors have crossed any particular level. Therefore, by performing rapid variation of the threshold (SAT. LEVEL) and rapid measurement (e.g. through an A/D converter and input to a processor), it is possible to have access to a complete cumulative histogram of exposure levels during the exposure; from this information, it is possible to make more complex determinations of good exposure levels, beyond the simple threshold method used in the presently preferred embodiment.
When the bias transistor 24 is present, isolating the storage node involves timing signals to turn off both the bias transistor 24 and the first source follower 20. It is simpler, and potentially advantageous in terms of storage integrity, to include a transfer transistor 28 that can isolate the storage node under control of a single logic signal. The transfer transistor 28 can also be added to the basic circuit, even without the bias transistor, for a similar advantage, since even turning off the first source follower transistor 20 reliably involves coordinating the Reset and VR signals, which is a complexity that can be eliminated with the transfer transistor 28.
In operation, the SAT. LEVEL line 44 is driven to a voltage VSAT corresponding to a selected photocharge saturation level. Because accumulation of photocharge drives the output node 22 of the first MOS N-Channel source-follower transistor 20 downward, MOS N-Channel saturation level transistor 42 is initially turned off because its gate voltage at VSAT is lower than the voltage at node 16. MOS N-Channel saturation level transistor 42 remains off until accumulation of photocharge at photocharge integration node 16 has lowered its voltage below VSAT (and that at the source of MOS N-Channel saturation level transistor 42, common to the output node 22 of the first MOS N-Channel source-follower transistor 20, to a level one Vt below the voltage VSAT). At this point, MOS N-Channel saturation level transistor 42 turns on and starts to draw current (less than or equal to the bias current through bias transistor 24) from the global current summing node 46.
As will be appreciated by persons of ordinary skill in the art, other pixel sensors in the array will also begin to accumulate enough photocharge to turn on their MOS N-Channel saturation level transistors 42, thus drawing additional current from node 46, and further dropping the voltage on global current summing node 46. As will be appreciated by persons of ordinary skill in the art, comparator 48 may be a voltage comparator having one input coupled to global current summing node 46 and one input coupled to a voltage VTERM chosen to correspond to the voltage on global current summing node 46 when a selected number of pixels are saturating (i.e., have their MOS N-Channel saturation level transistors 42 turned on). When the voltage on global current summing node 46 equals VTERM, the comparator 48 generates a TERMINATE EXPOSURE signal that can be used to terminate the exposure period in one of numerous ways, such as by closing a mechanical shutter or initiating end-of-exposure signals (such as the XFR signal) to control the pixel sensors. The TERMINATE EXPOSURE signal can also be used to quench a strobe flash if desired.
Alternatively, A/D converter 50 may be coupled to global current summing line 46 to convert the voltage representing the global summed current to a digital value that can be processed by employing a smart auto-exposure algorithm shown at reference numeral 52.
The auto-exposure circuit 40 of the present invention may be advantageously operated in a power saving mode by simultaneously pulsing both the VSFD1 signal to the drain of the source-follower transistor 20 and one or both of the SF bias signal supplied to the gate of source-follower bias transistor 24 and the SAT. LEVEL signal supplied to the gate of saturation level transistor 42. In such a mode, the auto-exposure sensing current flows only when these signals are pulsed, at which time the overexposure sensing is performed. At other times during photointegration, the overexposure currents from each pixel do not flow, thus saving power. When this mode of operation is used, the auto-exposure circuit 40 can be advantageously used at higher current levels for better signal-to-noise ratio.
According to another mode of operating the auto-exposure circuit 40 of the present invention, the SAT. LEVEL voltage at the gates of all saturation level transistors 42 in an array can be swept from zero to the maximum level do develop a full cumulative distribution of the states of all pixels in the array. This mode of operation is most useful when AID converter 50 is used in the auto-exposure circuit 40. In embodiments of the present invention employing optional transfer transistor 28, this device should either be turned off before the ramping of SAT. LEVEL voltage each measurement cycle, or an extra cycle should be performed with the SAT. LEVEL voltage low in order to store a signal voltage that is not clipped to the variable SAT. LEVEL voltage. An example of an autoexposure algorithm that could use this cumulative distribution information is one that would analyze the distribution and classify the scenes as being backlit or not, and set different values of SAT. LEVEL and i-threshold accordingly, during exposure.
In a typical application of the MOS pixel sensor of the present invention, a plurality of such pixel sensors will be disposed in an array. Referring now to
As would be expected by persons of ordinary skill in the art and as shown in
The 2 by 2 portion 60 of the array in
A first ROW SELECT line 64-1 is connected to the row-select inputs (RSEL) of MOS active pixel sensors 62-1 and 62-2. A second ROW SELECT line 64-2 is connected to the row-select inputs (RSEL) of MOS active pixel sensors 62-3 and 62-4. The first and second ROW SELECT lines may be driven from a row decoder (not shown) as is well known in the art.
A first COLUMN OUTPUT line 66-1 is connected to the outputs (OUT) of MOS active pixel sensors 62-1 and 62-3. A second COLUMN OUTPUT line 66-2 is connected to the outputs (OUT) of MOS active pixel sensors 62-2 and 62-4. The first and second COLUMN OUTPUT lines are coupled to a column readout circuit (not shown) as is well known in the art.
A global RESET line 68 is connected to the reset (R) inputs of all of the MOS active pixel sensors 62-1 through 62-4. A first VSFD line 70-1 is connected to the VSFD inputs of the MOS active pixel sensors 62-1 and 62-2 in the first row of the array. A second VSFD line 70-2 is connected to the VSFD inputs of the MOS active pixel sensors 62-3 and 62-4 in the second row of the array. A global BARRIER line 72 is connected to the BARRIER inputs of all of the MOS active pixel sensors 62-1 through 62-4. A global SAT LEVEL line 74 is connected to the SAT LEVEL inputs of all of the MOS active pixel sensors 62-1 through 62-4. A global XFR line 78 is connected to the XFR inputs of all of the MOS active pixel sensors 62-1 through 62-4.
Auto-exposure circuit 80 is coupled to the GLOBAL CURRENT SUMMING LINE line 82 and generates a TERMINATE EXPOSURE signal on line 84 as described herein. The TERMINATE EXPOSURE signal on line 84 may be used to terminate the exposure of the image in a known manner, e.g., by closing a mechanical shutter, or electronically by causing the transition of the signals in
When the array including 2 by 2 portion 60 is driven by the signals shown in
Referring now to
Attached to the three output faces of prism 92 are three chip-on-board assemblies, labeled 106R, 106G, and 106B, aligned in such a way that the color-separated images fall on their active areas in registration. Each chip-on-board assembly includes an imaging array of pixel sensors like that partially depicted in
Signal connections to the chip-on-board assemblies 106R, 106G, and 106B are made by way of a ribbon cable 108 which is fitted with three connectors that mate with connectors on the 3 chip-on-board assemblies. In addition, ribbon cable 98 is attached to a circuit board 110 by way of connector 112. Circuit board 110 comprises the support electronics for controlling the reading of image data from the three imaging arrays on the chip-on-board assemblies 106R, 106G, and 106B mounted on the prism 92 as is understood by those: skilled in the art. Cable 114 carries power into camera 80, and carries out of the camera signals representative of the image captured through lens 86. Cable 114 exits housing 94 through light-tight fixture 116.
While embodiments and applications of this invention have been shown and described, it would,be apparent to those skilled in the art that many more modifications than mentioned above are possible without departing from the inventive concepts herein. The invention, therefore, is not to be restricted except in the spirit of the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
3866067 | Amelio | Feb 1975 | A |
3934161 | Caywood | Jan 1976 | A |
3971065 | Bayer | Jul 1976 | A |
3988619 | Malaviya | Oct 1976 | A |
4011016 | Layne et al. | Mar 1977 | A |
4236760 | Haar et al. | Dec 1980 | A |
4238760 | Carr | Dec 1980 | A |
4309604 | Yoshikawa et al. | Jan 1982 | A |
4363963 | Ando | Dec 1982 | A |
4473836 | Chamberlain | Sep 1984 | A |
4499529 | Figueroa | Feb 1985 | A |
4499590 | Bluzer | Feb 1985 | A |
4573077 | Imai | Feb 1986 | A |
4613895 | Burkey et al. | Sep 1986 | A |
4626915 | Takatsu | Dec 1986 | A |
4651001 | Harada et al. | Mar 1987 | A |
4654714 | Hurst, Jr. et al. | Mar 1987 | A |
4677289 | Nozaki et al. | Jun 1987 | A |
4704633 | Matsumoto | Nov 1987 | A |
4734776 | Wang et al. | Mar 1988 | A |
4742238 | Sato | May 1988 | A |
4786818 | Mead et al. | Nov 1988 | A |
4809075 | Akimoto et al. | Feb 1989 | A |
4839735 | Kyomasu et al. | Jun 1989 | A |
4845553 | Konomura et al. | Jul 1989 | A |
4875091 | Yamada et al. | Oct 1989 | A |
4901129 | Hynecek | Feb 1990 | A |
4942473 | Zeevi et al. | Jul 1990 | A |
5014107 | Vora | May 1991 | A |
5021853 | Mistry | Jun 1991 | A |
5038214 | Miida | Aug 1991 | A |
5055418 | Vora | Oct 1991 | A |
5117292 | Matsunaga | May 1992 | A |
5161024 | Oishi | Nov 1992 | A |
5227887 | Dohi et al. | Jul 1993 | A |
5241575 | Miyatake et al. | Aug 1993 | A |
5276521 | Mori | Jan 1994 | A |
5289023 | Mead | Feb 1994 | A |
5317174 | Hynecek | May 1994 | A |
5335015 | Cooper et al. | Aug 1994 | A |
5341008 | Hynecek | Aug 1994 | A |
5355165 | Kosonocky et al. | Oct 1994 | A |
5396289 | Nakamura | Mar 1995 | A |
5397734 | Iguchi et al. | Mar 1995 | A |
5414464 | Sasaki | May 1995 | A |
5414465 | Kodama et al. | May 1995 | A |
5414683 | Tani | May 1995 | A |
5424223 | Hynecek | Jun 1995 | A |
5428390 | Cooper et al. | Jun 1995 | A |
5434620 | Higuchi et al. | Jul 1995 | A |
5461425 | Fowler et al. | Oct 1995 | A |
5471245 | Cooper et al. | Nov 1995 | A |
5502299 | Standley | Mar 1996 | A |
5541402 | Ackland et al. | Jul 1996 | A |
5541654 | Roberts | Jul 1996 | A |
5547881 | Wang et al. | Aug 1996 | A |
5572074 | Standley | Nov 1996 | A |
5576763 | Ackland et al. | Nov 1996 | A |
5589423 | White et al. | Dec 1996 | A |
5619262 | Uno | Apr 1997 | A |
5625210 | Lee et al. | Apr 1997 | A |
5631704 | Dickinson et al. | May 1997 | A |
5668596 | Vogel | Sep 1997 | A |
5705441 | Wang et al. | Jan 1998 | A |
5712682 | Hannah | Jan 1998 | A |
5739562 | Ackland et al. | Apr 1998 | A |
5742047 | Buhler et al. | Apr 1998 | A |
5742058 | Pantigny et al. | Apr 1998 | A |
5801657 | Fowler et al. | Sep 1998 | A |
5841126 | Fossum et al. | Nov 1998 | A |
5883421 | Ben Chouikha et al. | Mar 1999 | A |
5952686 | Chou et al. | Sep 1999 | A |
5962844 | Merrill et al. | Oct 1999 | A |
6046444 | Afghahi | Apr 2000 | A |
6078037 | Booth, Jr. | Jun 2000 | A |
6111245 | Wu et al. | Aug 2000 | A |
6115066 | Gowda et al. | Sep 2000 | A |
6157016 | Clark et al. | Dec 2000 | A |
6211510 | Merrill et al. | Apr 2001 | B1 |
6243134 | Beiley | Jun 2001 | B1 |
6246436 | Lin et al. | Jun 2001 | B1 |
6317154 | Beiley | Nov 2001 | B1 |
Number | Date | Country |
---|---|---|
43 04 506 | Aug 1994 | DE |
198 36 356 | May 1999 | DE |
62143571 | Jun 1987 | EP |
0 300 365 | Jan 1989 | EP |
0 300365 | Jan 1989 | EP |
01103378 | Apr 1989 | EP |
0 466 929 | Jan 1992 | EP |
06133320 | May 1994 | EP |
0 605 898 | Jul 1994 | EP |
08009391 | Jan 1996 | EP |
0707416 | Apr 1996 | EP |
08095670 | Apr 1996 | EP |
09128091 | May 1997 | EP |
0 777 379 | Jun 1997 | EP |
0 854 516 | Jul 1998 | EP |
54-108628 | Aug 1979 | JP |
59-42527 | Mar 1984 | JP |
59-152424 | Aug 1984 | JP |
60-53912 | Mar 1985 | JP |
60-23841 | Jun 1985 | JP |
58-83824 | May 1993 | JP |
WO 9615626 | May 1996 | WO |
WO 9717800 | May 1997 | WO |
WO 9819455 | May 1998 | WO |
WO 9966560 | Dec 1999 | WO |
WO 9966712 | Dec 1999 | WO |
WO 0072604 | Nov 2000 | WO |