The present disclosure is described in conjunction with the appended figures:
In the appended figures, similar components and/or features may have the same reference label. Further, various components of the same type may be distinguished by following the reference label by a dash and a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.
Embodiments of the present invention relate in general to methods and systems for processing outputs from image sensors, including the amplification and analog to digital conversion of signals produced by an image sensor. More specifically, but not by way of limitation, embodiments of the present invention concern the storage of an analog signal from an image sensor on a sample and hold circuit and the processing and amplification of the signal prior to the digital conversion of the signal.
An image sensor may be a two-dimensional array of pixels and the pixels on the array may be considered as rows and columns. Outputs from the pixels may be applied to circuits and processed to produce an output signal from the image sensor. In certain aspects, circuits may provide for the amplification and analog to digital conversion of the signals produced by the pixels. Typically, a pixel produces an output voltage. As generally known in the relevant art and for purposes of this specification, the set of circuits used to process pixel signals that is connected to the columns of an image sensor array is referred to as a “column amplifier.” Embodiments of this invention may concern column amplifiers and column amplification of signals produced by an image sensor. However, embodiments of the present invention may be used in other image sensor amplification and/or analog to digital conversion circuits other than column amplifiers. As discussed in this specification, the column amplifier may comprise sample and hold circuits, analog multiplexers, operational amplifiers, and the like.
Embodiments of the present invention may be used with any type of image sensor, e.g., a charge coupled device (“CCD”) or a complementary metal oxide semiconductor (“CMOS”) image sensor. Operation of a CMOS image sensor is discussed in U.S. Pat. No. 6,035,077, “SINGLE-CHIP COLOR CMOS IMAGE SENSOR WITH TWO OR MORE LINE READING STRUCTURE AND HIGH-SENSITIVITY INTERLACE COLOR STRUCTURE,” to Chen et al., that is incorporated by reference in its entirety for all purposes. Generally, image sensors incorporate on-chip analog processing of the light-induced charge in each pixel. As described in U.S. Pat. No. 6,124,819, “CHARGE INTEGRATION SUCCESSIVE APPROXIMATION ANALOG-TO-DIGITAL CONVERTER FOR FOCAL PLANE APPLICATIONS USING A SINGLE AMPLIFIER,” to Zhou et al, that is incorporated by reference in its entirety for all purposes, there is an engineering tradeoff between the number of analog to digital converters and the complexity and size of the imager device, e.g., the more analog top digital converters the more complex the imager device. The range of this tradeoff spans from one analog to digital converter (“ADC”) for each pixel in one extreme, to a single ADC for the all of the pixels on the image sensor. In the latter situation, it is necessary to provide for analog multiplexing of all pixel units to the aforementioned single ADC.
In general, most image sensor devices take an intermediate approach. For example, each pixel may be connected by a circuit to a primitive one transistor amplifier. In such an image sensor device, the output of a row of pixels on the image sensor is read in parallel to a plurality of column amplifiers and the analog voltages, representing the light-induced charge at each pixel, are converted to digital form by one or more ADCs. Because, in such devices, multiple pixel outputs are being converted through the same ADC, pixel columns are sampled into a plurality of sample and hold circuits where the pixel outputs are stored until the ADC is ready to convert the analog signals to a digital form. In such devices, the plurality of sample and hold circuits may be connected to a plurality of amplifiers that, in turn, connect to a single or to a plurality of ADCs. The greater the number of ADCs the more complicated the image sensor device.
When the number of ADCs is smaller than the number of sample and hold circuits, analog to digital conversion may be done serially for several pixels. In the situation where analog pixel outputs are stored and then converted to digital signals, for accuracy reasons, the output from the sample and hold circuit should, ideally, correspond to the signal input to the sample and hold circuit from a pixel. Consequently, the sample and hold circuit should be able to hold the analog value to be converted with a minimum of leakage, even though it may take some time until the analog value is converted to a digital form. Because sample and hold circuits store the analog value on a capacitor and because capacitors associated with semiconductor devices leak, a drop in the analog signal over the time it is stored will occur. This drop in the stored analog value prior to analog to digital conversion presents a problem in image sensor sample and hold circuits. Moreover, due to the variation of process parameters and to uneven thermal distribution across the image sensor chip, the amount of the drop in the analog signal is not necessarily equal for each of an image sensor's sample and hold circuits. As a consequence, the drop in the analog signals stored in the sample and hold circuits associated with the image sensor will very often cause vertical noise stripes in the image produced by the image sensor.
The ensuing description provides preferred exemplary embodiment(s) only, and is not intended to limit the scope, applicability or configuration of the invention. Rather, the ensuing description of the preferred exemplary embodiment(s) will provide those skilled in the art with an enabling description for implementing a preferred exemplary embodiment of the invention. It is understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the invention as set forth in the appended claims.
Specific details are given in the following description to provide a thorough understanding of the embodiments. However, it will be understood by one of ordinary skill in the art that the embodiments may be practiced without these specific details. For example, circuits may be shown in block diagrams in order not to obscure the embodiments in unnecessary detail. In other instances, well-known circuits, structures and techniques may be shown without unnecessary detail in order to avoid obscuring the embodiments.
Also, it is noted that the embodiments may be described as a process that is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process is terminated when its operations are completed, but could have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination corresponds to a return of the function to the calling function or the main function.
Each light-sensitive element in image sensor array 100 integrates the luminance sensed at the geometrical location of that element and transforms it to a voltage level, herein referred to as Vp. The structure and elements of the image sensor array 100 are well-known in the art and, therefore, are not described.
In various embodiments of the present invention, when row decoder 120 sends a reset signal, a horizontal row reset is activated and all the light-sensitive elements on the selected horizontal row of the array may be reset to an initial value. In such embodiments, at reset, the output Vp from the light-sensitive elements is Vref, where Vref is the output of a light sensitive element under reset. In certain embodiments of the present invention, when the row decoder 120 sends a row select signal, a selected horizontal row may be activated and each element of that row will drive the corresponding vertical Vpix line with a voltage Vp, where Vp is the voltage produced by the light-sensitive element when illuminated by the image. In embodiments of the present invention, since the row select line drives all image elements of that particular row, all elements of the row drive their corresponding Vpix lines at the same time. In certain embodiments, a select output, Vp, and a reset output, Vref, may be produced by each light-sensitive element to provide for a determination of a change in output by the light-sensitive element when it is illuminated by the image compared to its output at reset.
In certain embodiments, as discussed above, row select and row reset signals may be generated by row decoder 120. In certain aspects, a row select line may be driven when a corresponding row of the light-sensitive elements of the image sensor array 100 are scanned. In some embodiments of the present invention, the row select lines for each of the rows of light sensitive elements may be driven twice during the scan time of one frame. In these embodiments, the Vpix values of each row may be sampled twice to allow for double sampling of the light-sensitive elements. In some embodiments of the present invention, the row reset lines that may be produced by the row decoder 120 to reset the Vp levels of the light-sensitive elements in the image array may also be double sampled and driven twice per frame. In certain embodiments of the present invention, such double sampling may be performed to mitigate the parasitic effects of the reset control on Vp by subtracting the value of Vp after reset from its value at the end of the exposure period.
In various embodiments, the columns of image array 100 may be sampled in two sets of sample and hold circuits, a first set of sample and hold circuits 101 and a second set of sample and hold circuits 102. In certain embodiments, the first set of sample and hold circuits 101 and the second set of sample and hold circuits 102 may each comprise N/2 dual-sample and hold circuits (where N, as described above, is the number of columns of pixels on the image sensor array 100), each of which samples and holds the value of a single Vpix line at two time instances—after the light sensitive element is exposed and after a reset signal is applied to the light-sensitive elements.
In
In some embodiments of the present invention, the outputs from the first set of sample and hold circuits 101 and the second set of sample and hold circuits 102 connect, respectively, to a first set of analog multiplexers 103 and a second set of analog multiplexers 104. In certain embodiments, the first set of analog multiplexers 103 and the second set of analog multiplexers 104. In certain aspects, each of the analog multiplexers 103 and 104 may comprise N/8 dual 4→1 analog multiplexers. In various embodiments, each of the analog multiplexers in the first set of analog multiplexers 103 and the second set of analog multiplexers 104 may scan its four inputs and connect the scanned input to the next stage. In some embodiments of the present invention, the next stage comprises a first set of operational amplifiers 105 and a second set of operational amplifiers 106. In certain aspects, the first set of operational amplifiers 105 and the second set of operational amplifiers 106 each comprise N/8 pairs of operational amplifiers. In certain aspects of the present invention, one of the pairs of the operational amplifiers may amplify the voltage difference (smpi-cvcom) and the other operational amplifier in the pair may amplify the voltage difference of (refi-cvcom).
In certain embodiments of the present invention, the outputs from the first set of operational amplifiers 105 and the second set of operational amplifiers 106 connect to a first set of N/8 analog multiplexers 107 and a second set of N/8 analog multiplexers 108. In some embodiments of the present invention, each multiplexer of the first set of N/8 analog multiplexers 107 and the second set of N/8 analog multiplexers may multiplex a pair of the N/8 smpi signals and the N/8 refi signals and may connect one of the pairs at a time to a first analog to digital converter 109 and a second analog to digital converter 110. In this way, an output from each light-sensitive element of the image sensor array 100, where the output from the light-sensitive element is smpi-refi, may be converted from an analog signal to a digital signal.
The embodiments of the present invention illustrated in
In
In some embodiments, when the strobe control signal smp_strobe is active, capacitor 120 may be connected to the Vpixi 202 output from the image array sensor 100 in its positive terminal and to the common voltage source cvcom in its negative terminal. In certain embodiments of the present invention, the capacitors may be non-polar, and therefore, the reference to positive and negative terminals is for convenience only. In embodiments of the present invention, when the strobe control signal is off, switches 231 and 241 may be closed and the voltage differential between the output Vpixi 202 and the common voltage cvcom 205 may be stored on the capacitor. In different aspects, after storage on the capacitor an output smpi 212 from the positive terminal of the capacitor 220 capacitor and an output csmpi from the negative terminal of the capacitor may be output from the storage and hold circuit for further processing. In certain aspects, the second half of the sample and hold circuit described below may control aspects of the output from capacitor 220.
In various dual sampling embodiments of the present invention, an smp_strobe signal may be activated after the exposure period for capacitor 220 to provide for storage of a second signal on the capacitor 220 during the image frame. In certain embodiments of the present invention, the plates of the capacitor 220 and the positions of the switches 231 and 241 may be arranged so that the sample and hold circuit may be arranged symmetrically around a symmetrical axis 217. In certain aspects, this symmetrical arrangement may provide for matching the loads on the terminals of capacitor 220. Although
In various embodiments of the present invention, the electrical components of circuit 200 may provide that the reverse voltage across the capacitor 220 is much larger than the thermal voltage associated with the capacitor 220. In some embodiments, the loads on the terminals of the capacitor 220 may be matched. In certain embodiments of the present invention, the loads on the terminals of the capacitor 220 may be matched and the reverse voltage across the capacitor 220 may be made to be much larger than the thermal voltage associated with the capacitor 220. In certain embodiments, the loads on the terminal of the capacitor 220 may be matched by symmetrically arranging the components of the circuit associated with the capacitor 220 symmetrically around the capacitor 220 and providing that components on either side of the capacitor have matching electrical properties. In some embodiments, a symmetrical arrangement may not be used, but instead the electrical properties of the components connected to a first terminal of the capacitor 220 may be matched to the electrical properties of the components connected to a second terminal of the capacitor 220. In certain embodiments, the terminals of the capacitor 220 may not be identical, and matching of the loads connected to the terminals may be provided for by taking account of differences between the terminals. In other embodiments, the loads on the terminals of the capacitor 220 may not be matched and the properties of the terminals may be adjusted to take into account differences in the loads.
In some embodiments, when the strobe control signal smp_strobe is active, capacitor 120 may be connected to the Vpixi 202 output from the image array sensor 100 in its positive terminal and to the common voltage source cvcom in its negative terminal. In some embodiments, when the strobe control signal ref_strobe is active, capacitor 120 may be connected to the Vpixi 202 output from the image array sensor 100 in its positive terminal and to the common voltage source cvcom in its negative terminal. In certain aspects, when smp_strobe signal 207 is active the output from the light-sensitive element of image sensor array 100 under incident illumination may be outputted through switch 231 to the positive terminal of the capacitor 220. In certain aspects, when ref_strobe signal 203 is active the output from the light-sensitive element of image sensor array 100 under reset may be outputted through switch 232 to the positive terminal of the capacitor 230.
In embodiments of the present invention, when the strobe control signal is off, switches 231, 232, 241 and 242 may be closed and the voltage differential between the output Vpixi 202 and the common voltage cvcom 205, when the sensing element is illuminated and under reset, respectively, may be stored on the two capacitors 220 and 230. In different aspects, after storage on the capacitor the output smpi 212 from the positive terminal of the capacitor 220 capacitor and the output csmpi from the negative terminal of the capacitor may be output from a first part of the dual storage and hold circuit for further processing. Similarly, in certain aspects, after storage on the capacitor the output refi 214 from the positive terminal of the capacitor 230 capacitor and the output crefi from the negative terminal of the capacitor may be output from the second part of the dual storage and hold circuit for further processing.
In various dual sampling embodiments of the present invention, the smp_strobe signal 207 may be activated after the exposure period for capacitor 220. In various dual sampling embodiments of the present invention, the ˜ref_strobe signal 204 may be activated shortly after reset for capacitor 230. In certain embodiments of the present invention, the plates of the capacitors 220 and 230 and the positions of the switches 231, 232, 241 and 242 and any other components in the circuit may be arranged so that the dual sample and hold circuit 201 is arranged symmetrically around the symmetrical axis 217. Although
In various embodiments of the present invention, the electrical components of circuit 201 may be to provide that the reverse voltage across the capacitor 220 is much larger than the thermal voltages associated with the capacitors 220 and 230. In some embodiments, the loads on the terminals of the capacitor 220 and the loads on the terminals of the capacitor may be matched. In certain embodiments of the present invention, the loads on the terminals of the two capacitors 220 and 230 may be matched and the reverse voltage across the two capacitors 220 and 230 may be made to be much larger than the thermal voltage associated with the two capacitors 220 and 230. In certain embodiments, the loads on the terminals of the capacitor 220 and the loads on the terminals of the capacitor 230 may be matched by symmetrically arranging the components of the circuits associated with the two capacitor 220 and 230 symmetrically around each of the capacitors 220 and 230 and providing that components on either side of the capacitors 220 and 230 have matching electrical properties. In some embodiments, a symmetrical arrangement may not be used, but instead the electrical properties of the components connected to a first terminal of the capacitor 220 may be matched to the electrical properties of the components connected to a second terminal of the capacitor 220. Similarly, in some embodiments, a symmetrical arrangement may not be used with capacitor 230, but instead the electrical properties of the components connected to a first terminal of the capacitor 230 may be matched to the electrical properties of the components connected to a second terminal of the capacitor 230. In certain embodiments, the terminals of the capacitor 220 and the terminals of the capacitor 230 may not be identical, and matching of the loads connected to the terminals may be provided for by taking account of the differences in the characteristics of the terminals. In other embodiments, the loads on the terminals of the capacitor 220 may not be matched and the properties of the terminals of the capacitor 230 may be adjusted to take into account differences in the loads. Similarly, in some embodiments, the loads on the terminals of the capacitor 230 may not be matched and the properties of the terminals of the capacitor 230 may be adjusted to take into account differences in the loads.
In various embodiments of the present invention, electrical components and schematics may be arranged to provide that the reverse voltage across the capacitors may be much larger than any thermal voltage. In various embodiments, by matching the loads on the terminals of each of the capacitors 220 and 230 and providing that the reverse voltage across the capacitors may be much larger than any thermal voltage, the embodiments of the present invention provide that the leakage current from the terminals of the capacitors 220 and 230 may be very small.
In some embodiments of the present invention, when switches 430 and 440 are turned on by one of the control signals ˜se1410 or se1420, a first output smpout and a second output smpout_n from capacitor 220 may be connected to the outputs of the two switches 430 and 440. In certain embodiments, these outputs may then connect be to an operational amplifier, as will be discussed below.
In some embodiments of the present invention, a discharge mechanism 450 may be connected between the first switch 430 and the second switch 440. In certain embodiments, the discharge mechanism 450 may comprise one or more transistors. In certain aspects, capacitor 220 may be discharged by turning switches 430 and 440 on using control signals ˜se1410 and se1420 and applying a discharge control 490 to the discharge mechanism 450. In such embodiments, the capacitor 220 may be connected to the discharge mechanism 450 through switches 430 and 440 and when the discharge mechanism is set high the capacitor 220 may discharge through the discharge mechanism 450.
In embodiments of the present invention, when a signal is being stored on capacitor 220 switches 430 and 440 may not be activated and the discharge mechanism may be isolated from the capacitor 220. By isolating the capacitor 220 from the discharge mechanism 450, in various embodiments of the present invention, voltage droop from the capacitor 220 may be prevented and/or reduced.
In various embodiments, the first multiplexer 510 and the second multiplexer 520 may be positioned symmetrically around the symmetry axis 217. As discussed above, symmetrical positioning of electrical components in the multiplexing circuit may provide for load balancing on the two terminals of the hold capacitors in the sample and hold circuits. In some embodiments, balancing of electrical properties of components in communication with the terminals of the hold capacitors may provide for load matching. In various embodiments, the discharge mechanism 450 may only be connected to a hold capacitor in a sample and hold circuit when the capacitor is to be discharged. This, unlike discharge configurations described in references concerning sample and hold circuits, may prevent leakage to ground from the terminals of the capacitors. In various embodiments, the multiplexing circuit 500 may provide for serially producing an output smpout 470 and an output smpout_n 480 from multiple the terminal of hold capacitors in multiple sample and hold circuits. In certain embodiments, the first multiplexer 510 and the second multiplexer 420 may be controlled to select the sample and hold output to be processed.
In embodiments of the present invention, an smpi signal selected form the group of smpi signals 530 may be routed through the first analog multiplexer 510 to the output 637 of the operational amplifier 630. In such embodiments, the common terminal signal csmpi from the group of common terminal signals csmpi 540 related to the selected input smpi signal may be routed to the negative input 635 of the operational amplifier 630. Merely by way of example, when smp2 is selected and routed through the first multiplexer 510 to the output 637 of the operational amplifier 630, corresponding common terminal signal csmp2 may be selected and routed to the negative input 635 of the operational amplifier 630. Further, in these embodiments, the positive input 632 of the operational amplifier 530 may be held at the common voltage cvcom 205. In various embodiments, the operational amplifier 630 may work in a closed loop and the negative input 635 may, as a consequence, be at virtual ground. In embodiments of the present invention, the negative input 635 may be at the common voltage cvcom 205 and, as a result, the output 652 of the operational amplifier 630 may settle to the value of smpi. In such embodiments, the configuration of the operational amplifier 630 may provide that the accuracy of the output from the sample and hold circuit does not depend on the value of capacitor 220 or on matching of capacitor pairs.
In various embodiments of the present invention, a feedback loop 639 of the operational amplifier 630 may be closed by: (1) a first switch sw1541; a second switch sw2543; and/or by the capacitor 220 via the first multiplexer 510 and the second multiplexer 520. In various embodiments, the second switch sw2643 may be controlled by a signal cph2647. In certain aspects, the signal cph2647 may be used to activate the second switch sw2643 when the first analog multiplexer 510 switches between its inputs. In this way, control signal cph2647 may ensure that the-operational amplifier may be in closed loop operation when the first multiplexer 510 switches between inputs. In certain aspects the first switch sw1641 may be controlled by a signal gate_n 649. In aspects of the present invention, the signal gate_n 649 may activate the switch sw1541 when the operational amplifier 630 is not in use. In some embodiments of the present invention, an enable control 651 associated with the operational amplifier 630 may be used to provide that no power will be consumed by the operational amplifier 530 when the operational amplifier 630 is not in use. In certain aspects, the enable control 651 may disenable the operational amplifier 530 when the operational amplifier 630 is not in use. In certain aspects, the enable control 651 may be activated to enable the operational amplifier 630 a certain amount of time before an output from a sample and hold circuit capacitor, not shown, may be applied to the operational amplifier 630 to allow the operational amplifier 630 enough time to stabilize.
In some embodiments of the present invention, a second amplification circuit 640 may be provided with the same configuration as the first amplification circuit 600. In certain aspects, refi signals 610, discussed in
In certain embodiments, four control signals—control signal add0730, control signal add1731, control signal add2732 and control signal add3733 may be used as control signals for the first multiplexer 510 and the second multiplexer 520. In certain embodiments, the four decoded address-lines may be used to control the first and second multiplexers so as to connect the capacitor 220 and the other capacitors connected to the first and second multiplexers to the feedback of the operational amplifier 630. In various embodiments, when none of four control signals is active, signal cph2647 may be activated to provide that the feedback of the operational amplifier 630 is never disconnected for a long period of time. In some embodiments, discharge signal 740 may be applied for several pixel clock periods after control signal add3733 is activated to discharge the capacitor 220. In certain embodiments, all of the control signals add0 through add3 may be opened for a period of four clock cycles before the discharge control signal 740 to provide that the discharge of four capacitor pairs, such as the capacitor pair of the capacitor 220 and the capacitor 230, may be discharged in preparation for the reading of the next row of light-sensitive elements on the image array sensor. In further embodiments with a different number of capacitors or capacitor pairs multiplexed to the operational amplifier, different pixel clock periods may be used to provide for discharge of all of the capacitors associated with the operational amplifier.
According to some embodiments of the present invention, the control signals to the analog multiplexers—the control signal add0730, the control signal add1731, the control signal add2732 and the control signal add3733—may be pulse-shaped. In certain aspects, the feedback control signal cph2547 may also be pulse-shaped. In various embodiments of the present invention, the use of pulse-shaped control signals and pulse-shaped feedback signals may provide that there is no overlap between the two different signals.
While the principles of the disclosure have been described above in connection with specific apparatuses and methods, it is to be clearly understood that this description is made only by way of example and not as limitation on the scope of the invention.
This application claims the benefit of and is a non-provisional of U.S. Application Ser. No. 60/539,616 filed on Jan. 27, 2004, which is incorporated by reference in its entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
60539616 | Jan 2004 | US |