The present invention relates, in general, to image sensors. More specifically, the present invention relates to systems and methods for running online tests of an image sensor's pixel analog paths and digital data paths. This is accomplished without losing data or frame rate, although a short time slot is allocated to performing the tests.
Automotive safety critical applications, such as emergency braking to prevent a crash, require that the CMOS imager runs self tests at regular intervals during operation to detect any failure mechanism that may occur due to reliability issues. As other examples, imagers are used as sensors in lane tracking systems, edge-of-road detection systems, near-obstacle-avoidance detection systems, crash alert systems and passenger position sensing systems. Such safety critical applications require imagers with high reliability.
Conventional imagers are tested at the manufacturer using precision equipment to inject a known quantity of light and compare the imager output to the expected output resulting from the known quantity of light. Such test equipment is generally sophisticated and correspondingly expensive. Additionally, operational testing is performed at the manufacturer using precision equipment to inject a known quantity of light and compare the imager output to the expected output resulting from the known quantity of light. Such test equipment is generally sophisticated and correspondingly expensive.
Camera systems for use in safety critical applications can be designed based on a “majority vote” among three cameras viewing approximately the same scene. As an example, one of three cameras detects an object interpreted by its image processing software as the headlights of an approaching car on a collision path. Since no such object is detected in either of the two other cameras, no further action is required and the images for the other two cameras are used for image processing. The failing camera unit results in an error message “camera service required immediately”. Such a “majority vote” camera system has a relative large latency, before a pixel error or a pixel cluster error is detected by the software in the camera system. This is so, because pixel cluster defect errors occurring over the product's lifetime must interfere with the detection of relevant objects in the image to trigger an alarm.
In contrast, a less expensive two-camera system for use in safety critical application may be designed based on active real-time validation of pixel output circuits. As will be described, the present invention uses a column-parallel analog-to-digital-converter (ADC) architecture of an image sensor. The present invention provides complete testing of the signal path from each pixel in a row and throughout the column-parallel ADC architecture. In addition, the test is run during real time image processing, without losing real data or frame rate.
The present invention may be understood from the following detailed description, when read in connection with the accompanying figures:
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof and show by way of illustration specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention, and it is to be understood that other embodiments may be utilized, and that structural, logical, and electrical changes may be made without departing from the spirit and scope of the present invention. The progression of processing steps described is exemplary of embodiments of the invention; however, the sequence of steps is not limited to that set forth herein and may be changed as is known in the art, with the exception of steps necessarily occurring in a certain order.
The term “pixel,” as used herein, refers to a photo-element unit cell containing a photo sensor and associated transistors for converting photons to an electrical signal. For purposes of illustration, a small number of representative pixels are illustrated in the figures and description herein; however, typically fabrication of a large plurality of like pixels proceeds simultaneously. Accordingly, the following detailed description is not to be taken in a limiting sense; and the scope of the present invention is defined only by the appended claims.
In addition, although the invention is described below with reference to a CMOS imager, the invention has applicability to any solid state imaging device having a storage node which is reset and then has charges transferred to it. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.
Now referring to the figures, where like numerals designate like elements,
The S/H circuits 72 are connected to the column lines 22 of the array 56. The analog-to-digital converters 60 are connected to the S/H circuits 72 by what is commonly known as a column-parallel architecture. That is, in the illustrated imaging device 500, each column or column line 22 of the array 56 is connected to a respective analog-to-digital converter 60, which operate in parallel to convert analog signals from the array 56 (via the S/H circuitry 72) to digital signals.
The imaging device 500 is operated by the row operations and ADC controller 58, which controls the row driver 54 and the analog-to-digital converters 60. The row operations and ADC controller 58 also issues a sample control signal SAMPLE to the first memory bank 62, which is illustratively an SRAM device. The second controller, i.e., the SRAM/read controller 66 also controls the operation of the imaging device 500 by controlling the second memory bank 64 which is a SRAM device via a shift control signal SHIFT, and by controlling the column decoder 70.
In operation, row lines are selectively activated by the row driver 54 in response to the row decoder 52. The S/H circuits 72 input a pixel reset signal VRST and a pixel image signal VSIG for selected pixels. A differential signal is produced, by a differential amplifier within the S/H circuits 72, for each pixel and is digitized by the analog-to-digital converters 60. The digitizing of the data from each column is performed in parallel. The digitized signals are stored in the first memory bank 62 (when the sample control signal SAMPLE is issued) and subsequently shifted into the second memory bank 64. The sense amplifier circuitry 68 senses the stored digital data from the second memory bank 64 and outputs the digital information so that it may be processed by, for example, an image processor (not shown).
The states of the transfer and reset transistors 111, 112 determine whether the floating diffusion region C is coupled to the light sensitive element 101 for receiving photo generated charge generated by the light sensitive element 101 during a charge integration period, or a source of pixel power VAA from node A during a reset period.
The pixel 100 is operated as follows: The SEL control signal is asserted to cause the row select transistor 114 to conduct. At the same time, the RS control signal is asserted while the TX control signal is not asserted. This couples the floating diffusion region C to the pixel power VAA at node A, and resets the voltage at node C to an initial voltage. The pixel 100 outputs a reset signal VRST to the load circuit 120. Node B is coupled between the row select transistor 114 and the load circuit 120 and serves as an input to a sample-and-hold circuit (not shown) that samples and holds the pixel reset voltage VRST.
After the reset signal VRST has been output, the RS control signal is de-asserted. The light sensitive element 101 has been exposed to incident light and accumulates charge on the level of the incident light during a charge integration period. After the charge integration period and the output of the signal VRST, the TX control signal is asserted. This couples the floating diffusion region C to the light sensitive element 101. Charge flows through the transfer transistor 111 and diminishes the voltage at the floating diffusion region C. The pixel 100 outputs a photo signal VSIG to the load circuit 120 which appears at node B and is sampled by the sample-and-hold circuit (not shown). The reset and photo signals VRST, VSIG, are different components of the overall pixel output (i.e., Voutput=VRST−VSIG).
Referring next to
Referring now to
Referring back to
It will be appreciated that the circuit shown in
The switches controlled by “shx” and “cmp_rst” in
Vc1=Vcn−VRST.
The C1 capacitor carries the pixel reset level information, plus some fixed column-wise and temporal noise components.
The actual sampling is a two-step operation of phase 1 and phase 2, as follows:
In phase 1 of the sampling process, the “cmp_rst” switches open first and inject small charges into C1 and C2. The voltage across C1, thus, equals the pixel reset level with added random temporal noise and fixed pattern noise. The voltage across C2 is
Vcp=Vcn+Vcomp_offset+Vcomp_noise.
The random noise component in the offset, including comparator 1/f noise, modulates the threshold level when the comparator is used during the conversion process.
In phase 2 of the sampling process, the shx switch opens at time t=t1. This causes a small random charge injection error in the VRST=Vdac voltage. The average value of the charge injection is negative if an NMOS switch dominates. During Phase 2, the charge on C1 stays constant, because C2 is floating at the minus node of a CMOS comparator.
To remove the average values of the errors caused by charge injections into capacitors C1 and C2 and at the capacitive node “vdac”, a double successive approximation process is started in the ADC: One is for the pixel reset level and the other is for the pixel reset level minus the signal level.
Still referring to
The input voltage “Vin” is sampled under three conditions: (1) the Vref_a>Vref_b, (2) a digital pedestal value is set up on the complementary n+1 bit-wide pedestal buses, namely “pedestal—0” and “pedestal—1” and (3) a control signal “pedestal” is enabled.
When the input voltage has settled, the “pedestal” control signal is disabled and an all-bit reset of the SAR pulls down the voltage at the “vdac” node, as much as necessary in order to be well outside the distribution of the peak noise voltages across all columns (considering the noise voltages stored across both the C1 and C2 capacitors and the DAC capacitors). It is important to note that when the second voltage is sampled on the “vdac” node, the charge on C1 and C2 does not change, i.e., the comparator is not reset. The digital pedestal value is identical for both conversions.
As an example, when the pedestal in
(3/31)(Vref—a−Vref—b).
Taking the difference between the two digital values from the SAR with a pedestal, both the average and column-wise random noise stored across C1 and C2 cancels out, greatly improving the accuracy of the ADC. Only temporal random noise, internal to the comparators (due to the preceding circuits in the analog signal path and in the sampling process itself) contribute temporal noise which is not clipped.
It will now be appreciated that the ADC in
Vfs=Vref—a−Vref—b.
Secondly, the order of sampling of SHR and SHS can be interchanged, if the polarity of Vfs is changed by swapping Vref_a and Vref_b. Thirdly, regardless of the polarity of Vfs, the pedestal digital value bits are loaded in parallel from the “pedestal—1<n:0>” and “pedestal—0<n:0>” buses by the control signal “pedestal”; the digital pedestal number is the same. This implies that in the fail-safe test method of the present invention, the lowest voltage level and the pedestal with swapped polarity can be converted first; and the highest voltage level corresponding to the actual and final shutter level is the last level sampled with the pedestal and converted. (Note that the comparator has an input polarity switch which is used to accept negative Vfs (full scale reference voltages)).
Referring next to
Referring now to
On the other hand, when connected to (VAAPIX_LN−VADC_FULL_SCALE), the VRST_D node provides the test mode of the present invention. The test mode includes sampling and conversion of an SHS_TST (signal test) and sampling and conversion of an SHR_TST (reset test) at times t=3 and t=4, respectively (see
Continuing the description of
It will be appreciated that resistor 914 and capacitor CVAAPIX_LN provide a low pass filter to the VAAPIX voltage supply. Accordingly, the filtered voltage is referred to herein as VAAPIX_LN. The resistor 914 may be omitted in the circuit shown in
Finally, the “VREF polarity switch” reverses the polarity of (Vref_a−Vref_b) during the test mode of the present invention. The (Vref_a−Vref_b) is also referred to herein as Vfs, or VADC_FULL_SCALE, as shown in
Referring next to
The present invention allows interchanging the order of pixel output sampling in the test mode. Thus, SHS_TST (lowest test level) is done prior to SHR_TST (highest test level), as shown in
The duration of the standard shutter interval is split into two parts. During the first part, or the SHS-test, a first known test voltage of:
VAAPIX—LN−Vdelta=VRST—D
is set up at the drain of the reset transistor (RST) and at the floating diffusion (FD) when RST_G<n> is ON and TX<n> is OFF. In a first embodiment of the invention, the gate voltage at the RST transistor is still ON and the FD tracks VRST_D plus RST device thermal noise. In another embodiment of the invention, the SHS-test is done after turning OFF the RST_G<n>, thereby replacing thermal noise with the equivalent kT/C noise plus charge injection noise. If a failure occurs in the pixel active devices, leakage current errors can be detected.
During the second part of the shutter interval, the SHR-test is set up by placing the TX<n> and RST_G<n> ON and the voltage VAAPIX_LN is set up in the FD in order to reset or shutter the photo diodes of the pixels in that row.
The Vdelta voltage is derived from a voltage bandgap (Vbg) reference, as described earlier with respect to
Prior to sending a row of pixel data off-chip, the image processor (not shown) checks if the analog and digital data paths on the sensor are working correctly, including the charge redistribution successive approximation ADC. If no error is found, the row is validated and sent off-chip. If a pixel error, or pixel cluster error is found, an error message may be transmitted off-chip to the application software.
An error message from a 4-way shared pixel may be: “Pixel cluster error in 4 positions (x0, y0) to (x1, y1)”. An error message in a two way shared pixel array may be “Pixels fail in positions (x0, y0) and (x1, y1)”. The error message may be transmitted prior to transmitting the pending row with the known error. Thus, the built-in test speed is equal to the row-rate. The application program may determine what to do, depending on the severity of the suspected error. The nature of the error(s) determine(s) the actions to be taken.
In summary, the present invention includes a built-in real-time self-test, which allows for complete testing of the signal path from each pixel in a row and throughout the column-parallel ADC architecture. The test is done at the end of each read-out from a row, during an extended row shutter interval.
Performing the SHS-test first followed by the SHR-test has the following speed benefit: The SHS-test follows right after a normal SHS and SHR-test levels are reached and is very fast when the PIXOUT node (
It will be appreciated that all bit switches must work in the charge redistribution DAC, both during sampling and during successive approximation. In one embodiment, the two upper biased resistors “R” set up the full scale voltage to a digital-to-analog voltage converter (DAC), designated as 952, in which the latter may step through all voltage levels, row-by-row. In a 12-bit DAC, there can be a maximum of 4095 levels. These voltage levels may rotate through the rows.
Referring now to
Although the invention is illustrated and described herein with reference to specific embodiments, the invention is not intended to be limited to the details shown. Rather, various modifications may be made in the details within the scope and range of equivalents of the claims and without departing from the invention.
Number | Name | Date | Kind |
---|---|---|---|
6903670 | Lee et al. | Jun 2005 | B1 |
7872645 | Myers | Jan 2011 | B2 |
8040414 | Nakao et al. | Oct 2011 | B2 |
8275213 | Richardson | Sep 2012 | B2 |
20070138375 | Lee et al. | Jun 2007 | A1 |
Number | Date | Country | |
---|---|---|---|
20130110444 A1 | May 2013 | US |