This relates generally to imaging devices, and more particularly, to imaging sensor pixels that include more than one photosensitive region and that are capable of high dynamic range functionalities.
Image sensors are commonly used in electronic devices such as cellular telephones, cameras, and computers to capture images. In a typical arrangement, an image sensor includes an array of image pixels arranged in pixel rows and pixel columns. Circuitry may be coupled to each pixel column for reading out image signals from the image pixels.
Typical image pixels contain a photodiode for generating charge in response to incident light. Conventional imaging systems may have images with artifacts associated with low dynamic range. Scenes with bright and dark portions may produce artifacts in conventional image sensors, as portions of the low dynamic range images may be over exposed or under exposed. Image sensors may therefore be equipped with high dynamic range (HDR) functionality, where multiple images are captured with an image sensor with different exposure times. The images are later combined into a high dynamic range image, but this can introduce motion artifacts, especially in dynamic scenes with non-static objects.
It would therefore be desirable to be able to provide imaging devices with improved image sensor pixels.
Embodiments of the present invention relate to image sensors, and more particularly, to image sensors having pixels with high dynamic range (HDR) functionality. It will be recognized by one skilled in the art, that the present exemplary embodiments may be practiced without some or all of these specific details. In other instances, well known operations have not been described in detail in order to not unnecessarily obscure the present embodiments.
Imaging systems having digital camera modules are widely used in electronic devices such as digital cameras, computers, cellular telephones, and other electronic devices. A digital camera module may include one or more image sensors that gather incoming light to capture an image. Image sensors may include arrays of image pixels. The pixels in the image sensors may include photosensitive elements such as photodiodes that convert the incoming light into electric charge. Image sensors may have any number of pixels (e.g., hundreds or thousands or more). A typical image sensor may, for example, have hundreds, thousands, or millions of pixels (e.g., megapixels). Image sensors may include control circuitry such as circuitry for operating the image pixels and readout circuitry for reading out image signals corresponding to the electric charge generated by the photosensitive elements.
Image sensor pixels may be dual gain pixels that have high dynamic range capabilities. In particular, the image sensor pixels may have multiple photosensitive regions to capture multiple images to be used in high dynamic range schemes. These photosensitive regions may be photodiodes that are arranged symmetrically about a shared floating diffusion region. The shared photodiodes and the floating diffusion region may all be configured to generate charge in response to light incident on the image sensor pixel.
Storage and processing circuitry 18 may include one or more integrated circuits (e.g., image processing circuits, microprocessors, storage devices such as random-access memory and non-volatile memory, etc.) and may be implemented using components that are separate from camera module 12 and/or that form part of camera module 12 (e.g., circuits that form part of an integrated circuit that includes image sensors 16 or an integrated circuit within module 12 that is associated with image sensors 16). Image data that has been captured by camera module 12 may be processed and stored using processing circuitry 18 (e.g., using an image processing engine on processing circuitry 18, using an imaging mode selection engine on processing circuitry 18, etc.). Processed image data may, if desired, be provided to external equipment (e.g., a computer, external display, or other device) using wired and/or wireless communications paths coupled to processing circuitry 18.
As shown in
Image readout circuitry 28 (sometimes referred to as column readout and control circuitry 28) may receive image signals (e.g., analog pixel values generated by pixels 22) over column lines 32. Image readout circuitry 28 may include sample-and-hold circuitry for sampling and temporarily storing image signals read out from array 20, amplifier circuitry, analog-to-digital conversion (ADC) circuitry, bias circuitry, column memory, latch circuitry for selectively enabling or disabling the column circuitry, or other circuitry that is coupled to one or more columns of pixels in array 20 for operating pixels 22 and for reading out image signals from pixels 22. ADC circuitry in readout circuitry 28 may convert analog pixel values received from array 20 into corresponding digital pixel values (sometimes referred to as digital image data or digital pixel data). Image readout circuitry 28 may supply digital pixel data to control and processing circuitry 24 and/or processor 18 (
If desired, image pixels 22 may include one or more photosensitive regions for generating charge in response to image light. Photosensitive regions within image pixels 22 may be arranged in rows and columns on array 20. Pixel array 20 may be provided with a color filter array having multiple color filter elements which allows a single image sensor to sample light of different colors. As an example, image sensor pixels such as the image pixels in array 20 may be provided with a color filter array which allows a single image sensor to sample red, green, and blue (RGB) light using corresponding red, green, and blue image sensor pixels arranged in a Bayer mosaic pattern. The Bayer mosaic pattern consists of a repeating unit cell of two-by-two image pixels, with two green image pixels diagonally opposite one another and adjacent to a red image pixel diagonally opposite to a blue image pixel. In another suitable example, the green pixels in a Bayer pattern are replaced by broadband image pixels having broadband color filter elements (e.g., clear color filter elements, yellow color filter elements, etc.). These examples are merely illustrative and, in general, color filter elements of any desired color and in any desired pattern may be formed over any desired number of image pixels 22.
Image sensor 16 may be configured to support a global shutter operation (e.g., pixels 22 may be operated in a global shutter mode). For example, the image pixels 22 in array 20 may each include a photodiode, floating diffusion region, and local charge storage region. With a global shutter scheme, all of the pixels in the image sensor are reset simultaneously. A charge transfer operation is then used to simultaneously transfer the charge collected in the photodiode of each image pixel to the associated charge storage region. Data from each storage region may then be read out on a per-row basis, for example.
A gate terminal of transfer transistors 308-1 and 308-2 respectively receive control signals TG_L and TG_R. A gate terminal of anti-blooming transistors 306-1 and 306-2 respectively receive control signals AB_L and AB_R. A gate terminal of gain select transistor 314 receives control signal DCG. A gate terminal of reset transistor 318 receives control signal RG. A gate terminal of row select transistor 322 receives control signal SEL. Control signals TG_L, TG_R, AB_L, AB_R, DCG, RG, and SEL are provided by row control circuitry, such as row control circuitry 26 in
Photodiodes 302-1 and 302-2 may generate charge (e.g., electrons) in response to receiving impinging photons. The amount of charge that is collected by photodiodes 302 depends on the intensity of the impinging light and the exposure duration (or integration time). Floating diffusion region 310 may also generate charge in response to impinging photons. For example, floating diffusion region 310 may be a doped semiconductor region (e.g., a region in a silicon substrate that is doped by ion implantation, impurity diffusion, or other doping process) that is not covered, allowing impinging light to enter the floating diffusion region. The charge collected by floating diffusion region 310 may depend on the intensity of the impinging light and the integration time. If the storage capacity of floating diffusion region 310 is not large enough to store the collected charge (e.g., in high illumination conditions), at least some of the charge may overflow and may be stored at dual conversion gain capacitor 312.
Following the charge integration at photodiodes 302 and floating diffusion region 310, control signals SEL and DCG may be asserted to turn on row select transistor 322 and gain select transistor 314 (e.g., the transistors may be closed by asserting the gate voltage to provide electrical connection between their source and drain terminals), allowing the charge generated by floating diffusion region 310 to be read out to column output line 322. Because gain select transistor 314 is asserted, both charge generated in floating diffusion region 310 that is still in floating diffusion region 310 and charge generated in floating diffusion region 310 that has overflowed into dual conversion gain capacitor 312 will all be read out. After the charge generated by the FD is read out, control signal RG may be asserted (while gain select transistor 314 is still asserted) to reset floating diffusion region 310 and dual conversion gain capacitor 312 to a known value (e.g, voltage Vpix). The floating diffusion region reset value may then be read out to column output line 324. Reading out the charge collected by floating diffusion region 310 and the reset value allows for noise and/or dark current compensation (e.g., through subtraction operations). These subtraction operations may be referred to as double sampling. Since reset voltage level readout occurs after signal readout, the double sampling readout is with uncorrelated noise (e.g., the double sampling readout is not a correlated double sampling readout). However, the double sampling readout may still reduce noise levels compared to reading out the signal level alone.
After the floating diffusion region charge and reset value have been read out, gain select transistor 314 may be deasserted and control signal RG may again be asserted to reset floating diffusion region 310, and a reset value may be read out to column output line 322. Then, control signals TG_L and TG_R may be asserted to transfer and read out the charge generated by photodiodes 302-1 and 302-2. Control signals TG_L and TG_R may be asserted simultaneously, or they may be asserted individually. Following the readout of the charge generated by both photodiodes, control signal SEL may be deasserted, and control signals AB_L, AB_R, and RG may be asserted to reset photodiodes 302, floating diffusion region 310, and dual conversion gain capacitor 312.
Gain select transistor 314 and dual conversion gain capacitor 312 may be used by pixel 300 (
Although
Following period T1, image readout circuitry 28 of
After floating diffusion region 310 has been reset, image readout circuitry 28 may be used to sample the image signals generated by photodiodes 302. During period T3, correlated double sampling may be used to sample the charge generated by photodiodes 302-1 and 302-2. First, a reset value, SHR_PD, may be sampled. In this case, SHR_PD is a high conversion gain reset value, as gain select transistor 314 is off (e.g., control signal DCG has been deasserted). Control signals TG_L and TG_R may then be asserted to transfer the accumulated charge from photodiodes 302-1 and 302-2, allowing the generated charge to be sampled as high conversion gain signal SHS_PD. High gain reset value SHR_PD may be used by processing circuitry 24 to decrease the noise and dark current associated with high gain signal SHS_PD (e.g., through correlated double sampling operations). Following the sampling of high gain signal SHS_PD, control signal SEL may be deasserted and control signal RG may be asserted to reset the image sensor pixel.
While control signals TG_L and TG_R are asserted simultaneously in the pixel timing diagram shown in
After resetting the floating diffusion region, photodiodes, and dual conversion gain capacitor during reset period D0, integration period D1 begins. During integration period D1, photodiodes 302 may generate charge in response to light incident on the image sensor pixel. Similarly, floating diffusion region 310 may not be shielded from incident light and may also generate charge in response to incident light. In this way, floating diffusion region 310 serves as an additional photosensitive region during the integration period. Dual conversion gain capacitor 312 may collect any charge that overflows from floating diffusion region 310. Charge may overflow from floating diffusion region 310 once the charge storage capacity of floating diffusion region 310 is exceeded. This may occur during high illumination conditions.
Following period D1, image readout circuitry 28 of
After floating diffusion region 310 has been reset, image readout circuitry 28 may be used to sample the image signals generated by first photodiode 302-1. During period D3, correlated double sampling may be used to sample the charge generated by first photodiode 302-1. First, a first reset value, SHR_PD_L, may be sampled. In this case, SHR_PD_L is a high conversion gain reset value, as gain select transistor 314 is off (e.g., control signal DCG has been deasserted). Control signal TG_L may then be asserted to transfer the accumulated charge from first photodiode 302-1, allowing the generated charge to be sampled as first high conversion gain singal SHS_PD_L. First gain reset value SHR_PD_L may be used by processing circuitry 24 to reduce the noise and dark current associated with first high gain signal SHS_PD_L (e.g., through correlated double sampling operations). Following the readout of first high gain signal SHS_PD_L, control signal RG may be asserted to reset the image sensor pixel.
Following the readout of the charge generated by first photodiode 302-1, image readout circuitry 28 may be used to sample the image signals generated by second photodiode 302-2. During period D4, correlated double sampling may be used to sample the charge generated by second photodiode 302-2. First, a second reset value, SHR_PD_R, may be sampled. In this case, SHR_PD_R is a high conversion gain reset value, as gain select transistor 314 is off (e.g., control signal DCG has been deasserted). Control signal TG_R may then be asserted to transfer the accumulated charge from second photodiode 302-2, allowing the generated charge to be sampled as second high gain signal SHS_PD_R. Second high gain reset signal SHR_PD_R may be used by processing circuitry 24 to reduce the noise and dark current associated with second high gain signal SHS_PD_R (e.g., through correlated double sampling operations). Following the sampling of second high gain signal SHS_PD_R, control signal SEL may be deasserted and control signal RG may be asserted to reset the image sensor pixel.
Reading out the charge generated by first photodiode 302-1 and second photodiode 302-2 individually, as shown in the timing diagram of
While the charge generated by first photodiode 302-1 is sampled prior to the charge generated by second photodiode 302-2 in the illustrative timing diagram of
In the readout schemes shown in
It should be noted that the readout schemes described above in connection with
In the imaging pixel of
As shown in
Pixel regions 620 and 624 may be shielded. For example, pixel regions 620 and 624 may be provided with isolation structures to prevent light incident on image sensor pixel 600 from interfering with components 612, 616, 618, and 622. The isolation structures may include different type of isolation devices such as trench isolation structures (e.g., backside deep trench isolation (BDTI)), doped semiconductor regions, metallic barrier structures, or any other suitable isolation structures. Regions 620 and 624 may be completely uncovered, completely covered, or partially covered by the isolation structures.
As depicted in
Photodiodes 602-1 and 602-2 may be covered by a microlens, such as microlens 626 of
The incorporation of at least one microlens in image sensor pixel 600 may be advantageous in phase detection applications when the image output of a first half-pixel (e.g., one of photodiodes 602) is compared to the image output of a second half-pixel (e.g., the second of photodiodes 602) to determine a phase difference (e.g., for determining whether or not focusing settings for an imaging system are appropriate). More than one pixel may be used in phase detection applications, as multiple first half-pixels in an array of image pixels may be compared to multiple second half-pixels in the array of image pixels.
In
A cross-section of an illustrative image sensor pixel, which may correspond to image sensor pixel 600 of
As shown in
Although not shown in
While
Various embodiments have been described illustrating image sensor pixels having split photodiodes that are symmetric about a shared charge storage region (e.g., a floating diffusion region).
In various embodiments of the present invention, an image sensor pixel may have a first photosensitive region, a second photosensitive region, and a third photosensitive region about which the first and second photosensitive regions are symmetric. The image sensor pixel may be formed in a semiconductor substrate having first and second opposing surfaces. The first photosensitive region, the second photosensitive region, and the floating diffusion region may have respective first, second, and third heights. The third height may be within 20% of the first height and within 20% of the second height. The first photosensitive region, the second photosensitive region, and the floating diffusion region may each be n-type doped regions of the semiconductor substrate. In some embodiments, the first photosensitive region, the second photosensitive region, and the floating diffusion region may extend from the first surface of the semiconductor substrate to within 1 micron of the second surface of the semiconductor substrate.
A microlens may cover the first photodiode, the second photodiode, and the floating diffusion region. The semiconductor substrate may include isolation structures, which may be deep trench isolation structures. In some embodiments, the first photodiode, the second photodiode, and the floating diffusion region may extend from the first surface to within 1 micron of the second surface.
In accordance with an embodiment, a dual conversion gain capacitor that is configured to store overflow charge generated by the floating diffusion region may be coupled to the floating diffusion region. A gain select transistor may be coupled between the floating diffusion region and the dual conversion gain transistor and may be turned on to provide the floating diffusion region with increased capacitance.
In various embodiments, the image sensor pixel may have column readout circuitry that is coupled to the floating diffusion region. The column readout circuitry may read out the charge generated by the floating diffusion region, followed by the charge generated by the first and second photodiodes. In some embodiments, the column readout circuitry may read out the charge generated by the first and second photodiodes simultaneously. In other embodiments, the column readout circuitry may read out the charge generated by the first photodiode prior to reading out the charge generated by the second photodiode. The gain select transistor may be enabled when the charge generated by the floating diffusion region is read out, while the gain select transistor may be disabled when the charge generated by the first photodiode and the second photodiode is read out.
In some embodiments, an image sensor pixel having a first photosensitive region, a second photosensitive region, and a floating diffusion region may be operated by generating charge in the first photosensitive region, the second photosensitive region, and the floating diffusion region during an integration time. After generating the charge, the charge generated by the floating diffusion region may be read out, followed by the charge generated by the first and second photosensitive regions. According to some embodiments, the charge generated by the first and second photosensitive regions may be read out simultaneously. The image sensor pixel may also reset the floating diffusion region to a first reset value and read out the first reset value after reading out the charge generated by the floating diffusion region, and reset the image sensor pixel to a second reset value associated with the first and second photosensitive regions and read out the second reset value after reading out the first reset value.
According to other embodiments, the charge generated by the first photosensitive region may be read out prior to the charge generated by the second photosensitive region. The image sensor pixel may reset the floating diffusion region to a first reset value and read out the first reset value after reading out the charge generated by the floating diffusion region, reset the image sensor pixel to a second reset value associated with the first photosensitive region and read out the second reset value after reading out the first reset value, and reset the image sensor pixel to a third reset value associated with the second photosensitive region and read out the third reset value after reading out the charge generated by the first photosensitive region.
The image sensor pixel may also have a dual conversion gain capacitor coupled to the floating diffusion region and a gain select transistor coupled between the dual conversion gain capacitor and the floating diffusion region. The gain select transistor may be activated after the integration time, and the charge generated by the floating diffusion region may be read out while the gain select transistor is activated. After the charge generated by the floating diffusion region is read out, the gain select transistor may be deactivated, and the charge generated by the first and second photosensitive regions may be read out while the gain select transistor is deactivated.
The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
Number | Name | Date | Kind |
---|---|---|---|
9344647 | Agranov et al. | May 2016 | B2 |
9942503 | Velichko | Apr 2018 | B2 |
10075663 | Oh | Sep 2018 | B2 |
10271037 | Oh | Apr 2019 | B2 |
20060208161 | Okita | Sep 2006 | A1 |
20090045319 | Sugawa et al. | Feb 2009 | A1 |
20100181602 | Oishi | Jul 2010 | A1 |
20130222552 | Agranov et al. | Aug 2013 | A1 |
20160204158 | Hsu | Jul 2016 | A1 |
20160286108 | Fettig | Sep 2016 | A1 |
20170040360 | Iizuka | Feb 2017 | A1 |
20170330906 | Korobov | Nov 2017 | A1 |
Number | Date | Country |
---|---|---|
1887626 | Feb 2008 | EP |
2013008425 | Jan 2013 | WO |
Entry |
---|
M. Sakakibara et. el. “An 83dB-Dynamic-Range Single-Exposure Global-Shutter CMOS Image Sensor with In-Pixel Dual Storage”, in ISSCC 2012 Proc., pp. 380-382, Feb. 2012. |
N. Akahane, et al., “Optimum Design of Conversion Gain and Full Well Capacity in CMOS Image Sensor With Lateral Overflow Integration Capacitor,” IEEE Trans. Electron Devices, vol. 56, No. 11, pp. 2429-2435, Nov. 2009. |
Number | Date | Country | |
---|---|---|---|
20190215471 A1 | Jul 2019 | US |