The present invention relates, in various embodiments, to the construction, fabrication, and use of charge-coupled-device (CCD) image sensors.
CCD image sensors typically include an array of photosensitive areas (or “pixels”) that collect charge carriers in response to illumination. The collected charge is subsequently transferred from the array of pixels and converted to a voltage from which an image may be reconstructed by associated circuitry.
Systems such as digital cameras utilizing CCD image sensors typically need to operate at high frame rates for, e.g., machine vision applications and video display. For cameras using conventional CCD image sensors, these high frame rates can result in high power consumption to generate so many horizontal scanning CCD clocking voltages and currents. Much of the power is generally lost to heat, which degrades the operation of the camera through higher imager dark current. Other potential disadvantages include increased readout noise due to the high signal-sampling frequency utilized during the readout operation.
One technique that has been utilized to address the power-consumption and noise issues with CCD image sensors is the separation of the pixel array and the readout circuitry onto separate chips, which are then bonded together. For example,
Embodiments of the present invention provide image sensors with reduced power consumption and noise, particularly at high signal readout frequencies. The image sensors combine the imaging performance advantages of CCD detection and charge transport with the low power and low noise of column-scanning readout techniques. Embodiments of the invention thus include monolithic (i.e., single-chip) CCD image sensors that utilize a sense node at the end of each VCCD (or set of multiplexed VCCDs) and that replace the conventional HCCD with different, typically passive, readout circuitry. The pixel array and VCCDs may be fabricated via the same process as the readout circuitry, simplifying manufacture and rendering the fabrication less expensive. Thus, in many embodiments it is difficult for the pitch of the readout circuits for each column to match the pitch of the columns of pixels and associated VCCDs, as each column readout circuit typically includes too many transistors to fit within the chip width of each column defined by each column of pixels and its associated VCCD. Therefore, embodiments of the invention feature serialized VCCDs that share and are multiplexed into a single shared column readout circuit, thereby trading off readout speed for decreased chip area and readout transistor count. Furthermore, the column pitch of the image sensor may be additionally decreased via the fabrication of readout circuits on multiple sides of the pixel array, where some VCCDs are read out on one side while other VCCDs are read out on another side. For example, in one specific embodiment, every other VCCD is read out at the top of the array while the other VCCDs are read out at the bottom of the array.
Embodiments of the invention advantageously utilize charge binning within the VCCDs, as described in U.S. patent application Ser. No. 12/570,048, filed on Sep. 30, 2009, U.S. Pat. No. 7,385,638, filed on Apr. 28, 2004, U.S. Pat. No. 7,893,981, filed on Feb. 28, 2007, and U.S. Pat. No. 7,948,534, filed on Oct. 22, 2008, the entire disclosure of each of which is incorporated by reference herein.
Embodiments of the invention feature an electronic shutter and associated control circuitry, as described in U.S. patent application Ser. No. 12/770,811, filed on Apr. 30, 2010, the entire disclosure of which is incorporated by reference herein.
In an aspect, embodiments of the invention feature an image sensor including or consisting essentially of an array of photosensitive pixels arranged in columns, a plurality of vertical CCDs, a plurality of sense nodes, and readout circuitry. Each vertical CCD is associated with one of the columns of pixels, and each sense node is associated with and accepts charge from one or more vertical CCDs and converts the charge into a voltage. The readout circuitry accepts voltage from the plurality of sense nodes and, based thereon, outputs signals for reconstruction into an image sensed by the array of photosensitive pixels.
Embodiments of the invention may incorporate one or more of the following in any of a variety of different combinations. Each sense node may be associated with a single vertical CCD. The readout circuitry may include or consist essentially of a discrete column readout circuit associated with each sense node. Each column readout circuit may include circuitry for subtracting a reference value from the sense node from a signal value from the sense node. The array of photosensitive pixels, the plurality of vertical CCDs, the plurality of sense nodes, and the readout circuitry may be all portions of a single monolithic integrated circuit. The readout circuitry may include or consist essentially of a readout circuit shared by multiple vertical CCDs. Delay registers may be disposed between the multiple vertical CCDs and the sense nodes associated therewith.
The delay registers may serialize output from the multiple vertical CCDs into the readout circuit shared thereby. A multiplexer may rout signals between the sense nodes associated with the multiple vertical CCDs and the readout circuit.
The image sensor may include one or more delay stages for outputting charges from two or more vertical CCDs into a single sense node. The delay stage(s) may be configured to combine charges from the two or more vertical CCDs prior to output to the single sense node. The readout circuitry may include or consist essentially of (i) a first portion disposed on a first side of the array of photosensitive pixels and (ii) a second portion disposed on a second side of the array of photosensitive pixels different from (e.g., opposite) the first side. Some of the sense nodes may be disposed on the first side and some other sense nodes may be disposed on the second side. Each sense node may include or consist essentially of a floating diffusion, a reset transistor, and an amplifier. The image sensor may have an interline architecture in which each vertical CCD is proximate the column of pixels associated therewith. The image sensor may have a full-frame architecture in which each vertical CCD is the column of pixels associated therewith.
In another aspect, embodiments of the invention feature a method of operating an image sensor comprising an array of photosensitive pixels arranged in columns and a vertical CCD associated with each column of pixels. Charge is converted from one or more vertical CCDs into voltage, thereby forming a plurality of different sense voltages. The plurality of sense voltages are read out for reconstruction thereof into an image sensed by the array of photosensitive pixels.
Embodiments of the invention may incorporate one or more of the following in any of a variety of different combinations. The charge conversion may be performed at sense nodes, each of which is associated with one or more vertical CCDs. Charge from a plurality of vertical CCDs may be serially transferred into a single source node. Charge from a plurality of vertical CCDs may be combined prior to the charge conversion. Reading out the plurality of sense voltages may include multiplexing multiple sense voltages for transfer into a single readout circuit. The charge conversion and reading out may be performed for a first portion of the photosensitive pixels on a first side of the array and for a second portion of the photosensitive pixels on a second side of the array different from (e.g., opposite) the first side. The charge conversion and reading out of the sense voltages may be performed on a single monolithic integrated circuit that also contains the array of photosensitive pixels and the vertical CCDs.
These and other objects, along with advantages and features of the present invention herein disclosed, will become more apparent through reference to the following description, the accompanying drawings, and the claims. Furthermore, it is to be understood that the features of the various embodiments described herein are not mutually exclusive and may exist in various combinations and permutations. As used herein, the terms “approximately” and “substantially” mean ±10%, and in some embodiments, ±5%. The term “consists essentially of” means excluding other materials that contribute to function, unless otherwise defined herein. Nonetheless, such other materials may be present, collectively or individually, in trace amounts.
In the drawings, like reference characters generally refer to the same parts throughout the different views. Also, the drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the invention. In the following description, various embodiments of the present invention are described with reference to the following drawings, in which:
Each VCCD 340 (or set of multiple VCCDs 340, as detailed further below) transfers charge from the pixels in columns 330 to a sense node 350, e.g., a floating diffusion node electrically isolated from other nodes in the device. At each sense node 350, the received charge is converted to a voltage that is passed to readout circuitry 320 for output and reconstruction into an image outside image sensor 300 (either on the same chip or on another chip electrically connected thereto). The readout circuitry 320 replaces the conventional HCCD, and may include or consist essentially of a passive circuit as detailed below. (Thus, readout circuitry 320 is not an HCCD.) The imaging array region 310, sense nodes 350, and readout circuitry 320 are typically fabricated as a single monolithic integrated circuit utilizing, for example, the same semiconductor-manufacturing process (and, in some embodiments, design rules). Power consumption is reduced via replacement of the power-hungry conventional HCCD, and noise reduction is enabled by the utilization of sense nodes between the VCCDs and the column readout circuitry.
In some embodiments of the present invention, there may be insufficient chip area to fabricate particular column readout circuits (e.g., circuit 400) for each column of the CCD imaging array due to the number of devices within the individual readout circuits; that is, the individual column readout circuits may not fit within the column pitch of the pixel array, which is preferably minimized to provide higher imaging resolution. However, utilization of a certain number of devices within a column readout circuit may be advantageous, as in many embodiments (and as described above) the signal and reference voltage levels may both be sampled, enabling the minimization of various types of noise (e.g., fixed pattern noise due to the source follower offset voltage and/or temporal noise).
As also shown in
While the embodiment of
Various embodiments of the present invention increase the chip area available for sense nodes 350 and/or associated readout circuits by utilizing multidirectional readout schemes. As depicted in
Embodiments of the present invention may be utilized in a variety of different systems and devices, including, for example, digital cameras, digital video cameras, scanners, and telescopes.
Light 802 from a subject scene to be imaged is input to an imaging stage 804, where the light is focused by a lens 806 to form an image on a CCD image sensor 808 (which may include or consist essentially of, e.g., imaging region 310 of
The light passes through the lens 806 and a filter 810 prior to being sensed by image sensor 808. Optionally, light 802 passes through a controllable iris 812 and a mechanical shutter 814. The filter 810 may include or consist essentially of an optional neutral-density filter for imaging brightly lit scenes. An exposure controller 816 responds to the amount of light available in the scene, as metered by a brightness sensor block 818, and regulates the operation of filter 810, iris 812, shutter 814, and the integration time (or exposure time) of image sensor 808 to control the brightness of the image as sensed by image sensor 808.
This description of a particular camera configuration will be familiar to those skilled in the art, and it will be obvious that many variations and additional features are, or may be, present. For example, an autofocus system may be added, or the lenses may be detachable and interchangeable. It will be understood that embodiments of the present invention may be applied to any type of digital camera, where similar functionality is provided by alternative components. For example, the digital camera may be a relatively simple point-and-shoot digital camera, where shutter 814 is a relatively simple movable blade shutter, or the like, instead of a more complicated focal plane arrangement as may be found in a digital single-lens reflex camera. Embodiments of the invention may also be incorporated within imaging components included in simple camera devices such as those found in, e.g., mobile phones and automotive vehicles, which may be operated without controllable irises 812 and/or mechanical shutters 814. Lens 806 may be a fixed focal-length lens or a zoom lens.
As shown, the analog signal from image sensor 808 (corresponding to the amount of charge collected from one or more pixels) is processed by analog signal processor 820 and applied to one or more analog-to-digital (A/D) converters 822. A timing generator 824 produces various clocking signals to select rows, columns, or pixels in image sensor 808, to transfer charge out of image sensor 808, and to synchronize the operations of analog signal processor 820 and A/D converter 822. An image sensor stage 826 (all or parts of which may correspond to CCD image sensor 300 as depicted in
DSP 830 is one of three processors or controllers in the illustrated embodiment, which also includes a system controller 832 and exposure controller 816. Although this partitioning of camera functional control among multiple controllers and processors is typical, these controllers or processors are combined in various ways without affecting the functional operation of the camera and the application of embodiments of the present invention. These controllers or processors may include or consist essentially of one or more DSP devices, microcontrollers, programmable logic devices, or other digital logic circuits. Although a combination of such controllers or processors has been described, it should be apparent that one controller or processor may be designated to perform all of the required functions. All of these variations may perform the same function and fall within the scope of various embodiments of the invention, and the term “processing stage” is utilized herein to encompass all of this functionality within one phrase, for example, as in processing stage 834 in
In the illustrated embodiment, DSP 830 manipulates the digital image data in memory 828 according to a software program stored in a program memory 836 and copied to memory 828 for execution during image capture. DSP 830 executes the software necessary for image processing in an embodiment of the invention. Memory 828 may include or consist essentially of any type of random access memory, such as SDRAM. A bus 838, a pathway for address and data signals, connects DSP 830 to its related memory 828, A/D converter 822, and other related devices.
System controller 832 controls the overall operation of the image capture device 800 based on a software program stored in program memory 836, which may include or consist essentially of, e.g., flash EEPROM or other nonvolatile memory. This memory may also be used to store image sensor calibration data, user setting selections, and/or other data to be preserved when the image capture device 800 is powered down. System controller 832 controls the sequence of image capture by directing exposure controller 816 to operate lens 806, filter 810, iris 812, and shutter 814 as previously described, directing timing generator 824 to operate image sensor 808 and associated elements, and directing DSP 830 to process the captured image data. After an image is captured and processed, the final image file stored in memory 828 may be transferred to a host computer via an interface 840, stored on a removable memory card 842 or other storage device, and/or displayed for the user on an image display 844.
A bus 846 includes a pathway for address, data and control signals, and connects system controller 832 to DSP 830, program memory 836, a system memory 848, host interface 840, memory card interface 850, and/or other related devices. Host interface 840 provides a high-speed connection to a personal computer or other host computer for transfer of image data for display, storage, manipulation, and/or printing. This interface may include or consist essentially of an IEEE 1394 or USB 2.0 serial interface or any other suitable digital interface. Memory card 842 is typically a Compact Flash card inserted into a socket 852 and connected to system controller 832 via memory card interface 850. Other types of storage that may be utilized include, without limitation, PC-Cards, MultiMedia Cards, and/or Secure Digital cards.
Processed images may be copied to a display buffer in system memory 848 and continuously read out via a video encoder 854 to produce a video signal. This signal may be output directly from image capture device 800 for display on an external monitor, or processed by a display controller 856 and presented on image display 844. This display is typically an active-matrix color liquid crystal display, although other types of displays may be utilized.
A user interface 858, including all or any combination of a viewfinder display 860, an exposure display 862, a status display 864, image display 844, and user inputs 866, may be controlled by one or more software programs executed on exposure controller 816 and system controller 832. User inputs 866 typically include some combination of buttons, rocker switches, joysticks, rotary dials, and/or touch screens. Exposure controller 816 operates light metering, exposure mode, autofocus and other exposure functions. System controller 832 manages the graphical user interface (GUI) presented on one or more of the displays, e.g., on image display 844. The GUI typically includes menus for making various option selections and review modes for examining captured images.
Exposure controller 816 may accept user inputs selecting exposure mode, lens aperture, exposure time (shutter speed), and exposure index or ISO speed rating and directs the lens and shutter accordingly for subsequent captures. Optional brightness sensor 818 may be employed to measure the brightness of the scene and provide an exposure meter function for the user to refer to when manually setting the ISO speed rating, aperture, and shutter speed. In this case, as the user changes one or more settings, the light meter indicator presented on viewfinder display 860 tells the user to what degree the image will be over- or under-exposed. In an alternate case, brightness information is obtained from images captured in a preview stream for display on image display 844. In an automatic exposure mode, the user changes one setting and exposure controller 816 automatically alters another setting to maintain correct exposure, e.g., for a given ISO speed rating when the user reduces the lens aperture, exposure controller 816 automatically increases the exposure time to maintain the same overall exposure.
The foregoing description of an image capture device will be familiar to one skilled in the art. It will be obvious that there are many variations that are possible and may be selected to reduce the cost, add features, or improve the performance thereof.
The terms and expressions employed herein are used as terms and expressions of description and not of limitation, and there is no intention, in the use of such terms and expressions, of excluding any equivalents of the features shown and described or portions thereof. In addition, having described certain embodiments of the invention, it will be apparent to those of ordinary skill in the art that other embodiments incorporating the concepts disclosed herein may be used without departing from the spirit and scope of the invention. Accordingly, the described embodiments are to be considered in all respects as only illustrative and not restrictive.
This application claims the benefit of and priority to U.S. Provisional Patent Application No. 61/480,390, filed Apr. 29, 2011, the entire disclosure of which is hereby incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
61480390 | Apr 2011 | US |