Cameras used in devices such as mobile phones, tablets, personal media players, digital cameras, surveillance systems, and the like comprise arrays of sensor elements, or pixels, arranged in two dimensions in order to obtain a two-dimensional image of a scene. Correlated double sampling (CDS) circuits are widely used with these arrays to reduce column fixed pattern noise (FPN), thereby increasing the accuracy of the pixel values produced by the arrays. Traditional CDS circuits, however, include a variety of components that may themselves be a source of noise and can be difficult to reduce in scale at the same rate that pixel sizes are being reduced.
Techniques provided herein are directed toward a simplified correlated double sampling (CDS) circuit that reduces the amount of components and potential noise sources utilized to two switches and a capacitor. Such CDS circuits can be used in conjunction with downstream programmable gain amplifier (PGA) circuitry to provide double sampling along with variable gain and/or other features. Embodiments may further utilize one or more analog multiplexers (muxes) to reduce parasitic capacitance and increase accuracy.
An example apparatus for providing image sensing, according to the disclosure, comprises an active pixel sensor array comprising a pixel array having a plurality of columns of pixels, and, for each column of pixels of the plurality of columns of pixels of the active pixel sensor array, a correlated double sampling (CDS) circuit corresponding to, and coupled with, the each column of pixels, wherein each CDS circuit comprises a first switch, a first capacitor, and a second switch, wherein, for each CDS circuit. The first capacitor is connected in series between the first switch and the second switch without an active element disposed between the first capacitor and the second switch, and an input of the first switch is coupled to an output of the corresponding column of pixels. The apparatus further includes an amplification circuit comprising a second capacitor and a third switch connected in parallel with the second capacitor, wherein, for the each CDS circuit, an output of the second switch of is coupled to an input of the amplification circuit.
An example method of providing image sensing, according to the disclosure comprises obtaining, for each column of pixels in an active pixel sensor array, a first value from a pixel sensor in the column of pixels, and storing, for each column of pixels in the active pixel sensor array, the first value with a corresponding CDS circuit comprising a first switch, a first capacitor, and a second switch. The first capacitor is connected in series between the first switch and the second switch without an active element disposed between the first capacitor and the second switch, and an input of the first switch is coupled to an output of the corresponding column of pixels. The method further comprises providing, with an amplification circuit coupled to each of the CDS circuits, a plurality of output signals, wherein each output signal corresponds to a column of pixels in the active pixel sensor array, and is based on the first value stored by the CDS circuit corresponding to the column of pixels and a second value obtained by the CDS circuit corresponding to the column of pixels. The amplification circuit comprises a second capacitor and a third switch connected in parallel with the second capacitor.
Another example apparatus, according to the disclosure, comprises means for obtaining, for each column of pixels in an active pixel sensor array, a first value from a pixel sensor in the each column of pixels, means for storing, for each column of pixels in the active pixel sensor array, the first value within a corresponding CDS circuit that does not include a buffer or amplifier, and means for providing a plurality of amplified output signals. Each output signal corresponds to a column of pixels in the active pixel sensor array, and is based on the first value stored by the means for storing and a second value obtained by the means for storing CDS circuit corresponding to the column of pixels
An example non-transitory computer-readable medium, according to the disclosure, comprises instructions for causing an apparatus to provide image sensing. The instructions include computer code for obtaining, for each column of pixels in an active pixel sensor array, a first value from a pixel sensor in the column of pixels, storing, for each column of pixels in the active pixel sensor array, the first value with a corresponding CDS circuit comprising a first switch, a first capacitor, and a second switch, where the first capacitor is connected in series between the first switch and the second switch without an active element disposed between the first capacitor and the second switch, and an input of the first switch is coupled to an output of the corresponding column of pixels. The instructions further comprise computer code for providing, with an amplification circuit coupled to each of the CDS circuits, a plurality of output signals, wherein each output signal corresponds to a column of pixels in the active pixel sensor array, and is based on the first value stored by the CDS circuit corresponding to the column of pixels and a second value obtained by the CDS circuit corresponding to the column of pixels, and the amplification circuit comprises a second capacitor and a third switch connected in parallel with the second capacitor.
An understanding of the nature and advantages of various embodiments may be realized by reference to the following figures.
The ensuing description provides embodiment(s) only, and is not intended to limit the scope, applicability or configuration of the disclosure. Rather, the ensuing description of the embodiment(s) will provide those skilled in the art with an enabling description for implementing an embodiment. It is understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope of this disclosure.
As used herein, the term “mobile device” can include any of a variety of portable electronic devices, such as mobile phones, tablets, portable media players, wearable devices, and the like. And although embodiments provided herein are described in terms of mobile devices, embodiments are not so limited. For example, embodiments may utilize stationary battery-powered devices, devices that are not battery powered, and more. A person of ordinary skill in the art will recognize that techniques and features described herein may be utilized in many different applications.
It should be noted that the embodiments herein describe values from pixel sensors (intensity values sensed by and/or associated with pixels) as being indicated with voltage values. However, it will be appreciated that other analog or digital values (e.g., currents) may additionally or alternatively be utilized. It can be further noted that, for the embodiments disclosed herein the terms “pixel,” “pixel sensor,” and “active pixel sensor” (or “APS”) are used interchangeably, referring to a single element of a pixel sensor array, such as an APS array.
The APS array 110 comprises an array of pixel sensors arranged in rows and columns. When exposed to the light, each pixel sensor generates a value (e.g., a voltage or current value) that represents, for example, and intensity of the light sensed by the pixel sensor. The APS array 110 may include monochrome and/or color pixel sensors, depending on desired functionality. Although the APS array 110 shown in
According to some embodiments, the general operation of the camera circuitry 100 is as follows. Camera optics (not shown) focus light onto the APS array 110, and the pixel sensors generate pixel values that are read from the APS array 110 a row at a time. The row driver 130 selects a row of the APS array 110 (e.g., by causing a row select output for a selected row to switch from a low to a high voltage) and the pixel values are provided to the CDS circuitry 120. Through a process explained in more detail below, the CDS circuitry 120 (which includes a CDS circuit for each column of the APS array 110) removes noise from the value of each pixel in the row, and provides pixel values to the PGA 160, one pixel at a time. The PGA 160, which buffers and optionally amplifies the signal from the CDS circuitry 120, provides pixel values to the ADC 170, which converts the pixel values to a digital value. All of this is orchestrated by the timing generator 140, the bias circuitry 150 providing a bias voltage and/or current as needed, and a digital output (labeled “D_OUT<0:M>” in
The CDS circuit 220-1 is a type of “sample and hold” circuit that, as illustrated, traditionally comprises two switches, two capacitors, and two buffers. Simply put, the CDS circuit 220-1 samples and holds output values of the APS 210 twice: once during the reset of the pixel value to capture the source follower signal (during which the SEL input to the APS 210 is low, the RES switch of the CDS circuit 220-1 is turned on, and the SIG switch is turned off), and once during the readout of the pixel signal value (during which the SEL input to the APS 210 is high, the RES switch of the CDS circuit 220-1 is turned off, and the SIG switch is turned on). These reset and signal values are fed to the PGA 230-1, which then subtracts the signal value from the reset value and provides resulting value to the ADC. Since each source follower varies from one column to the next (a noise known as column fixed pattern noise (FPN)), this subtraction of the reset and signal values provided by the CDS circuit 220-1 helps minimize these variations and increase the accuracy of the image captured by the camera. (The source follower current is represented in
Because there is a CDS circuit 220-1 for each column of the APS array 110, the components of the CDS circuit 220-1 are typically laid out such that they match—at least to a degree—the pitch of each column of the APS array 110. Currently, for example, careful layout is required to put all of the components of the CDS circuit 220-1 into a limited area of approximately 2-10 μm (where the pixel pitch is approximately 1-5 μm). To help ensure accuracy from one column to the next, the CDS circuit 220-1 for each column must be matched as closely as possible. This can be difficult with the amount and complexity of the components in the CDS circuit 220-1. Additionally, the buffers of the CDS circuit 220-1 are a source of noise and increased power consumption of the circuitry 200-1. Techniques provided herein utilize modified circuitry that addresses these and other issues. Hence, for example, in some implementations, CDS circuit 220-1 can have lower power consumption if CDS circuit 220-1 does not include an active element, such as, for example, an operational amplifier (op amp). For example, in some implementations described below, an operational amplifier near the output of the CDS circuit 220-1 may be omitted to allow for a low power CDS circuit.
The modified CDS circuit 320 and the modified PGA 370 are far simpler in design. According to some embodiments, and as illustrated in
Bearing in mind that the modified CDS circuit 320 is replicated for every column of the APS array 110, the benefits of the simplification of the modified CDS circuit 320 are compounded in view of the overall camera circuitry 100 of
It can be noted that VM is a DC bias voltage provided from bias circuitry (e.g., bias circuitry 150 of
The signal voltages, VSIG, for all columns are captured on corresponding capacitors, C1, by turning on switches S1, S2, and the csel switch for all columns (e.g., csel0, csel1, . . . , cselM) at time T0. The output voltage, V0, becomes VM, because switches S2 short the output of the op amp of the PGA to the input value VM. For illustrative purposes, a schematic diagram of this configuration of the circuit is provided in
Once switches S1, S2, and the csel switch for all columns are turned back off, the reset voltage (VRST) is applied at time T1, and the reset voltage minus the signal voltage (VRST-VSIG) is read out column by column, starting at time T2, by turning on switches S3 and csel (for the column) while S1 is on. For illustrative purposes, a schematic diagram of the configuration of the circuit for reading the output voltage for the first column (selected with signal csel0) is provided in
Simulated results show that the circuitry illustrated in
As can be seen, variations in the offset voltages Voff had very little impact in the output voltage V0. With regard to changes in the offset voltage at transistor M1, as shown in chart 722, the standard variation in the output voltage V0 was 0.487 mV, with the maximum variation being 1 mV. Chart 724 indicates that the output voltage V0 was affected far less by offset voltages at transistor M2. Graph 730 illustrates the relationship between varying drain currents 732 and 734 of M1 and M2, respectively, and corresponding output voltages 736 and 738.
These variations in the output voltage may be undetectable by downstream circuitry. For example, where the output voltage varies from 0 V to approximately 1 V and the ADC to which the output voltage of the PGA is connected provides 8-bit ADC conversion (providing 256 unique output levels), the granularity of each step of the ADC is 1 V/246, or approximately 4 mV. Thus, a standard variation in the output voltage V0 of 0.487 mV (or even a maximum variation of 1 mV) is unlikely to impact the value of digitally-converted output. (And in the instances in which it does impact the value of the digitally converted output, it would only change the output value at most by 1 on a scale of 0 to 255.) As such, the modified CDS circuit 320 and the modified PGA 370 of
Here, the PGA circuitry includes a plurality of switches (g1, g2, and g3) connected in parallel with a plurality of additional capacitors (C2, C2/2, and C2/4) such that the amount of capacitance is adjustable by turning on and off the switches to bypass one or more of the plurality of additional capacitors. To be clear, for a given value of C2, the capacitors C2/2 and C2/4 have ½ and ¼ the capacitance of C2, respectively. If C2=C1, this allows for a 1-8× gain depending on how the switches are configured, as reflected in the following table:
Here, when switches g1, g2, and g3 are all turned on, the additional capacitors (C2, C2/2, and C2/4) are bypassed, which increases the capacitance (because the additional capacitors are connected in series). And because C2=C1, the gain of the APS is 1. When switches g1, g2, and g3 are all turned off, the additional capacitors serve to decrease the capacitance to ⅛ the value of C2, thereby leading to a gain of 8. As indicated in Table 1, other gains are achievable by activating switches g1, g2, and g3 in different combinations. Of course, other embodiments may include additional or alternative values for the additional capacitors, thereby making additional or alternative gain values possible, depending on desired functionality. By adjusting the capacitance value as described above using the plurality of switches (g1, g2, and g3), the amount of amplification, or gain, by the amplification circuit, can be adjusted using the plurality of switches. Second capacitor discussed below with reference to
In the schematic diagram 900, 160 inputs correspond with 160 columns in the APS array 110. (For simplicity, the circuitry in the boxes of the schematic diagram 900 has been simplified, showing only a single switch, whereas the actual circuitry utilized may include several switches—one for each input. A person of ordinary skill in the art will appreciate the actual circuitry utilized.) An initial layer of circuitry 910 comprises 160 switches S1 and capacitors C1, similar to what is shown in
Of course, alternative embodiments may include a larger or smaller number of columns than what is shown in
Such muxes may not be utilized in every embodiment. For example, in embodiments with an APS array 110 having relatively few columns, the amount of parasitic capacitance from csel switches may not result in errors that would necessitate the utilization of muxes. In some embodiments, the determination of whether to include a mux is based on the amount of error the system downstream (e.g., the ADC) can handle. A person of ordinary skill in the art would appreciate these considerations when determining whether to use one or more muxes.
At block 1010, for each column of pixels in an active pixel sensor array, a first value is obtained from a pixel sensor in the column of pixels. As explained previously, the first value be obtained by CDS circuitry by closing switch S1 in the manner illustrated in
At block 1020, for each column of pixels in the active pixel sensor array, the first value is stored with a corresponding CDS circuit, where the corresponding CDS circuit comprises a first switch, a first capacitor, and a second switch. The first capacitor (e.g., C1 in
At block 1030 an amplification circuit coupled to each of the CDS circuits provides a plurality of output signals, where each output signal is based on the first value stored by a corresponding CDS circuit and a second value obtained by the corresponding CDS circuit, wherein the amplification circuit comprises a second capacitor and a third switch connected in parallel with the second capacitor. Stated differently, the amplification circuit (e.g., PGA circuitry shown in
The method of
The mobile device 1100 is shown comprising hardware elements that can be electrically coupled via a bus 1105 (or may otherwise be in communication, as appropriate). The hardware elements may include a processing unit(s) 1110 which can include without limitation one or more general-purpose processors, one or more special-purpose processors (such as digital signal processing (DSP) chips, graphics acceleration processors, application specific integrated circuits (ASICs), and/or the like), and/or other processing structure or means. The processing unit(s) 1110 may correspond to the processing unit of the previously-described embodiments. As shown in
The mobile device 1100 might also include a wireless communication interface 1130, which can include without limitation a modem, a network card, an infrared communication device, a wireless communication device, and/or a chipset (such as a Bluetooth™ device, an Institute of Electrical and Electronics Engineers standard (IEEE) 802.11 device, an IEEE 802.15.4 device, a WiFi device, a WiMax device, cellular communication facilities, etc.), and/or the like. The wireless communication interface 1130 may permit data to be exchanged with a network, wireless access points, other computer systems, and/or any other electronic devices described herein. The communication can be carried out via one or more wireless communication antenna(s) 1132 that send and/or receive wireless signals 1134.
Depending on desired functionality, the wireless communication interface 1130 can include separate transceivers to communicate with base transceiver stations (e.g., base stations of a cellular network) access point(s). Additionally, a WWAN may be a Code Division Multiple Access (CDMA) network, a Time Division Multiple Access (TDMA) network, a Frequency Division Multiple Access (FDMA) network, an Orthogonal Frequency Division Multiple Access (OFDMA) network, a Single-Carrier Frequency Division Multiple Access (SC-FDMA) network, a WiMax (IEEE 802.16), and so on. A wireless local area network (WLAN) may also be an IEEE 802.11x network, and a WPAN may be a Bluetooth network, an IEEE 802.15x, or some other type of network.
The mobile device 1100 can further include sensor(s) 1140. Such sensors can include, without limitation, one or more accelerometer(s), gyroscope(s), camera(s), vision sensor(s), magnetometer(s), altimeter(s), microphone(s), proximity sensor(s), light sensor(s), and the like. The camera(s) may include one or more of the components shown in the camera circuitry 100 of
Some embodiments of the mobile device may also include a satellite positioning system (SPS) receiver 1180 capable of receiving signals 1184 from one or more SPS satellites using an SPS antenna 1182.
The mobile device 1100 may further include and/or be in communication with a memory 1160. The memory 1160 can include, without limitation, local and/or network accessible storage, a disk drive, a drive array, an optical storage device, a solid-state storage device, such as a random access memory (“RAM”), and/or a read-only memory (“ROM”), which can be programmable, flash-updateable, and/or the like. Such storage devices may be configured to implement any appropriate data stores, including without limitation, various file systems, database structures, and/or the like.
The memory 1160 of the mobile device 1100 also can comprise software elements (not shown), including an operating system, device drivers, executable libraries, and/or other code, such as one or more application programs, which may comprise computer programs provided by various embodiments, and/or may be designed to implement methods, and/or configure systems, provided by other embodiments, as described herein. In an aspect, then, such code and/or instructions can be used to configure and/or adapt a general purpose computer (or other device) to perform one or more operations in accordance with the described methods.
It will be apparent to those skilled in the art that substantial variations may be made in accordance with specific requirements. For example, customized hardware might also be used, and/or particular elements might be implemented in hardware, software (including portable software, such as applets, etc.), or both. Further, connection to other computing devices such as network input/output devices may be employed.
With reference to the appended figures, components that can include memory can include non-transitory machine-readable media. The term “machine-readable medium” and “computer-readable medium” as used herein, refer to any storage medium that participates in providing data that causes a machine to operate in a specific fashion. In embodiments provided hereinabove, various machine-readable media might be involved in providing instructions/code to processing units and/or other device(s) for execution. Additionally or alternatively, the machine-readable media might be used to store and/or carry such instructions/code. In particular, although embodiments described above include hardware components, techniques described herein (e.g., the method of
The methods, systems, and devices discussed herein are examples. Various embodiments may omit, substitute, or add various procedures or components as appropriate. For instance, features described with respect to certain embodiments may be combined in various other embodiments. Different aspects and elements of the embodiments may be combined in a similar manner. The various components of the figures provided herein can be embodied in hardware and/or software. Also, technology evolves and, thus, many of the elements are examples that do not limit the scope of the disclosure to those specific examples.
It has proven convenient at times, principally for reasons of common usage, to refer to such signals as bits, information, values, elements, symbols, characters, variables, terms, numbers, numerals, or the like. It should be understood, however, that all of these or similar terms are to be associated with appropriate physical quantities and are merely convenient labels. Unless specifically stated otherwise, as is apparent from the discussion above, it is appreciated that throughout this Specification discussions utilizing terms such as “processing,” “computing,” “calculating,” “determining,” “ascertaining,” “identifying,” “associating,” “measuring,” “performing,” or the like refer to actions or processes of a specific apparatus, such as a special purpose computer or a similar special purpose electronic computing device. In the context of this Specification, therefore, a special purpose computer or a similar special purpose electronic computing device is capable of manipulating or transforming signals, typically represented as physical electronic, electrical, or magnetic quantities within memories, registers, or other information storage devices, transmission devices, or display devices of the special purpose computer or similar special purpose electronic computing device.
Terms, “and” and “or” as used herein, may include a variety of meanings that also is expected to depend at least in part upon the context in which such terms are used. Typically, “or” if used to associate a list, such as A, B, or C, is intended to mean A, B, and C, here used in the inclusive sense, as well as A, B, or C, here used in the exclusive sense. In addition, the term “one or more” as used herein may be used to describe any feature, structure, or characteristic in the singular or may be used to describe some combination of features, structures, or characteristics. However, it should be noted that this is merely an illustrative example and claimed subject matter is not limited to this example. Furthermore, the term “at least one of” if used to associate a list, such as A, B, or C, can be interpreted to mean any combination of A, B, and/or C, such as A, AB, AA, AAB, AABBCCC, etc.
Having described several embodiments, various modifications, alternative constructions, and equivalents may be used without departing from the spirit of the disclosure. For example, the above elements may merely be a component of a larger system, wherein other rules may take precedence over or otherwise modify the application of the invention. Also, a number of steps may be undertaken before, during, or after the above elements are considered. Accordingly, the above description does not limit the scope of the disclosure.