1. Field of the Invention
The present invention relates to an image capture apparatus having an image capture device for capturing images of a subject and a driving system for driving the image capture device.
2. Description of the Related Art
Photodiodes (hereinafter referred to as “PD sections”) 101 convert light into electrical charges (i.e., photoelectrical conversion) in accordance with the amount of exposure and accumulate the charges. Reference numeral 102 indicates floating diffusion sections (hereinafter referred to as “FD sections”). Upon the end of the accumulation, transfer gates (hereinafter referred to as “TXs”) 103 transfer the charges from the PD sections 101 to the corresponding FD sections 102 at the next stages. Reset gates (hereinafter referred to as “RSs”) 104 are used to reset the FD sections 102 and the PD sections 101. Floating diffusion amplifiers (hereinafter referred to as “FD amplifiers) 105 convert the charges, photoelectrically converted by the FD sections 102, into voltages. Selection gates (hereinafter referred to as “SELs”) 106 serve as selection switches for switching the reading of signals from the FD sections 102. For example, a typical digital camera has a pixel area including several millions of pixels, each defined by one PD section 101, one FD section 102, one TX 103, one RS 104, one FD amplifier 105, and one SEL 106.
A known operation of the image capture device shown in
First, before accumulation of charges, the PD sections 101 and the FD sections 102 are reset once. This is achieved by turning on the TXs 103 and RSs 104. Subsequently, when the TXs 103 and the RSs 104 are turned off, accumulation is started. At this point, since no charges are accumulated in the FD sections 102, first, the SELs 106 are turned, so that signals corresponding to that situation are read out to corresponding vertical output lines (V output lines) 125. As a result, reset noise levels are stored in corresponding circuit-module capacitors 108 provided in an S-n circuit block, the number of capacitors 108 being equal to the number of pixel columns.
When a predetermined amount of time has elapsed, the TXs 103 are turned on, so that the charges stored in the PD sections 101, which are buried photodiodes, are completely transferred to the corresponding FD sections 102 via the corresponding TXs 103. After read-out waiting time has elapsed, the SELs 106 are turned on, so that outputs corresponding to the accumulated charges are read out to the corresponding vertical output lines 125. Then, the signal levels of the outputs are stored in the capacitors 109 via corresponding switches 111. At this point, the reset levels and the signals levels are stored in the capacitors 108 and the capacitors 109, respectively. Thus, turning on read-out switches 115 and 116 to connect the reset levels and the signal levels to a differential amplifier 123 allows “pure” accumulation signals to be extracted.
In general, reset noises are first read, and then signals are read. When this sequence is reversed, while random reset noise cannot be completely eliminated, variations in gate-source voltages (Vgs) across the FD amplifiers 105 can be substantially cancelled. In a typical electronic-shutter mode, therefore, signals are first read, and then immediately, the FD sections 102 are reset again so that reset levels are read.
Graphics represented by a square 56 and a triangle 57 below the waveforms represent, in a time axis, an operation for each pixel row in the pixel area. Reference numeral 50 indicates a line at the upper side of the screen and 51 indicates a line in the lower side of the screen. At time 52, the TXs 103 and the RSs 104 are reset in a pulsed manner at the same time, so that the PD sections 101 and the FD sections 102 of all the pixels are simultaneously reset. After the reset is completed, charges generated in response to incident light are stored in the PD sections 101 of all the pixels. The square 56 represents charges being accumulated in the PD sections 101. Time 53 indicates the end of the accumulation. The horizontal length indicates accumulation time Tint. Since the charges in all the pixels are simultaneously transferred at the end of the accumulation, first, in order to ensure that the FD sections 102 contain no charges, the RSs 104 are turned on in a pulsed manner to reset the FD sections 102. Immediately after the reset, the TXs 103 are turned on in a pulsed manner to simultaneously transfer the charges of all the pixels.
At time 54, reading/scanning for each row is started. Time until charges in all the rows are read out refers to waiting time Twait. A vertical scan circuit 121 sequentially selects the rows, thereby performing the scanning/reading.
In a row selected by the SELs 106, signals (S) stored in the FD sections 102 in a waiting state are transferred and stored in the capacitors 108 in response to ON pulses PTS (pulses applied to switching transistors 110) indicated at reference numeral 58. Next, in order to cancel variations in gate-source voltages Vgs of the FD amplifiers 105, only the RSs 104 in the selected row are turned on, so that the FD sections 102 are reset, and pulses PTN go high (i.e., pulses are applied to the switching transistors 111), so that reset levels (N) are stored in the corresponding capacitors 109. After all signals of the pixels in the selected row are stored in the capacitors 108, the number thereof being equal to the number of horizontal pixels, in the S-n circuit (shown in
When outputs of all the pixels in one row are scanned and read, the vertical scan circuit 121 selects the next row. Scanning, as described above, is repeated for all the rows, and at time 55, reading from the FD sections 102 ends. The triangle 57 represents a state in which the reading from the FD sections 102 is performed while the rows are scanned vertically, i.e., from the top to the bottom of the screen. A related example is disclosed in Japanese Patent Laid-Open No. 11-341363 (pages 10 to 18, FIG. 9).
In the known example, waiting time Twait, which is time until charges are read out, differs depending on the position of a row from the top of the screen. For example, since the top row is selected first in the row scanning, waiting time Twait therefor is substantially zero. On the other hand, since the bottom row needs to wait until reading of substantially all the rows is finished, waiting time Twait therefor becomes the longest. Since the PD sections 101 and the corresponding FD sections 102 are adjacent to each other, during the waiting period in which reading from the FD sections 102 is waited for, a certain percentage of light that enters the PD sections 101 leak into the adjacent FD sections 102. More specifically, this phenomenon will now be described with reference to the structure shown in
Accordingly, an object of the present invention is to provide an image capture apparatus that provides low-noise image signals.
To achieve the object, an image capture apparatus according to the present invention includes first and second pixels. Each pixel has a sensor and a reading portion for reading out a signal from the sensor to an output line. The apparatus further includes a correcting section for changing a correction signal in accordance with waiting time in which signals from the first and second pixels are held and for correcting noise components contained in image signals output from the first and second pixels in accordance with the correction signal. Waiting times in which the image signals are held in the first and second pixels are different from each other and the noise components are generated due to the different waiting times.
This arrangement can output signals that are held in the pixels for a different amount of time and signals that are held in the pixels for a different amount of time and that contain photoelectric conversion signals. Thereafter, the signals that are held in the pixels for a different amount of time are used to correct the signals that are held in the pixels for a different amount of time and that contain the photoelectric conversion signals. As a result, an image having an improved image quality is provided.
Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
Referring to
A differential amplifier 123 performs differential processing on a plurality of signals. Reference numeral 107 denotes transistors. The transistors 105, 106, and 107 constitute amplifiers, which serve as source-follower amplifiers, only when the corresponding transistors 106 and 107 are turned on. One PD section 101, one FD section 102, and the corresponding transistors 103, 104, 105, and 106 define one pixel. The buffers 113 and 114, the switching capacitors 115 and 116, the horizontal output lines 119 and 120, and the resetting transistors 117 and 118 constitute an output portion for sequentially outputting signals for one line from the capacitors 108 and 109, in which the signals are stored, to the differential amplifier 123.
First, a first mode will be described with reference to
At time T01, high pulses are applied to a terminal 19 and a terminal 21, so that the FD sections 102 of all the pixels are reset at the same time and also the PD sections 101 of all the pixels are reset at the same time. At time T02, a vertical-scan start pulse is input to a terminal 2 and a vertical-scan pulse is input to a terminal 3, so that the first line is selected and a signal 20a (not shown in
The operation of the first line in the period from time T02 to time T09 is also performed, after time T09, for all the rows after the second line, until reading of all the rows is completed.
According to the operation described above, after the FD sections 102 of all the pixels are reset at the same time, signals are sequentially read out for each line. Thus, signals read from the pixels in the lower lines have a larger amount of noise-signal voltage component that results from an accumulation-time difference.
Thus, noise signal voltages that result from an accumulation-time difference and that have a different signal level for each line are output from the differential amplifier 123.
Now, a second mode will be described with reference to
The operation for the second mode is performed after the end of the operation for the first mode.
At time T21, high pulses are applied to terminals 19 and 21, so that the FD sections 102 of all the pixels are reset at the same time, and the PD sections 101 of all the pixels are also reset at the same time.
After the reset is completed, an accumulation operation of electric charges (i.e., photoelectric conversion signals) generated in response to light incident on the PD sections 101 of all the pixels is started. After the photoelectric conversion signals are stored for a predetermined amount of time, at time T22, a high pulse is applied to terminal 21 again, so that the FD sections 102 of all the pixels are reset at the same time. Thereafter, at time T23, a high pulse is applied to terminal 19 again, so that the charges stored in the PD sections 101 of all the pixels are transferred to the corresponding FD sections 102 at the same time. After the high pulse goes low, the charges transferred to the FD sections 102 are held. At time T24, a vertical-scan start pulse is input to terminal 2 and a vertical-scan pulse is input to terminal 3, so that the first row is selected and the signal 20a (not shown in
According to the operation described above, after the FD sections 102 of all the pixels are reset, photoelectric conversion signals are transferred from the PD sections 101 to the FD sections 102 at the same time, and then signals are sequentially read out for each line. Thus, signals read from the pixels in the lower lines have a larger amount of noise-signal voltage component that results from an accumulation-time difference.
That is, in the first mode, noise signal voltages (i.e., a signal 58 generated at the time of reading, as shown
The timing pulses described above and shown in
An operation after the signals of all the pixels are read in the first and second modes will now be described with reference to
The configuration shown in
In the first mode, immediately before charges are accumulated in the PD sections 101, signals read from the differential amplifier 123 are temporarily stored in the memory 61 via the computational processing circuit 60. Thereafter, the signals that are stored in the memory 61 and signals that are read from the differential amplifier 123 in the second mode are subjected to differential processing by the computational processing circuit 60.
In this case, the signals read in the first mode are noise signal components that result from an accumulation-time difference, and the signals read in the second mode are the mixtures of the noise signal components resulting from an accumulation-time difference and photo-conversion signal components generated by the PD sections 101. Thus, the computational processing circuit 60 performs differential processing for subtracting a difference between the signals read in the first mode and the signals read in the second mode, thereby providing only the photoelectric conversion signal components.
In this case, the memory 61 may have a capacity capable of storing signals for two frames from the image capture device, so as to temporarily store the signals obtained in the second mode as well.
The computational processing circuit 60 performs the above-described differential processing operation in response to a control signal sent from a correction controlling section included in the CPU 62 shown in
In the moving-picture mode in the embodiment described above, the photoelectric conversion signals in all the lines of the image capture device can be stored at the same time. Thus, this arrangement is advantageously used for capturing moving images for which a shutter for shielding light that enters the image capture device cannot be used.
In the first embodiment, while reset signals are read in both the first and second modes and noise is removed by the differential amplifier (i.e., noise is removed by two different operations), the reading of the reset signals and the difference operation do not have be performed. That is, the operations at T04 and T05 shown in
For example, the arrangement may be such that, immediately before charges are accumulated in the PD sections 101, the signals read in the first mode are temporarily stored in the memory 61 via the computational processing circuit 60. In this case, without the reading and differential processing of the reset signals, while the signals that are read in the first mode are being subtracted from photoelectric conversion signals that have been accumulated in the PD sections in the second mode, have been simultaneously transferred to the FD sections, and that have been read out immediately after the signals were read in the first mode, the resulting signal may be stored.
In such an operation, however, since the computational processing circuit 60 removes three types of noise, i.e., FD amplifier variations, reset voltage variations, and noise that results from an accumulation-time difference, the rate of eliminating noise is reduced compared to a case in which the differential amplifier 123 is used. That is, when noise is removed by two operations, since the differential amplifier 123 is arranged in the image capture device and is relatively close to the pixels, it is possible to remove FD amplifier variations and reset voltage variations without permitting noise to flow through circuits, such as an amplifier and an image-signal processing circuit 205, which are provided at subsequent stages. In contrast, when noise is removed by one operation, since noise signals also flow through the amplifier, the amount of noise component increases.
Such an arrangement in which noise is removed by one operation has a low rate of noise reduction, but also has advantages in that the circuit configuration and the driving mechanism are simplified and the speed of reading is increased.
A second embodiment of the present embodiment includes a mode for capturing a moving image and a mode for capturing a still image. An image capture device in the second embodiment has essentially the same configuration as the image capture device in the first embodiment shown in
In the second embodiment, when a mode for capturing a moving image is selected, the same operation as in the first embodiment is performed, and when a mode for capturing a still image is selected, an operation described below is performed to capture a still image.
First, the FD sections 102 of all the pixels are reset and also the PD sections 101 of all the pixels are reset. After the reset is completed, an accumulation operation of electric charges (i.e., photoelectric conversion signals) generated in response to light incident on the PD sections 101 of all the pixels is started. Under the control of the CPU 62, a mechanical shutter, which is described below, is closed to thereby cause the charges to be stored for a predetermined amount of time. The mechanical shutter can be closed by adjusting a diaphragm 203, which is described below and shown in
An operation after the mechanical shutter is closed will now be described with reference to
Thereafter, the resulting signals are input to the computational processing circuit 60 shown in
The mode for capturing a moving image and the mode for capturing a still image are controlled by the CPU (controlling section) 62, which is described below.
As described above, in the still-image mode, since the mechanical shutter can be used, photoelectric conversion signals in the PD sections 101 can be transferred to the corresponding FD sections 102 for each line. Thus, first, signals obtained by resetting the FD sections 102 are read out, and without the reset of the FD sections 102, the photoelectric conversion signals can be read out to the FD sections 102. As a result, the signals that are first read and the signals that are sequentially read contain the same reset voltage component. Thus, reseat voltage variations can be removed with high accuracy, compared to the moving mode.
That is, for the still-image mode, the above-described driving operation, which is different from the operation for the moving image mode, is performed to thereby make it possible to provide a high-quality still image.
As described above, the mode for capturing a moving image and the mode for capturing a still image are provided in the present embodiment. While this arrangement in the present embodiment cannot completely eliminate noise at the time of capturing a moving image, it can provide an image having no distortion and also can provide a high-quality still image from which noise has been completely eliminated. That is, according to the present embodiment, optimum signals are read depending on applications.
The mode for capturing a moving image and the mode for capturing a still image are generated by an image-capture controlling circuit (image-capture controlling section) included in a timing generator, which is described below. The mode for capturing a moving image and the mode for capturing a still image are switched in accordance with a control signal supplied from a selecting section included in the CPU 62, which is described below.
In the pixel area shown in
However, providing two capacitors and two vertical output lines, as shown in
The operation of this configuration will now be described with reference to
First, high pulses are applied to reset gates (RS) 104, reset gates (RS3) 303, transfer gates (TX) 103, and transfer gates (TX2) 302, so that the FD sections 102 and FD sections (FD2) 301 of all the pixels are reset at the same time, and also the PD sections 101 of all the pixels are reset at the same time. After the reset is completed, an accumulation operation of electric charges (i.e., photoelectric conversion signals) that are generated in response to light incident on the PD sections 101 of all the pixels is started. After photoelectric conversion signals are stored for a predetermined amount of time, high pulses are again applied to the reset gates (RS) 104, so that the FD sections 102 of all the pixels are reset at the same time, and, simultaneously, high pulses are applied to the transfer gates (TX2) 302. Consequently, the charges accumulated in the PD sections 101 of all the pixels are transferred to the FD sections (FD2) 301. After the high pulses go low, the charges transferred to the FD sections 102 are held. High pulses are applied to selection circuits (SEL) 106 and selection circuits (SEL2) 305, so that signals are read from the FD sections 102 and the FD sections (FD2) 301 to the corresponding vertical output lines. The individual pixel circuits configured as shown in
In a fourth embodiment of the present embodiment, the image capture device shown in
An image signal read out from one row in the image capture device can be substantially expressed by q(Tint+K*Twait), where K indicates a sensitivity ratio coefficient that is the ratio of photoelectrically converting light incident on the FD sections 102 to light incident on the PD sections 101, Tint indicates the accumulation time of photoelectric conversion signals in the PD sections 101, Twait indicates the waiting time of photoelectric conversion signals in the FD sections 102, and q indicates the amount of photo charge generated in the FD sections per unit of time. In this case, however, since the accumulation time and the waiting time are sufficiently short, it is presumed that the amount of light that enters the pixels when photoelectric conversion signals are accumulated in the PD sections 101 is substantially the same as the amount of light that enters the pixels when the reading of photoelectric conversion signals in the FD sections 102 are waited for.
In this case, since q*K*Twait is noise generated in the read-out waiting time, multiplying an image signal read from the image capture device by Tint/(Tint+K*Twait), which is the ratio of photo charge generated only in the PD sections 101 to photo charge generated in the PD sections 101 and the FD sections 102, provides photo charge qTint that is generated in substantially only the PD sections 101 and that has a reduced amount of q*K*Twait component.
The sensitivity ratio coefficient K of the FD sections 102 to the PD sections 101 is affected by, for example, a luminous flux, and thus can be expressed with a table based on incident-light states, including lens pupil distance information, lens f-number information, and pixel positions in the image capture device.
In the relationship of the lens pupil distance information, when the lens pupil distance decreases, the angle of incident light increases toward an image edge, thereby causing no light to enter vertically, so that the amount of light that leaks into the FD sections 102 increases. In the relationship of lens f-number information, when the lens f-number decreases, the size of the pupil (i.e., a diaphragm or diaphragm ghost image viewed from the pixel side) increases and the angle of incident light-beam increases, thereby causing no light to enter vertically, so that the amount of light that leaks into the FD sections 102 increases.
To ensure that light rays do not vary depending on positions in the image capture device, micro lenses are generally arranged to be displaced in accordance with image heights (i.e., distances between optical axes and the pixels). If the variations are still significant, K is expressed with the table in accordance with pixel x-y coordinates.
Before shipment of a camera, sensitivity ratio coefficient K1 for lens pupil distance d1, lens f-number F1, and pixel x-y coordinates (x1, y1), and sensitivity ratio coefficient K2 for lens pupil distance d2, lens f-number F2, and pixel x-y coordinates (x2, y2) are determined for the table and the table is stored in the camera.
The sensitivity ratio coefficient is set to be larger as the lens pupil distance is larger and the position is closer to an edge of the image capture device. The sensitivity ratio coefficient is also set to be smaller as the lens f-number increases.
At the time of actually taking an image, the use of the table can provide an image signal having a smaller amount of noise.
During manufacture of a camera, the table for the sensitivity ratio coefficient K is created in accordance with lens pupil distance information, lens f-number information, and pixel position information. Alternatively, the table may be created in accordance with lens pupil distance information and pixel position information (e.g., the lens is fixed), lens f-number information and pixel position information (e.g., the diaphragm is fixed), or only pixel position information (e.g., the lens and the diaphragm are fixed). The table for the sensitivity ratio coefficient K may be pre-set to have a fixed value that does not allow for the angle of incident light.
The image capture device in the fourth embodiment has the same configuration as that in the first embodiment shown in
According to the operation described above, after the FD sections 102 of all the pixels are reset, photoelectric conversion signals are transferred from the PD sections 101 to the FD sections 102 at the same time, and then signals are sequentially read out for each line. Thus, signals read from the pixels in the lower lines have a larger amount of noise-signal voltage component that results from an accumulation-time difference.
That is, noise signal voltages (the signal 57 generated in the read-out time, as shown in
The timing pulses described above and shown in
An image signal correction executed by the CPU 62 in the fourth embodiment of the present invention will now be described with reference to a flow chart shown in
In step S170, a row counter is set to the first row. Next, the CPU 62 performs the computations shown in step S171. Since row-scanning is employed in this case, when the row number is represented by n, correction can be achieved by multiplying original image data ADin(n) by a correction signal Tint/(Tint+K*Twait(n)), which is the ratio of amount of signal stored in the FD sections 102 to the amount of signal stored in both the FD sections 102 and the FD sections 102, where Twait(n) indicates the waiting time of optical conversion signals in the FD sections 102 in the pixels in the n-th line.
In step S172, the line counter is advanced to the next row. In step S173, a determination is made whether all of the lines have been completed. If all the lines have not been completed, the processes in steps 171 and 172 are repeated. When all the lines have been completed, the process ends in step S174.
In this manner, the fourth embodiment can extract pure accumulation signals from noise-containing accumulation signals without directly determining noise signals. This not only reduces the read-out time, but simplifies the configuration of the apparatus.
The configuration of an image capture device in a fifth embodiment and the operation of reading signals therefrom are the same as those in the fourth embodiment.
That is, the computational processing circuit 60 has the table containing incident-light states, for example, lens pupil distance information, lens f-number information, and pixel positions, as in the fourth embodiment.
Multiplying the signal (i.e., input data ADin) that has been output from the pixels by the correction signal Tint/(Tint+K*Twait(n)) provides a corrected signal ADout. As a result of the correction processing, a uniform level of ADout is ensured at any position on the screen.
A sixth embodiment of the present invention will now be described with reference to a sequence diagram shown in
Although gain correction dealing only with leak-light components have been described above, fixed pattern noise that cannot be eliminated by the above-described S-n circuit exists in practice.
Major causes of the fixed pattern noise are “cancel remainder of FD amplifier variations”, “dark current in the PD sections in the pixels”, and “dark current variations in the FD sections 102”. For a moving image, however, since the accumulation time is also short, the fixed pattern noise is not a significant factor. In contrast, waiting time until “dark current in the FD sections 102” is read differs depending on a position within the screen, and a longer one can exceed 10 ms. While the PD sections 101 have provision for reducing dark current with the buried photodiodes, the FD sections 102 are exposed at a chip surface, and thus the amount of dark current in the FD sections 102 is orders of magnitude larger. Accordingly, dark correction (i.e., “black compensation”), which deals with dark current in the FD sections 102, is considerably effective.
Reference numeral 184 in
Reference numeral 180 indicates an accumulation when the mechanical shutter is closed. In this case, accumulation time in the PD sections is substantially zero and reading from the FD sections takes the same amount of time used for a sequence in a typical electronic-shutter moving-picture mode. As a result, an image obtained from the accumulation 180 includes the above-noted “cancel remainder of FD amplifier variations” and also includes “dark current variations in the FD sections” corresponding to the waiting time for each row. This image will be referred to as a “dark-time image”.
At time 184, when the mechanical shutter is opened, reading of moving images shifts in the order of 181, 182, and 183. Subtracting the “dark-time image”, which is obtained from the accumulation 180, from the respective moving images obtained from 181, 182, and 183 makes it possible to substantially cancel fixed pattern noise contained in the moving images.
On the basis of the resulting images, performing the gain correction described in the first and second embodiments can ensure the correction of both the signal level and the gain, thereby allowing reproduction of moving images faithful to a subject.
With this system, once the “dark-time image” is sampled before a moving image is taken, the temperature does not change much in the subsequent moving-image taking and thus dark current also does not increase, so that the dark-time image can be reused during the same series. Thus, as indicated by 181 to 183, immediately after reading for one frame is finished, the operation can be shifted to the accumulation for the next frame, thereby eliminating waste of time. Further, the subtraction of the “dark-time image” can be performed in parallel with the reading operation and can also be processed during accumulation for the next frame.
Accordingly, this correction system, as well as the above-described gain correction for dealing with light leak, is suitable for sequential processing for taking moving images.
As described above, in the fourth to sixth embodiments, the CPU is provided to correct the correction signal in accordance with incident light states, such as lens pupil distance information, lens f-number information, and pixel positions. Further, in accordance with the correction signal, the CPU corrects noise components that are contained in image signals having different waiting time, in which the image signals are held, and that are produced due to the difference in the waiting time. As a result, the embodiments described above can ensure a uniform output level at any position of the screen.
A seventh embodiment of the present embodiment will now be described with reference to
The pixel area shown in
That is, after the FD sections 102 of all the pixels are reset, while signals are sequentially being read from the FD amplifiers 105 for each line, the PD sections 101 need to continue the photoelectric conversion operation.
In other words, it is impossible to arbitrarily set accumulation time for the PD sections 101.
Thus, in the first and fourth embodiments, as shown in
Reference numeral 74 in
Reference numeral 70 indicates a state in which signals corresponding to reset voltages after the FD sections 102 of all the pixels are reset are sequentially read from the FD amplifiers 105 for each line without the transfer from the PD sections 101. Reading from the FD sections 102 takes the same amount of time used for a sequence in a typical electronic-shutter moving-picture mode. As a result, signals obtained from the accumulation 70 include noise signals that have been photoelectrically converted in accordance with waiting time for each row and the photoelectric conversion sensitivity of the FD sections 102.
At time 74, when the mechanical shutter is opened, reading of moving images in the order of accumulations 71, 72, and 73 is started and also reading of moving images in the order or accumulations 70, 75, and 76 that result from only the photoelectric conversion sensitivity of the FD sections 102 is started. Subtracting the images that are obtained from the accumulations 70, 75, and 76 from the corresponding images that are obtained immediately thereafter from the accumulations 71, 72, and 73 makes it possible to substantially cancel fixed pattern noise and components that are contained in the moving images and that result from the photoelectric conversion sensitivity of the FD sections 102, in the same manner as the first and fourth embodiments.
With this approach, however, it is still impossible to reduce the read-out time for the FD sections 102. Accordingly, as shown in
In this manner, the reset gates RS 104 for resetting the FD sections 102 and the reset gates RS2124 for resetting the PD sections 101 are separately provided. As a result, after the FD sections 102 of all the pixels are reset at the same time, while the resulting signals are being sequentially read from the FD amplifiers 105 for each line, the PD sections 101 can be reset.
In this case, the reset gates RS2124 and the transfer gates TX 103 can be used for the front curtain and the rear curtain, respectively, of the shutter. Thus, charges can be accumulated in the PD sections 101 in parallel with the waiting time in which signals are read from only the FD sections 102 That is, the frame rate of a sequence of moving images read out from the FD sections 102 of each line is defined by double the amount of read-out time, thereby making it possible to provide a moving-image capture system having a high frame rate.
As described in the first embodiment, both the differential processing by the differential amplifier 123 and the differential processing by the computational processing circuit 60 may also be performed in the present embodiment. Also, the operations at time T04, T05, T26, and T27 shown in
Although examples in which the pixels are arranged in a matrix and reading is sequentially performed for each line in have been provided in the descriptions for the first and second embodiments, the arrangement may be such that the pixels are arranged in one line and reading is sequentially performed for each pixel by a line sensor.
In the first and second embodiments, the time when noise signals are detected varies between signals that are held in the pixels for a different amount of time and signals that contain photoelectric conversion signals and that are held in the pixels for a different amount of time. However, since the amount of signal that is held in the pixels for a different amount of time is smaller than the amount of photoelectric conversion signal, noise can be sufficiently corrected.
In the first and second embodiments, although noise signals that are generated due to a difference in time in which signals are held in the pixels are read out from the pixels, signals corresponding to noise signals generated due to a difference in time in which signals are held in the pixels may be pre-stored in the first storing portion.
In the fourth to sixth embodiments, the reset gate RS2124 may be provided for each pixel, as shown in
As described above, in the first to seventh embodiments, the correcting section is provided to correct the correction signal in accordance with the waiting time in the FD sections serving as holding sections. Further, in accordance with the correction signal, the correcting section corrects noise components that are contained in image signals having different waiting time in which the image signals are held and that are produced due to the difference in the waiting time. As a result, the embodiments described above can ensure a uniform output level at any position of the screen.
In the first to third embodiments, noise signals that provide a correction signal and that correspond to the waiting time in the FD sections 102 are read out from the image capture device, and then images signals are read out from the image capture device. The noise signals that differ for each line and the image signals are subjected to differential processing performed by a timing generator and a computational processing circuit which serve as a correcting section.
In the fourth to sixth embodiments, the CPU (correcting section) 62 changes the correction signal, i.e., Tint/(Tint+K*Twait(n)), in accordance with the waiting time (Twait(n)) in the FD sections 102 and multiplies image signals sent from the image capture device by the correction signal.
The operations of the image capture device and the image capture apparatus described in the first to seventh embodiments will now be described with reference to
Referring to
First, a description is given of the operation of the image capture apparatus, which has the above-described configuration, at the time of capturing a still image. When the barrier 201 is opened, a main power supply is turned on. In turn, a control-system power supply is turned on, and further, image-capture-system circuits, such as the A/D converter 206, are powered on.
Thereafter, in order to control the amount of exposure, the CPU 62 causes the diaphragm 203 to open, so that signals are output from the image capture device 204. The signals are then converted into digital signals by the A/D converter 206 and the resulting signals are input to the computational processing circuit 60.
In accordance with data output from the computational processing circuit 60, the CPU 62 computes the exposure. In accordance with the result of the photometric measurement, the CPU 62 determines the brightness and controls the diaphragm 203.
Based on the signals sent from the image capture device 204, the CPU 62 extracts high-frequency components and computes a distance to the subject. Thereafter, the CPU 62 drives the lens 202 and determines whether or not the lens 202 is focused on the subject. When it is determined that the lens 202 is out of focus, the CPU 62 drives the lens 202 again and measures the distance.
After the focusing is confirmed, a main exposure is started. A still image is captured in accordance with the operation described in the second embodiment. Thereafter, data is stored in the memory section 61. Under the control of the CPU 62, the data is recorded in the detachable recording medium 212, such as a semiconductor memory, via the recording-medium control I/F unit 211. Alternatively, the data may be directly transferred to a computer or the like via the external I/F unit 213 for image processing.
Next, a description is given of the operation of the image capture apparatus, which has the above-described configuration, at the time of capturing a moving image. When the barrier 201 is opened, a main power supply is turned on. In turn, a control-system power supply is turned on, and further, image-capture-system circuits, such as the A/D converter 206, are powered on.
Photoelectric conversion signals corrected at the time of capturing a moving image are output in the following two ways.
In the first way, the CPU 62 causes the diaphragm 203 to open, so that noise signals are read out from the FD sections 102 with the same amount of time as that for reading out photoelectric conversion signals, the noise signals having different waiting times in the FD sections 102 for the individual pixels. The noise signals are then output from the image capture device 204. The output noise signals are converted by the A/D converter 206 and are then stored in the memory section 61 by the CPU 62. Thereafter, photoelectric conversion signals that were accumulated in the PD sections 101 and have been transferred to the FD sections 102 and that have different waiting times in the FD sections 102 for the individual pixels are output from the image capture device 204. The output photoelectric conversion signals are converted by the A/D converter 206 and the resulting photoelectric conversion signals are input to the computational processing circuit 60. In parallel, the above-noted noise signals are input to the computational processing circuit 60. In the computational processing circuit 60, the noise signals are subtracted from the photoelectric conversion signals, so that the photoelectric conversion signals are corrected. Thereafter, the corrected photoelectric conversion signals are stored in the memory section 61 by the CPU 62.
In the second way, the CPU 62 causes the diaphragm 203 to open, so that photoelectric conversion signals are stored in the PD sections 101, are transferred to the FD sections 102, and are held for a different amount of time for each pixel. Then the photoelectric conversion signals are output from the image capture device 204. The output photoelectric conversion signals are converted by the A/D converter 206 and are input to the computational processing circuit 60. In the computational processing circuit 60, the photoelectric conversion signals are converted in accordance with the correction signal described in the fourth and fifth embodiments. Thereafter, under the control of the CPU 62, the corrected photoelectric-conversion signals are stored in the memory section 61.
In accordance with the data of the corrected photoelectric-conversion signals that are output in either of the two ways described above and that are stored in the memory section 61, the exposure is computed by the CPU 62. In accordance with the result of the exposure computation, the CPU 62 determines the brightness. Further, in accordance with the result of the determination, the CPU 62 controls the amount of exposure for capturing images of the next screen. In parallel, based on the signals output from the image capture device 204, the CPU 62 extracts high-frequency components and computes a distance to the subject. In accordance with the result of the computation, the CPU 62 drives the lens 202 for capturing the images of the next screen.
Under the control of the CPU 62, the data stored in the memory section 61 is recorded in the detachable recording medium 212, such as a semiconductor memory, via the recording-medium control I/F unit 211. After the focusing is confirmed, the exposure control for the next screen is resumed.
The corrected photoelectric-conversion signals are then output in either of the two ways described above and the resulting data is stored in the memory section 61 by the CPU 62.
In accordance with the data, exposure computation for controlling the diaphragm 203 for the next screen and photometric measurement for driving the lens 202 are performed by the CPU 62. Thereafter, under the control of the CPU 62, the data stored in the memory section 61 is recorded in the detachable recording medium 212, such as a semiconductor memory, via the recording-medium control I/F unit 211. Alternatively, the data may be directly transferred to a computer or the like via the external I/F unit 213 for image processing. In this manner, for capturing a moving image, the exposure adjustment and the lens driving adjustment are controlled in accordance with the signals of the previous screen. The above operation is repeated. Thus, the image capture apparatus having the configuration illustrated in
As described in the first embodiment, control may be performed such that noise is eliminated in the image capture device, is read out therefrom, and is then subjected to the noise elimination as described in the present invention. Although the description in the present embodiment has been given of the cases for capturing a still image and a moving image, the image capture apparatus may be applied to only a case for capturing a moving image.
The present invention is not limited to the above embodiments and various changes and modifications can be made within the spirit and scope of the present invention. Therefore to apprise the public of the scope of the present invention, the following claims are made.
Number | Date | Country | Kind |
---|---|---|---|
2003/154909 | May 2003 | JP | national |
2003/184940 | Jun 2003 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
4556851 | Levine | Dec 1985 | A |
5434619 | Yonemoto | Jul 1995 | A |
6025875 | Vu et al. | Feb 2000 | A |
6320616 | Sauer | Nov 2001 | B1 |
6831685 | Ueno et al. | Dec 2004 | B1 |
Number | Date | Country |
---|---|---|
11-341363 | Dec 1999 | JP |
Number | Date | Country | |
---|---|---|---|
20040239781 A1 | Dec 2004 | US |