The imaging apparatus of the present invention is an imaging apparatus that can shoot a moving image and a still image, the imaging apparatus including: a solid-state imaging device, an illumination light source for illuminating a subject; and a controlling apparatus for controlling the solid-state imaging device and the illumination light source, wherein the solid-state imaging device includes: a plurality of photoelectric conversion parts that are arranged in matrix; and a read-out part for reading out a charge that is accumulated in each of the photoelectric conversion parts. The controlling apparatus allows the read-out part to read out the charge in a state where the illumination light source is ON at a time of shooting the moving image. When an instruction for shooting the still image is provided, the controlling apparatus turns OFF the illumination light source after completion of light exposure for obtaining the still image, allows the read-out part to read out all of the charges by dividing the charges into a plurality of fields while the illumination light source is OFF, and synthesizes the charges that are read out separately by the respective fields so as to generate one still image.
Moreover, the endoscope apparatus of the present invention is an endoscope apparatus including an imaging apparatus that can shoot a moving image and a still image, wherein the imaging apparatus includes: a solid-state imaging device; an illumination light source for illuminating a subject; and a controlling apparatus for controlling the solid-state imaging device and the illumination light source, the solid-state imaging device includes: a plurality of photoelectric conversion parts that are arranged in matrix; and a read-out part for reading out a charge that is accumulated in each of the photoelectric conversion parts. The controlling apparatus allows the read-out part to read out the charge in a state where the illumination light source is ON at a time of shooting the moving image. When an instruction for shooting the still image is provided, the controlling apparatus turns OFF the illumination light source after completion of light exposure for obtaining the still image, allows the read-out part to read out all of the charges by dividing the charges into a plurality of fields while the illumination light source is OFF, and synthesizes the charges that are read out separately by the respective fields so as to generate one still image.
In the imaging apparatus and the endoscope apparatus of the present invention, the controlling apparatus can allow the read-out part to perform field read-out for adding the charges of the two or more photoelectric conversion parts that are arranged in a vertical direction, at the time of shooting the moving image. In this case, a smooth output of the moving image can be obtained.
Moreover, in the imaging apparatus and the endoscope apparatus of the present invention, the controlling apparatus also can allow the read-out part to read out only a charge accumulated in a part of the photoelectric conversion parts among the plurality of the photoelectric conversion parts, at the time of shooting the moving image. In this case, it is effective when the subject to be shot is moving actively.
In the imaging apparatus and the endoscope apparatus of the present invention, it is preferable that the photoelectric conversion part is formed on a semiconductor substrate, and the solid-state imaging device has an overflow barrier for adjusting an amount of the charge that is accumulated in the photoelectric conversion part. According to this case, by adjusting a potential height of the overflow barrier, the amount of the charge that is accumulated in the photoelectric conversion part can be adjusted.
Moreover, in the above-described case, it is preferable that the controlling apparatus applies, to the semiconductor substrate, an electronic shutter pulse for ejecting the charge after the instruction for shooting the still image is provided, thereby controlling the length of time of the light exposure for obtaining the still image. In this case, the length of the time of the light exposure for obtaining the still image can be adjusted easily, thereby setting the exposure time with a high precision.
Further, in the above-described case, it is preferable that the controlling apparatus allows a potential height of the overflow barrier to be higher than a potential height at the time of shooting the moving image, after the instruction for shooting the still image is provided and until the read-out of the charge of each of the fields is completed. In this case, the sensitivity at the time of shooting the still image can be improved.
Further, in the above-described case, it is preferable that the solid-state imaging device is an interline transfer type solid-state imaging device, the read-out part is provided in each column of the plurality of the photoelectric conversion parts in the vertical direction, and includes a plurality of charge transfer apparatuses for transferring, in the vertical direction, the charge that is read out, the controlling apparatus allows the plurality of the charge transfer apparatuses respectively to perform field read-out for adding the charges of the N photoelectric conversion parts (N represents the number of the photoelectric conversion parts) that are arranged in the vertical direction, at the time of shooting the moving image, when a maximum transfer charge amount of each of the plurality of the charge transfer apparatuses is SVCCD, the potential height of the overflow barrier at the time of shooting the moving image is set such that a maximum accumulated charge amount Smotion of each of the plurality of the photoelectric conversion parts at the time of shooting the moving image satisfies a below formula (1), the potential height of the overflow barrier after the instruction for shooting the still image is provided and until the read-out of the charge of each of the fields is completed is set such that a maximum accumulated charge amount Sstill of each of the plurality of the photoelectric conversion parts at the time of shooting the still image satisfies a below formula (2). Thereby, generation of blooming can be suppressed.
S
VCCD
≧N×S
motion (1)
SVCCD≧Sstill (2)
Moreover, in the above-described case, it is preferable that the controlling apparatus turns OFF the illumination light source and then allows the potential height of the overflow barrier to be higher than a potential height at the time of shooting the moving image, and subsequently, allows the read-out part to read out all of the charges by dividing the charges into the plurality of the fields. Thereby, while reading out a charge in an initial field, ejection of a charge that is to be read out in a subsequent field can be suppressed, and generation of an output signal step difference between the fields can be prevented.
In the imaging apparatus and the endoscope apparatus of the present invention, it is preferable that the solid-state imaging device is an interline transfer type solid-state imaging device, the read-out part is provided in each column of the plurality of the photoelectric conversion parts in the vertical direction, and includes a plurality of charge transfer apparatuses for transferring in the vertical direction the charge that is read out, and the controlling apparatus turns OFF the illumination light source, then respectively applies to the plurality of the charge transfer apparatuses, sweeping-out pulses for ejecting the charges that are accumulated in the charge transfer apparatuses, and subsequently, allows the read-out part to read out all of the charges by dividing the charges into the plurality of the fields. In this case, only the signal charge can be extracted by removing an unwanted charge, and a S/N ratio of the output signal can be improved, thereby improving the image quality of the shot image. Also, the generation of the step difference between the fields of the output signals, which is caused by a difference between amounts of the unwanted charges generated in the respective fields, can be suppressed.
An imaging apparatus and an endoscope apparatus according to Embodiment 1 of the present invention will be described below with reference to
The imaging apparatus according to Embodiment 1 constitutes a part of the endoscope apparatus (see
Specifically, as shown in
Moreover, the CCD 1 is similar to the CCD 101 that is shown in
Moreover, each of the vertical transfer electrodes is connected to any of driving terminals ΦV1 to ΦV4 via a bus line wiring (not illustrated) that is provided around an imaging area. The vertical charge transfer part functions as a read-out part for reading out a signal charge that is accumulated in the photoelectric conversion part, when H (high)-level read-out pulses are applied to the driving terminals ΦV1 and ΦV3. Further, the vertical charge transfer part transfers, in the vertical direction, the signal charge that is read out, when M (middle)-level and L (low)-level transfer pulses are applied to the driving terminals ΦV1 to ΦV4. Moreover, each of the horizontal transfer electrodes is connected to any of driving terminals ΦH1 and ΦH2. The horizontal charge transfer part transfers the signal charge in the horizontal direction, when H (high)-level and L (low)-level transfer pulses are applied alternately to the driving terminals ΦH1 and ΦH2.
Moreover, the photoelectric conversion part of the CCD 1 is structured similarly to the photoelectric conversion part of the conventional CCD 101 (see
Further, also in Embodiment 1, the CCD 1 is provided with a SUB terminal for applying a reverse bias voltage between a region of the semiconductor substrate where the P-well is not formed and the P-well (see
As described above, the imaging apparatus of Embodiment 1 has a structure that is similar to the imaging apparatus of Conventional Example 1. Also in Embodiment 1, similarly to Conventional Examples 1 and 2, the controlling apparatus 10 allows the vertical charge transfer part to perform field read-out for adding the charges of the two or more photoelectric conversion parts that are arranged in the vertical direction, thereby shooting a moving image.
It should be noted that the imaging apparatus of Embodiment 1 is distinctive from the imaging apparatus of Conventional Example 1 in a point that timings of turning the illumination light source 30N and OFF are controlled by the system controller 8. Moreover, the imaging apparatus of Embodiment 1 can shoot a still image by the frame read-out system, in spite of having no mechanical shutter unlike the imaging apparatus of Conventional Example 2. This point will be described below specifically with reference to
As shown in
Whereas, when a shutter trigger is input (ON), the field period thereof becomes a light exposure period (for example, 1/30 seconds) similarly to Conventional Examples 1 and 2. In Embodiment 1, the illumination light source 3 is turned OFF by the system controller 8 after termination of the light exposure period. Moreover, the imaging apparatus of Embodiment 1 constitutes a part of the endoscope apparatus, and is used for shooting an image in a dark space. Thus, by turning OFF the illumination light source 3, the incident light 11 hardly is incident onto the CCD 1 via the imaging lens system 2. Further, this state is substantially the same as the state where the mechanical shutter is dosed in Conventional Example 2.
And, as shown in
Specifically, at the same time of turning OFF the illumination light source 3, the CCD driving circuit 5 applies a H-level read-out pulse to the driving terminal ΦV1 according to an instruction from the system controller 8. Subsequently, the CCD driving circuit 5 applies M-level and L-level transfer pulses to the driving terminals ΦV1 to ΦV4, and transfers in the vertical direction the charges that are read out. Moreover, after completion of this transfer, the CCD driving circuit 5 then applies a H-level read-out pulse to the driving terminal ΦV3. And, the CCD driving circuit 5 also transfers the charges that are read out at this time in the vertical direction.
As a result, also in Embodiment 1, similarly to Conventional Example 2, charges accumulated in pixel columns in odd rows and charges accumulated in pixel columns in even rows are read out without being mixed (see
Moreover, in Embodiment 1, similarly to Conventional Examples 1 and 2, a reverse bias voltage (a substrate voltage) that is applied to the SUB terminal of the CCD 1 is fixed at the M-level, and a charge beyond a certain amount is ejected to the semiconductor substrate via an OFB region, in either of the moving image shooting period and the still image shooting period.
Moreover, in the light of improving image quality of the still image, an environment for using the imaging apparatus preferably has a luminosity of about 10 lux or less while the illumination light source is OFF. Specifically, insides of a human body, another animal body, a pipeline and the like are exemplified.
Further, in Embodiment 1, in order to obtain a color moving image and a color still image, the CCD 1 can be provided with a color filter.
As shown in
Incidentally, the reason for using the complementary color filters in the present embodiment is as follows. In the case of using primary color filters, if adding signals of vertical two pixels (for example, R+G or B+G), original primary color signals cannot be recovered in signal processing in a latter step. Thus, in the case of using the primary color filters, all of the pixels generally are read out independently. Whereas, in the case of using the complementary color filters, even if the signals of the vertical two pixels are added and are read out, primary color signals approximately can be introduced by performing the below-described color-difference signal processing in the latter step.
When a brightness signal Y is approximated by a following formula (3), color-difference signals (R-Y) and (B-Y) are approximated as shown by formulae (4) and (5).
Y={(G+Cy)+(Mg+Ye)}×½ (3)
R−Y={(Mg+Ye)−(G+Cy)}=2R−G (4)
B−Y={(Mg+Cy)−(G+Ye)}=2B−G (5)
From these formulae (3) to (5), the primary color signals R, G and B are approximated by the below formulae (6) to (8). Herein, below-described n, m, p and q are coefficients.
G=Y−(R−Y)−(B−Y) (6)
R=n(R−Y)+m{Y−(B−Y)} (7)
B=p(B−Y)+q{Y−(R−Y)} (8)
As described above, the complementary color filters that do not lose color information even when adding the charges of the vertical two pixels can increase a sensitivity twice by the signal adding, and is more advantageous for shooting a moving image in a dark space than the primary color filters, thus being used preferably for a camcorder, an endoscope and the like. However, it should be noted that, in a structure using the complementary color filters, since the primary color signals are introduced approximately by calculating the complementary color signals, it has a drawback that color reproducibility is lower than that in the case of reading out all of the pixels independently by using the primary color filters. Thus, in the case where the color reproducibility is required to be prioritized to the sensitivity, a CCD provided with the primary color filter is used generally.
Next, the endoscope apparatus according to Embodiment 1 will be described with reference to
The camera unit 23 is provided with an insertion part 21 that is inserted into an inside of a human body, an inside of a pipeline or the like, and an operation part 22. The insertion part 21 has a tube-shape, and is provided with the CCD 1 constituting the imaging apparatus, the imaging lens system 2 and the illumination light source 3 on its tip. Moreover, the tip of the insertion part 21 is bendable, and constitutes a bending part 25. Specifically, inside the insertion part 21, a wire for transmitting a motive power for bending, an actuator (not illustrated) for generating the motive power for bending and the like are mounted.
Further, the operation part 22 is provided with a dial for pulling the wire, a button for operating the actuator and the like, and an operator controls the bending of the insertion part 21 via the operation part 22. Beside these, a forceps for performing treatment, collecting tissues and the like, a nozzle for spouting a medicament and air, and the like may be mounted on the tip of the insertion part 21. In this case, these operations also are performed via the operation part 22.
Moreover, in the control unit 24, a remaining part of the imaging apparatus, that is, the signal processing circuit 7, the power source 4 of the illumination light source 3 and the system controller 8 are mounted. Thus, a video image (a moving image and a still image) that is shot by the camera unit 23 and is subjected to the signal processing by the control unit 24 is displayed on the display 9.
As described above, the endoscope apparatus of Embodiment 1 is provided with the imaging apparatus of Embodiment 1 shown in
Next, an imaging apparatus and an endoscope apparatus according to Embodiment 2 of the present invention will be described with reference to
The imaging apparatus of Embodiment 2 is distinctive from the imaging apparatus of Embodiment 1 shown in
As shown in
Specifically, according to the instruction from the system controller, the CCD driving circuit applies read-out pulses only to a first pixel row and a fourth pixel row from the top, where four pixel rows constitute one group, for example. Thereby, only charges that are accumulated in the photoelectric conversion parts 110 in the first pixel row and the fourth pixel row are read out by the respective vertical charge transfer parts 111.
Thus, according to Embodiment 2, since only two pixel rows per four pixel rows are read out and the rest two pixel rows are omitted, a resolution of the moving image in the vertical direction is reduced by half. Thereby, the moving image, however, can be output at a frame rate of, for example, 60 frames/second (30 frames/second in Embodiment 1), thus increasing the frame rate of the moving image. The imaging apparatus of Embodiment 2 is useful for shooting a subject that moves quickly or for capturing a moving image at a high speed.
Moreover, the imaging apparatus of Embodiment 2 shoots a moving image by reducing the pixel rows to be read out as described above, only in the case where the vertical resolution is not required, and in other cases, the imaging apparatus of Embodiment 2 also can shoot a moving image similarly to the imaging apparatus of Embodiment 1. Specific examples of the case where the vertical resolution is not required include a case where the imaging apparatus is operated in a view finder mode or a monitor mode, a case where a focus is adjusted by autofocus, a case where light exposure and a white balance are adjusted and the like. As shown in
Also in Embodiment 2, in order to obtain a color moving image and a color still image, the CCD may be provided with a color filter.
As shown in
It should be noted that, in Embodiment 2, the case where only two pixel rows per four pixel rows are read out is described as an example, but a cycle for reading out the pixel rows and the pixel rows to be read out may be determined according to the necessary vertical resolution and the necessary frame rate. For example, in the case of reading out only two pixel rows per six pixel rows, the vertical resolution is reduced to one-third, but the frame rate can be increased to 90 frames/second.
Next, an imaging apparatus and an endoscope apparatus according to Embodiment 3 of the present invention will be described with reference to
The imaging apparatus of Embodiment 3 also is distinctive from the imaging apparatus of Embodiment 1 shown in
As shown in
Subsequently, according to the instruction from the system controller, the CCD driving circuit applies read-out pulses only to the third pixel row and the fourth pixel row from the top. As a result, charges in the first pixel row that already are read out and transferred are added to charges in the third pixel row that are read out. Similarly, charges in the second pixel row that already are read out and transferred are added to charges in the fourth pixel row that are read out.
As described above, in Embodiment 3, since the signals of the two pixel rows are added without being reduced, a sensitivity at the time of shooting a moving image is increased twice, compared with that of Embodiment 2. Moreover, in Embodiment 3, since the number of lines in the vertical direction is decreased by half, the moving image can be output at a frame rate of, for example, 60 frames/second similarly to Embodiment 2. Embodiment 3 is useful particularly for shooting a moving image in the case where the CCD is provided with a primary color filter. This point will be described with reference to
As shown in
In Embodiment 3, the case where the four pixel rows constitute one cycle, and the first and third pixel rows, and the second and fourth pixel rows from the top are read out and added respectively is explained, but the number of the pixel rows that constitute one cycle may be determined according to the necessary vertical resolution and the necessary frame rate. For example, it also is possible that six pixel rows constitute one cycle, and a first pixel row+a third pixel row+a fifth pixel row, and a second pixel row+a fourth pixel row+a sixth pixel row are read out and added, respectively. In this case, the vertical resolution is decreased to one third, but the frame rate can be increased to 90 frames/second.
Next, an imaging apparatus and an endoscope apparatus according to Embodiment 4 will be described with reference to
The imaging apparatus of Embodiment 4 is distinctive from the imaging apparatus of Embodiment 1 shown in
As shown in
Herein, the electronic shutter pulse will be explained. Also in Embodiment 4, on the semiconductor substrate constituting the CCD, a SUB terminal is provided (see
As shown in
Moreover, when the application of the electronic shutter pulse is completed, accumulation of the charge is started in the photoelectric conversion part. In Embodiment 4, the light exposure period is from the completion of the application of the electronic shutter pulse to the starting of the read-out of the charge that is accumulated in the photoelectric conversion part.
Incidentally, the read-out and the transfer of the charge for obtaining a still image are performed similarly to Embodiment 1. Also in Embodiment 4, a moving image is shot by the field read-out. Moreover, also in Embodiment 4, when the electronic shutter pulse is not applied, a level of the reverse bias voltage is maintained at the M-level similarly to Embodiment 1.
As described above, in Embodiment 4, the controlling apparatus can determine the starting time of the light exposure and can adjust a length of the light exposure period for obtaining a still image easily, by varying a time for supplying the electronic shutter pulse and the number thereof. Thus, according to Embodiment 4, the light exposure period can be set with a higher precision than those of Embodiments 1 to 3. Also, for example, since the light exposure period can be set to be an extremely short period of time ( 1/1000 seconds or less) easily, a still image of a subject that moves at a high speed also can be shot.
Next, an imaging apparatus and an endoscope apparatus according to Embodiment 5 will be described with reference to
The imaging device of Embodiment 5 is distinctive from the imaging apparatus of Embodiment 1 shown in
As shown in
As a result, as shown in
However, if the potential height of the overflow barrier becomes too high, an amount of the charge that is accumulated in the photoelectric conversion region becomes too large, and the charge possibly flows out from the vertical charge transfer part at the time of reading out. Thus, in Embodiment 5, the level of the reverse bias voltage preferably is set as described below.
A maximum transfer charge amount of each of the vertical charge transfer part is represented by SVCCD, a maximum accumulated charge amount of each of the photoelectric conversion parts at the time of shooting a moving image is represented by Smotion, and the number of pixels that are added at the time of shooting the moving image is represented by N (N=2 in Embodiment 5). In this case, the below formula (1) is required to be satisfied so that the charge does not flow out from the vertical charge transfer part at the time of shooting the moving image.
S
VCCD
≧N×S
motion (1)
Moreover, a maximum accumulated charge amount of each of the photoelectric conversion parts at a time of shooting a still image is represented by Sstill, then the below formula (2) is required to be satisfied such that the charge does not flow out from the vertical charge transfer part at the time of shooting the still image.
SVCCD≧Sstill (2)
Moreover, the most appropriate level of the reverse bias voltage at the time of shooting the moving image is represented by a M′-level, then the M′-level may be set such that the above formula (1) is satisfied, that is, the potential height of the overflow barrier is equal to the potential height at the time of shooting the moving image shown in
As described above, if respectively setting the levels (the potential heights of the overflow barrier) of the reverse bias voltages at the time of shooting the moving image and at the time of shooting the still image as described above, the outflow of the charge from the vertical charge transfer part can be suppressed, and the amount of the charge to be accumulated in the photoelectric conversion part can be increased to be as large as possible.
Next, an imaging apparatus and an endoscope apparatus according to Embodiment 6 of the present invention will be described with reference to
The imaging apparatus of Embodiment 6 is distinctive from the imaging apparatus of Embodiment 5 in that a modulation timing of the reverse bias voltage (the SUB voltage) is after the termination of the light exposure period. Except for this point, the imaging apparatus of Embodiment 6 is similar to the imaging apparatus of Embodiment 5. The distinctive point from Embodiment 5 will be described below. Incidentally, the endoscope apparatus of Embodiment 6 also has a structure that is similar to the endoscope apparatus of Embodiment 1 shown in
As shown in
Unlike Embodiment 6, a case where the reverse bias voltage always is set at the M-level during a period when the still image is read out and transferred will be assumed (see
In this case, it is possible that a charge amount SFLD1 of the charge CFLD1 that is accumulated in the pixel column in the odd row is larger than a charge amount SFLD2 of the charge CFLD2 that is accumulated in the pixel column in the even row (SFLD1>SFLD2). Further, when SFLD1 is larger than SFLD2, a field step difference occurs between an image of the first field and an image of the second field, which is caused by a difference in saturation power.
In order to solve this problem, in Embodiment 6, the level of the reverse bias voltage is modulated from the M-level to the L-level while reading out the charge CFLD1 in the odd row after the termination of the light exposure period (after turning OFF the illumination light source). Thereby, as shown in
Next, an imaging apparatus and an endoscope apparatus according to Embodiment 7 of the present invention will be described with reference to
The imaging apparatus of Embodiment 7 is distinctive from the imaging apparatus of Embodiment 1 shown in
As shown in
Herein, the high-speed sweep-out pulse will be explained with reference to
As shown in
In order to solve this problem, in Embodiment 7, as shown in
Moreover, after completion of a step shown in
As described above, in Embodiment 7, after applying the high-speed sweep-out pulse to the vertical charge transfer part, the charges in the first field and the second field are read out. Thus, since the unwanted charge is removed and only the signal charge is extracted, a S/N ratio of the output signal is improved. Further, the image quality of the shot image can be improved thereby. Moreover, the step difference between the fields of the output signal, which is caused by a difference between the amounts of the unwanted charges generated in the first field and the second field, also is suppressed.
Also, in the example shown in
As described above, in Embodiments 1 to 7, the case where the solid-state imaging device is the interline transfer type CCD imaging device is explained, but the present invention is not limited to this. In the present invention, the solid-state imaging device may be a frame interline transfer type CCD imaging device or a MOS type imaging device.
Moreover, in Embodiments 1 to 7, the overflow barrier is a vertical type overflow barrier (with an overflow drain structure), and is formed in a region from a bottom surface of the N type diffusion layer that constitutes the photoelectric conversion part to a bottom surface of the P-well. However, the present invention is not limited to this, and the overflow barrier may be a horizontal type overflow barrier (with the overflow drain structure).
Specifically, in the case of adopting the horizontal type overflow barrier, a N+ type second diffusion layer is formed in parallel with the N type diffusion layer constituting the photoelectric conversion part, and a region between them is an overflow barrier region. Moreover, a gate electrode is formed therebetween, and by adjusting a level of a voltage to be applied thereto, the potential height of the overflow barrier is adjusted.
Moreover, in any of Embodiments 1 to 7, four pixel rows constitute one cycle for the processing, but the present invention is not limited to this. In the present invention, three or another number of rows may constitute one cycle for the processing. Moreover, at the time of shooting a moving image, charges of three pixels or more may be added. Further, at the time of shooting a still image, the pixels may be read out by dividing the charges into three fields or more.
Further, the endoscope apparatus of the present embodiment is not limited to the tube type endoscope apparatus, and it may be a capsule type endoscope apparatus in the present invention. The capsule type endoscope apparatus can navigate independently, for example, inside a human body, thereby decreasing a load on a patient significantly.
The imaging apparatus of the present invention is useful particularly for decreasing a size of an endoscope apparatus and increasing a resolution of a still image in the endoscope apparatus. Thus, the imaging apparatus and the endoscope apparatus of the present invention have industrial applicability.
The invention may be embodied in other forms without departing from the spirit or essential characteristics thereof. The embodiments disclosed in this application are to be considered in all respects as illustrative and not limiting. The scope of the invention is indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are intended to be embraced therein.
Number | Date | Country | Kind |
---|---|---|---|
2006-215914 | Aug 2006 | JP | national |