The present invention relates to an image pickup device such as a CCD image sensor, and a microscope apparatus using the same.
A CCD image sensor being an image pickup device that acquires a one-dimensional or two-dimensional image is constructed with a photodetecting section for which a plurality of pixels are arranged in an array form and a horizontal shift register inputted, in parallel, with electric charges from a plurality of vertical shift registers composing the photodetecting section. In such a configuration, electric charges generated in the respective pixels of the photodetecting section are transferred in the vertical direction by the vertical shift registers and are inputted to corresponding cells of the horizontal shift register. The horizontal shift register transfers the electric charges inputted from the vertical shift registers in the horizontal direction to be an output direction, and the electric charges are read out from an output end thereof.
Moreover, in order to speed up reading out of the electric charges generated in the photodetecting section, employed is a multi-tap structure for which the horizontal shift register is divided into a plurality of segmental shift registers and electric charge output ends are provided for the respective segmental shift registers. Such a configuration providing a plurality of output ends is useful particularly in such a case that the number of pixels in the photodetecting section is increased and a long time is required for reading out electric charges from all pixels with an ordinal configuration (see Patent Documents 1 and 2, for example).
Patent Document 3: Japanese Patent Application Laid-Open No. H08-18779
In the above-described image pickup device having a multi-tap structure, an abnormal output such as a drop in output may occur in data signals (initial data of each tap) outputted first from the respective output ends. Such an abnormal output constitutes a factor of deterioration in quality of image data as a whole obtained by adding up signal arrays of data signals respectively outputted from the plurality of output ends.
As a method for reducing such influence of an abnormal output of data signals, there is a method for carrying out, after acquiring image data composed of data signals outputted from an image pickup device, data correction by means of software in a computer or the like loaded with the image data. However, in such a method, since a correction processing is carried out after image data is outputted from the image pickup device, there is a problem such that it takes time to acquire final image data applied with a data correction.
The present invention has been made to solve the above problems, and an object thereof is to provide an image pickup device that is capable of favorably reducing influence of an abnormal output produced in data signals and a microscope apparatus using the same.
In order to achieve this object, an image pickup device according to the present invention includes: (1) photodetecting means that has a plurality of pixels arranged in an array form and outputs an electric charge generated according to an incident light amount in the pixel; (2) charge transfer means provided for the photodetecting means along one of the arrangement directions of the plurality of pixels and having N (N is an integer equal to or more than 2) segmental charge transfer sections divided in terms of the arrangement direction; (3) A/D converting means that converts signals by electric charges outputted from the photodetecting means via the charge transfer means to digital data signals; and (4) digital signal processing means that carries out a signal processing for the data signals outputted from the A/D converting means, and (5) the segmental charge transfer section transfers electric charges from pixels present in a predetermined photodetecting region of the photodetecting means in an output direction and outputs from an output end, and the digital signal processing means carries out, to a correction target of a data signal outputted first in a signal array from the segmental charge transfer section, a data correction by use of a plurality of correcting data signals including at least one of a first correcting data signal and a second correcting data signal while setting another predetermined data signal included in the signal array as the first correcting data signal, and a predetermined data signal included in another signal array from a segmental charge transfer section adjacent to an output end side of the segmental charge transfer section as the second correcting data signal.
In the above-described image pickup device, employed is a multi-tap structure for which the charge transfer means inputted, in parallel, with electric charges from the plurality of pixels of the photodetecting means or a plurality of vertical shift registers composing the photodetecting means is divided into the plurality of segmental charge transfer sections each having an output end. This speeds up reading out of electric charges generated in the respective pixels of the photodetecting means.
Moreover, in such a multi-tap structure, in response to an abnormal output that occurs in the initial data signals outputted from the respective output ends of the plurality of segmental charge transfer sections, the digital signal processing means using a digital signal processor (DSP) is provided and a data correction for the abnormal output of data signals is carried out in the digital signal processing means. This makes it possible to easily and speedily acquire final image data applied with a data correction. In addition, by using a plurality of correcting data signals including at least one of the first correcting data signal and the second correcting data signal described above, influence of an abnormal output produced in data signals can be favorably reduced so as to obtain image data with a satisfactory quality.
A microscope apparatus according to the present invention includes: the image pickup device described above for acquiring an image by an optical image of a sample to be an observation target; a light guiding optical system that includes an objective lens into which light from the sample is made incident and which guides the optical image of the sample to the image pickup device; and image acquisition control means that controls acquisition of the image of the sample by the image pickup device.
In the microscope apparatus described above, a microscope apparatus is constructed with use of the image pickup device described above that carries out, with regard to initial data signals outputted from the respective output ends of the plurality of segmental charge transfer sections, a data correction in response to an abnormal output of data signals in the digital signal processing means. Thereby, it becomes possible to acquire image data with a satisfactory quality in an observation of the sample.
According to an imaging device and a microscope apparatus using the same of the present invention, by employing a multi-tap structure for which the charge transfer means is divided into a plurality of segmental charge transfer sections and carrying out, with regard to data signals outputted first in signal arrays from the respective output ends of the plurality of segmental charge transfer sections, a data correction in response to an abnormal output by a predetermined correcting method in the digital signal processing means, it becomes possible to favorably reduce influence of an abnormal output produced in data signals.
1A, 1B, 1C—image pickup device, 10—photodetecting section, R01 to R16—photodetecting region, 11—accumulating section, 12—charge transfer section, T01 to T16—segmental charge transfer section, 13—accumulating section, 14—charge transfer section, T17 to T32—segmental charge transfer section, 15—A/D converting section, C01 to C16—A/D converter, 16a to 16c—data selector circuit (DS circuit), 17—RAM, 18—buffer, 19—control section, 20—digital signal processing section, 21 to 29—digital signal processor (DSP), 3—microscope apparatus, 30—sample stage, 35—XY stage driving section, 40—light guiding optical system, 41—objective lens, 45—optical system driving section, 50—control device, 51—input device, 52—display device.
Hereinafter, preferred embodiments of an image pickup device and a microscope apparatus using the same according to the present invention will be described in detail along with the accompanying drawings. Here, in the description of the drawings, identical elements are designated with identical numerical symbols so as to avoid overlapping descriptions. Dimensional ratios of the drawings are not always coincident with those in the description.
The photodetecting section 10 is photodetecting means that has a plurality of pixels arranged in a two-dimensional array form and each having a photoelectric conversion function and outputs an electric charge generated according to the incident light amount in the pixel. Hereinafter, for convenience of description, of the arrangement directions of the pixels in the photodetecting section 10, the direction from left to right is set as an x-axis direction, and the direction from bottom to top is set as a y-axis direction. Moreover, the plurality of two-dimensional array formed pixels in the photodetecting section 10 compose a plurality of vertical shift registers whose charge transfer direction is in a vertical direction (negative y-axis direction in
For the photodetecting section 10, under the same in the figure, a charge transfer section 12 is provided along the x-axis direction being one arrangement direction of the plurality of pixels. The charge transfer section 12 is a horizontal shift register that transfers electric charges outputted from the plurality of vertical shift registers composing the photodetecting section 10 and inputted in parallel in a predetermined output direction (horizontal direction, negative x-axis direction in
In the present embodiment, the charge transfer section 12 is divided into a plurality of segments in the x-axis direction to have 16 segmental charge transfer sections T01 to T16. The segmental charge transfer sections T01 to T16 are each constructed with a plurality of and an equal number of cells, and are disposed in order from the left side to the right side in the figure. In addition, the charge transfer direction in each of the segmental charge transfer sections T01 to T16 is a negative x-axis direction as described above, and a left end side thereof is an electric charge output end.
Moreover, for the segmental charge transfer sections T01 to T16 of the charge transfer section 12, the photodetecting section 10 can be sectioned into corresponding 16 photodetecting regions R01 to R16. In such a configuration, the first segmental charge transfer section T01 of the charge transfer section 12 transfers electric charges outputted by the vertical shift registers from pixels present in the first photodetecting region R01 of the photodetecting section 10 in the output direction and outputs from the output end. At this time, signals outputted from the output end of the segmental charge transfer section T01 are of a signal array for which signals resulting from electric charges inputted in parallel to the plurality of cells of the segmental charge transfer section T01 from the plurality of vertical shift registers in the photodetecting region R01 are outputted in sequence. The second to the sixteenth segmental charge transfer sections T02 to T16 of the charge transfer section 12 and the second to the sixteenth photodetecting regions R02 to R16 of the photodetecting section 10 are also the same in configurations as the first segmental charge transfer section T01 and the first photodetecting region R01, respectively.
Corresponding to these segmental charge transfer sections T01 to T16, 16 A/D converters C01 to C16 are provided in the A/D converting section 15. Analog signals resulting from electric charges from the photodetecting section 10 outputted from the output ends of the segmental charge transfer sections T01 to T16 are converted to digital data signals by corresponding A/D converters of the A/D converters C01 to C16.
The data signals outputted from the A/D converters C01 to C16 are inputted to a digital signal processing section 20 for carrying out a predetermined signal processing to data signals. In the present embodiment, the digital signal processing section 20 is composed of four digital signal processors (DSPs) 21 to 24.
The first DSP 21 is provided for the first to the fourth segmental charge transfer sections T01 to T04, and is inputted with data signals from the A/D converters C01 to C04. The second DSP 22 is provided for the fifth to the eighth segmental charge transfer sections T05 to T08, and is inputted with data signals from the A/D converters C05 to C08. The third DSP 23 is provided for the ninth to the twelfth segmental charge transfer sections T09 to T12, and is inputted with data signals from the A/D converters C09 to C12. The fourth DSP 24 is provided for the thirteenth to the sixteenth segmental charge transfer sections T13 to T16, and is inputted with data signals from the A/D converters C13 to C16. In addition, signal processing operations in these DSPs 21 to 24 are controlled by a control section 19 including a CPU.
Moreover, in
To first to fourth ports of an input FIFO 21a of the first DSP 21, data signals from the A/D converters C01, C02, and C03 and the DS circuit 16a are inputted, respectively. To first to fourth ports of an input FIFO 22a of the second DSP 22, data signals from the DS circuit 16a, the A/D converters C06 and C07, and the DS circuit 16b are inputted, respectively.
To first to fourth ports of an input FIFO 23a of the third DSP 23, data signals from the DS circuit 16b, the A/D converters C10 and C11, and the DS circuit 16c are inputted, respectively. To first to fourth ports of an input FIFO 24a of the fourth DSP 24, data signals from the DS circuit 16c, the A/D converters C14, C15, and C16 are inputted, respectively.
Here, each of the DS circuits 16a to 16c sends out the data signal inputted from the segmental charge transfer section via the A/D converter to a corresponding DSP. In addition, as will be described later, each holds a predetermined data signal and sends out the held data signal to another DSP as a correcting data signal for a data correction to be executed in the DSP.
The DSPs 21 to 24 each carry out a necessary signal processing such as a data correction to data signals inputted from corresponding A/D converters C01 to C16 and DS circuits 16a to 16c. Then, the data signals after a signal processing are outputted as final image data acquired in the present image pickup device 1A from output FIFOs 21b to 24b of the DSPs 21 to 24.
Next, description will be given of a data correction executed to image data in the image pickup device 1A having a configuration shown in
Here, the number n of data signals outputted from the segmental charge transfer section is equivalent to the number of vertical shift registers in the corresponding photodetecting region of the photodetecting section 10. For example, the data signal 01-1 outputted first from the segmental charge transfer section T01 corresponds to an electric charge outputted from the leftmost vertical shift register of the photodetecting region R01. In addition, the data signal 01-n outputted last corresponds to an electric charge outputted from the rightmost vertical shift register. In addition, the signal arrays outputted from the segmental charge transfer sections T01 to T16 are inputted to the DSPs 21 to 24 as digital data signals, via the corresponding A/D converters C01 to C16 as described above.
In the present embodiment, to the second DSP 22, in addition to the signal arrays from the segmental charge transfer sections T05 to T08 to be a processing target, a predetermined data signal included in another signal array from the segmental charge transfer section T04 adjacent to the output end side thereof and being a processing target of the different DSP 21 is inputted as a correcting data signal. Similarly, to the third and fourth DSPs 23 and 24, in addition to the signal arrays from the segmental charge transfer sections T09 to T12 and T13 to T16 to be processing targets, predetermined data signals included in other signal arrays from the segmental charge transfer sections T08 and T12 are inputted as correcting data signals.
Concretely, to the first port of the first DSP 21, a signal array 01-1 to 01-n from the segmental charge transfer section T01 is inputted. In addition, to the second port, a signal array 02-1 to 02-n from the segmental charge transfer section T02 is inputted. In addition, to the third port, a signal array 03-1 to 03-n from the segmental charge transfer section T03 is inputted. In addition, to the fourth port, a signal array 04-1 to 04-n from the segmental charge transfer section T04 is inputted via the DS circuit 16a. Here, in terms of the first DSP 21, no adjacent DSP exists at its output end side. Therefore, no input of correcting data signals being a processing target of a different DSP is carried out.
To the first port of the second DSP 22, a signal array 05-1 to 05-n from the segmental charge transfer section T05 is inputted via the DS circuit 16a, and furthermore, the data signal 04-n outputted last in the signal array from the segmental charge transfer section T04 is inputted as a correcting data signal. In addition, to the second port, a signal array 06-1 to 06-n from the segmental charge transfer section T06 is inputted. In addition, to the third port, a signal array 07-1 to 07-n from the segmental charge transfer section T07 is inputted. In addition, to the fourth port, a signal array 08-1 to 08-n from the segmental charge transfer section T08 is inputted via the DS circuit 16b.
To the first port of the third DSP 23, a signal array 09-1 to 09-n from the segmental charge transfer section T09 is inputted via the DS circuit 16b, and furthermore, the data signal 08-n outputted last in the signal array from the segmental charge transfer section T08 is inputted as a correcting data signal. In addition, to the second port, a signal array 10-1 to 10-n from the segmental charge transfer section T10 is inputted. In addition, to the third port, a signal array 11-1 to 11-n from the segmental charge transfer section T11 is inputted. In addition, to the fourth port, a signal array 12-1 to 12-n from the segmental charge transfer section T12 is inputted via the DS circuit 16c.
To the first port of the fourth DSP 24, a signal array 13-1 to 13-n from the segmental charge transfer section T13 is inputted via the DS circuit 16c, and furthermore, the data signal 12-n outputted last in the signal array from the segmental charge transfer section T12 is inputted as a correcting data signal. In addition, to the second port, a signal array 14-1 to 14-n from the segmental charge transfer section T14 is inputted. In addition, to the third port, a signal array 15-1 to 15-n from the segmental charge transfer section T15 is inputted. In addition, to the fourth port, a signal array 16-1 to 16-n from the segmental charge transfer section T16 is inputted.
Of the data signals from the segmental charge transfer sections T01 to T16 inputted to the DSPs 21 to 24, respectively, in the data signals 01-1 to 16-1 outputted first from the respective segmental charge transfer sections shown with hatching in
Moreover, with regard to the data signal 02-1 from the segmental charge transfer section T02, the data signal 02-2 outputted second in the signal array is used as a first correcting data signal, and the data signal 01-n outputted last in the signal array from the segmental charge transfer section T01 adjacent to the output end side is used as a second correcting data signal. Then, a data correction to replace the correction target data signal 02-1 with an average of the first correcting data signal 02-2 and the second correcting data signal 01-n (02-1=(01-n+02-2)/2) is carried out.
A data correction for the data signals 03-1 and 04-1 in the first DSP 21, a data correction for the data signals 05-1 to 08-1 in the second DSP 22, a data correction for the data signals 09-1 to 12-1 in the third DSP 23, and a data correction for the data signals 13-1 to 16-1 in the fourth DSP 24 are also carried out in the same manner as the data correction to the data signal 02-1 in the first DSP 21. By the above data corrections, the data signals shown in
Effects of an image pickup device by the above-described embodiment will be described.
In the image pickup device 1A shown in
Moreover, in such a multi-tap structure, in response to an abnormal output that occurs in the initial data signals 01-1 to 16-1 outputted from the output end present at the left end in each of the plurality of segmental charge transfer sections T01 to T16, the digital signal processing section 20 using DSPs is provided and a data correction for the abnormal output of data signals is carried out in DSPs 21 to 24 of the digital signal processing section 20. As such, not by executing a data correction to acquired image data by means of software after this is outputted from an image pickup device, but by executing a data correction in the DSPs 21 to 24 provided in the image pickup device 1A, final image data applied with a data correction can be easily and speedily acquired.
Here, with regard to the configuration of the photodetecting section 10 used for detection of an incident optical image, it is generally sufficient to have a plurality of pixels arranged in an array form. More specifically, if the image pickup device employs a multi-tap structure for which the charge transfer section 12 being a horizontal shift register is divided into a plurality of segmental charge transfer sections (segmental shift registers), with regard to the configuration of the photodetecting section 10, it is possible to apply the above-described data correcting method by DSPs to either sensor of an image sensor for which pixels are arranged in a two-dimensional array form and a line sensor for which pixels are arranged in an one-dimensional array form. In addition, it may be an image sensor that performs a TDI line sensor operation. Moreover, as a charge transferring type in the photodetecting section 10, any of the FT type, FFT type, IT type, and FIT type may be employed.
In addition, with regard to the segmental charge transfer sections in the charge transfer section 12, the charge transfer section is not limited to a structure having the above-described 16 segmental charge transfer sections T01 to T16. Generally, it is sufficient that the charge transfer section is divided into N (N is an integer equal to or more than 2) segmental charge transfer sections in the arrangement direction. In addition, the number of cells in each individual segmental charge transfer section may be set as appropriate.
With regard to a data correcting method for a data signal executed in the digital signal processing section 20, it is preferable to carry out a data correction for a data signal to be a correction target of a DSP outputted first in a signal array from a segmental charge transfer section, while setting another predetermined data signal included in the signal array as a first correcting data signal and a predetermined data signal included in a signal array (another signal array) from a segmental charge transfer section adjacent to the output end side (left side in
In this case, with regard to the first correcting data signal selected in a signal array from a segmental charge transfer section identical with regard to the correction target data signal and the second correcting data signal selected in a signal array from another adjacent segmental charge transfer section, one or a plurality of data signals may be selected according to the concrete data correcting method, respectively. In addition, more generally, a data correction may be carried out by use of a plurality of correcting data signals including at least one of the first correcting data signal and the second correcting data signal. By such a data correcting method as well, influence of an abnormal output produced in data signals can be favorably reduced.
In particular, in the above-described embodiment, as shown in
Moreover, with regard to the correction target data signal 01-1 outputted from the segmental charge transfer section T01 having no adjacent segmental charge transfer section at the output end side, as described above, it is preferable to carry out a data correction (01-1=01-2) to replace the correction target data signal, while setting the data signal 01-2 outputted second in the signal array as a correcting data signal, by the correcting data signal. Alternatively, a data correction may be carried out while setting a plurality of data signals in the signal array as correcting data signals.
With regard to such a concrete data correcting method for a data signal, generally, various methods can be used.
A correcting method for the data signal I(x) includes the method for using data signals at the last and next one points as first and second correcting data signals and averaging these, as mentioned above with regard to
I(x)={I(x−1)+I(x+1)}/2.
In addition, as another correcting method, there is a method for using data signals at the last and next two points as first and second correcting data signals and averaging while weighting these with coefficients a and b,
The number of respective last and next data points used for a data correction may be set in various ways such as, for example, using data signals at the last and next three points.
Alternatively, a method may be used, such as using a plurality of data signals I(x+1) and I(x+2) included in an identical signal array as with the data signal I(x) being a correction target as correcting data signals, and estimating the data signal I(x) based on a slope thereof for correction by
With regard to a method for calculating a data signal after correction using a plurality of correcting data signals, various methods may be used, such as, for example, a least squares method, and a spline interpolation method, in addition to the averaging described above.
Moreover, in the digital signal processing section 20, a shading correction (see Patent Document 3, for example) may be carried out in addition to the data correction described above. More specifically, in the image pickup device 1A, nonuniformity in the image due to an uneven sensitivity of the photodetecting section 10 itself, an uneven luminance by an optical system, and the like can occur. In such a case, by carrying out a shading correction for a correction target of all data signals included in the signal array from the charge transfer section 12 including the segmental charge transfer sections T01 to T16, image data obtained in the image pickup device 1A can further be improved in quality.
For example, the number of cells in the segmental charge transfer section is 256, 256 correction coefficients CC(0) to CC(255) are prepared for one segmental charge transfer section in the DSP of the digital signal processing section 20. At this time, when one correction coefficient is 16 bits, the data amount is 16 bits×256=512 Bytes. Here, an example where a shading correction is carried out in only the x-axis direction for electric charges from the photodetecting section 10 has been shown, however, a two-dimensional shading correction may be carried out in the x-axis direction and y-axis direction. In this case, correction coefficients are expressed by a two-dimensional matrix of coefficients CC (x, y).
With regard to the configuration of the digital signal processing section 20 that carries out a signal processing such as a data correction for data signals outputted from the charge transfer section 12, in the image pickup device 1A shown in
Moreover, in the configuration using a plurality of DSPs as such, as mentioned above with regard to the second to the fourth DSPs 22 to 24 in
A concrete configuration example of the image pickup device 1A shown in
In response to the photodetecting section 10, the charge transfer section 12 is composed of the 16 segmental charge transfer sections T01 to T16 each having 256 cells. Moreover, at the output end side of the individual segmental charge transfer section, dummy cells are provided as necessary. Such a configuration includes, for example, a configuration for which 4 dummy cells are connected at the output end side in addition to the above-described 256 active cells, and a total of 260 cells are provided as a segmental charge transfer section. Moreover, in the present configuration example, an accumulating section 11 with, similar to the photodetecting section 10, 4096 cells and 70 lines is provided between the photodetecting section 10 and charge transfer section 12.
Furthermore, in the configuration of
Of these, the VP0 to VP2 video ports are used as an input FIFO and an output FIFO in the DSPs 21 to 24 of the digital signal processing section 20 shown in
Next, description will be given of a microscope apparatus according to the present invention using the image pickup device shown in
The sample stage 30 is formed of an XY stage movable in the x-direction and y-direction (horizontal direction), and by driving this XY stage 30 in an xy plane, an observation position in the microscope apparatus 3 for the sample S is set or changed in terms of the direction perpendicular to the optical axis. In addition, the sample stage 30 is drive-controlled by an XY stage driving section 35.
For the sample S on the sample stage 30, a light guiding optical system 40 for guiding an optical image of the sample S is provided above the stage 30. This light guiding optical system 40 includes an objective lens 41 into which light from the sample S is made incident and optical components necessary for guiding and converging the optical image of the sample S. Moreover, at a predetermined position on an optical path along which the optical image of the sample S is guided by the light guiding optical system 40, the image pickup device 1A having the configuration shown in
Moreover, for the light guiding optical system 40 and the image pickup device 1A, an optical system driving section 45 is installed. The optical system driving section 45 is constructed with use of, for example, a stepping motor or a piezo actuator, and shifts the optical system 40 and the image pickup device 1A fixed to the optical system 40 in the z-axis direction being the optical axis direction. In this configuration, the optical system driving section 45 has a function to adjust or change a focal position on the sample S for the image pickup device 1A and the light guiding optical system 40 in terms of the optical axis direction. This optical system driving section 45 is used for controlling a focal point in acquisition of an image of the sample S.
For the sample stage 30, the light guiding optical system 40, and the image pickup device 1A, a control device 50 is installed. The control device 50 is image acquisition control means that controls acquisition of an image of the sample S by the image pickup device 1A. Moreover, it is preferable that the control device 50 has a focal point controlling function to carry out acquisition of focus information including an in-focus position concerning acquisition of the image of the sample S, control of a focal point at the time of acquiring the image of the sample S, and the like.
The control device 50 is composed of, for example, a computer including a CPU and necessary storage such as a memory and a hard disk. Moreover, to the control device 50, an input device 51 and a display device 52 are connected. The input device 51 is composed of, for example, a keyboard, a mouse, and the like connected to a computer and is used for input and the like of information and instructions necessary for executing a sample S image acquiring operation in the present microscope apparatus 3. Moreover, the display device 52 is composed of, for example, a CRT display, a liquid crystal display, or the like connected to a computer and is used for displaying necessary information and the like with regard to acquisition of the image in the present microscope apparatus 3.
In the microscope apparatus 3 shown in
The configuration of an image pickup device according to the present invention will further be described.
Data signals outputted from the A/D converters C01 to C16 are inputted to the digital signal processing section 20 for carrying out a predetermined signal processing for data signals. In the present embodiment, the digital signal processing section 20 is composed of four DSPs 25 to 28. Moreover, in
As such, in the configuration where data storing means such as a RAM 17 is provided between the A/D converting section 15 and the digital signal processing section 20, according to the concrete configuration of the digital signal processing section 20 and the concrete data correcting method for a data signal, necessary data signals can be favorably inputted from the A/D converting section 15 to each of the DSPs 25 to 28 composing the digital signal processing section 20. In particular, such a configuration has an advantage that the degree of freedom of an input configuration of data signals to the DSPs of the digital signal processing section 20 is high. For example, for the image pickup device 1B having the configuration shown in
Data signals outputted from the A/D converters C01 to C16 are inputted to the digital signal processing section 20 for carrying out a predetermined signal processing for data signals. In the present embodiment, the digital signal processing section 20 is composed of one DSP 29. Moreover, in
As such, when the digital signal processing section 20 is composed of one DSP 29, the configuration of the image pickup device 1C including the digital signal processing section 20 can be simplified. Moreover, with such a configuration, the input configuration of data signals from the A/D converting section 15 to the DSP of the digital signal processing section 20 is also simplified. Here, it is preferable to set the number of DSPs composing the digital signal processing section 20 while taking processing capability, processing speed, and the like of the DSPs into consideration.
The image pickup device according to the present invention and the microscope apparatus using the same are not limited to the above-described embodiments and configuration examples, and can be variously modified. For example, in
Moreover, in all of the above-described embodiments, shown is a configuration where a data correction is carried out for data signals outputted from a single photodetecting section, however, it is also possible to employ, for example, a configuration where a data correction is carried out for data signals from three photodetecting sections corresponding to RGB. In this case, a configuration can be used where a data correction is carried out with regard to all data signals from one of the three photodetecting sections, then a data correction is carried out with regard to the two other photodetecting sections, in order. Alternatively, a configuration may be employed where three data signals from corresponding pixels in the three photodetecting sections are provided as a set of RGB data signals, and a data correction is carried out for the sets of these data signals, in sequence.
Here, it is preferable that the image pickup device includes: (1) photodetecting means that has a plurality of pixels arranged in an array form and outputs an electric charge generated according to an incident light amount in the pixel; (2) charge transfer means provided for the photodetecting means along one of the arrangement directions of the plurality of pixels and having N (N is an integer equal to or more than 2) segmental charge transfer sections divided in terms of the arrangement direction; (3) A/D converting means that converts signals by electric charges outputted from the photodetecting means via the charge transfer means to digital data signals; and (4) digital signal processing means that carries out a signal processing for the data signals outputted from the A/D converting means, and (5) the segmental charge transfer section transfers electric charges from pixels present in a predetermined photodetecting region of the photodetecting means in an output direction and outputs the same from an output end, and the digital signal processing means carries out, to a correction target of a data signal outputted first in a signal array from the segmental charge transfer section, a data correction by use of a plurality of correcting data signals including at least one of a first correcting data signal and a second correcting data signal while setting another predetermined data signal included in the signal array as the first correcting data signal, and a predetermined data signal included in another signal array from a segmental charge transfer section adjacent to an output end side of the segmental charge transfer section as the second correcting data signal.
Moreover, for the digital signal processing means, a configuration having M (M is an integer equal to or more than 2) digital signal processors to each of which signal arrays from one or a plurality of segmental charge transfer sections are inputted can be used.
In this case, it is preferable that, to the digital signal processor, in addition to the signal arrays from one or a plurality of segmental charge transfer sections to be a processing target, the second correcting data signal included in the other signal array from a segmental charge transfer section adjacent to an output end side thereof and being a processing target of a different digital signal processor is inputted. Consequently, even when a plurality of digital signal processors are used for a data correction for data signals, it becomes possible, in each thereof, to favorably execute a data correction in response to an abnormal output of data signals.
Alternatively, for the digital signal processing means, a configuration having one digital signal processor to which signal arrays from the N segmental charge transfer sections are inputted can be used.
Moreover, data storing means for temporarily storing the data signals outputted from the A/D converting means may be provided between the A/D converting means and the digital signal processing means. In this case, necessary data signals can be favorably inputted from the A/D converting means to one or each of the plurality of digital signal processors composing the digital signal processing means according to the concrete configuration of the digital signal processing means.
Moreover, it is preferable that the digital signal processing means carries out a shading correction to a correction target of all data signals included in the signal array from the segmental charge transfer section in addition to the data correction described above. Thereby, obtained image data is further improved in quality.
With regard to a concrete data correcting method for a data signal, for example, a method of the digital signal processing means carrying out, for the correction target data signal, the data correction to replace the correction target data signal by an average of the first correcting data signal and the second correcting data signal while setting a data signal outputted second in the signal array as the first correcting data signal, and a data signal outputted last in the other signal array as the second correcting data signal can be used.
Moreover, it is preferable that the digital signal processing means carries out the data correction to replace the correction target data signal by a correcting data signal while setting a data signal outputted second in the signal array as the correcting data signal when there is no segmental charge transfer section adjacent to an output end side of the segmental charge transfer section that outputs the correction target data signal. Alternatively, various methods other than these can also be used as data correcting methods for data signals.
Moreover, it is preferable that a microscope apparatus includes: the above-described image pickup device for acquiring an image by an optical image of a sample to be an observation target; a light guiding optical system that includes an objective lens into which light from the sample is made incident and which guides the optical image of the sample to the image pickup device; and image acquisition control means that controls acquisition of the image of the sample by the image pickup device.
The present invention can be used as an image pickup device capable of favorably reducing influence of an abnormal output produced in data signals and a microscope apparatus using the same.
Number | Date | Country | Kind |
---|---|---|---|
2004-224523 | Jul 2004 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2005/013758 | 7/27/2005 | WO | 00 | 11/8/2007 |