Method and apparatus for taking pictures

Abstract

Detection information is obtained from captured-image information of an imaging element array. An area is provided in an image capturing region in the imaging element array. In response to the obtained detection information, a pattern is generated which defines a ratio of a number of photosensor pixels used to capture an image to a number of all photosensor pixels in the area. The imaging element array is driven in accordance with the generated pattern. Interpolation responsive to a first picture signal generated by the used photosensor pixels in the area is implemented to generate a second picture signal corresponding to unused ones among all the photosensor pixels in the area. The first picture signal and the second picture signal are combined into a captured-image signal. The captured-image signal is outputted at a prescribed frame rate.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an imaging apparatus according to a first embodiment of this invention.

FIG. 2 is a block diagram of a driving section and a main controller in FIG. 1.

FIG. 3 is a diagram of a frame provided during a landscape taking mode of operation of the imaging apparatus in FIG. 1.

FIG. 4 is a diagram of a frame provided during the portrait taking mode of operation of the imaging apparatus in FIG. 1.

FIG. 5 is a diagram showing an example of the division of a frame into a plurality of areas according to a pixel selection pattern (a signal readout pattern).

FIG. 6 is a diagram of an example of the arrangement of photosensor pixels in an imaging element array in FIG. 1.

FIG. 7 is a diagram of a group of photosensor pixels.

FIG. 8 is a diagram of a first example of the arrangement of selected and used photosensor pixels in the imaging element array in FIG. 1.

FIG. 9 is a diagram of a unit composed of 6 pixel groups having selected and used photosensor pixels and non-selected and non-used photosensor pixels.

FIG. 10 is a diagram of a second example of the arrangement of selected and used photosensor pixels in the imaging element array in FIG. 1.

FIG. 11 is a diagram of a third example of the arrangement of selected and used photosensor pixels in the imaging element array in FIG. 1.

FIG. 12 is a diagram showing the hierarchy of weighting modes of operation of the imaging apparatus in FIG. 1.

FIG. 13 is a flowchart of a segment of a control program which relates to an external mode of operation.

FIG. 14 is a flowchart of a segment of the control program which relates to a zoom mode of operation.

FIG. 15 is a flowchart of a segment of the control program which relates to a video state mode of operation.

FIG. 16 is a flowchart of a segment of a computer program in a second embodiment of this invention.

FIG. 17 is a diagram of an imaging apparatus according to a third embodiment of this invention.

FIG. 18 is a diagram showing an example of division borders and division-result rectangles in one frame.

FIG. 19 is a diagram showing an example of conditions of video data pieces corresponding to the respective division-result rectangles in FIG. 18.

FIG. 20 is a diagram showing an example of the values of variable quantities for the respective division-result rectangles in the case where the video data pieces corresponding to the respective division-result rectangles are in the conditions of FIG. 19.

FIG. 21 is a diagram showing an example of the values of after-normalization variable quantities for the respective division-result rectangles in the case where the values of before-normalization variable quantities are equal to those of the variable quantities in FIG. 20.

FIG. 22 is a diagram of a set of chosen pixel selection types for the respective division-result rectangles and collation with pixel-selection-pattern tables (signal-readout-pattern tables).

FIG. 23 is a diagram of a first pixel-selection-pattern table.

FIG. 24 is a diagram of a second pixel-selection-pattern table.

FIG. 25 is a diagram of a third pixel-selection-pattern table.

FIG. 26 is a diagram of an imaging element array in FIG. 17.

FIG. 27 is a time-domain diagram showing the waveforms of switch selection signals and conditions of output data which occur while signals are read out from all photosensor pixels of the imaging element array in FIG. 26.

FIG. 28 is a time-domain diagram showing the waveforms of switch selection signals and conditions of output data which occur while signals are read out from only used ones selected among the photosensor pixels of the imaging element array in FIG. 26.

FIG. 29 is a diagram of an imaging apparatus according to a fourth embodiment of this invention.

FIG. 30 is a diagram showing a luminance information piece corresponding to a representative point at coordinates of (3, 4) for a first vertical scanning period.

FIG. 31 is a diagram showing the luminance information piece corresponding to a representative point at coordinates of (5, 6) for a second vertical scanning period immediately after the first vertical scanning period of FIG. 30, and a related motion vector.

FIGS. 32, 33, and 34 are diagrams of first, second, and third examples of a pixel selection pattern applied to an imaging element array in a fifth embodiment of this invention, respectively.

FIG. 35 is a diagram showing signal readout patterns (pixel selection patterns) applied to an imaging element array in a sixth embodiment of this invention.

Claims

1. A method of taking a picture, comprising the steps of: obtaining detection information from captured-image information of an imaging element array;providing an area in an image capturing region in the imaging element array;generating, in response to the obtained detection information, a pattern defining a ratio of a number of photosensor pixels used to capture an image to a number of all photosensor pixels in the area;driving the imaging element array in accordance with the generated pattern;implementing interpolation responsive to a first picture signal generated by the used photosensor pixels to generate a second picture signal corresponding to unused ones among all the photosensor pixels in the area; andcombining the first picture signal and the second picture signal into a captured-image signal, and outputting the captured-image signal at a prescribed frame rate.

2. A method of taking a picture, comprising the steps of: obtaining detection information from captured-image information of an imaging element array;providing an area in an image capturing region in the imaging element array;choosing, in response to the obtained detection information, one among different patterns each defining a ratio of a number of photosensor pixels used to capture an image to a number of all photosensor pixels in the area;driving the imaging element array in accordance with the generated pattern;implementing interpolation responsive to a first picture signal generated by the used photosensor pixels to generate a second picture signal corresponding to unused ones among all the photosensor pixels in the area; andcombining the first picture signal and the second picture signal into a captured-image signal, and outputting the captured-image signal at a prescribed frame rate.

3. A method as recited in claim 1, wherein the area includes a first sub-area and a second sub-area, and the pattern prescribes that all photosensor pixels in the first sub-area should be used to capture a related image portion and that ones selected from all photosensor pixels in the second sub-area on a thinning-out basis should be used to capture a related image portion, and wherein a number of the used photosensor pixels in the first and second sub-areas is equal to a predetermined constant number.

4. A method as recited in claim 1, wherein the obtained detection information includes at least one of information about a motion of a subject which occurs after compensation for a shake of the imaging element array, information about a zoom power, motion information based on a motion vector of a subject, still information based on the motion vector of the subject, information about prescribed-frequency components of the captured-image signal which occurs when auto focus is established, and information about a human face represented by the captured-image signal.

5. An apparatus for taking a picture, comprising: an imaging element array having a matrix of photosensor pixels and having an image capturing region;means for obtaining detection information from captured-image information of the imaging element array;means for providing an area in the image capturing region in the imaging element array;means for generating, in response to the obtained detection information, a pattern defining a ratio of a number of photosensor pixels used to capture an image to a number of all photosensor pixels in the area;means for driving the imaging element array in accordance with the generated pattern;means for implementing interpolation responsive to a first picture signal generated by the used photosensor pixels to generate a second picture signal corresponding to unused ones among all the photosensor pixels in the area; andmeans for combining the first picture signal and the second picture signal into a captured-image signal, and outputting the captured-image signal at a prescribed frame rate.

6. An apparatus for taking a picture, comprising: an imaging element array having a matrix of photosensor pixels and having an image capturing region;means for obtaining detection information from captured-image information of the imaging element array;means for providing an area in the image capturing region in the imaging element array;means for choosing, in response to the obtained detection information, one among different patterns each defining a ratio of a number of photosensor pixels used to capture an image to a number of all photosensor pixels in the area;means for driving the imaging element array in accordance with the generated pattern;means for implementing interpolation responsive to a first picture signal generated by the used photosensor pixels to generate a second picture signal corresponding to unused ones among all the photosensor pixels in the area; andmeans for combining the first picture signal and the second picture signal into a captured-image signal, and outputting the captured-image signal at a prescribed frame rate.

7. An apparatus as recited in claim 5, wherein the area includes a first sub-area and a second sub-area, and the pattern prescribes that all photosensor pixels in the first sub-area should be used to capture a related image portion and that ones selected from all photosensor pixels in the second sub-area on a thinning-out basis should be used to capture a related image portion, and wherein a number of the used photosensor pixels in the first and second sub-areas is equal to a predetermined constant number.

8. An apparatus as recited in claim 5, wherein the obtained detection information includes at least one of information about a motion of a subject which occurs after compensation for a shake of the imaging element array, information about a zoom power, motion information based on a motion vector of a subject, still information based on the motion vector of the subject, information about prescribed-frequency components of the captured-image signal which occurs when auto focus is established, and information about a human face represented by the captured-image signal.