Exposure control apparatus and image pickup apparatus

Abstract

An exposure control apparatus for controlling an exposure adjustment mechanism on the basis of a captured image signal includes the following elements. A face detecting unit detects a face of a person appearing in a captured image on the basis of the captured image signal. A histogram data determining unit determines histogram data by setting a face detection region in the captured image according to detection information and detecting at least a brightness value of the face detection region from the captured image signal. A target brightness setting unit sets a target brightness range for desired brightness of the face. An exposure control amount determining unit determines, when a face is detected, an amount of control for the exposure adjustment mechanism by comparing the target brightness range with a brightness value at a peak of the histogram data or a brightness region in the vicinity of the peak.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the structure of the main part of an image pickup apparatus according to an embodiment of the present invention;

FIG. 2 is a flowchart showing the overall flow of exposure control and flash emission control;

FIG. 3 is a flowchart showing a procedure for calculating an importance level of a face;

FIG. 4 is a graph showing the correspondence between the face proportion and the face size importance level factor;

FIG. 5 is a diagram showing a method for calculating the distance between the screen center region and the face;

FIG. 6 is a diagram showing a method for calculating the included angle;

FIGS. 7A and 7B are graphs showing a method for calculating the face position importance level factor and a method for calculating the position-posture importance level factor, respectively;

FIGS. 8A and 8B are diagrams showing methods for setting a detection frame on the basis of face detection results;

FIG. 9 is a flowchart showing the flow of a process for determining a peak of histogram data;

FIG. 10 is a graph showing a first example of the detection of brightness histogram data of the face and the background;

FIG. 11 is a graph showing a second example of the detection of brightness histogram data of the face and the background;

FIG. 12 is a graph showing a third example of the detection of brightness histogram data of the face and the background;

FIG. 13 is a flowchart showing the flow of a process for setting a target brightness range;

FIG. 14 is a graph showing the relationship between the amount of external light and the shift amount of the target brightness range;

FIG. 15 is a graph showing the relationship between the importance level of the face and the adjustment ratio for the width of the target brightness range;

FIG. 16 is a flowchart showing a first portion of the flow of a process for re-calculating the amount of exposure control and flash control information;

FIG. 17 is a flowchart showing a second portion of the flow of the process for re-calculating the amount of exposure control and flash control information;

FIG. 18 is a diagram showing histogram data obtained when the adjustment amount is applied in step S511 in the state shown in FIG. 12;

FIG. 19 is a correction curve to be used in step S513 shown in FIG. 17;

FIG. 20 is a diagram showing histogram data obtained when an adjustment amount is applied in the state shown in FIG. 12 after gradation correction is performed;

FIG. 21 is a diagram showing histogram data obtained when the adjustment amount is applied in the state shown in FIG. 10;

FIG. 22 is a diagram showing histogram data obtained when an adjustment amount lower than the determined adjustment amount is applied in the state shown in FIG. 10;

FIG. 23 is a correction curve used in step S520 shown in FIG. 17;

FIG. 24 is a diagram showing histogram data obtained when a corrected adjustment amount is used in the state shown in FIG. 10 and gradation correction is performed; and

FIG. 25 is a diagram showing an example of the setting of an eye detection region.

Claims

1. An exposure control apparatus for controlling an exposure adjustment mechanism on the basis of an image signal captured by a solid-state image pickup device, the exposure control apparatus comprising: face detecting means for detecting a face of a person appearing in a captured image on the basis of the captured image signal;histogram data determining means for determining histogram data by setting a face detection region in the captured image according to detection information obtained by the face detecting means and detecting at least a brightness value of the face detection region from the captured image signal;target brightness setting means for setting a target brightness range for desired brightness of the face; andexposure control amount determining means for, when the face detecting mean detects a face, determining an amount of control for the exposure adjustment mechanism on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

2. The exposure control apparatus according to claim 1, wherein the exposure control amount determining means determines an amount of control for the exposure adjustment mechanism so that the brightness value at the peak of the histogram data corresponding to the face detection region or the brightness region in the vicinity of the peak is included in the target brightness range.

3. The exposure control apparatus according to claim 1, wherein the brightness region in the vicinity of the peak has a frequency equal to or higher than a threshold value that is determined according to a peak value at which the frequency of the histogram data corresponding to the face detection region peaks.

4. The exposure control apparatus according to claim 1, further comprising: overexposure/underexposure determining means for determining a degree of occurrence of overexposed areas and a degree of occurrence of underexposed areas in the captured image on the basis of a brightness value of a background region except for the face detection region in the captured image or a brightness value of an entire screen region; andcontrol target shifting means for shifting the target brightness range according to a determination result obtained by the overexposure/underexposure determining means so as to shift the target brightness range toward a low-brightness side when the degree of occurrence of overexposed areas is high and to shift the target brightness range toward a high-brightness side when the degree of occurrence of underexposed areas is high, and supplying the shifted target brightness range to the exposure control amount determining means.

5. The exposure control apparatus according to claim 1, further comprising: external light amount detecting means for detecting an amount of external light; andcontrol target shifting means for shifting the target brightness range according to the amount of external light detected by the external light amount detecting means so as to shift the target brightness range toward a low-brightness side when the amount of external light is small and to shift the target brightness range toward a high-brightness side when the amount of external light is large, and supplying the shifted target brightness range to the exposure control amount determining means.

6. The exposure control apparatus according to claim 1, further comprising: color detecting means for detecting color information for the face detection region from the captured image signal; andcontrol target shifting means for shifting the target brightness range according to the color information detected by the color detecting means, and supplying the shifted target brightness range to the exposure control amount determining means.

7. The exposure control apparatus according to claim 1, further comprising: reflectivity detecting means for detecting a face reflectivity according to a ratio of a brightness value of an eye region to a brightness value of a whole face region among brightness values detected from the face detection region; andcontrol target shifting means for shifting the target brightness range according to the face reflectivity detected by the reflectivity detecting means so as to shift the target brightness range toward a low-brightness side when the face reflectivity is low and to shift the target brightness range toward a high-brightness side when the face reflectivity is high, and supplying the shifted target brightness range to the amount of exposure control determining means.

8. The exposure control apparatus according to claim 1, further comprising: importance level determining means for estimating and determining an importance level for a photographer with respect to the face detected by the face detecting means; andcontrol target range correcting means for correcting the target brightness range according to the importance level determined by the importance level determining means so as to reduce the target brightness range when the importance level of the face is high and to increase the target brightness range when the importance level of the face is low, and supplying the corrected target brightness range to the exposure control amount determining means.

9. The exposure control apparatus according to claim 1, further comprising: underexposure predicting means for predicting a degree of occurrence of underexposed areas in the captured image when the exposure adjustment mechanism is controlled using the amount of control determined by the exposure control amount determining means; andgradation correcting means for correcting the captured image signal so that brightness gradation in a low-brightness side increases when the degree of occurrence of underexposed areas predicted by the underexposure predicting means exceeds a predetermined threshold value.

10. The exposure control apparatus according to claim 1, further comprising: overexposure predicting means for predicting a degree of occurrence of overexposed areas in the captured image when the exposure adjustment mechanism is controlled using the amount of control determined by the exposure control amount determining means; andgradation correcting means for correcting the captured image signal for brightness gradation,wherein when the degree of occurrence of overexposed areas predicted by the overexposure predicting means exceeds a predetermined threshold value,the exposure control amount determining means corrects the determined amount of control for the exposure adjustment mechanism so as to reduce an amount of exposure, andthe gradation correcting means performs correction so as to increase brightness and gradation of a brightness area including a zone between a lower limit of the target brightness range and a lower limit of the brightness value at the peak or the brightness region in the vicinity of the peak.

11. The exposure control apparatus according to claim 10, wherein when the degree of occurrence of overexposed areas predicted by the overexposure predicting means exceeds the predetermined threshold value and when the detected face is within a flash light range and emission of flash light is allowed, the exposure control amount determining means uses the determined amount of control for the exposure adjustment mechanism, and issues a request to emit the flash light.

12. The exposure control apparatus according to claim 10, further comprising display control means for generating display information for displaying warning information on a display to instruct a photographer to perform an operation for emitting flash light, wherein when the degree of occurrence of overexposed areas predicted by the overexposure predicting means exceeds the predetermined threshold value and when the detected face is within a flash light range and emission of the flash light is not allowed,the exposure control amount determining means corrects the determined amount of control for the exposure adjustment mechanism so as to reduce the amount of exposure,the gradation correcting means performs correction so as to increase brightness and gradation of a brightness area including a zone between a lower limit of the target brightness range and a lower limit of the brightness value at the peak or the brightness region in the vicinity of the peak, andthe display control means generates the display information, and issues a request to display the warning information.

13. The exposure control apparatus according to claim 1, wherein the exposure control amount determining means determines an amount of control for the exposure adjustment mechanism using at least a brightness value of an entire screen that is detected from the captured image signal, andwhen the face detecting means detects a face, the exposure control amount determining means corrects the amount of control for the exposure adjustment mechanism on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

14. The exposure control apparatus according to claim 1, further comprising importance level determining means for estimating and determining an importance level for a photographer with respect to the face detected by the face detecting means, wherein the exposure control amount determining means determines an amount of control for the exposure adjustment mechanism on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak only when the importance level of the detected face is equal to or higher than a predetermined value.

15. The exposure control apparatus according to claim 1, further comprising: importance level determining means for estimating and determining an importance level for a photographer with respect to the face detected by the face detecting means; andhistogram normalizing means for, when the face detecting means detects a plurality of faces, normalizing histogram data of a brightness value determined for each of the detected faces according to the importance level of each of the faces,wherein the exposure control amount determining means determines an amount of control for the exposure adjustment mechanism according to the histogram data normalized by the histogram normalizing means.

16. An image pickup apparatus for capturing an image using a solid-state image pickup device, the image pickup apparatus comprising: face detecting means for detecting a face of a person appearing in a captured image on the basis of an image signal captured by the solid-state image pickup device;histogram data determining means for determining histogram data by setting a face detection region in the captured image according to detection information obtained by the face detecting means and detecting at least a brightness value of the face detection region from the captured image signal;target brightness setting means for setting a target brightness range for desired brightness of the face; andexposure control amount determining means for, when the face detecting means detects a face, determining an amount of control for an exposure adjustment mechanism on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

17. An image processing apparatus for correcting for a brightness component of an input image signal, the image processing apparatus comprising: face detecting means for detecting a face of a person appearing in an image on the basis of the image signal;histogram data determining means for determining histogram data by setting a face detection region in the image according to detection information obtained by the face detecting means and detecting at least a brightness value of the face detection region from the image signal;target brightness setting means for setting a target brightness range for desired brightness of the face; andbrightness correction amount determining means for, when the face detecting means detects a face, determining an amount of correction for the brightness component on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

18. An exposure control method for controlling an exposure adjustment mechanism on the basis of an image signal captured by a solid-state image pickup device, the exposure control method comprising the steps of: detecting a face of a person appearing in a captured image on the basis of the captured image signal;determining histogram data by setting a face detection region in the captured image according to detection information concerning the detected face and detecting at least a brightness value of the face detection region from the captured image signal;setting a target brightness range for desired brightness of the face; andwhen a face is detected, determining an amount of control for the exposure adjustment mechanism on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

19. An image processing method for correcting for a brightness component of an input image signal, the image processing method comprising the steps of: detecting a face of a person appearing in an image on the basis of the image signal;determining histogram data by setting a face detection region in the image according to detection information concerning the detected face and detecting at least a brightness value of the face detection region from the image signal;setting a target brightness range for desired brightness of the face; andwhen a face is detected, determining an amount of correction for the brightness component on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

20. An exposure control apparatus for controlling an exposure adjustment mechanism on the basis of an image signal captured by a solid-state image pickup device, the exposure control apparatus comprising: a face detecting unit configured to detect a face of a person appearing in a captured image on the basis of the captured image signal;a histogram data determining unit configured to determine histogram data by setting a face detection region in the captured image according to detection information obtained by the face detecting unit and detecting at least a brightness value of the face detection region from the captured image signal;a target brightness setting unit configured to set a target brightness range for desired brightness of the face; andan exposure control amount determining unit configured to, when the face detecting mean detects a face, determine an amount of control for the exposure adjustment mechanism on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

21. An image pickup apparatus for capturing an image using a solid-state image pickup device, the image pickup apparatus comprising: a face detecting unit configured to detect a face of a person appearing in a captured image on the basis of an image signal captured by the solid-state image pickup device;a histogram data determining unit configured to determine histogram data by setting a face detection region in the captured image according to detection information obtained by the face detecting unit and detecting at least a brightness value of the face detection region from the captured image signal;a target brightness setting unit configured to set a target brightness range for desired brightness of the face; andan exposure control amount determining unit configured to, when the face detecting unit detects a face, determine an amount of control for an exposure adjustment mechanism on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.

22. An image processing apparatus for correcting for a brightness component of an input image signal, the image processing apparatus comprising: a face detecting unit configured to detect a face of a person appearing in an image on the basis of the image signal;a histogram data determining unit configured to determine histogram data by setting a face detection region in the image according to detection information obtained by the face detecting unit and detecting at least a brightness value of the face detection region from the image signal;a target brightness setting unit configured to set a target brightness range for desired brightness of the face; anda brightness correction amount determining unit configured to, when the face detecting unit detects a face, determine an amount of correction for the brightness component on the basis of a comparison result obtained by comparing the target brightness range with a brightness value at a peak of histogram data corresponding to the face detection region or a brightness region in the vicinity of the peak.