Object detection apparatus

Abstract
An object detection apparatus according to an aspect of the invention which detects a specific object in an input image includes specific object detection means for performing a specific object detecting process of setting the input image or a reduced image of the input image as a target image, and of determining whether or not the specific object exists in a determination region while scanning the determination region in the target image or an edge feature image of the target image. In the object detection apparatus, the specific object detection means includes determination means for determining whether or not the specific object exists in the determination region, based on an edge feature amount of the edge feature image corresponding to the determination region, and a previously determined relationship between an edge feature amount and a weight indicating object likelihood for each predetermined feature pixel in an image having the same size as the determination region.
Description

BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a block diagram showing a configuration of a face detection apparatus;



FIG. 2 is a flowchart showing an operation of the face detection apparatus;



FIG. 3 is a schematic view showing plural hierarchical images obtained through Step S2 of FIG. 2;



FIG. 4 is a flowchart showing a procedure of a process of generating four-direction edge feature images performed in Step S3 of FIG. 2;



FIGS. 5A to 5D are a schematic view showing an example of a differentiation filter corresponding to each of four directions of a horizontal edge, a vertical edge, an obliquely upper right edge, and an obliquely upper left edge;



FIG. 6 is a schematic view explaining a face detecting process of Step S4 of FIG. 2;



FIGS. 7A to 7D are schematic views showing four-direction edge feature images corresponding to a determination region in an input image;



FIG. 8 is a schematic view showing an example of contents of a weighting table;



FIG. 9 is a flowchart showing a procedure of the face detecting process performed to the determination region set in the input image;



FIG. 10 is a flowchart showing a procedure of a determination process performed in each determination step of FIG. 9;



FIG. 11 is a flowchart showing a modification of the face detecting process;



FIG. 12 is a graph showing a weighting table value (hereinafter referred to as table value) and a polynomial curve which approximates the table value of each pixel value of a feature pixel, when a certain pixel value of the feature pixel is set to a horizontal axis while a weight w is set to a vertical axis;



FIG. 13 is a schematic view showing an example of contents of a coefficient table;



FIG. 14 is a flowchart showing a procedure of determination process in the case of use of the coefficient table;



FIG. 15 is a graph showing a relationship (polygonal line A) between a detection ratio and a false detection ratio in the case of use of a coefficient table (polynomial) and a relationship (polygonal line B) between a detection ratio and a false detection ratio in the case of use of a weighting table;



FIG. 16 is a flowchart showing an operation of a face detection apparatus;



FIG. 17 is a schematic view showing two hierarchical images obtained through Step S52 of FIG. 16 and plural kinds of determination regions;



FIG. 18 is a flowchart showing a procedure of a face detecting process performed to three kinds of determination regions in an input image;



FIGS. 19A to 19D are schematic views showing examples of the input images in the case where a rotation angle of a detection-target face is changed;



FIG. 20 is a schematic view showing a correspondence between a feature point (feature pixel) assigned by a weighting table and a feature point on a face image in an upright state and a correspondence between the feature point (feature pixel) assigned by the weighting table and a feature point on a face image rotated by +90°;



FIG. 21 is a schematic view showing a relationship, between an xy coordinate of the feature point (feature pixel) assigned by the weighting table and an xy coordinate of feature points corresponding to −90°, +90°, and 180° face images (edge feature images);



FIGS. 22A to 22D are schematic views showing examples of the input images when the rotation angle of the detection-target face is changed;



FIG. 23 is a schematic view showing a correspondence between the feature point (feature pixel) assigned by the weighting table and the feature point on the face image in the upright state and a correspondence between the feature point (feature pixel) assigned by the weighting table and the feature point on the face image rotated by +45°;



FIG. 24 is a schematic view showing a relationship between the coordinate of the feature point assigned by the weighting table and the xy coordinate of the feature points corresponding to +45°, −45°, +135°, and −135° face images (edge feature images);



FIG. 25 is a schematic view showing two hierarchical images and a determination region used for each hierarchical image;



FIG. 26 is a flowchart showing the procedure of the face detecting process;



FIG. 27 is a schematic view showing two hierarchical images, a determination region, and a roughly-detecting determination region;



FIG. 28 is a schematic view conceptually explaining a method of generating a common weighting table;



FIG. 29 is a flowchart showing the procedure of the face detecting process performed to a hierarchical image;



FIG. 30 is a schematic view showing two hierarchical images, a determination region, and a roughly-detecting determination region;



FIG. 31 is a flowchart showing the procedure of the face detecting process;



FIG. 32 is a schematic view showing two hierarchical images, a determination region, and roughly-detecting determination region;



FIG. 33 is a flowchart showing the procedure of the face detecting process; and



FIG. 34 is a flowchart showing the procedure of the face detecting process.


Claims
  • 1. An object detection apparatus which detects a specific object in an input image, the object detection apparatus comprising: specific object detection means for performing a specific object detecting process of setting the input image or a reduced image of the input image as a target image, and of determining whether or not the specific object exists in a determination region while scanning the determination region in the target image or an edge feature image of the target image,wherein the specific object detection means includes determination means for determining whether or not the specific object exists in the determination region, based on an edge feature amount of the edge feature image corresponding to the determination region, and a previously determined relationship between an edge feature amount and a weight indicating object likelihood for each predetermined feature pixel in an image having the same size as the determination region.
  • 2. An object detection apparatus which detects a specific object in an input image, the object detection apparatus comprising: reduced-image generating means for generating one or a plurality of reduced images from the input image; andspecific object detection means for performing a specific object detecting process of setting each of a plurality of hierarchical images as a target image, and of determining whether or not the specific object exists in a determination region while scanning the determination region in the target image or an edge feature image of the target image, the plurality of hierarchical images including the input image and one or a plurality of reduced images of the input image,wherein the specific object detection means includes determination means for determining whether or not the specific object exists in the determination region, based on an edge feature amount of the edge feature image corresponding to the determination region, and a previously determined relationship between an edge feature amount and a weight indicating object likelihood for each predetermined feature pixel in an image having the same size as the determination region.
  • 3. The object detection apparatus according to claim 1, wherein the specific object detection means includes a specific object detecting table, which is previously prepared from a plurality of sample images including the specific object and stores the previously determined relationship between an edge feature amount and a weight indicating object likelihood for each predetermined feature pixel in the image having the same size as the determination region; the determination means determining whether or not the specific object exists in the determination region based on an edge feature amount of the edge feature image corresponding to the determination region and the specific object detecting table.
  • 4. The object detection apparatus according to claim 2, wherein the specific object detection means includes a specific object detecting table, which is previously prepared from a plurality of sample images including the specific object and stores the previously determined relationship between an edge feature amount and a weight indicating object likelihood for each predetermined feature pixel in the image having the same size as the determination region; the determination means determining whether or not the specific object exists in the determination region based on an edge feature amount of the edge feature image corresponding to the determination region and the specific object detecting table.
  • 5. The object detection apparatus according to claim 3, wherein the determination means includes a plurality of determination processing means having the different numbers of feature pixels which are used in determination for the determination region at any position, a determination process is performed in the order from the determination processing means having the smaller number of feature pixels used in the determination, and, when any determination processing means determines that the specific object does not exist, a subsequent process performed by the determination processing means is aborted.
  • 6. The object detection apparatus according to claim 4, wherein the determination means includes a plurality of determination processing means having the different numbers of feature pixels which are used in determination for the determination region at any position, a determination process is performed in the order from the determination processing means having the smaller number of feature pixels used in the determination, and, when any determination processing means determines that the specific object does not exist, a subsequent process performed by the determination processing means is aborted.
  • 7. The object detection apparatus according to claim 3, wherein the edge feature image is plural kinds of edge feature images having different edge directions.
  • 8. The object detection apparatus according to claim 4, wherein the edge feature image is plural kinds of edge feature images having different edge directions.
  • 9. The object detection apparatus according to claim 3, wherein the specific object detection means performs the specific object detecting process using a determination region having a single size and one kind of the specific object detecting table corresponding to the size of the determination region.
  • 10. The object detection apparatus according to claim 4, wherein the specific object detection means performs the specific object detecting process using a determination region having a single size and one kind of the specific object detecting table corresponding to the size of the determination region.
  • 11. The object detection apparatus according to claim 3, wherein the specific object detection means prepares a plurality of kinds of the determination regions having the different sizes, the specific object detection means holds the plurality of specific object detecting tables according to the plurality of kinds of the determination regions, the specific object detection means sets the plurality of kinds of the determination regions in the target image or the edge feature image of the target image, and the specific object detection means performs the specific object detecting process in each set determination region using the specific object detecting table corresponding to the determination region.
  • 12. The object detection apparatus according to claim 4, wherein the specific object detection means prepares a plurality of kinds of the determination regions having the different sizes, the specific object detection means holds the plurality of specific object detecting tables according to the plurality of kinds of the determination regions, the specific object detection means sets the plurality of kinds of the determination regions in the target image or the edge feature image of the target image, and the specific object detection means performs the specific object detecting process in each set determination region using the specific object detecting table corresponding to the determination region.
  • 13. The object detection apparatus according to claim 4, wherein the specific object detection means prepares the determination region having the different size in each hierarchical target image, the specific object detection means holds the plurality of specific object detecting tables according to the determination regions, the specific object detection means performs a specific object roughly-detecting process to a lower hierarchical target image or the edge feature image of the lower hierarchical target image using the determination region corresponding to the lower hierarchy and the specific object detecting table corresponding to the determination region of the lower hierarchy when the specific object detection means performs the specific object detecting process to an arbitrary hierarchy, and the specific object detection means performs the specific object detecting process to the hierarchical target image or the edge feature image of the hierarchical target image using the determination region corresponding to the arbibrary hierarchy and the specific object detecting table corresponding to the determination region of the arbitrary hierarchy when a face is detected in the specific object roughly-detecting process.
  • 14. The object detection apparatus according to claim 3, wherein the specific object detection means prepares a plurality of kinds of the determination regions having the different sizes, the specific object detection means holds the plurality of specific object detecting tables according to the plurality of kinds of the determination regions and a specific object roughly-detecting table for detecting faces having all the sizes, the face being able to be detected by each determination region, the specific object detection means sets a common determination region including all the kinds of the determination regions in the target image or the edge feature image of the target image, the specific object detection means performs the specific object roughly-detecting process using the specific object roughly-detecting table, and the specific object detection means sets the plurality of kinds of the determination regions in the target image or the edge feature image of the target image and performs the specific object detecting process in each set determination region using the specific object detecting table corresponding to the determination region when a face is detected in the specific object roughly-detecting process.
  • 15. The object detection apparatus according to claim 4, wherein the specific object detection means prepares a plurality of kinds of the determination regions having the different sizes, the specific object detection means holds the plurality of specific object detecting tables according to the plurality of kinds of the determination regions and a specific object roughly-detecting table for detecting faces having all the sizes, the face being able to be detected by each determination region, the specific object detection means sets a common determination region including all the kinds of the determination regions in the target image or the edge feature image of the target image, the specific object detection means performs the specific object roughly-detecting process using the specific object roughly-detecting table, and the specific object detection means sets the plurality of kinds of the determination regions in the target image or the edge feature image of the target image and performs the specific object detecting process in each set determination region using the specific object detecting table corresponding to the determination region when a face is detected in the specific object roughly-detecting process.
  • 16. The object detection apparatus according to claim 3, wherein the edge feature image is an edge feature image corresponding to each of the four directions of a horizontal direction, a vertical direction, an obliquely upper right direction, and an obliquely upper left direction, the feature pixel of the specific object detecting table is expressed by an edge number indicating an edge direction and an xy coordinate, a position in which the edge number of the feature pixel and/or the xy coordinate is converted by a predetermined rule is used as a position on the edge feature image corresponding to any feature pixel of the specific object detecting table, and the specific object which is rotated by a predetermined angle with respect to a default rotation angle position of the specific object can be detected by the post-conversion position.
  • 17. The object detection apparatus according to claim 4, wherein the edge feature image is an edge feature image corresponding to each of the four directions of a horizontal direction, a vertical direction, an obliquely upper right direction, and an obliquely upper left direction, the feature pixel of the specific object detecting table is expressed by an edge number indicating an edge direction and an xy coordinate, a position in which the edge number of the feature pixel and/or the xy coordinate is converted by a predetermined rule is used as a position on the edge feature image corresponding to any feature pixel of the specific object detecting table, and the specific object which is rotated by a predetermined angle with respect to a default rotation angle position of the specific object can be detected by the post-conversion position.
  • 18. The object detection apparatus according to claim 3, wherein the edge feature image is an edge feature image corresponding to each of the four directions of a horizontal direction, a vertical direction, an obliquely upper right direction, and an obliquely upper left direction, the feature pixel of the specific object detecting table is expressed by an edge number indicating an edge direction and an xy coordinate, a position in which the edge number of the feature pixel and/or the xy coordinate is converted by a predetermined rule is used as a position on the edge feature image corresponding to any feature pixel of the specific object detecting table, and the specific object in which a default attitude is horizontally flipped or the specific object in which a default attitude is vertically flipped can be detected by the post-conversion position.
  • 19. The object detection apparatus according to claim 4, wherein the edge feature image is an edge feature image corresponding to each of the four directions of a horizontal direction, a vertical direction, an obliquely upper right direction, and an obliquely upper left direction, the feature pixel of the specific object detecting table is expressed by an edge number indicating an edge direction and an xy coordinate, a position in which the edge number of the feature pixel and/or the xy coordinate is converted by a predetermined rule is used as a position on the edge feature image corresponding to any feature pixel of the specific object detecting table, and the specific object in which a default attitude is horizontally flipped or the specific object in which a default attitude is vertically flipped can be detected by the post-conversion position.
  • 20. The object detection apparatus according to claim 3, wherein weights indicating the object likelihood are stored in the specific object detecting table for each predetermined feature pixel of the image having the same size as the determination region, the weights corresponding to the respective edge feature amounts which are possibly taken in the feature pixel.
  • 21. The object detection apparatus according to claim 4, wherein weights indicating the object likelihood are stored in the specific object detecting table for each predetermined feature pixel of the image having the same size as the determination region, the weights corresponding to the respective edge feature amounts which are possibly taken in the feature pixel.
  • 22. The object detection apparatus according to claim 3, wherein coefficients of a polynomial are stored in the specific object detecting table for each predetermined feature pixel of the image having the same size as the determination region, the polynomial representing the edge feature amounts possibly taken in the feature pixel and the weights indicating the object likelihood.
  • 23. The object detection apparatus according to claim 4, wherein coefficients of a polynomial are stored in the specific object detecting table for each predetermined feature pixel of the image having the same size as the determination region, the polynomial representing the edge feature amounts possibly taken in the feature pixel and the weights indicating the object likelihood.
Priority Claims (2)
Number Date Country Kind
JP2006-053304 Feb 2006 JP national
JP2006-354005 Dec 2006 JP national