Methods and Systems for Detecting Pictorial Regions in Digital Images

Abstract

Embodiments of the present invention comprise systems, methods and devices for detection of pictorial regions in an image using a masking condition, an entropy measure, and region growing.

Description

BRIEF DESCRIPTION OF THE SEVERAL DRAWINGS

FIG. 1 is an example of an image comprising a multiplicity of regions of different content type;

FIG. 2 is a diagram of an exemplary region-detection system (prior art);

FIG. 3 is an exemplary histogram showing feature value separation;

FIG. 4 is an exemplary histogram showing feature value separation;

FIG. 5 is a diagram showing exemplary embodiments of the present invention comprising a masked-entropy calculation from a histogram;

FIG. 6 is a diagram showing an exemplary embodiment of masked-image generation;

FIG. 7 is a diagram showing an exemplary embodiment of histogram generation;

FIG. 8 is a diagram showing exemplary embodiments of the present invention comprising masking, quantization, histogram generation and entropy calculation;

FIG. 9 is a diagram showing exemplary embodiments of the present invention comprising multiple quantization of select data and multiple entropy calculations;

FIG. 10 is a diagram showing exemplary embodiments of the present invention comprising multiple quantization of select data;

FIG. 11 is diagram showing pixel classification comprising an image window;

FIG. 12 is a diagram showing block classification comprising an image window;

FIG. 13 is a diagram showing exemplary embodiments of the present invention comprising lobe-based histogram modification;

FIG. 14 is a diagram showing exemplary embodiments of the present invention comprising pixel selection logic using multiple mask input;

FIG. 15 is a diagram showing exemplary embodiments of the present invention comprising a masked-entropy calculation from a histogram using confidence levels;

FIG. 16 is a diagram showing an exemplary embodiment of masked-image generation using confidence levels;

FIG. 17 is a diagram showing an exemplary embodiment of histogram generation using confidence levels;

FIG. 18 is a diagram showing exemplary embodiments of the present invention comprising refinement and verification;

FIG. 19 is a diagram showing exemplary embodiments of the present invention comprising region growing from pictorial-region seeds; and

FIG. 20 shows an exemplary pictorial region.

Claims

1. A method for detecting a pictorial region in a digital image, said method comprising: a) calculating a masked entropy value for each of a plurality of pixels in a digital image;b) determining a confidence level for each of said plurality of pixels based on said masked entropy values;c) determining a seed region based on said masked entropy values wherein said seed region comprises seed-region pixels from said plurality of pixels; andd) growing said seed region based on said confidence levels thereby producing a pictorial region wherein said pictorial region comprises pictorial-region pixels from said plurality of pixels.

2. A method as described in claim 1 further comprising refining said pictorial region thereby producing a refined pictorial region.

3. A method as described in claim 2 wherein said refining comprises filling at least one of holes and concave boundary regions in said pictorial region.

4. A method as described in claim 1 further comprising verifying said pictorial region thereby producing a verified pictorial region.

5. A method as described in claim 4 wherein said verifying said pictorial region comprises determining at least one of the size of said pictorial region, the shape of said pictorial region, the area of said pictorial region within a first bounding shape, and the distribution of said pictorial region with a second bounding shape.

6. A method as described in claim 1 wherein said determining said seed region further comprises: a) determining a first confidence-level threshold value; andb) identifying a target pixel from said plurality of pixels as one of said seed-region pixels if said confidence level for said target pixel is greater than said first confidence-level threshold value.

7. A method as described in claim 1 wherein said growing further comprises: a) determining a second confidence-level threshold value; andb) identifying a candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is connected to said seed region and said confidence level for said candidate pixel is greater than said second confidence-level threshold value.

8. A method as described in claim 6 wherein said first confidence-level threshold is based on the range of said confidence levels.

9. A method as described in claim 7 further comprising: a) obtaining a labeled background map for said digital image; andb) identifying said candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is less than said second confidence-level threshold value and said candidate pixel is labeled as pictorial content in said labeled background map.

10. A system for detecting a pictorial region in a digital image, said system comprising: a) a calculator for calculating a masked entropy value for each of a plurality of pixels in a digital image;b) a first determiner for determining a confidence level for each of said plurality of pixels based on said masked entropy values;c) a second determiner for determining seed regions based on said masked entropy values; andd) a region grower for growing said regions based on said confidence levels.

11. A system as described in claim 10 further comprising a refiner for refining said pictorial region thereby producing a refined pictorial region.

12. A system as described in claim 11 wherein said refining comprises filling at least one of holes and concave boundary regions in said pictorial region.

13. A system as described in claim 10 further comprising a verifier for verifying said pictorial region thereby producing a verified pictorial region.

14. A system as described in claim 13 wherein said verifier comprises at least one of a size determiner for determining the size of said pictorial region, a shape determiner for determining the shape of said pictorial region, an area determiner for determining the area of said pictorial region within a first bounding shape, and a distribution determiner for determining the distribution of said pictorial region within a second bounding shape.

15. A system as described in claim 10 wherein said second determiner for determining said seed region further comprises: a) a first-confidence-level-threshold determiner for determining a first confidence-level threshold value; andb) a seed-region-pixel identifier for identifying a target pixel from said plurality of pixels as one of said seed-region pixels if said confidence level for said target pixel is greater than said first confidence-level threshold value.

16. A system as described in claim 10 wherein said growing further comprises: a) a second-confidence-level-threshold determiner for determining a second confidence-level threshold value; andb) a first pictorial-region-pixel identifier for identifying a candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is connected to said seed region and said confidence level for said candidate pixel is greater than said second confidence-level threshold value.

17. A system as described in claim 15 wherein said first confidence-level threshold is based on the range of said confidence levels.

18. A system as described in claim 16 further comprising: a) an obtainer for obtaining a labeled background map for said digital image; andb) a second pictorial-region-pixel identifier for identifying said candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is less than said second confidence-level threshold value and said candidate pixel is labeled as pictorial content in said labeled background map.

19. A method for detecting a pictorial region in a digital image, said method comprising: a) calculating a masked entropy value for each of a plurality of pixels in a digital image;b) determining a confidence level for each of said plurality of pixels based on said masked entropy values;c) determining a seed region based on said masked entropy values wherein said seed region comprises seed-region pixels from said plurality of pixels;d) obtaining a labeled background map for said digital image wherein said labeled background map comprises a label corresponding to pictorial content; ande) growing said seed region based on said confidence levels and said labeled background map thereby producing a pictorial region wherein said pictorial region comprises pictorial-region pixels from said plurality of pixels.f) refining said pictorial region thereby producing a refined pictorial region; andg) verifying said refined pictorial region thereby producing a verified pictorial region.

20. The method as described in claim 19 further comprising: a) determining a first confidence-level threshold value;b) identifying a target pixel from said plurality of pixels as one of said seed-region pixels if said confidence level for said target pixel is greater than said first confidence-level threshold value;c) determining a second confidence-level threshold value;d) identifying a candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is connected to said seed region and said confidence level for said candidate pixel is greater than said second confidence-level threshold value; ande) identifying said candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is less than said second confidence-level threshold value and said candidate pixel is labeled as pictorial content in said labeled background map.