Ring dilation and erosion techniques for digital image processing

Information

  • Patent Grant
  • 6148114
  • Patent Number
    6,148,114
  • Date Filed
    Wednesday, November 27, 1996
    28 years ago
  • Date Issued
    Tuesday, November 14, 2000
    24 years ago
  • Inventors
  • Original Assignees
  • Examiners
    • Couso; Yon J.
    Agents
    • Skjerven, Morrill, MacPherson LLP
    • MacPherson; Alan H.
    • Edwards; Gary J.
Abstract
Dilation and erosion operations are performed on imaged objects that are represented using a number of object pixels; the object pixels are a subset of a larger number of image pixels. A ring-shaped structuring element is specified by a radius and an origin. In the ring dilation operation, the boundary of the structuring element includes two concentric circles, one having a radius that is one pixel greater than the other so that the boundary is two-pixels wide. The origin of a copy of the structuring element is then overlaid onto each object pixel such that the boundaries of the copies intersect to form a dilated image feature. The image feature includes a feature boundary defined by the outermost portions of the boundaries of the overlapping copies of the structuring element. This feature boundary is identified and described using conventional chain-coding techniques. The dilation is then completed by filling an area defined within the feature boundary. To erode objects, a second ring-shaped structuring element is specified by a second origin and by a second radius. The origin of a copy of the second structuring element is overlaid onto each pixel within the object. A pixel within the object is selected only if the boundary of the copy of the second structuring element lies completely within the object when the origin of the copy is overlaid onto that pixel. The selected pixels represent an eroded version of the object.
Description

BACKGROUND
Most morphological operations can be defined in terms of two fundamental image-processing operations, dilation and erosion. As their names imply, the dilation operation expands image features, while the erosion operation contracts them. These conventional operations are described below in connection with FIGS. 1A and 1B; for a detailed explanation of conventional dilation and erosion, see pp. 518-560 of Gonzales and Wood, "Digital Image Processing," Addison-Wesley 1992), which is incorporated herein by reference.
FIG. 1A depicts an image 100, which includes a plurality of random pixels 110, and a structuring element 120 of radius r. The dilation of image 100 by structuring element 120 is conventionally accomplished by superimposing the origin (e.g., the center) of element 120 sequentially over each of pixels 110. The dilation operation then selects each image pixel covered by element 120. Whether element 120 covers a given image pixel is determined by comparing the location of that image pixel with the locations of the pixels defined within element 120. FIG. 1B depicts image 100 after dilation using element 120. Each of pixels 110 is shown included within a disk 130 of selected image pixels. Each disk 130 has a radius equal to the radius of element 120. overlapping groups of disks 130 create a pair of objects 140 and 150.
FIG. 2A depicts objects 140 and 150 and the isolated disk 130, all of FIG. 1B, undergoing a conventional erosion process. A structuring element 200 of radius .di-elect cons. is provided for the erosion. The erosion of objects 140 and 150 and the isolated disk 130 by structuring element 200 is conventionally accomplished by superimposing the origin (e.g., the center) of element 200 over each object pixel of image 100. The only pixels selected by the erosion process are those at which structuring element 200, when centered on the pixel, lies completely within one of object 140, object 150, or the isolated disk 130. Whether element 200 lies completely within one of object 140, object 150, or the isolated disk 130 is determined by comparing the location of each pixel of element 200 with the locations of corresponding pixels of image 100. The results of such erosion are illustrated in FIG. 2B as objects 210, 220, 230, and 240.
The trouble with conventional dilation and erosion techniques is that they are relatively computation intensive. For an image of n pixels, either dilation or erosion requires on the order of n.sup.3 individual pixel comparisons. There is therefore a need for faster methods of image dilation and erosion.
SUMMARY
The present invention is directed to morphological operations that address the need for faster methods of image dilation and erosion. As with conventional dilation and erosion operations, the methods in accordance with the present invention are performed on imaged objects that are represented using a number of object pixels that are a subset of a larger number of image pixels.
In accordance with one embodiment of the invention, a ring-shaped structuring element is specified by a radius and an origin. The boundary of the structuring element include two concentric circles, one having a radius that is one pixel greater than the other so that the boundary is two-pixels wide. The origin of a copy of the structuring element is then overlaid onto each object pixel such that the boundaries of the copies intersect to form a dilated image feature. The image feature includes a feature boundary defined by the outermost portions of the boundaries of the overlapping copies of the structuring element. This feature boundary is identified and described using a conventional chain-coding technique. The dilation is then completed by filling in the feature boundary.
Another embodiment of the invention may be used to erode image objects, such as the dilated object of the foregoing example. In accordance with that embodiment, a second ring-shaped structuring element is specified by a radius and an origin. To erode an object, the origin of a copy of the second structuring element is overlaid onto each pixel within the object. Pixels within the object are selected only if the boundary of the copy of the second structuring element lies completely within the object when the origin of the copy is overlaid onto that pixel. The selected pixels then represent an eroded version of the object.
Using dilation and erosion techniques of the prior art, the number of pixel comparisons is proportional to the number of pixels required to specify a disk (.pi.r.sup.2). In contrast, the number of pixel comparisons required using the techniques in accordance with the present invention is proportional to the number of pixels required to specify a ring (2 .pi.r). The resulting decrease in the number of necessary comparison operations greatly increases the speed at which the dilation and erosion operations may be completed: the need for faster methods of image dilation and erosion is satisfied.





BRIEF DESCRIPTION OF THE FIGURES
These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying figures, where:
FIG. 1A depicts an image 100, which includes a plurality of random pixels 110, and a structuring element 120 of radius r;
FIG. 1B depicts image 100 after dilation using element 120;
FIG. 2A depicts objects 140 and 150 and the isolated disk 130, all of FIG. 1B, undergoing a conventional erosion process;
FIG. 2B depicts the eroded objects 210, 220, 230, and 240;
FIG. 3 is a flowchart depicting a dilation process in accordance with the present invention;
FIGS. 4A-4E graphically depict the dilation process of FIG. 3;
FIG. 5 is a flowchart depicting an erosion process in accordance with the present invention; and
FIGS. 6A-6C graphically depict the erosion process of FIG. 5.





DETAILED DESCRIPTION
FIG. 3 is a flowchart depicting a dilation process in accordance with the present invention. The dilation process of FIG. 3 is described in connection with FIGS. 4A, 4B, 4C, 4D, and 4E.
Beginning at step 300, a digital image 400 containing one or more objects to be dilated is obtained and represented using conventional techniques. In the present example, the objects to be dilated are a plurality of random pixels 410 within a border 420 (FIG. 4A).
Next, in step 310 a ring-shaped structuring element 430 is constructed. Structuring element 430 has a central origin and a radius R (FIG. 4B). The boundary of structuring ring 430 includes an outer ring 432, specified by a solid line, and an inner ring 434, specified by a dashed line. Rings 432 and 434 are adjacent and are each one pixel wide. Thus, rings 432 and 434 combined form a single two-pixel-wide boundary.
In accordance with the present invention, each of pixels 410 within border 420 is dilated using a copy of structuring element 430 (step 320). This is done by superimposing a copy of structuring element 430 concentricity over each of pixels 410 within border 420 as illustrated in FIG. 4C. Border 420 is separated from the edges of image 400 by a distance greater than or equal to the radius of the outer ring 432 of structuring element 430 to ensure that the dilated object resulting from a dilation of pixels 410 fits within image 400. Pixels 410 outside the border 420 are ignored.
In step 330, the outermost boundary 440 (FIGS. 4C and 4D) of the overlapping copies of structuring element 420 is then traced and represented using a conventional chain-coding scheme such as that described on pp. 484-486 of Rafael C. Gonzalez and Richard E. Woods "Digital Image Processing," Addison-Wesley (1992), which is incorporated herein by reference. The outermost boundary 440 is detected by traversing image 400 from left-to-right and top-to-bottom until an object pixel is encountered. The chain-coding scheme then traverses the outermost boundary 440 as illustrated by the curved arrows of FIG. 4C. At each junction of two or more outer rings 432, the corresponding inner 434 enables the chain-coding scheme to select the appropriate path along outermost boundary 440. In effect, inner rings 434 "trick" the conventional chain coding scheme into seeing the concentric rings 432 and 434 as solid disks.
FIG. 4D depicts image 400 including only the outermost boundary 440. In the final step of the dilation process (step 340), an image-region growing method commonly known as "line scanning" is used to fill the area inside the outermost boundary 440. The resulting object 460, the dilation result of pixels 410 within the border 420, is illustrated in FIG. 4E. In accordance with conventional line-scanning techniques, an image is scanned from left-to-right and top-to-bottom. When a segment of a horizontal line is determined to be inside the object, all pixels in that line segment are marked as object pixels. As a result, the area within the object boundary is filled in.
For an image of n pixels, the dilation method of FIGS. 3 and 4A-4E requires on the order of n.sup.2 pixel comparisons. Consequently, the dilation method in accordance with the present invention offers significant time savings over conventional methods that, as discussed above in connection with FIGS. 1A and 1B, require on the order of n.sup.3 pixel comparisons.
FIG. 5 is a flowchart depicting an erosion process in accordance with the present invention. Beginning at step 500, one (or more) object to be eroded is obtained and represented using conventional techniques. In the present example, the object to be eroded is the dilated object 460 of FIG. 4E. Next, in step 510 a ring-shaped structuring element 630 having a central origin and a radius r is constructed (FIG. 6A).
In accordance with an embodiment of the present invention, object 460 is eroded (step 520) by overlaying each pixel of image 400 with the origin of a copy of the structuring element 630. Alternatively, the origin of the copy may be overlaid on only those pixels within the boundary of object 460. In either case, pixels at the origin of a copy of the structuring element 630 are only selected if the ring-shaped boundary of the copy lies completely within the boundary of object 460. This is illustrated in FIG. 6B, in which portions of a number of exemplary copies of structuring element 630 are shown around the periphery of an eroded object 640. Copies of structuring element 630 with origins overlaying pixels within eroded object 640 are completely contained within the boundary of object 460. FIG. 6C depicts the final result of the erosion process of FIG. 5, the eroded object 640.
For an image of n pixels, the erosion method of FIGS. 5 and 6A-6C requires on the order of n.sup.2 pixel comparisons. Consequently, the erosion method in accordance with the present invention offers significant time savings over conventional methods that, as discussed above in connection with FIGS. 1A and 1B, require on the order of n.sup.3 pixel comparisons.
While the present invention has been described in connection with specific embodiments, variations of these embodiments will be obvious to those of ordinary skill in the art. For example, the structuring elements need not be circular, but may be of any desirable shape, and the origin of a structuring element need not be at the center of, or even within, the element. Furthermore, dilation and erosion are separate operations, and can be performed independently or in any order. Therefore, the spirit and scope of the appended claims should not be limited to the foregoing description of the preferred versions.
Claims
  • 1. A method for dilating an object within an image, wherein the image is represented using a plurality of image pixels, and wherein the object is represented using a plurality of object pixels that are a subset of the plurality of image pixels, the method comprising:
  • specifying a structuring-element boundary and a structuring-element origin, wherein the structuring-element boundary includes a plurality of structuring-element boundary pixels;
  • overlaying the origin of a copy of the structuring element onto each of the image pixels such that the structuring-element boundaries of the copies intersect to form a dilated image feature having a feature boundary; and
  • identifying the feature boundary.
  • 2. The method of claim 1, further comprising filling an area bounded by the feature boundary.
  • 3. The method of claim 2, wherein the area is filled by line scanning.
  • 4. The method of claim 1, wherein the structuring element is a ring, and wherein the boundary of the structuring element is specified by radius.
  • 5. The method of claim 1, wherein the boundary has a width of two pixels.
  • 6. The method of claim 1, wherein the feature boundary is identified using chain coding.
  • 7. A method for eroding an object within an image, wherein the image is represented using a plurality of image pixels, and wherein the object is represented using a plurality of object pixels that are a subset of the plurality of image pixels, the method comprising:
  • specifying a boundary and an origin of a structuring element, wherein the boundary includes a plurality of boundary pixels; and
  • for each image pixel,
  • overlaying a copy of the structuring element onto the pixel such that the origin of the copy is adjacent the image pixel;
  • comparing each boundary pixel with an adjacent ones of the image pixels; and
  • selecting the image pixel if each of the boundary pixels overlaps an object pixel.
  • 8. The method of claim 7, wherein the structuring element is a ring, and wherein the boundary of the structuring element is specified by radius.
  • 9. The method of claim 7, wherein the boundary has a width of one image pixel.
  • 10. A method for grouping selected pixels within an image represented using a plurality of image pixels, wherein the selected pixels are a subset of the plurality of image pixels, the method comprising:
  • specifying a first structuring-element having a first boundary and a first origin, wherein the first boundary includes a first plurality of structuring-element boundary pixels;
  • overlaying the origin of a copy of the first structuring element onto each of the selected pixels such that the first boundaries of the copies intersect to form a dilated image feature having a first feature boundary;
  • specifying a second structuring-element having a second boundary and a second origin, wherein the boundary includes a second plurality of boundary pixels; and
  • for each image pixel within the first feature boundary,
  • overlaying a copy of the structuring element onto the image pixel such that the second origin is adjacent the image pixel;
  • comparing the second boundary pixel with an adjacent one of the image pixels; and
  • selecting the image pixel if each of the second boundary pixels is adjacent an image pixel within the first feature boundary.
CROSS-REFERENCES TO RELATED APPLICATIONS

The present application is related to the commonly owned application Ser. No. 08/497,162, filed on Jun. 30, 1995 now abandoned, entitled "Method for Characterizing Defects on Semiconductor Wafers," by Ken K. Lee, et al.

US Referenced Citations (126)
Number Name Date Kind
H1530 Lee May 1996
RE34214 Carlsson et al. Apr 1993
2758502 Scott et al. Aug 1956
2969708 Polanyi et al. Jan 1961
3013467 Minsky Dec 1961
3049047 Polanyi et al. Aug 1962
3187627 Kapany Jun 1965
3360659 Young Dec 1967
3497694 Jura et al. Feb 1970
3602572 Norriss Aug 1971
3705755 Baer Dec 1972
3719776 Fujiyasu et al. Mar 1973
3764512 Greenwood et al. Oct 1973
3775735 Funk et al. Nov 1973
3782823 Kantorski et al. Jan 1974
3790281 Kessler et al. Feb 1974
3813140 Knockeart May 1974
3926500 Frosh et al. Dec 1975
3947628 Allen et al. Mar 1976
3980818 Browning Sep 1976
4045772 Bouton et al. Aug 1977
4063226 Kozma et al. Dec 1977
4068381 Ballard et al. Jan 1978
4111557 Bouton et al. Sep 1978
4125828 Resnick et al. Nov 1978
4141032 Haeusler Feb 1979
4160263 Christy et al. Jul 1979
4194217 Van den Bosch Mar 1980
4198571 Shepperd Apr 1980
4207554 Resnick et al. Jun 1980
4211924 Muller et al. Jul 1980
4218112 Ruker Aug 1980
4223354 Noble et al. Sep 1980
4236179 Dreyfus et al. Nov 1980
4240692 Winston Dec 1980
4247203 Levy et al. Jan 1981
4255971 Rosencwaig Mar 1981
4284897 Sawamura et al. Aug 1981
4311358 Gibbons et al. Jan 1982
4314763 Steigmeier et al. Feb 1982
4333838 Ballnus Jun 1982
4342905 Fujii et al. Aug 1982
4343993 Binning et al. Aug 1982
4347001 Levy et al. Aug 1982
4348263 Draper et al. Sep 1982
4350892 Kay et al. Sep 1982
4354114 Karnaukhov et al. Oct 1982
4362943 Presby Dec 1982
4366380 Mirkin Dec 1982
4379135 Sasaki et al. Apr 1983
4379231 Shii et al. Apr 1983
4381963 Goldstein et al. May 1983
4405237 Manuccia et al. Sep 1983
4406015 Koga Sep 1983
4406525 Itoh et al. Sep 1983
4407008 Schmidt et al. Sep 1983
4448532 Joseph et al. May 1984
4455485 Hosaka et al. Jun 1984
4485409 Schumacher Nov 1984
4532650 Wihl et al. Jul 1985
4549204 Bertero et al. Oct 1985
4555798 Broadbent, Jr. et al. Nov 1985
4556317 Sandland et al. Dec 1985
4579455 Levy et al. Apr 1986
4604910 Chadwick et al. Aug 1986
4618938 Sandland et al. Oct 1986
4631581 Carlsson Dec 1986
4633504 Wihl Dec 1986
4636069 Balasubramanian Jan 1987
4639587 Chadwick et al. Jan 1987
4644172 Sandland et al. Feb 1987
4733063 Kimura et al. Mar 1988
4758094 Wihl et al. Jul 1988
4786170 Groebler Nov 1988
4805123 Specht et al. Feb 1989
4818110 Davidson Apr 1989
4827125 Goldstein May 1989
4844617 Kelderman et al. Jul 1989
4845373 Jamieson et al. Jul 1989
4845558 Tsai et al. Jul 1989
4863226 Houpt et al. Sep 1989
4863252 McCarthy et al. Sep 1989
4877326 Chadwick et al. Oct 1989
4926489 Danielson et al. May 1990
4957367 Dulman Sep 1990
5030008 Scott et al. Jul 1991
5032735 Kobayashi et al. Jul 1991
5034613 Denk et al. Jul 1991
5035476 Ellis et al. Jul 1991
5046847 Nakata et al. Sep 1991
5084612 Iwasaki et al. Jan 1992
5091652 Mathies et al. Feb 1992
5112129 Davidson May 1992
5117466 Buican et al. May 1992
5119434 Bishop et al. Jun 1992
5122648 Cohen et al. Jun 1992
5122653 Ohki Jun 1992
5127726 Moran Jul 1992
5127730 Brelje et al. Jul 1992
5129010 Higuchi et al. Jul 1992
5153428 Ellis Oct 1992
5162641 Fountain Nov 1992
5243406 Ando et al. Sep 1993
5280452 Ozeki et al. Jan 1994
5289267 Busch et al. Feb 1994
5306902 Goodman Apr 1994
5311598 Bose et al. May 1994
5355212 Wells et al. Oct 1994
5438413 Mazor et al. Aug 1995
5438417 Busch et al. Aug 1995
5448364 Moran Sep 1995
5465145 Nakashige et al. Nov 1995
5479252 Worster et al. Dec 1995
5483055 Thompson et al. Jan 1996
5502306 Meisburger et al. Mar 1996
5537669 Evans et al. Jul 1996
5563702 Emery Oct 1996
5572598 Wihl et al. Nov 1996
5578821 Meisberger et al. Nov 1996
5583632 Haga Dec 1996
5621532 Ooki et al. Apr 1997
5627646 Stewart et al. May 1997
5671056 Sato Sep 1997
5680207 Hagiwara Oct 1997
5684509 Hatanaka et al. Nov 1997
5799113 Lee Aug 1998
Foreign Referenced Citations (12)
Number Date Country
0112401 Jul 1984 EPX
0155247 Sep 1985 EPX
1232367 Jan 1967 DEX
2360197 Jun 1975 DEX
2655525 Jun 1978 DEX
3243890 Jun 1983 DEX
487318 Jun 1938 GBX
1185839 Mar 1970 GBX
2132852 Jul 1984 GBX
2152697 Aug 1985 GBX
2184321 Jun 1987 GBX
WO 7901027 Nov 1979 WOX
Non-Patent Literature Citations (34)
Entry
John C. Russ, "The Image Processing Handbook", Second Edition, pp. 396-397, Dec. 1995.
G. J. Brakenhoff, "Imaging Modes in Confocal Scanning Light Microscopy (CSLM)", Journal of Microscopy, vol. 117, Pt. 2, Nov. 1979, pp. 233-242.
"The Yield Manager System", Knights Technology, 1996 (4 pages).
Technical Brief, "The KLA SAT", KLA Instruments Corporation, Wafer Inspection Division, 1996 (2 pages).
Gonzalez et al., "Digital Image Processing", Addison-Wesley Publishing Company, 1992, pp. 185-187 and 446-456.
"Working Together", Knights Technology, Inc., Nov. 1995 (8 pages).
A. F. Slomba et al., "A Laser Flying Spot Scanner for Use in Automated Fluorescence Antibody Instrumentation", Journal of the Association for the Advancement of Medical Instrumentation, vol. 6, No. 3, May-Jun. 1972, pp. 230-234.
Max Born et al., "Principles of Optics," Pergamon Press, London, 1959, p. 417.
I. J. Cox et al., "Scanning Optical Microscope Incorporating a Digital Framestore and Microcomputer", Applied Optics, vol. 22, No. 10, May 15, 1983, pp. 1474-1478.
Paul Davidovits, "Scanning Laser Microscope", NATURE, vol. 223, Aug. 23, 1969, pp. 831.
Paul Davidovits et al., "Scanning Laser Microscope for Biological Investigations", Applied Optics, vol. 10, No. 7, Jul. 6, 1971, pp. 1615-1619.
G. J. Brakenhoff et al., "Confocal Scanning Light Microscopy with High Aperture Immersion Lenses", Journal of Microscopy, vol. 117, Pt. 2, Nov. 1979, pp. 219-232.
"Merlin's Framework", Knights Technology, Inc., Jul. 1997 (4 pages).
"Knightline", Knights Technology, Inc., Winter 1995 (6 pages).
Louis Breaux, et al., "Integration of Automated Defect Classification into Integrated Circuit Manufacturing", 1944 IEEE/SEMICONDUCTOR Advanced Semiconductor Manufacturing Conference, pp. 290-292.
Kenneth R. Castleman, "Digital Image Processing", Prentice-Hall, Inc., 1979, pp. 351-359.
I. J. Cox et al., "Digital Image Processing of Confocal Images", Image and Vision Computing, Butterworth & Co., Ltd., 1983, pp. 52-56.
I. J. Cox et al., "Electronic Image Processing of Scanning Optical Microscope Images", International Conference on Electronic Image Processing, Jul. 26-28, 1982, pp. 101-104.
D. K. Hamtilon et al., "Three Dimensional Surface Measurement Using the Confocal Scanning Microscope", Applied Physics, B27, 1982, pp. 211-213.
D. K. Hamilton et al., "Experimental Observations of the Depth-Discrimination Properties of Scanning Microcope", Optics Letters, vol. 6, No. 12, Dec. 1981, pp. 625-626.
Gerd Hausler et al., "Imaging with Expanded Depth of Focus", Zeiss Information, No. 98E, Oberkochen 19, 1986-87, pp. 9-13.
Youling Lin, "Techniques for Syntactic Analysis of Images with Application for Automatic Visual Inspection", Ph.D. Dissertation, Texas Tech University, 1990.
H. J. B. Marsman et al., "Mechanical Scan System for Microscopic Applications", Review of Scientific Instruments, vol. 54, Aug. 1983, pp. 1047-1052.
H. M. Nier, "Automatic Moving Part Measuring Equipment", IBM Technical Disclosure Bulletin, vol. 22, No. 7, Dec. 1979, pp. 2856-2857.
Mojmir Petran et al., "Tandem-Scanning Reflected Light Microscope", Journal of the Optical Society of America, vol. 58, No. 5, May 1968, pp. 661-664.
C. J. R. Sheppard et al., "Depth of Field in the Scanning Microscope", Optics Letters, vol. 3, No. 3, Sep. 1978, pp. 115-117.
C. J. R. Sheppard et al., "Optical Microscopy with Extended Depth of Field", Proc. R. Soc. Lond, A., vol. 387, 1983, pp. 171-186.
Shura Agadshanyan et al., "MORPHOQUANT-An Automatic Microimage Analyzer of the JENA Optical Works", Jena Review, Jr. 6, 1977, pp. 270-276.
Philip G. Stein, "Image-Analyzing Microscope", Analytical Chemistry, vol. 42, No. 13, Nov. 1970, pp. 103A-106A.
V. Wilke et al., "Laser-Scan-Mikroskop", Laser-Anwendung, Nr., Feb. 1983, pp. 93-101.
T. Wilson et al., "Dynamic Focusing in the Confocal Scanning Microscopic", Journal of Microscopy, vol. 128, Pt. 2, Nov. 1982, pp. 139-143.
Frederick Y. Wu et al., "Automated Classification of Defects in Integrated Circuit Manufacturing ", IBM T. J. Watson Research Center, Yorkton Heights, NY, pp. 109.
"The Engineering Index Annual", 1983, pp. 3434, 4491.
IBM Technology, Disclosure Bulletin, vol. 18, No. 12, 1976, pp. 4174.