This application is based on and claims priority under 35 U.S.C. § 119 to Korean Patent Application No. 10-2023-0039132, filed on Mar. 24, 2023 and Korean Patent Application No. 10-2023-0053577, filed on Apr. 24, 2023, in the Korean Intellectual Property Office, the disclosures of which are incorporated by reference herein in their entireties.
The inventive concept relates to a scanning electron microscopy (SEM) equipment alignment method, and more particularly, to a training SEM image selection method.
The SEM technology has been widely known as that devices and wiring patterns on a semiconductor substrate are scanned into an SEM image in SEM equipment and the differences are inspected between the SEM image and a design image. However, according to the conventional inspection method, the similarity is measured between images, or the same features, which have been found, are compared and aligned between images, so that there is a limitation that the shape or vector component needs to be similar between images. Accordingly, when inspecting heterogeneous images, the comparison and alignment may be difficult between heterogeneous images, and thus, the inspection on the heterogeneous images often fails. When the inspection fails, an operator has no choice but to proceed with direct comparison and alignment, and thus, it may take a lot of time and cost to proceed with the direct comparison and alignment.
The inventive concept provides a training scanning electron microscopy (SEM) image selection method and an SEM equipment alignment method in which SEM equipment is accurately aligned based on the selected training SEM image.
In addition, the problems to be solved by the inventive concept are not limited to the above-described problems, and some other problems are clearly understood by one of ordinary skill in the art from the following descriptions hereinafter.
According to an aspect of the inventive concept, there is provided a training SEM image selection method including setting a plurality of patterns of SEM images as samples, performing training on each of a plurality of training patterns to generate a conversion model between a design image pattern and the plurality of training patterns, converting the plurality of training patterns into a plurality of converted design patterns using the conversion model, comparing the plurality of converted design patterns with the design image pattern to determine misalignment therebetween, obtaining, for each of the plurality of training patterns, effective distances which are smallest values of distances from each of the plurality of training patterns to a pattern that is misaligned, extracting one of the plurality of training patterns having a maximum effective distance as an optimal training pattern, deleting the samples that are within the maximum effective distance in the optimal training pattern, and determining whether all the samples are aligned.
According to another aspect of the inventive concept, there is provided a training SEM image selection method including obtaining a plurality of SEM images for a measurement target using SEM equipment, performing pre-processing on the plurality of SEM images and corresponding design images, selecting training SEM images from the plurality of SEM images, performing training based on the training SEM images and the corresponding training design images to generate a first conversion model between the plurality of SEM images and the corresponding design images, and converting the plurality of SEM images into converted design images using the first conversion model, wherein the selecting the training SEM images includes setting a plurality of patterns of the plurality of SEM images as samples, performing training on each of a plurality of training patterns to generate a second conversion model between a design image pattern and the plurality of training patterns, converting the plurality of training patterns into a plurality of converted design patterns using the second conversion model, comparing the plurality of converted design patterns with the design image pattern to determine misalignment therebetween, obtaining, for each of the plurality of training patterns, effective distances which are smallest values of distances from each of the plurality of training patterns to a pattern that is misaligned, extracting one of the plurality of training patterns having a maximum effective distance as an optimal training pattern, deleting the samples that are within the maximum effective distance in the optimal training pattern, and determining whether all the samples are aligned.
According to another aspect of the inventive concept, there is provided a training SEM equipment alignment method including obtaining a plurality of SEM images for a measurement target using SEM equipment, performing pre-processing on the plurality of SEM images and corresponding design images, selecting training SEM images from the plurality of SEM images, performing training based on the training SEM images and corresponding training design images to generate a first conversion model between the plurality of SEM images and the corresponding design images, converting the plurality of SEM images into first converted design images using the first conversion model, comparing and aligning the first converted design images with the corresponding design images to extract alignment coordinate values, and determining a measurement error of the SEM equipment based on the alignment coordinate values, wherein the selecting the training SEM images includes setting a plurality of patterns of the plurality of SEM images as samples, performing training on each of a plurality of training patterns to generate a second conversion model between a design image pattern and the plurality of training patterns, converting the plurality of training patterns into a plurality of converted design patterns using the second conversion model, comparing the plurality of converted design patterns with the design image pattern to determine misalignment therebetween, obtaining, for each of the plurality of training patterns, effective distances which are smallest values of distances from each of the plurality of training patterns to a pattern that is misaligned, extracting one of the plurality of training patterns having a maximum effective distance as an optimal training pattern, deleting the samples that are within the maximum effective distance in the optimal training pattern, and determining whether all the samples are aligned.
Embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings in which:
Hereinafter, various embodiments of the inventive concept are described in detail with reference to the accompanying drawings. The same reference numerals denote the same elements in the drawings, and the descriptions of the same elements are omitted.
Referring to
The SEM image may have a bitmap file format. For example, the SEM image may have a bitmap file format such as a bitmap (BMP) format, a tagged image file format (TIFF), and a joint photographic expert group (JPEG) format. The image file may be largely divided into a bitmap file format and a vector file format. The bitmap file format refers to an image file format in which an image is configured by a quadrangular pixel. Since each pixel of a bitmap image gives different colors, the gray level or the color difference may be accurate in the whole image, and thus, various colors may be shown in the image. In addition, the color may be easily changed in each pixel, and thus, image correction and synthesis may also be easily performed. However, since the number of pixels in the image is fixed, the original pixels of the image may be lost when the size of the image is changed or the image is compressed, and accordingly, image quality may deteriorate when the image is excessively enlarged/reduced or continuously compressed and stored.
In contrast, the vector file format is an image file format in which an image is constructed by values of line segments connecting points and points, so that the vector image is expressed by lines and surfaces that are defined based on coordinate values of the points and lines and curve values of the surfaces, which are obtained by mathematical calculation in an x, y coordinate system. Since the vector image is reconstructed by the mathematical calculation without using pixels, image quality may not easily deteriorate and the original image quality may be maintained without any damages to the image even when the image is sufficiently enlarged, so that the vector image may be free to the size adjustment and the curve deformation and a deformation process such as a morphing and animation may be easily performed on the vector image. However, the vector file format may be difficult to express a fine picture or gradual changes in color and have low speed when an effect is applied to the image, so that the vector image is difficult to perform natural synthesis with other images.
The devices or wiring patterns on semiconductor substrates may be formed by a photolithography process based on design images such as computer-aided design (CAD) images. The CAD image may have a file format, for example, a graphic data system (GDS) format or a GDSII format. The GDS file format may be a kind of a binary file format and include a standard database file format for data exchange in an integrated circuit (IC) or IC-layout artwork. The GDS file format may include a variety of information on a layout of planar geometric shapes, a text label, and a hierarchical form.
Then, after obtaining the SEM images, a pre-processing may be performed on the SEM images and the corresponding design images (S120). For example, a measurement information file for the SEM images may be generated and the design images may be converted into a bitmap file format in the pre-processing process. The measurement information file may include some information such as measured coordinate values, a field of view (FOV), a pixel size, and/or rotation, etc. Since the design image is formatted as the GDS file format as described above, the GDS file format may be converted into a digital image file format such as a portable networks graphics (PNG) file format in the pre-processing process. The pre-processing may facilitate the comparison and alignment between the SEM image and the design image in subsequent processes.
After performing the pre-processing, training SEM images may be selected (S130). The training SEM images may be selected from the SEM images. That is, the training SEM images may be generated as a combination of at least some of the SEM images. For example, thousands or tens of thousands of the SEM images may be obtained by the SEM equipment 110, and tens or hundreds of the SEM images may be selected as the training SEM images. Particularly, some of the SEM images in which the pattern and the space are clear may be selected as the training SEM images to increase the accuracy of conversion models generated by training.
The training SEM images may be used for aligning the SEM images with a minimal combination of patterns. Therefore, the SEM images may be efficiently aligned with one another by the training SEM images. The selection of the training SEM images may be described in detail with reference to
After selecting the training SEM images, the training may be performed by using the training SEM images and the corresponding design images (S140). The training may be performed to find an optimal conversion model between the training SEM images and the corresponding training design images. That is, when a training SEM image A corresponds to a training design image B, the training may include a process of finding a conversion model for converting the training SEM image A into another SEM image B′, which is almost identical to the training design image B. The training may be performed by artificial intelligence (AI) learning algorithms such as generative adversarial network (GAN) algorithms. The training by using the GAN is described in more detail with reference to
Thereafter, as a result of the training, a conversion model may be generated between the SEM image and the design image (S150). The conversion model may include an image conversion program or image conversion algorithm that converts an image a into an image. That is, the SEM image may be converted into another SEM image that is substantially identical to the corresponding design image by the conversion model, as described above. Hereinafter, another SEM image, which is converted from a corresponding SEM image by the conversion model, is referred to as ‘converted design image’.
After generating the conversion model, the SEM images may be converted into converted design images by the conversion model (S160). In other words, the rest of the SEM images, which are not involved in the training, may be converted into the converted design images by the conversion model.
After generating the converted design images, the design images may be compared and aligned with the converted design images and alignment coordinate values may be extracted (S170). The alignment coordinate value may include a criterion for indicating the degree of deviation between the converted design image and the corresponding design image. For example, the converted design image may be an image corresponding to a pattern on the semiconductor substrate at the same position of the corresponding SEM image. Accordingly, the converted design image and the corresponding SEM image may have the same coordinate value. In case that no errors are in measurement coordinates of the SEM equipment, the converted design image may have to be accurately matched to the design image based on the correspondence between the design image and the converted design image. However, when there are errors in measurement coordinates of the SEM equipment, the pattern on a position of the semiconductor substrate may not be exactly measured when obtaining an SEM image. Accordingly, each position in the SEM image may be deviated or misaligned from the originally intended position, and thus, the converted design image may be a deviated image that is converted from the deviated positions of the deviated SEM image. As a result, the design image may not match the converted design image and the design image and the converted design image may be deviated from each other. Therefore, there is required that the converted design image be aligned with the design image, and the alignment coordinate values may be extracted in an aligning process.
After extracting an alignment coordinate value, a measurement error of the SEM equipment may be determined based on the alignment coordinate values (S180). For example, when the alignment coordinate value is over a preset allowable value, the SEM equipment may be determined to have the measurement error, and when the alignment coordinate value is below the allowable value, the SEM equipment may be determined to be normal. When the SEM equipment has the measurement error, an aligning process for the SEM equipment may be performed.
According to an embodiment of the SEM equipment alignment method, the conversion model may be generated by using the AI learning algorithm, such as the GAN algorithm, and the SEM image may be converted into the converted design image by the conversion model. In addition, some patterns of the SEM image may be combined to generate an effective training SEM image.
Referring to
Hereinafter, training data is extracted (S220). Operation S220 may correspond to operation S130 of selecting the training SEM images shown in
Then, the training for generating the conversion model may be performed (S230). Operation S230 may correspond to operation S140 of performing the training and operation S150 of generating the conversion model shown in
Then, the image A may be converted into a converted image B by using the conversion model (S240). Operation S240 may correspond to operation S160 of converting into the converted design image shown in
Then, the converted image B and the image B may be compared and aligned with each other (S250). Operation S250 may correspond to operation S170 of extracting the alignment coordinate value shown in
In operation S250 of comparing and aligning the converted image B and the image B in
Referring to
For example, the generator model may convert the real image to generate a converted design image, the converted design image may be compared with a real design image, and it may be determined whether the converted design image is a real design image or a fake design image that is generated from the generator model in the discriminator model. Specifically, in
To better understand the operation of the GAN algorithm, the generator model is assumed to be a counterfeiter and the discriminator model is assumed to be a policeman. Thus, the counterfeiter is set to make fake money that is not distinguished from real money, and the policeman is set to distinguish real money from fake money well. Therefore, the counterfeiter and the policeman compete, and in terms of game theory, they are adversarial and have effects on each other as if they played a zero-sum game. In other words, when the policeman successfully distinguishes between fake money and real money, the policeman does not need to update the parameters for the distinction. In contrast, the counterfeiter needs to update many parameters for forgery. Conversely, when the counterfeiter successfully makes fake money and the policeman cannot distinguish between fake money and real money, the counterfeiter does not need to update the parameters for forgery. In contrast, the policeman needs to update many parameters for distinction. When the above-mentioned process continues to be repeated, the forgery may reach such a level that the police cannot distinguish between fake money and real money, and the forgery method may be a final generation model or a final conversion model.
Referring to
The SEM image may include a plurality of patterns. All the plurality of patterns of the SEM image may be selected as a sample, or at least some of the plurality of patterns of the SEM image may be selected as the training pattern. For example, all the plurality of patterns of the SEM image may be set as the training pattern. Accordingly, the plurality of patterns of the SEM image may be set as the sample or the training pattern.
Thereafter, the training may be performed individually by using a plurality of training patterns (S132). Each of the plurality of training patterns may be independently used for the training. Operation S132 may correspond to operation S140 of performing the training, operation S150 of generating the conversion model, operation S160 of converting to the converted design image, operation S170 of extracting the alignment coordinate value, and operation S180 of determining the measurement error shown in
That is, a plurality of trainings may be independently performed by individually using the plurality of training patterns to thereby generate the conversion model, and then, a plurality of inferred patterns individually corresponding to the plurality of patterns of the SEM image may be obtained by using the conversion model. That is, a plurality of the trainings may be performed independently on each of the plurality of training patterns, to thereby obtain the plurality of inferred patterns corresponding to each sample.
After performing the training, an effective distance of each training pattern may be calculated (S133). The effective distance may indicate the smallest value of the distances from each of the plurality of training patterns to a pattern that fails to be aligned after placing the pattern of the SEM image on a coordinate plane. The alignment-failed pattern may indicate a case that the shapes of the inferred pattern and the design pattern are different, a case that the absolute positions of the inferred pattern and the design pattern are different, and/or a case that the relative positions of the inferred pattern and the design pattern are different. Herein, the inferred pattern may also be referred to as a pattern of the converted design image.
For example, in case of the pattern that fails to be aligned, the shapes of the inferred pattern and the SEM pattern may be different. For example, in case of a pattern that is successfully aligned, the shapes of the inferred pattern and the SEM pattern may be substantially the same.
The plurality of training patterns may independently and respectively have a plurality of effective distances. At least two effective distances among the plurality of effective distances may be different from each other.
Then, a training pattern corresponding to the largest effective distance is selected from among the plurality of training patterns (S134). For example, the selected training pattern may be the optimal training pattern, and the effective distance corresponding to the optimal training pattern may be the maximum effective distance.
Thereafter, all samples, which are arranged within the maximum effective distance from the optimal training pattern, may be deleted (S135). That is, the sample may be updated. As defined above, since the effective distance may indicate the smallest value of the distances from the training pattern to the pattern that fails to be aligned, all samples, which are spaced apart from the optimal training pattern by a gap distance less than or equal to the maximum effective distance, may be determined as being aligned sufficiently. Herein, the optimal training pattern may also be deleted from the sample.
Thereafter, it may be determined whether all samples are aligned (S136). When all samples are aligned, one or more optimal training patterns may be synthesized, and the synthesized optimal training patterns may be selected as a training SEM image (S137). In contrast, when at least some of the samples are not aligned, operation S131 to operation S135 may be repeated until the samples are finally aligned, and the optimal training pattern is additionally selected.
The conventional training SEM image selection method is generally performed with low efficiency due to manual selection of the patterns. In addition, when a model trained with the training SEM image fails to align at least some of the SEM images, a process of selecting the training SEM image may be additionally required.
However, the training SEM image selection method according to an embodiment may select the training SEM image quickly and accurately by sequentially performing the selection of a plurality of training patterns and the calculation of the effective distances for each of the training patterns.
Referring to
For example, the training may be performed by using the SEM image in
Each pattern of the converted design image in
However, in
In
Referring to
Referring to
By repeating the training process, the alignment process, and the deletion process several times, the training pattern in which all samples are aligned may be selected and combined.
Referring to
For example, the first training pattern P1 may have a first line width and a first space width, the second training pattern P2 may have a second line width and a second space width, and the third training pattern P3 may have a third line width and a third space width.
For example, the dashed circle in
In
Referring to
Referring to
The SEM measurement device 110 may include a device for taking a picture of the patterns, which are arranged on a semiconductor substrate, as an SEM image. More particularly, the SEM measurement device 110 may include an electron gun, an anode, a magnetic lens, a scanning coil, a first detector, a second detector, a scanner, and a stage. The electron gun may include, for example, a Schottky type or a thermoelectric emission type. An electron beam may be emitted by applying an acceleration voltage to the electron gun. The anode may include an acceleration electrode, and the electron beam may be accelerated by a voltage applied between the electron gun and the anode. The magnetic lens may focus and accelerate the electron beam. The scanning coil may scan the electron beam one-dimensionally or two-dimensionally on a semiconductor substrate that is a specimen to be measured. The first detector may detect backward scattered electrons (BSE) that are emitted from the semiconductor substrate by the electron beam irradiation, and the second detector may detect secondary electrons (SE) that are generated from the semiconductor substrate by the electron beam irradiation. The scanner may analyze detection signals for the electrons that are detected from the first and second detectors and may generate an image of the patterns on the semiconductor substrate, that is, the SEM image. The stage may be a device on which the semiconductor substrate is located, and thus, the semiconductor substrate may be positioned on an upper surface of the stage and supported by the stage and may move along with the movement of the stage.
The SEM server 130 may control all operations of the SEM measurement device 110 and transfer the SEM image, which is obtained from the SEM measurement device 110, and data related to the SEM image measurement to the calculation and alignment server 150. For example, the data related to SEM image measurement may include data on measurement coordinates, field of view (FOV), pixel size, rotation, etc. The SEM image may be obtained by the SEM measurement device 110 based on the measurement coordinates stored in the SEM server 130. When there is an error in the measurement coordinates stored in the SEM server 130, the SEM image obtained by the SEM measurement device 110 may include a position error, and thus, the SEM image may deviate from the corresponding design image. Therefore, the SEM measurement device 110 or the SEM equipment 100 may be aligned by correcting the measurement coordinates in the SEM server 130, so that the SEM measurement device 110 may obtain the SEM image at the correct measurement coordinates.
The calculation and alignment server 150 may perform various operations, such as the pre-processing on the design images corresponding to the SEM images, the selection of the training SEM images, the training by using the GAN algorithm to thereby generate conversion models, the generation of the converted design images, and the extraction of the alignment coordinate values by comparison and alignment. After extracting the alignment coordinate values, the alignment coordinate values may be fed back to the SEM server 130, and thus, the measurement coordinates stored in the SEM server 130 may be corrected.
Referring to
Until now, the inventive concept has been described with reference to the embodiments illustrated in the drawings, but this is only an example, and those of ordinary skill in the art will understand that various modifications and equivalent other embodiments are obtainable therefrom. Therefore, the true technical scope of protection of the disclosure should be determined by the technical idea of the appended claims.
While the inventive concept has been particularly shown and described with reference to embodiments thereof, it will be understood that various changes in form and details may be made therein without departing from the scope of the following claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2023-0039132 | Mar 2023 | KR | national |
10-2023-0053577 | Apr 2023 | KR | national |