This invention relates to a method and system for optimising system failure notification for products requiring quality to be within certain standards by enabling the identification of problematic tools.
Rapid yield degradation detection in modern fabrication facilities is important. Identifying the cause cuts the losses suffered from process and equipment failure and helps improve profitability. The usual methods such as SPC control rules are not easily applied on non-normal distributions such as yield. In particular, if there is only a small yield loss, SPC rules are difficult to apply. This difficulty results in either the non-triggering or the slow triggering of the degradation, which may result in significant loss of profits.
Other problems in detecting degradation include the non-linear process manufacturing nature of wafer fabrication adding to the complexity of identifying degradation and the different volumes produced of different products.
Accordingly what is needed overcomes the above disadvantages or at least provides the public or industry with a useful choice.
In a first aspect, the present invention may broadly be said to consist in a method of detecting suspect production tools, said method comprising:
testing produced products using a test sequence, said testing producing yield data, said yield data related to a production batch and a production process, said production process identified with a process tool;
calculating and storing for each production process a first data series R1, wherein each element of said first series is the yield of a production batch divided by a baseline yield;
calculating and storing for each production process a second data series R2, wherein each element of said second series is an m consecutive element moving average of R1;
calculating and storing a simple linear regression of R1;
calculating the standard deviations of data series R1 and R2;
calculating for each production process lower trigger points for series R1 1-n standard deviations of R1 for the last p data points;
calculating and storing for each production process lower trigger points for series R2 being 1-o standard deviations of R2 for the last o data points;
calculating and storing R2 of said simple linear regression of R1;
applying decision rules to data series for each production process to produce a list of suspect processes, wherein each rule that is matched stores a match point against said production process; wherein said rules include:
calculating for each process tool the number of match points of said production processes identified with said tool; and
notifying a user of said tools that have the most match points.
Preferably the values of m, n, o, p, r, s and z to be used are calculated using a confusion matrix and historic data, said data including data on the success and failure of detecting suspect production tools, said values to be used determined when the accuracy of detection and the capture rate are maximised.
In a second aspect, the present invention may broadly be said to consist in a method of detecting suspect production tools, said method comprising:
testing produced products using a test sequence, said testing producing yield data, said yield data related to a production batch and a production process, said production process identified with a process tool;
calculating and storing for each production process a first data series R1, wherein each element of said first series is the yield of a production batch divided by a baseline yield;
calculating the standard deviation of data series R1;
calculating for each production process lower trigger points for series R1 1-n standard deviations of R1 for the last p data points;
applying decision rules to data series for each production process to produce a list of suspect processes, wherein each rule that is matched stores a match point against said production process; wherein said rules include:
calculating for each process tool the number of match points of said production processes identified with said tool; and
notifying a user of said tools that have the most match points.
Preferably the values of m, n, o, p, r, s and z to be used are calculated using a confusion matrix and historic data, said data including data on the success and failure of detecting suspect production tools, said values to be used determined when the accuracy of detection and the capture rate are maximised.
In a third aspect, the present invention may broadly be said to consist in a method of detecting suspect production tools, said method comprising:
testing produced products using a test sequence, said testing producing yield data, said yield data related to a production batch and a production process, said production process identified with a process tool;
calculating and storing for each production process a first data series R1, wherein each element of said first series is the yield of a production batch divided by a baseline yield;
calculating and storing for each production process a second data series R2, wherein each element of said second series is an m consecutive element moving average of R1;
calculating the standard deviation of data series R2;
calculating and storing for each production process lower trigger points for series R2 being 1-o standard deviations of R2 for the last o data points;
applying decision rules to data series for each production process to produce a list of suspect processes, wherein each rule that is matched stores a match point against said production process; wherein said rules include:
calculating for each process tool the number of match points of said production processes identified with said tool; and
notifying a user of said tools that have the most match points.
Preferably the values of m, n, o, p, r, s and z to be used are calculated using a confusion matrix and historic data, said data including data on the success and failure of detecting suspect production tools, said values to be used determined when the accuracy of detection and the capture rate are maximised.
In a fourth aspect, the present invention may broadly be said to consist in a method of detecting suspect production tools, said method comprising:
testing produced products using a test sequence, said testing producing yield data, said yield data related to a production batch and a production process, said production process identified with a process tool;
calculating and storing for each production process a first data series R1, wherein each element of said first series is the yield of a production batch divided by a baseline yield;
calculating and storing a simple linear regression of R1;
calculating and storing R2 of said simple linear regression of R1;
applying decision rules to data series for each production process to produce a list of suspect processes, wherein each rule that is matched stores a match point against said production process; wherein said rules include:
calculating for each process tool the number of match points of said production processes identified with said tool; and
notifying a user of said tools that have the most match points.
Preferably the values of m, n, o, p, r, s and z to be used are calculated using a confusion matrix and historic data, said data including data on the success and failure of detecting suspect production tools, said values to be used determined when the accuracy of detection and the capture rate are maximised.
In a fifth aspect, the present invention may broadly be said to consist in a method of detecting suspect production tools, said method comprising:
testing produced products using a test sequence, said testing producing yield data, said yield data related to a production batch and a production process, said production process identified with a process tool;
calculating and storing for each production process a first data series R1, wherein each element of said first series is the yield of a production batch divided by a baseline yield;
calculating and storing for each production process a second data series R2, wherein each element of said second series is an m consecutive element moving average of R1;
calculating the standard deviations of data series R1 and R2;
calculating for each production process lower trigger points for series R1 1-n standard deviations of R1 for the last p data points;
calculating and storing for each production process lower trigger points for series R2 being 1-o standard deviations of R2 for the last o data points;
applying decision rules to data series for each production process to produce a list of suspect processes, wherein each rule that is matched stores a match point against said production process; wherein said rules include:
calculating for each process tool the number of match points of said production processes identified with said tool; and
notifying a user of said tools that have the most match points.
Preferably the values of m, n, o, p, r, s and z to be used are calculated using a confusion matrix and historic data, said data including data on the success and failure of detecting suspect production tools, said values to be used determined when the accuracy of detection and the capture rate are maximised.
In a sixth aspect, the present invention may broadly be said to consist in a method of detecting suspect production tools, said method comprising:
testing produced products using a test sequence, said testing producing yield data, said yield data related to a production batch and a production process, said production process identified with a process tool;
calculating and storing for each production process a first data series R1, wherein each element of said first series is the yield of a production batch divided by a baseline yield;
calculating and storing a simple linear regression of R1;
calculating the standard deviation of data series R1;
calculating for each production process lower trigger points for series R1 1-n standard deviations of R1 for the last p data points;
calculating and storing R2 of said simple linear regression of R1;
applying decision rules to data series for each production process to produce a list of suspect processes, wherein each rule that is matched stores a match point against said production process; wherein said rules include:
calculating for each process tool the number of match points of said production processes identified with said tool; and
notifying a user of said tools that have the most match points.
Preferably the values of m, n, o, p, r, s and z to be used are calculated using a confusion matrix and historic data, said data including data on the success and failure of detecting suspect production tools, said values to be used determined when the accuracy of detection and the capture rate are maximised.
In a seventh aspect, the present invention may broadly be said to consist in a method of detecting suspect production tools, said method comprising:
testing produced products using a test sequence, said testing producing yield data, said yield data related to a production batch and a production process, said production process identified with a process tool;
calculating and storing for each production process a first data series R1, wherein each element of said first series is the yield of a production batch divided by a baseline yield;
calculating and storing for each production process a second data series R2, wherein each element of said second series is an m consecutive element moving average of R1;
calculating and storing a simple linear regression of R1;
calculating the standard deviation of data series R2;
calculating and storing for each production process lower trigger points for series R2 being 1-o standard deviations of R2 for the last o data points;
calculating and storing R2 of said simple linear regression of R1;
applying decision rules to data series for each production process to produce a list of suspect processes, wherein each rule that is matched stores a match point against said production process; wherein said rules include:
calculating for each process tool the number of match points of said production processes identified with said tool; and
notifying a user of said tools that have the most match points.
Preferably the values of m, n, o, p, r, s and z to be used are calculated using a confusion matrix and historic data, said data including data on the success and failure of detecting suspect production tools, said values to be used determined when the accuracy of detection and the capture rate are maximised.
In an eighth aspect, the present invention may broadly be said to consist in a system implementing any of the above methods.
In a ninth aspect, the present invention may broadly be said to consist in software for effecting any of the above methods.
The present invention consists of a method of identifying failure in a manufacturing system and in particular to identify processing tools that are causing problems in the manufacturing process.
Referring to
While in the preferred form of the invention the testing systems are directly connected to the computer system, the data required by the present invention can be entered either manually or via other means, such as being stored on portable storage media.
The system of the present invention receives the yield of all lots or batches processed through a fabrication plant. In the preferred embodiment, the system would receive the yield of all processing steps required in fabrication. The processing steps are identified with production tools.
Referring to
The data obtained preferably includes information on the equipment identification, the processing step, the processing time and the yield. The yield is preferable the number of products produced that meet the required standard divided by the number of products produced in a particular batch. From the raw data, a normalised dataset is created. Normalising yield across products has the advantage that all products can be used in the triggering instead of only one product.
The transformation process consists of calculating a normalised yield index consisting of the yield of a given batch divided by a baseline yield. This dataset is stored as R1. The baseline yield is the median yield of all batches of the step over a long period. In the preferred embodiment, the period is preferably 30 days.
Additionally the normalised yield index is recalculated as a three lot moving average of the dataset R1. This is stored as dataset R2. A further dataset R3 is calculated by fitting a linear regression model using the least square method to dataset R1 and extracting R2. R is a measure of the goodness of fit and lies between 0 and 1.
The system using datasets R1 and R2 then calculates upper and lower trigger points. Sigma of the population is calculated being a standard deviation of the data sat and the upper trigger point is calculated as 1+2sigma. The lower trigger point is calculated as 1−2sigma. For R1 and R2 if the yield index is less than the lower trigger point the batch is identified as a decreasing point. If the yield index is the upper trigger point, the batch is an increasing point. In the preferred embodiment, n is 2.
To identify whether a batch is a trigger point, the system then applies a set of rules. Three rules have been identified as appropriate based on testing of the method. If the number of consecutive decreasing points for series R1 exceeds a certain number, then the first rule is triggered. If the number of consecutive decreasing points for series R2 exceeds a certain number, then the second rule is triggered. The third rule is triggered if the R value is greater than a certain value.
In the most preferred embodiment, the first rule is triggered if more than four consecutive points in series R1 are decreasing, and the second rule is triggered if more than three consecutive points in series R2 are decreasing. In relation to R3, if R2 is greater than 0.1 (depending on process) then the third rule is triggered.
The trigger rules will differ between processes. They are, however, the same for all process steps, but different for each technology. The trigger rules can be calculated ahead of time. The system will then mark the processes that trigger rules and will sort the processes by the number of trigger rules and will identify to users the suspect processes.
The trigger rules are calculated using a confusion matrix. Referring to
In the case of this method, the accuracy of the number of times that the method does not trigger is not important. Therefore, the accuracy of the method is defined as d/(d+b) and the capture rate being the number of times degradation is correctly identified is defined as d/(c+d).
In the preferred embodiment, data on identified degradation is obtained and stored. This includes data on correctly and incorrectly predicted degradation and data on degradation not predicted by the method. The system recalculates the trigger points until the accuracy and the trigger rate of the proposed trigger points are above 90%.
Referring to FIGS. 3 to 6, the present invention will be illustrated with reference to an example. In
In
Referring to
Referring to
Referring to
R2 being a tree point moving average of R1 has been calculated and is graphed 908, the upper trigger point has been calculated and shown as line 906, and the lower trigger point calculated and shown as line 905. A linear regression has been applied to R1, and the result graphed as line 909. The R2 value for the linear regression has been calculated as 0.0207. The rule that three or more points of R2 below the lower trigger point of R2 has been triggered. The three points are shown enclosed by a circle 910. The triggering of the rule has correctly identified degradation in a process.
To those skilled in the art to which the invention relates, many changes in construction and widely differing embodiments and applications of the invention will suggest themselves without departing from the scope of the invention as defined in the appended claims. The disclosures and the descriptions herein are purely illustrative and are not intended to be in any sense limiting.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/SG03/00297 | 12/31/2003 | WO | 6/9/2005 |