Experiment management system, method and medium

Information

  • Patent Grant
  • 6984198
  • Patent Number
    6,984,198
  • Date Filed
    Tuesday, August 14, 2001
    23 years ago
  • Date Issued
    Tuesday, January 10, 2006
    19 years ago
Abstract
Systems, methods and mediums are provided for automating experiments within an automated environment without the need to disassociate the test subject (e.g., the semiconductor chip or chips) from that environment. An “experiment” may be a pre-planned deviation of an established (e.g., pre-defined) process utilizing the automated environment.
Description
BACKGROUND OF THE INVENTION

1. Field of the Invention


The present invention concerns computer-related methods systems and mediums for managing experiments. More specifically, it relates to managing experiments concerning changes in a process, for example processes for controlling semiconductor technology manufacture.


2. Related Art


Machines, materials and processes in most industries are becoming increasingly complex and costly. Meanwhile, a need has arisen for the continuing improvement of processes and of machine and material quality.


Semiconductors and other products are typically manufactured under control of pre-defined processes. These pre-defined processes may be highly complex. For example, a pre-defined manufacturing process for producing semiconductor chips might contain five hundred to seven hundred and fifty steps. Moreover, each of these steps might have several variables, for example six variables, that are significant.


In order to improve manufacturing or test theories, it is often desirable to perform experiments by changing some small portion of the base manufacturing process. For example, an engineer might want to make one of the layers on a semiconductor ten percent thicker. This might entail performing the recipe for that step for an extra 15 seconds, with perhaps some adjustments in subsequent steps. Typically the engineer does not create a new base process including the modifications to adapt to the desired test, since that would be too time consuming.


Unfortunately, such an experiment using conventional techniques requires manual intervention and manual tracking of results. Accordingly, the engineer or operator performing the experiment would obtain a number of semiconductor chips and process them outside of an automated (e.g., production or mock-production manufacturing) environment. Thus, the products on which the experiment is performed need to be removed from the automated environment, which is both time-consuming and allows for the potential introduction of extraneous factors which may ultimately (and inadvertently) affect the results of the experiment. In addition, such removal of the semiconductor chips makes it difficult to coordinate manual tracking of changes or experiment history, and to control experiments and to analyze overall results.


Consequently, for research and development engineers, operators and other users working in factory settings, there remains a need for experiments on changes to existing processes to be flexible, easy and traceable.


SUMMARY OF THE INVENTION

The present invention alleviates the problems of the conventional techniques described above by providing systems, methods and mediums for automating experiments within an automated (e.g., production or mock-production manufacturing) environment without the need to disassociate the test subject (e.g., the semiconductor chip or chips) from that environment. An “experiment,” according to at least some embodiments of the present invention, is a pre-planned deviation of at least some portion of an established (e.g., pre-defined) process utilizing the automated environment.


According to at least some embodiments of the present invention, experimentation begins with an experiment order (i.e., request to initiate an experiment), which is first originated as an informal request, submitted to a computerized system, routed through various defined users, perhaps modified, and ultimately approved. In facilitating the implementation of the requested experiment, experiment management includes four conceptually distinct stages: order management, setup, execution, and analysis. The order management component of the invention assists in automatically navigating the formalization of the experiment order (mentioned above) and tracking the experiment. The setup stage typically handles the manual or automated translation of the experiment from the generalized statements, requirements, or proposed results into data defining a specific process ready to execute by the automated environment. The execution stage includes the execution of the experiment itself via the automated environment based on the process data, including the collection of experiment results. In the analysis stage, results of the experiment are reported and analyzed.


In accordance with at least some embodiments of the present invention, in operation, an experiment order is received, the experiment order including at least some deviation from a base process capable of operating in an automated environment. An approval of the experiment order is then obtained. At least a portion of the experiment order is translated into processing data suitable for implementation by said automated environment, and stored. The experiment is caused to be executed in conjunction with at least some portion of said base process via the automated environment according to the processing data.


Further, the invention may include storing data defining the experiment order, distributing the experiment order to a plurality of users, obtaining changes to the experiment order from at least one of the users, and receiving the approval for the experiment order from at least one user. Moreover, documents may be attached to the experiment request.


Additionally, information indicating a state change of the experiment request may be published, responsive to a document attached to the experiment request or to a change in state of the experiment order.


Moreover, the experiment may produce at least one test product and at least one production product (i.e., a control, which could be, e.g., a product which was processed before or after the test product, and which was processed according to the base process); the processing data may include an indication of the base process, the changes to the base process, and a split-off of a control set (i.e., the products subject to the experiment); and the split-off of a control set may produce the at least one production product according to the base process and the changes to the base process may produce the at least one test product. The results of the execution of the experiment may be stored.





BRIEF DESCRIPTION OF THE FIGURES

The above mentioned and other advantages and features of the present invention will become more readily apparent from the following detailed description in the accompanying drawings, in which:



FIG. 1 is a block diagram of a computerized process control system which may be used in connection with at least some embodiments of the present invention.



FIG. 2 is a flow chart of an overall process for experiment management according to at least some embodiments of the invention.



FIGS. 3A and B are a flow chart of an order management process portion of the overall process of FIG. 2.



FIG. 4 is a flow chart of a setup process portion of the overall process of FIG. 2.



FIG. 5 is a flow chart of an execution process portion of the overall process of FIG. 2.



FIG. 6 is a flow chart of an analysis process portion of the overall process of FIG. 2.



FIG. 7 is a diagram illustrating definition of an experiment.



FIG. 8 is an exemplary user interface for an experiment editor, used in connection with at least some embodiments of the present invention.



FIG. 9 is an exemplary user interface for the experiment editor, illustrating attachments, used in connection with the invention.



FIG. 10 is an exemplary user interface for an experiment editor, illustrating experiment content, used in connection with at least some embodiments of the present invention.



FIG. 11 is an exemplary user interface for an experiment editor, illustrating wafer level split details, used in connection with at least some embodiments of the present invention.



FIG. 12 is an illustration of at least some embodiments of an experiment.





DETAILED DESCRIPTION

The following detailed description includes many specific details. The inclusion of such details is for the purpose of illustration only and should not be understood to limit the invention. Throughout this discussion, similar elements are referred to by similar numbers in the various figures for ease of reference.


As indicated above in the Summary section, an “experiment,” according to at least some embodiments of the present invention, is a pre-planned deviation of at least some portion of a base process utilizing an automated environment. Typically an experiment is performed on materials, such as semiconductor chips, that are produced as a result of the automated process. Also as indicated above, at least some embodiments of the present invention envision that experiment management includes four conceptually distinct stages: order management, setup, execution, and analysis. Although these stages are conceptually distinct, they may temporally overlap.


According to at least some embodiments of the present invention, reports, memos, forms, files, and other documents may be associated with a particular experiment throughout the order management and setup stages. These may be reviewed by users allowed access to the experiment. This permits users and reviewers to comment on the experiment, provide background information, provide appropriate forms, attach relevant information, etc., in a user-friendly, highly flexible fashion. Due to its flexibility, it invites users to provide input and should result in higher quality experiments.


Reference is now made to FIG. 1, a block diagram generally illustrating a computerized process control system which may be used in connection with at least some embodiments of the present invention. As is illustrated, the experiment order 101 is input to a computerized system, referred to generally as a controller 103. The experiment order 101 contains a description, such as in text, of a desired experiment. The experiment order 101 could be, for example, a word processing document containing text. As one alternative, it could be input from a menu. The experiment described in the experiment order 101 is a deviation from an existing automated process for creating a product, although it is not necessarily described in the order as a deviation from a particular process.


The controller 103 has access to various stored processes 111, such as manufacturing processes for semiconductor chips. The controller 103 could be a general purpose computer, or a special purpose computer specially programmed, or other automated system or distributed system. (In general, such computers as used here, or whose use may be apparent from the context of the discussion, can be any number of different types of computers, including those containing processors from Intel Corporation of Santa Clara, Calif., wherein these computers can contain any number and different types of storage devices serving as computer-readable mediums; in addition, it is contemplated by at least some embodiments of the present invention that the computer-readable medium be a transmission). The stored processes 111 comprise a number of automated steps in a manufacturing process. The actual format of the contents of these steps is defined by the system and devices in the system. Some of the steps in the processes utilize recipes, stored in a recipe database 113. Recipes may be shared by various processes. The controller 103 controls the processing of an automated environment such as production system 105, which ultimately produces production products 107, or following an experiment, produces test products 109. The invention thereby allows users to submit experiment requests, create derivations of base processes, and to track the status of experiment requests.


Reference is made to FIG. 2, a flow chart of an overall process for experiment management according to at least some embodiments of the present invention. The four conceptual stages (as mentioned above) included: order management 201, Manufacturing Execution System (MES) setup 203, execution 205, and analysis 207.


At the order management stage 201, further defined below, the experiment order is defined. Typically, an experiment would be defined in the experiment order as a set of requirements, and may be specified as a deviation from an existing process. The experiment order is subject to routing, review, and change by various personnel, prior to being approved for the next stage.


At the MES setup stage 203, the experiment order is translated into the experiment setup, that is, specific processing data which can be executed by components in the production system. The processing data is in a format which is expected by the production system components. In typical situations, data to execute the experiment is interjected between (and/or replaces existing) steps of a base process.


At the execution stage 205, the execution of materials is performed, based on the experiment setup. Most or all of this stage is performed automatically by the production system components. The results of each step in the setup implemented at this execution stage 203 are recorded.


At the analysis stage 207, the results of the experiment are reported and analyzed. This may be done automatically by a computer, and/or may include analysis by the user.


Reference is made to FIGS. 3A and 3B, a flow chart of an example order management stage 201 of the overall process of FIG. 2, as envisioned by at least some embodiments of the present invention. This stage allows the experiment to be requested and be performed following experiment request review and sign-off. At step 301, the experiment is initially defined by a requestor. In order to facilitate experiments, it is envisioned that requests can be submitted in any appropriate form. One appropriate form is a textual description in an electronic document. Note that the experiment may be informally described. It is not necessary for the initial experiment request to define the experiment as a variation from an existing process.


At step 303, the experiment object (or other storage for experiment data) is created. Initial information is collected to identify the requestor and the experiment. The information is stored, such as in an object. The experiment request is then distributed to appropriate users identified in a distribution list.


At step 305, a user who received the experiment request (e.g., for review) may attach external files, memos, forms, or other documents to the experiment request. The ability to associate documents with the experiment request can be used to facilitate user interaction concerning the experiment request. These documents may then be reviewed by other users. At step 307, the user (or automated entity) determines the changes to be made to a particular base process. The user (or automated entity) may also determine the base process which is to be modified. Also, at step 309, the user (or automated entity) will determine when to split off a lot from the control set, and the lot-specific transactions that are to be made. At step 311, the user (or automated entity) determines what recipe changes, if any, need to be made. Having determined the specified changes to be made to the base process, the system receives and stores the changes as processing data. At step 313, the experiment, as it has been tweaked by the users, is sent for sign-off, described in FIG. 3B. At step 315, if the experiment has been approved by the users, the process ends 317 and the experiment proceeds to the next conceptual stage. Otherwise, the process returns to step 305 for further handling.



FIG. 3B illustrates one embodiment of the sign-off process. At step 321, a user who received the experiment request (e.g., for review) may attach external files, memos, forms, or other documents to the experiment request, which may then be reviewed by other users. At step 323, if documents are attached or deleted to the experiment request, or at step 325 if there was a state change for the experiment request, such information is published 327. One appropriate method for publication is to send such information to listed users via e-mail. A state change would include, for example, a “sign-off” on the experiment (or portion thereof). At step 329, if an indication of final approval (or affirmative lack of approval) has not been received, the process repeats at step 321. If final approval has been received, the stage is ended 331.


Reference is made to FIG. 4, a flow chart of a setup stage 203 portion of the overall process of FIG. 2. During the setup stage, a user can set up the particular experiment. For example, a user could set up experiment-specific data, for example a reticle or recipe details. At step 401, a user (or automated entity) retrieves and reviews the experiment order. As indicated above, the experiment order may be an informal description of an experiment. A user can determine how a process should be implemented to effect the requested experiment, or the process can be automated, for example, by parsing the description of the experiment and identifying certain key words or phrases that are indicative of what is requested. At least some embodiments of the present invention envision that this can be done utilizing, e.g., various expert system techniques. At least some embodiments of the present invention also envision some combination of automation and user participation.


Still referring to FIG. 4, at step 403, the user (or automated entity) determines the changes to be made to a particular base process. The user (or automated entity) may also determine the base process which is to be modified. Also, at step 405, the user (or automated entity) will determine when to split off a lot from the control set, and the lot-specific transactions that are to be made. At step 407, the user (or automated entity) determines what recipe changes, if any, need to be made. Having determined the specified changes to be made to the base process, the system receives and stores the changes as processing data.


Reference is made to FIG. 5, a flow chart of an execution stage 205 of the overall process of FIG. 2. At this point, the experiment has been defined in processing data which can be input to the automated environment. The experiment can then be processed in a manner which is transparent to the automated environment. At step 501, the automated environment receives the processing data for the modified process. At step 503, the automated environment executes a step of the processing data. If there are any test results to be stored, at steps 505-507, the system stores the test results. At step 509, if processing is not complete, the automated environment returns to continue processing at step 503. When processing is complete, this stage ends at step 511.


Reference is made to FIG. 6, a flow chart of an analysis stage 207 of the overall process of FIG. 2. Experiment history setup information and history data is available for use in analysis and reporting. The experiment results are collected at step 601. At step 603, the experiment results are made available for any analysis. For example, a user may wish to make a manual analysis of the results. At step 605, the automated environment performs any requested computerized analysis. If there are any proposed changes to the experiment, at steps 607-609, the user may generate another experiment request. The analysis is completed at step 611.


Reference is made to FIG. 7, a diagram illustrating the defining of an experiment, as contemplated by at least some embodiments of the present invention. Specifically, the experiment 701 initially is associated with stored data including attribute information 703, for example defined by the user, and operation information 705, defining how the experiment operates. An experiment initially may be created from scratch, or may be copied from another experiment used as a template. Typical attributes would include sufficient information to identify useful information about the experiment, such as an experiment identifier, an experiment objective, a requestor name, an experiment name, a requestor e-mail address.


When the experiment is initially defined, a starting state will be “underchange” 707 (indicating that the experiment may be changed), and once the experiment is approved, the ending stage is effective (distributed) 711. There may be a series of user-defined states 709 which are under control of the user, subsequent to the underchange state, and prior to the effective state. The effective state is entered after the experiment is approved and signoff is obtained. Preferably, a user cannot change the contents of an experiment without appropriate permission. There may be other user-defined attributes, as well as attached external documents and/or files, and a user-defined state model. According to one possible implementation, the experiment is implemented as an object. Note that this state table corresponds to the order management process portion.



FIGS. 8-11 are examples of a potential user interface to be used in connection with at least some embodiments of the present invention. First, reference is made to FIG. 8, one aspect of an exemplary user interface for an experiment editor. Here, the user may provide information about the experiment 811, about experiment attributes 813, and optionally about experiment category 815. Experiment information may include an objective 801, which may summarize a description of the experiment. Other experiment information includes requestor identification information 803 (for example, name, e-mail address); the basic process or state model 805 for the experiment; and optionally an effective date 807 after which the experiment request will expire. The information collected in this initial interface is associated with the experiment request.


Reference is made to FIG. 9, another aspect of an exemplary user interface for the experiment editor, illustrating attachments used in connection with at least some embodiments of the present invention. In such embodiments, documents such as files, memos, forms, web addresses, etc., without limitation, may be attached to or otherwise associated with the experiment request. FIG. 9 lists, by way of example, several documents, by file name 909, which are attached to the experiment request: a local document experiment doc 901; a filepath for another document C:\Experiment\Experiment.doc 903; a web site www.consolium.com 905; and an http document http://www.consilium.com/corp_events.html?phase=ge 907. The user interface of the present example also indicates whether or not the file is simply a reference 911.


Reference is made to FIG. 10, another aspect of an exemplary user interface for the experiment editor, illustrating experiment content, used in connection with at least some embodiments of the present invention. This exemplary user interface allows access to experiment content 1001, physical split details 1003, and merge details 1005, the split treating the standard and test materials differently, and the merge detailing how the standard and test materials are treated when merged after the split. The experiment content 1001 provides the file controlling the experiment process. Here, it names the experiment process 1007, the experiment route 1009, and the experiment operation 1011. Note that additional information on the experiment may be provided, such as whether the processing is pre- or post-split 1013.


Reference is made to FIG. 11, an exemplary user interface for the experiment editor, illustrating wafer level split details, used in connection with the invention. Here, the processing data provides specifics, at lot level, slot level, or unit level 1101. The present example concerns a slot level split. As is illustrated, the split details 1103 provide the slots and the quantity to be split; as well as the process plans 1105 to be associated with each split.


Reference is made to FIG. 12, illustrating at least some embodiments of an experiment as contemplated by the present invention. Each experiment order 1201 may have associated with it various documents, such as files 1203, forms 1205, memos 1207, and experiment results 1209. Users can add or delete the document to/from the experiment order. Preferably, an attachment of a document will be considered an event, and may result in the publication of the event for example by e-mail or Workflows.


An experiment order may be copied by a user, together with attached documents, attributes, and other correlated information


Also, according to at least some embodiments of the present invention, changes to the experiment order are stored in a history. Stored changes could include changes to native attributes, external document additions/deletions, and associated with other objects.


Consider an example of an experiment, with reference to FIGS. 3 through 6. In this example, the user wants a specified layer of a chip to be 10% thicker. The experiment in this example is an idea from an engineer. The experiment request is defined by a user, and submitted to the system at step 301 through 303. It could be a very general request with a simple textual description. An experiment object is created for the experiment request, and the experiment request is routed to the appropriate users for approval, at steps 305 through 313. The approval may be automated, such as delivery via e-mail awaiting a marking as approved. As shown in steps 321 through 329, until sign-off is received for the experiment, users may attach and/or delete relevant files, memos, etc. to the experiment object. If there are attachments or deletions, or if the experiment has changed state, the event is published to the users, shown in steps 323 through 327. The review process continues until sign-off is received.


Once sign-off is received, the experiment order is reviewed and translated to processing data, as shown in FIG. 4. This review and translation may be a manual process done by a person with the appropriate experience. In addition, it may also be performed (in whole or part) by automated means. In any event, it could be determined at step 403, for example, that wafers 1-11 in the lot will be the control (i.e., the established steps will not be effected), and the remainder of the wafers in the lot will be the test product. Also, it could be determined that a particular parameter in the 500th cycle of a standard base process must be changed from 100 to 200. It would be specified at step 405 that the controls will be split off from the other processing. If it was necessary, a new recipe would be created or an existing recipe would be modified at step 407. All of the wafers will be under automated control. The two lots will be re-united and held or delivered for analysis. The information related to the variations from the base process, specific execution transactions, and any recipe change are stored as processing data. Note that the experiment could call for additional or different information to be collected as part of the processing results.


The experiment is then run, as shown in FIG. 5. At this point, the experiment processing data are handled no differently from a regular control job. That is, no exception processing is required. The processing data is input into the manufacturing system at step 501, and the test proceeds automatically by executing the processing data at step 503. Test results that are generated during execution of the experiment are stored at steps 505-507.


Following the experiment, test product might be reclassified from test materials to standard production materials, if within tolerances, and shipped to customers. Alternatively, the non-standard processed materials could be scrapped, or saved for further analysis, as shown in FIG. 6.


While this invention has been described in conjunction with the specific embodiments outlined above, many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, the preferred embodiments of the invention as set forth are intended to be illustrative and not limiting. Various changes may be made without departing from the spirit and scope of the invention as defined in the following claims.


For example, it would be possible to define an entire experiment from scratch. A typical semiconductor manufacturing process is 500 to 750 steps, so it may often be more efficient to define an experiment as a variation from an existing process.


As another example, the controller may be a general purpose computer, a specially programmed special purpose computer; it may also be implemented as a distributed computer system rather than as a single computer.

Claims
  • 1. A computer-implemented method for managing experiments relating to automated processing technology, comprising the steps of: (A) receiving an experiment order, the experiment order including at least some pre-planned deviation from a base process capable of operating in an automated environment; (B) obtaining an approval of the experiment order; (C) translating and storing at least a portion of the experiment order into processing data suitable for implementation by said automated environment; and (D) causing the experiment to be executed in conjunction with at least some portion of said base process by the automated environment, in accordance with said processing data.
  • 2. The method of claim 1, wherein the obtaining step further includes the steps of storing data defining the experiment order, distributing the experiment order to a plurality of users, obtaining changes to the experiment order from at least one of the users, and receiving the approval for the experiment order from at least one user.
  • 3. The method of claim 1, further comprising the step of attaching documents to the experiment order.
  • 4. The method of claim 1, further comprising the step of publishing information indicating a state change of the experiment order, responsive to a document attached to the experiment order or to a change in state of the experiment order.
  • 5. The method of claim 1, wherein the translating step further includes the step of receiving the processing data.
  • 6. The method of claim 5, wherein: the experiment produces at least one test product and at least one production product; and wherein the processing data includes an indication of the base process, the changes to the base process, and a split-off of a control set; and wherein the split-off of a control set produces the at least one production product according to the base process and the changes to the base process produce the at least one test product.
  • 7. The method of claim 1, further comprising the step of receiving and storing the results of the execution of the experiment.
  • 8. The method of claim 1, wherein the automated environment produces semiconductor technology.
  • 9. A computer-implemented system for managing experiments relating to automated processing technology, comprising: (A) an experiment order, the experiment order including at least some pre-planned deviation from a base process capable of operating in an automated environment; (B) an approval of the experiment order, obtained in response to receipt of the experiment order; (C) processing data suitable for implementation by said automated environment, translated from at least a portion of the experiment order; and (D) wherein said automated environment causes the experiment to be executed in conjunction with at least some portion of said base process by the automated environment, in accordance with the processing data.
  • 10. The system of claim 9, wherein the approval further includes stored data defining the experiment order, a distribution of the experiment order to a plurality of users, stored changes to the experiment order from at least one of the users, and received approval for the experiment order from at least one user.
  • 11. The system of claim 9, further comprising at least one document attached to the experiment order.
  • 12. The system of claim 9, further comprising information indicating a state change of the experiment order, published responsive to a document attached to the experiment order or to a change in state of the experiment order.
  • 13. The system of claim 9, wherein the processing data is received from a user.
  • 14. The system of claim 13, wherein: the experiment produces at least one test product and at least one production product; and wherein the processing data includes an indication of the base process, the changes to the base process, and a split-off of a control set; and wherein the split-off of a control set produces the at least one production product according to the base process and the changes to the base process produce the at least one test product.
  • 15. The system of claim 9, wherein the results of the execution of the experiment are received and stored.
  • 16. The system of claim 9, wherein the automated environment produces semiconductor technology.
  • 17. A computer-readable medium comprising instructions being executed by a computer, the instructions including a computer-implemented method for managing experiments relating to automated processing technology, the instructions for implementing the steps of: (A) receiving an experiment order, the experiment order including at least some pre-planned deviation from a base process capable of operating in an automated environment; (B) obtaining an approval of the experiment order; (C) translating and storing at least a portion of the experiment order into processing data suitable for implementation by said automated environment; and (D) causing the experiment to be executed in conjunction with at least some portion of said base process by the automated environment in accordance with the processing data.
  • 18. The medium of claim 17, wherein the obtaining step further includes the steps of storing data defining the experiment order, distributing the experiment order to a plurality of users, obtaining changes to the experiment order from at least one of the users, and receiving the approval for the experiment order from at least one user.
  • 19. The medium of claim 17, wherein the computer program further comprises the step of attaching documents to the experiment order.
  • 20. The medium of claim 17, wherein the computer program further comprises the step of publishing information indicating a state change of the experiment order, responsive to a document attached to the experiment order or to a change in state of the experiment order.
  • 21. The medium of claim 17, wherein the translating step further includes the steps of receiving the processing data.
  • 22. The medium of claim 21, wherein: the experiment produces at least one test product and at least one production product; and wherein the processing data includes an indication of the base process, the changes to the base process, and a split-off of a control set; and wherein the split-off of a control set produces the at least one production product according to the base process and the changes to the base process produce the at least one test product.
  • 23. The medium of claim 17, wherein the computer program further comprises the step of receiving and storing the results of the execution of the experiment.
  • 24. The medium of claim 17, wherein the automated environment produces semiconductor technology.
  • 25. A computer-implemented method for managing experiments relating to semiconductor technology, comprising the steps of: (A) receiving an experiment order, the experiment order including at least some pre-planned deviation from a base process capable of operating in an automated environment; (B) obtaining an approval of the experiment order; (C) translating and storing at least a portion of the experiment order into processing data suitable for implementation by said automated environment; and (D) causing the experiment to be executed in conjunction with at least some portion of said base process by the automated environment in accordance with the processing data; (E) wherein the obtaining step further includes the steps of storing data defining the experiment order, distributing the experiment order to a plurality of users, obtaining changes to the experiment order from at least one of the users, and receiving the approval for the experiment order from at least one user; (F) wherein the experiment produces at least one test product and at least one production product; and wherein the processing data includes an indication of the base process, the changes to the base process, and a split-off of a control set; and wherein the split-off of a control set produces the at least one production product according to the base process and the changes to the base process produce the at least one test product.
  • 26. A computer-implemented system for managing experiments relating to semiconductor technology, comprising: (A) an experiment order, the experiment order including at least some pre-planned deviation from a base process capable of operating in an automated environment; (B) an approval of the experiment order, obtained in response to receipt of the experiment order; (C) processing data suitable for implementation by said automated environment, translated from at least a portion of the experiment order; (D) wherein said automated environment causes the experiment to be executed in conjunction with at least some portion of said base process by the automated environment in accordance with the processing data; (E) wherein the approval further includes stored data defining the experiment order, a distribution of the experiment order to a plurality of users, stored changes to the experiment order from at least one of the users, and received approval for the experiment order from at least one user; and (F) wherein the experiment produces at least one test product and at least one production product; and wherein the processing data includes an indication of the base process, the changes to the base process, and a split-off of a control set; and wherein the split-off of a control set produces the at least one production product according to the base process and the changes to the base process produce the at least one test product.
  • 27. The method of claim 1, wherein the processing data is related to at least one of: a change to the base process itself, an addition to the base process, and an omission from the base process.
  • 28. The system of claim 9, wherein the processing data is related to at least one of: a change to the base process itself, an addition to the base process, and an omission from the base process.
  • 29. The medium of claim 17, wherein the processing data is related to at least one of: a change to the base process itself, an addition to the base process, and an omission from the base process.
  • 30. A computer-implemented method for managing experiments relating to automated processing technology, comprising the steps of: (A) receiving an experiment order, the experiment order including at least some pre-planned deviation from a base process capable of operating in an automated environment; (B) translating and storing at least a portion of the experiment order into processing data suitable for implementation by said automated environment; and (C) causing the experiment to be executed in conjunction with at least some portion of said base process by the automated environment, in accordance with said processing data.
  • 31. The method of claim 30, further comprising the step of publishing information indicating a state change of the experiment order, responsive to a document attached to the experiment order or to a change in state of the experiment order.
US Referenced Citations (329)
Number Name Date Kind
3205485 Noltingk Sep 1965 A
3229198 Libby Jan 1966 A
3767900 Chao et al. Oct 1973 A
3920965 Sohrwardy Nov 1975 A
4000458 Miller et al. Dec 1976 A
4207520 Flora et al. Jun 1980 A
4209744 Gerasimov et al. Jun 1980 A
4302721 Urbanek et al. Nov 1981 A
4368510 Anderson Jan 1983 A
4609870 Lale et al. Sep 1986 A
4616308 Morshedi et al. Oct 1986 A
4663703 Axelby et al. May 1987 A
4698766 Entwistle et al. Oct 1987 A
4750141 Judell et al. Jun 1988 A
4755753 Chern Jul 1988 A
4757259 Charpentier Jul 1988 A
4901218 Cornwell Feb 1990 A
4938600 Into Jul 1990 A
4957605 Hurwitt et al. Sep 1990 A
4967381 Lane et al. Oct 1990 A
4974543 Jansen Dec 1990 A
5208765 Turnbull May 1993 A
5220517 Sierk et al. Jun 1993 A
5226118 Baker et al. Jul 1993 A
5231585 Kobayashi et al. Jul 1993 A
5240552 Yu et al. Aug 1993 A
5270222 Moslehi Dec 1993 A
5283141 Yoon et al. Feb 1994 A
5329463 Sierk et al. Jul 1994 A
5338630 Yoon et al. Aug 1994 A
5347446 Iino et al. Sep 1994 A
5369544 Mastrangelo Nov 1994 A
5375064 Bollinger Dec 1994 A
5420796 Weling et al. May 1995 A
5427878 Corliss Jun 1995 A
5444837 Bomans et al. Aug 1995 A
5469361 Moyne Nov 1995 A
5485082 Wisspeintner et al. Jan 1996 A
5495417 Fuduka et al. Feb 1996 A
5497316 Sierk et al. Mar 1996 A
5497381 O'Donoghue et al. Mar 1996 A
5503707 Maung et al. Apr 1996 A
5508947 Sierk et al. Apr 1996 A
5511005 Abbe et al. Apr 1996 A
5519605 Cawlfield May 1996 A
5525808 Irie et al. Jun 1996 A
5526293 Mozumder et al. Jun 1996 A
5534289 Bilder et al. Jul 1996 A
5541510 Danielson Jul 1996 A
5546312 Mozumder et al. Aug 1996 A
5553195 Meijer Sep 1996 A
5586039 Hirsch et al. Dec 1996 A
5599423 Parker et al. Feb 1997 A
5602492 Cresswell et al. Feb 1997 A
5603707 Trombetta et al. Feb 1997 A
5617023 Skalski Apr 1997 A
5621241 Jain Apr 1997 A
5627083 Tounai May 1997 A
5642296 Saxena Jun 1997 A
5646870 Krivokapic et al. Jul 1997 A
5649169 Berezin et al. Jul 1997 A
5654903 Reitman et al. Aug 1997 A
5657254 Sierk et al. Aug 1997 A
5660895 Lee et al. Aug 1997 A
5663797 Sandhu Sep 1997 A
5664987 Renteln Sep 1997 A
5665199 Sahota et al. Sep 1997 A
5665214 Iturralde Sep 1997 A
5666297 Britt et al. Sep 1997 A
5667424 Pan Sep 1997 A
5674787 Zhao et al. Oct 1997 A
5694325 Fukuda et al. Dec 1997 A
5695810 Dubin et al. Dec 1997 A
5719796 Chen Feb 1998 A
5735055 Hochbein et al. Apr 1998 A
5761064 La et al. Jun 1998 A
5761065 Kittler et al. Jun 1998 A
5777901 Berezin et al. Jul 1998 A
5787021 Samaha Jul 1998 A
5787269 Hyodo Jul 1998 A
5812407 Sato et al. Sep 1998 A
5824599 Schacham-Diamand et al. Oct 1998 A
5825356 Habib et al. Oct 1998 A
5825913 Rostami et al. Oct 1998 A
5828778 Hagi et al. Oct 1998 A
5831851 Eastburn et al. Nov 1998 A
5832224 Fehskens et al. Nov 1998 A
5838595 Sullivan et al. Nov 1998 A
5838951 Song Nov 1998 A
5844554 Geller et al. Dec 1998 A
5857258 Penzes et al. Jan 1999 A
5859777 Yokoyama et al. Jan 1999 A
5859964 Wang et al. Jan 1999 A
5862054 Li Jan 1999 A
5863807 Jang et al. Jan 1999 A
5867389 Hamada et al. Feb 1999 A
5870306 Harada Feb 1999 A
5871805 Lemelson Feb 1999 A
5874345 Coronel et al. Feb 1999 A
5889991 Consolatti et al. Mar 1999 A
5901313 Wolf et al. May 1999 A
5903455 Sharpe, Jr. et al. May 1999 A
5910846 Sandhu Jun 1999 A
5912678 Saxena et al. Jun 1999 A
5916016 Bothra Jun 1999 A
5923553 Yi Jul 1999 A
5926690 Toprac et al. Jul 1999 A
5930138 Lin et al. Jul 1999 A
5937323 Orczyk et al. Aug 1999 A
5940300 Ozaki Aug 1999 A
5943237 Van Boxem Aug 1999 A
5943550 Fulford, Jr. et al. Aug 1999 A
5960185 Nguyen Sep 1999 A
5960214 Sharpe, Jr. et al. Sep 1999 A
5961369 Bartels et al. Oct 1999 A
5963881 Kahn et al. Oct 1999 A
5975994 Sandhu et al. Nov 1999 A
5978751 Pence et al. Nov 1999 A
5982920 Tobin, Jr. et al. Nov 1999 A
6002989 Shiba et al. Dec 1999 A
6012048 Gustin et al. Jan 2000 A
6017771 Yang et al. Jan 2000 A
6036349 Gombar Mar 2000 A
6037664 Zhao et al. Mar 2000 A
6041263 Boston et al. Mar 2000 A
6041270 Steffan et al. Mar 2000 A
6059636 Inaba et al. May 2000 A
6064759 Buckley et al. May 2000 A
6072313 Li et al. Jun 2000 A
6074443 Venkatesh et al. Jun 2000 A
6077412 Ting et al. Jun 2000 A
6078845 Friedman Jun 2000 A
6094688 Mellen-Garnett et al. Jul 2000 A
6096649 Jang Aug 2000 A
6097887 Hardikar et al. Aug 2000 A
6100195 Chan et al. Aug 2000 A
6108092 Sandhu Aug 2000 A
6111634 Pecen et al. Aug 2000 A
6112130 Fukuda et al. Aug 2000 A
6113462 Yang Sep 2000 A
6114238 Liao Sep 2000 A
6127263 Parikh Oct 2000 A
6128016 Coelho et al. Oct 2000 A
6136163 Cheung et al. Oct 2000 A
6141660 Bach et al. Oct 2000 A
6143646 Wetzel Nov 2000 A
6148099 Lee et al. Nov 2000 A
6148239 Funk et al. Nov 2000 A
6148246 Kawazome Nov 2000 A
6150270 Matsuda et al. Nov 2000 A
6157864 Schwenke et al. Dec 2000 A
6159075 Zhang Dec 2000 A
6159644 Satoh et al. Dec 2000 A
6161054 Rosenthal et al. Dec 2000 A
6169931 Runnels Jan 2001 B1
6172756 Chalmers et al. Jan 2001 B1
6173240 Sepulveda et al. Jan 2001 B1
6175777 Kim Jan 2001 B1
6178390 Jun Jan 2001 B1
6181013 Liu et al. Jan 2001 B1
6183345 Kamono et al. Feb 2001 B1
6185324 Ishihara et al. Feb 2001 B1
6191864 Sandhu Feb 2001 B1
6192291 Kwon Feb 2001 B1
6197604 Miller et al. Mar 2001 B1
6201208 Wendt et al. Mar 2001 B1
6204165 Ghoshal Mar 2001 B1
6210983 Atchison et al. Apr 2001 B1
6211094 Jun et al. Apr 2001 B1
6212961 Dvir Apr 2001 B1
6214734 Bothra et al. Apr 2001 B1
6217412 Campbell et al. Apr 2001 B1
6217658 Orczyk et al. Apr 2001 B1
6219711 Chari Apr 2001 B1
6222936 Phan et al. Apr 2001 B1
6226563 Lim May 2001 B1
6226792 Goiffon et al. May 2001 B1
6228280 Li et al. May 2001 B1
6230069 Campbell et al. May 2001 B1
6232236 Shan et al. May 2001 B1
6236903 Kim et al. May 2001 B1
6237050 Kim et al. May 2001 B1
6240330 Kurtzberg et al. May 2001 B1
6240331 Yun May 2001 B1
6245581 Bonser et al. Jun 2001 B1
6246972 Klimasauskas Jun 2001 B1
6248602 Bode et al. Jun 2001 B1
6249712 Boiquaye Jun 2001 B1
6252412 Talbot et al. Jun 2001 B1
6253366 Mutschler, III Jun 2001 B1
6259160 Lopatin et al. Jul 2001 B1
6263255 Tan et al. Jul 2001 B1
6268270 Scheid et al. Jul 2001 B1
6271670 Caffey Aug 2001 B1
6276989 Campbell et al. Aug 2001 B1
6277014 Chen et al. Aug 2001 B1
6278899 Piche et al. Aug 2001 B1
6280289 Wiswesser et al. Aug 2001 B1
6281127 Shue Aug 2001 B1
6284622 Campbell et al. Sep 2001 B1
6287879 Gonzales et al. Sep 2001 B1
6290572 Hofmann Sep 2001 B1
6291367 Kelkar Sep 2001 B1
6292708 Allen et al. Sep 2001 B1
6298274 Inoue Oct 2001 B1
6298470 Breiner et al. Oct 2001 B1
6303395 Nulman Oct 2001 B1
6304999 Toprac et al. Oct 2001 B1
6307628 Lu et al. Oct 2001 B1
6314379 Hu et al. Nov 2001 B1
6317643 Dmochowski Nov 2001 B1
6320655 Matsushita et al. Nov 2001 B1
6324481 Atchison et al. Nov 2001 B1
6334807 Lebel et al. Jan 2002 B1
6336841 Chang Jan 2002 B1
6339727 Ladd Jan 2002 B1
6340602 Johnson et al. Jan 2002 B1
6345288 Reed et al. Feb 2002 B1
6345315 Mishra Feb 2002 B1
6346426 Toprac et al. Feb 2002 B1
6355559 Havemann et al. Mar 2002 B1
6360133 Campbell et al. Mar 2002 B1
6360184 Jacquez Mar 2002 B1
6363294 Coronel et al. Mar 2002 B1
6366934 Cheng et al. Apr 2002 B1
6368879 Toprac Apr 2002 B1
6368883 Bode et al. Apr 2002 B1
6368884 Goodwin et al. Apr 2002 B1
6373033 Waard et al. Apr 2002 B1
6379980 Toprac Apr 2002 B1
6381564 Davis et al. Apr 2002 B1
6388253 Su May 2002 B1
6391780 Shih et al. May 2002 B1
6395152 Wang May 2002 B1
6397114 Eryurek et al. May 2002 B1
6400162 Mallory et al. Jun 2002 B1
6405096 Toprac et al. Jun 2002 B1
6405144 Toprac et al. Jun 2002 B1
6417014 Lam et al. Jul 2002 B1
6427093 Toprac Jul 2002 B1
6432728 Tai et al. Aug 2002 B1
6435952 Boyd et al. Aug 2002 B1
6438438 Takagi et al. Aug 2002 B1
6440295 Wang Aug 2002 B1
6442496 Pasadyn et al. Aug 2002 B1
6449524 Miller et al. Sep 2002 B1
6455415 Lopatin et al. Sep 2002 B1
6455937 Cunningham Sep 2002 B1
6465263 Coss, Jr. et al. Oct 2002 B1
6470230 Toprac et al. Oct 2002 B1
6479902 Lopatin et al. Nov 2002 B1
6479990 Mednikov et al. Nov 2002 B2
6482660 Conchieri et al. Nov 2002 B2
6484064 Campbell Nov 2002 B1
6486492 Su Nov 2002 B1
6492281 Song et al. Dec 2002 B1
6495452 Shih Dec 2002 B1
6503839 Gonzales et al. Jan 2003 B2
6515368 Lopatin et al. Feb 2003 B1
6517413 Hu et al. Feb 2003 B1
6517414 Tobin et al. Feb 2003 B1
6528409 Lopatin et al. Mar 2003 B1
6529789 Campbell et al. Mar 2003 B1
6532555 Miller et al. Mar 2003 B1
6535783 Miller et al. Mar 2003 B1
6537912 Agarwal Mar 2003 B1
6540591 Pasadyn et al. Apr 2003 B1
6541401 Herner et al. Apr 2003 B1
6546508 Sonderman et al. Apr 2003 B1
6556881 Miller Apr 2003 B1
6560504 Goodwin et al. May 2003 B1
6563308 Nagano et al. May 2003 B2
6567717 Krivokapic et al. May 2003 B2
6580958 Takano Jun 2003 B1
6587744 Stoddard et al. Jul 2003 B1
6590179 Tanaka et al. Jul 2003 B2
6604012 Cho et al. Aug 2003 B1
6605549 Leu et al. Aug 2003 B2
6607976 Chen et al. Aug 2003 B2
6609946 Tran Aug 2003 B1
6616513 Osterheld Sep 2003 B1
6618692 Takahashi et al. Sep 2003 B2
6624075 Lopatin et al. Sep 2003 B1
6625497 Fairbairn et al. Sep 2003 B2
6630741 Lopatin et al. Oct 2003 B1
6640151 Somekh et al. Oct 2003 B1
6652355 Wiswesser et al. Nov 2003 B2
6660633 Lopatin et al. Dec 2003 B1
6678570 Pasadyn et al. Jan 2004 B1
6708074 Chi et al. Mar 2004 B1
6708075 Sonderman et al. Mar 2004 B2
6725402 Coss, Jr. et al. Apr 2004 B1
6728587 Goldman et al. Apr 2004 B2
6735492 Conrad et al. May 2004 B2
6751518 Sonderman et al. Jun 2004 B1
6774998 Wright et al. Aug 2004 B1
20010001755 Sandhu et al. May 2001 A1
20010003084 Finarov Jun 2001 A1
20010006873 Moore Jul 2001 A1
20010030366 Nakano et al. Oct 2001 A1
20010039462 Mendez et al. Nov 2001 A1
20010040997 Tsap et al. Nov 2001 A1
20010042690 Talieh Nov 2001 A1
20010044667 Nakano et al. Nov 2001 A1
20020032499 Wilson et al. Mar 2002 A1
20020058460 Lee et al. May 2002 A1
20020070126 Sato et al. Jun 2002 A1
20020077031 Johansson et al. Jun 2002 A1
20020081951 Boyd et al. Jun 2002 A1
20020089676 Pecen et al. Jul 2002 A1
20020102853 Li et al. Aug 2002 A1
20020107599 Patel et al. Aug 2002 A1
20020107604 Riley et al. Aug 2002 A1
20020113039 Mok et al. Aug 2002 A1
20020127950 Hirose et al. Sep 2002 A1
20020128805 Goldman et al. Sep 2002 A1
20020149359 Crouzen et al. Oct 2002 A1
20020165636 Hasan Nov 2002 A1
20020183986 Stewart et al. Dec 2002 A1
20020185658 Inoue et al. Dec 2002 A1
20020193899 Shanmugasundram et al. Dec 2002 A1
20020193902 Shanmugasundram et al. Dec 2002 A1
20020197745 Shanmugasundram et al. Dec 2002 A1
20020197934 Paik Dec 2002 A1
20020199082 Shanmugasundram et al. Dec 2002 A1
20030017256 Shimane Jan 2003 A1
20030020909 Adams et al. Jan 2003 A1
20030020928 Ritzdorf et al. Jan 2003 A1
20030154062 Daft et al. Aug 2003 A1
Foreign Referenced Citations (75)
Number Date Country
2050247 Aug 1991 CA
2165847 Aug 1991 CA
2194855 Aug 1991 CA
0 621 522 Oct 1994 EP
0 747 795 Dec 1996 EP
0 869 652 Oct 1998 EP
0 881 040 Dec 1998 EP
0 895 145 Feb 1999 EP
0 910 123 Apr 1999 EP
0 932 194 Jul 1999 EP
0 932 195 Jul 1999 EP
1 066 925 Jan 2001 EP
1 067 757 Jan 2001 EP
1 071 128 Jan 2001 EP
1 083 470 Mar 2001 EP
1 092 505 Apr 2001 EP
1072967 Nov 2001 EP
1 182 526 Feb 2002 EP
2 363 477 Dec 2001 GB
2 365 215 Feb 2002 GB
61-66104 Apr 1986 JP
61-171147 Aug 1986 JP
3-202710 Sep 1991 JP
05-151231 Jun 1993 JP
05-216896 Aug 1993 JP
05-266029 Oct 1993 JP
06-110894 Apr 1994 JP
06-176994 Jun 1994 JP
6-184434 Jul 1994 JP
06-252236 Sep 1994 JP
06-260380 Sep 1994 JP
8-23166 Jan 1996 JP
8-50161 Feb 1996 JP
8-304023 Nov 1996 JP
9-246547 Sep 1997 JP
10-34522 Feb 1998 JP
10-173029 Jun 1998 JP
11-126816 May 1999 JP
11-135601 May 1999 JP
2000-183001 Jun 2000 JP
2001-76982 Mar 2001 JP
2001-284299 Oct 2001 JP
2001-305108 Oct 2001 JP
2002-9030 Jan 2002 JP
2002-343754 Nov 2002 JP
434103 May 2001 TW
436383 May 2001 TW
455938 Sep 2001 TW
455976 Sep 2001 TW
WO 9534866 Dec 1995 WO
WO 9805066 Feb 1998 WO
WO 9845090 Oct 1998 WO
WO 9909371 Feb 1999 WO
WO 9925520 May 1999 WO
WO 9959200 Nov 1999 WO
WO 0000874 Jan 2000 WO
WO 0005759 Feb 2000 WO
WO 0035063 Jun 2000 WO
WO 0054325 Sep 2000 WO
WO 0079355 Dec 2000 WO
WO 0101205 Jan 2001 WO
WO 0111679 Feb 2001 WO
WO 0118623 Mar 2001 WO
WO 0125865 Apr 2001 WO
WO 0133277 May 2001 WO
WO 0133501 May 2001 WO
WO 0152055 Jul 2001 WO
WO 0152319 Jul 2001 WO
WO 0157823 Aug 2001 WO
WO 01080306 Oct 2001 WO
WO 0217150 Feb 2002 WO
WO 0231613 Apr 2002 WO
WO 0231613 Apr 2002 WO
WO 0233737 Apr 2002 WO
WO 02074491 Sep 2002 WO
Related Publications (1)
Number Date Country
20030036815 A1 Feb 2003 US