WO2002052365A2 - Model predictive control (mpc) system using doe based model - Google Patents

Model predictive control (mpc) system using doe based model Download PDF

Info

Publication number
WO2002052365A2
WO2002052365A2 PCT/IL2001/001194 IL0101194W WO02052365A2 WO 2002052365 A2 WO2002052365 A2 WO 2002052365A2 IL 0101194 W IL0101194 W IL 0101194W WO 02052365 A2 WO02052365 A2 WO 02052365A2
Authority
WO
WIPO (PCT)
Prior art keywords
data
model
input space
input
points
Prior art date
Application number
PCT/IL2001/001194
Other languages
French (fr)
Other versions
WO2002052365A3 (en
Inventor
Arnold J. Goldman
Jehuda Hartman
Joseph Fisher
Shlomo Sarel
Original Assignee
Insyst Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Insyst Ltd. filed Critical Insyst Ltd.
Priority to AU2002217391A priority Critical patent/AU2002217391A1/en
Publication of WO2002052365A2 publication Critical patent/WO2002052365A2/en
Publication of WO2002052365A3 publication Critical patent/WO2002052365A3/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/04Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators
    • G05B13/048Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators using a predictor
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B17/00Systems involving the use of models or simulators of said systems
    • G05B17/02Systems involving the use of models or simulators of said systems electric

Definitions

  • the present invention relates to a model predictive control system that uses a statistical model and more particularly but not exclusively to such a
  • DOE Design Of Experiment
  • example is silicon wafer production.
  • a model is essentially an educated guess as to the relationship between an output and one or more system inputs.
  • the model is required to predict the
  • a particularly useful group of prediction methods comprises what are known as empirical prediction methods.
  • empirical prediction methods existing process data, that is to say actually measured inputs and outputs, are utilized to define the model. Different methods use different ways of analyzing the data and incorporating it into a model to arrive at a prediction of an output for any given set of input parameters.
  • data is used herein to refer inter alia to the quantification of any observable parameter regarding the
  • Applicant's previously filed application no. USSN 09/689,884 concerns a manufacturing control system, known as a process output empirical modeler (POEM) that uses an empirical prediction method to provide a model as a basis for APC to operate a process, in particular a factory-based production process.
  • POEM process output empirical modeler
  • the model divides both input and output parameters into discreet sections, builds vectors of all reasonable combinations of the different discrete sections
  • lookup table and used in APC as part of a control process that optimizes the inputs that can be varied, in the light of the inputs that cannot be varied, to arrive at a desired result.
  • Another empirical method that may be used is the method of
  • each input vector should preferably have a statistically significant set of outputs that can be processed to provide a meaningful average output for the given vector.
  • the data to be relied upon may often be user specific, as different
  • the present invention is concerned with the problem of providing a robust model that may allow operation of the system prior to the user having been able to obtain a statistically significant data set.
  • a system for automatic process control of a process having an input space comprising input boundaries comprising: a measurement unit for taking measurements of said process at selected points of said input space,
  • a controller controllably associated with said input space, for selecting said points of said input space such as to maximize information about said input space from a predetermined number of said points, and
  • a regressor for obtaining a predictive model of said process over said input space by regression from said measurements, thereby to provide said
  • said predictive model comprises a first formula describing
  • said points comprise at least input boundaries of said
  • said points comprise further desired points across said input space.
  • said points are definable by a geometric spacing across said input space.
  • said geometric spacing is selectable to give an even spread of points across said input space.
  • said geometric spacing is selectable to cover at least the input boundaries and a center of the input space.
  • said geometric spacing is in accordance with DOE predetermined placing rules.
  • said predictive model is any one of a group comprising a
  • linear formula a linear formula with interaction between inputs
  • quadratic formula a quadratic formula with interaction between inputs
  • said input space is divisible into discrete regions, and wherein said predictive model comprises predicted process outputs associated with each discrete region.
  • said input space is divisible into discrete regions, and
  • said predictive model comprises predicted outputs associated with each discrete region.
  • results for said predicted outputs are producible by said predictive model and obtainable from running said process, said results being interchangeable within said empirical model.
  • a preferred embodiment further comprises an empirical results quantity assessor for interchanging results produced by said predictive model with results obtained from running said process when said results obtained from running said process are assessed to be statistically significant according to at least one predetermined criterion of significance.
  • a preferred embodiment further comprises a prediction quality assessor for interchanging results obtained by running said process with results obtained from said predictive model when a prediction of said predictive model is assessed to diverge significantly from an outcome of said process according to at least one predetermined criterion of significance.
  • the process has an input space and said data generation
  • the preselected points are orthogonally placed in said input space.
  • the preselected points are evenly spaced in said input space.
  • At least some of said preselected points are placed at boundaries and a center of said input space.
  • a preferred embodiment further comprises a step of replacing said generated data with data empirically obtained during the running of the process.
  • the step of replacing said generated data is carried out when said data obtained empirically has reached a threshold of significance according to at least one predetermined significance criterion.
  • a preferred embodiment comprises a further step of reverting to data generated using a data generation formula.
  • said step of reverting is carried out when results predicted by said data-based process model are detected to diverge from empirically
  • a further preferred embodiment uses an evolutionary approach to find an optimal operating region.
  • the embodiment begins operating at a first input
  • Such an embodiment comprises the steps of building a formula for a first input space, obtaining process output data for said first input space,
  • Fig. 1 is a simplified flow diagram of a process for building a useful model to simulate empirical data
  • Fig. 2 is a simplified screen display for use in defining inputs and outputs for preparation of a model in the process of Fig. 1,
  • Fig. 3 is a simplified screen display for use in defining a type of model in the process of Fig. 1,
  • Fig. 4 is a simplified screen display showing a table of experiments that may typically be recommended for building a model in the process of Fig. 1,
  • Fig. 5 is a simplified flow diagram showing the continuation of the process of Fig. 1, and detailing the building of a model for simulating empirical data followed by use of the data for building a model for automatic process control.
  • Fig. 6 is a screen display showing a typical model for simulating
  • Fig. 7 is a typical screen display showing various statistical tools
  • Fig. 8 is a simplified graph showing evolutionary operation of DOE over
  • Figs 9 - 13 are simplified graphs illustrating DOE rules for defining the
  • central composite design and three level two factor central composite design.
  • a process or process step is taken and defined in terms of significant input and output parameters.
  • the parameters are then related using a model type, for example linear, linear with interactions, quadratic, and quadratic with interactions .
  • the user is then encouraged to carry out the recommended experiments and record the results.
  • the results are processed using a mathematical method
  • regression to expand the results from the extremes to cover the entire input space in a meaningful manner.
  • the expanded results are then used as the raw data in an empirical method such as POEM.
  • the empirical method may be used after only a small number of results have been obtained, depending on the number of inputs and the way in which they are related.
  • the generation of a full set of empirical data results with statistically significant data for all sectors of the input space may take a significant length of time.
  • Fig. 1 is a simplified flow diagram showing a procedure for obtaining data suitable for empirical prediction methods, operable in accordance with a first embodiment of the present invention.
  • a process step is first defined in terms of a series of inputs and outputs.
  • An input is given a name, and is defined to be of any one of a number
  • the types may be "measurable", meaning that the input can be
  • API automatic process control
  • the input may be of type "controllable”, meaning that not only can it be measured but that it can be controlled by the APC. The input is then
  • fine length measurements may be
  • Each of the inputs may then be associated with a measurement range.
  • the range is preferably defined in terms of a maximum expected or permitted
  • the input may be associated independently with each of two different output levels. This is for example achievable by associating the input with different weightings for each of the associated outputs.
  • Fig. 2 is a simplified diagram showing the layout of a computer screen for defining a process step as described above.
  • the screen shows definitions being entered for a step, step 1, of a process, process 1.
  • the step comprises a first input, measl, of type "measurable” having units of microns, and a second input, contrl, of type "controllable", having units of angstroms. Lower and upper range limits are not shown.
  • the step comprises two outputs, outl and out2, having units respectively of microns and angstroms, and ranges respectively of 300 microns
  • Table 1 - Typically available model types As shown in table 1, a linear model without interactions is the simplest type of relationship between the inputs and the outputs. The model requires the least amount of experimentation to provide statistically significant data.
  • the recommended number is calculated using predetermined rules based on the selected model type and the number of inputs.
  • the way in which the number of experiments is calculated is part of the DOE procedure and will be described in greater detail at the end of this description with reference to Figures 9 to 13.
  • Fig. 3 shows a generalized screen
  • the recommended number shown is 18.
  • the results are preferably provided as a table, each row representing a different experiment. Such a table is shown in Fig. 4, with spaces for entering output values.
  • the process is preferably carried out for each one of the recommended experiments and the results obtained are entered into the table.
  • Fig. 5 is a simplified flow diagram showing how the data obtained from the experiments described with reference to Fig. 1 may be used to form a lookup table for the POEM empirical method.
  • a mathematical stage of regression is carried out to calculate a formula that describes the process output in terms of the inputs. More precisely, regression involves the taking of the formula of the model type selected previously and deriving coefficients for each of the terms so as best to fit the input data with the observed outputs.
  • Fig. ⁇ . shows a typical series of coefficients that may be generated in this way.
  • the formula may be used to build a full statistical results database by calculating outputs across the whole of the input space.
  • DOE experiments are preferably carried out at least at all of
  • Fig. 7 is a simplified diagram
  • Each of the input ranges is divided into a plurality of discrete regions and the input variable is henceforth described in terms of the discrete regions into which it has been divided.
  • the input space is now describable as a series of n-dimensional vectors which as a whole cover all input combinations.
  • Each vector entry preferably has a corresponding series of results, so that an average can be taken of the corresponding results to produce an average for the vector.
  • Annealing is preferably carried out to improve the precision of the process.
  • the vectors thus produced are incorporated into a lookup table for control of the process and the process is controlled by reference thereto for selection of the best recipe to control the process.
  • Such a best recipe is
  • the actual data may be steadily accumulated into the database or the user may
  • a silicon wafer is sharpened, that is to say an outer layer, perhaps an oxide layer, is removed.
  • the process involves the following input parameters:
  • the process has a single output parameter, namely the thickness of the wafer following processing.
  • the aim of applying the above-described embodiment to the process is to achieve a precise thickness at the end of the process although the relationship between the process's parameters result are initially unknown.
  • a model type is selected.
  • ThicknessAfter 0.2 * ThicknessBefore - 0.09*Temperature +
  • each input variable has a range, which is firstly divided into intervals or sub-ranges, for example:
  • the input space now comprises a series of the possible combinations of
  • Each combination is written as a vector and each of these input vectors defines a finite region of the input space.
  • Table 3 POEM Results Set Using DOE Data
  • every run of the process provides experimental data for collection which is genuinely empirical.
  • the data being collected can be used for improving the prediction ability of the empirical method that is being used.
  • the prediction ability of an empirical model improves as the amount of observed data increases.
  • Table 3 Partially Repeated for Convenient Reference Actual results obtained during running of the process are preferably stored in a separate but corresponding table, exemplified by Table 4 below.
  • the above three sets of values are values which belong to the ⁇ D, A, C ⁇ vector group of table 3 above.
  • all of the results corresponding to each respective input vector are taken and an average or equivalent statistic calculated.
  • the average may be calculated as follows:
  • result of a single process may be unrepresentative, and it is preferable to avoid using questionable, that is not statistically meaningful data in the look up table.
  • the look up table is being used directly to control the process and thus use of
  • an APC is able to switch automatically between DOE data and empirical data. Not only is it able, as described above, to replace DOE data with empirical data when there is statistically significant empirical data to be used, but additionally or alternatively, it is able to detect wandering of the actual process outputs from the predictions of the lookup table. Preferably the amount of wandering is tested for statistical significance. Additionally or alternatively it is tested against a threshold. The threshold may be a statistical threshold. If the process is found to have wandered beyond acceptable limits then the current empirical data may be discarded and the DOE process is begun again. Following the building of a DOE based look up table a new set of empirical data is obtained.
  • alternative DOE and empirical processes are built into an APC device.
  • the device is installed and
  • the embodiment may incorporate automatic return to DOE following significant wandering of actual results from predicted results, as described above.
  • Fig. 8 is a simplified graph of a two- dimensional input region 80, illustrating a mode of using DOE known as evolutionary operation. Two inputs Ii and I 2 define between them a total input space 80. Within the total input space 80, a smaller input region 82 is used in a first set of DOE experiments. The smaller region 82 may have been chosen
  • a reason may be a decision on methodology of searching the input area since carrying out DOE on the total area 80 may not detect, or may not be good at detecting, subtle
  • region 84 may yield results which are better, worse or indifferent. If the results are better then it will be clear that region 84 is a better region within which to run the process than region 82. Furthermore, if there is an improvement in yield when moving in the direction of region 84, then it makes sense to investigate further regions contiguous to region 84. For example, region 86 may be searched. Again, if region 86 produces an improved yield then it makes sense to investigate further regions contiguous to region 86, such as region 88, until no further improvement in the yield is found.
  • Figs. 9 - 13 are graphs of typical input regions for DOE analysis. The graphs illustrate the experiment placing
  • Fig. 9 shows a simple two-input system.
  • the A and B axes represent the
  • n is the number of inputs or factors.
  • the input conditions for each experiment are as defined by its position in the graph.
  • fractional factorial combinations As well as full factorial combinations, it is also possible to use fractional factorial combinations.
  • a fractional value is selected such as Vi, and this enables a significant decrease in the number of experiments at the cost of losing information regarding interactions between the different inputs or factors.
  • Fig. 11 is a graph showing a three level full factorial design for three inputs.
  • the input space, now 3 -dimensional, is represented by a cube 94.
  • a total of 3 3 27 experiments are recommended under evenly distributed input conditions.
  • Fig. 12 is a simplified graph showing what is known as central composite design (CCD). Again, a two-dimensional
  • CCD is efficient for calculating quadratic models
  • DOE thus preferably provides an orthogonal array of points geometrically arranged over the input space.
  • the arrangement may be such as to cover the input space evenly or may use a CCD arrangement. If a boundaries only version such as that of Fig. 9 is used for a linear model, it is recommended to take two central points as well to confirm that the process is in fact linear.
  • DOE In carrying out DOE, it may be borne in mind that the more experiments that are carried out the more accurate the resulting model may be expected to be, on the other hand the longer and more expensive the experimental setup stage becomes. Thus a DOE routine attempts to strike a balance between accuracy and efficiency in selecting the number of experiments. Furthermore the user may choose not to carry out some of the recommended experiments.
  • APC methods using a process model for control, and requiring empirical data to build the model, which data is difficult, expensive or time consuming to obtain, may be fed with
  • Embodiments may gradually or otherwise replace the calculated data with actual empirical data as it becomes available and certain preferred embodiments may revert to existing

Abstract

A system for automatic control of a process, comprising a process control model using data and further comprising a data model for generating data for said process model and an empirical data extractor for extracting data from said process for said model, and wherein said data used by said process model is interchangeable between data obtained by said data model and data obtained by said extractor (Fig.5). The data model may be a partly statistical partly empirical orthogonal process model. The system is useful in allowing control systems using empirical prediction methods to perform automatic control before having built up a results database.

Description

MODEL PREDICTIVE CONTROL (MPC) SYSTEM USING DOE BASED MODEL
Field of the Invention
The present invention relates to a model predictive control system that uses a statistical model and more particularly but not exclusively to such a
system using a Design Of Experiment (DOE) technique to provide data for such a statistical model for example in a manufacturing control system that uses empirical data as part of an automatic process control (APC) model.
Background of the Invention Automatic process control as a means of controlling the conditions under which a process is carried out is well known. For many years, simple and then steadily more complex closed loop control has been introduced. The control loop uses a formula or model to relate a process output to one or more inputs and, as the output varies, feedback is used to alter the inputs to ensure that the output stays on track.
Certain processes, however, require large numbers of variables having complex relationships therebetween to be incorporated into a model for effective control. In particular some of the variables involved may be variables
that are not changeable by a feedback signal, such as the quality of an input product. In such circumstances a fully comprehensive model is difficult to
build. Such a fully comprehensive model may be particularly useful in the event that extremely high quality is required in the resulting product. An
example is silicon wafer production.
A model is essentially an educated guess as to the relationship between an output and one or more system inputs. The model is required to predict the
behavior of the process under different input parameters. Accurate prediction
is required if the process is to be controlled to produce desired results. Thus, methods of deriving a model may be referred to as prediction methods.
A particularly useful group of prediction methods comprises what are known as empirical prediction methods. In empirical prediction methods, existing process data, that is to say actually measured inputs and outputs, are utilized to define the model. Different methods use different ways of analyzing the data and incorporating it into a model to arrive at a prediction of an output for any given set of input parameters. The term "data" is used herein to refer inter alia to the quantification of any observable parameter regarding the
process.
Applicant's previously filed application no. USSN 09/689,884 concerns a manufacturing control system, known as a process output empirical modeler (POEM) that uses an empirical prediction method to provide a model as a basis for APC to operate a process, in particular a factory-based production process.
The model divides both input and output parameters into discreet sections, builds vectors of all reasonable combinations of the different discrete sections
of the input parameters and uses empirical data to associate each of the vectors
with a statistical average of actual outputs corresponding to the given vector. The vectors, with their corresponding results are then placed in the form of a
lookup table and used in APC as part of a control process that optimizes the inputs that can be varied, in the light of the inputs that cannot be varied, to arrive at a desired result.
Another empirical method that may be used is the method of
classification and regression trees, CART. The skilled person will be aware of numerous other methods that make use of empirical information and to which the present considerations are applicable, such as CHAΪD, and Neural Nets.
A disadvantage of the above system, and indeed of any system requiring statistically significant empirical data, is that it requires relatively large amounts of data before it can begin to run effectively. Furthermore, it is not sufficient to have a large quantity of data. It is additionally necessary to have a good scatter of data across the input space. Certain parts of the input space may be utilized only rarely and it may require a very large number of experiments to effectively fill rarely used parts of the input space. In the case of POEM for example, each input vector should preferably have a statistically significant set of outputs that can be processed to provide a meaningful average output for the given vector.
The data to be relied upon may often be user specific, as different
manufacturers, even if making the same product, may often insert their own
proprietary variations to the process, or may use input materials from different
sources, which input materials may behave slightly differently in the process. Manufacturers are not generally willing to provide data sets to their competitors, and system manufacturers generally do not carry out the process
and thus do not have their own independent data sets to sell along with the system.
For all of the above reasons, providers of the system are generally unable to provide meaningful datasets with the systems.
Thus each new purchaser of a system is required to develop his own data set, and until he has done so the system cannot be used effectively. The number of process results required to provide statistically significant coverage of the entire input space is often very high, especially where there are large numbers of parameters involved. Depending on the process, individual experiments may be expensive or time-consuming or both.
Summary of the Invention The present invention is concerned with the problem of providing a robust model that may allow operation of the system prior to the user having been able to obtain a statistically significant data set.
According to a first aspect of the present invention there is provided a system for automatic process control of a process having an input space comprising input boundaries, the system comprising: a measurement unit for taking measurements of said process at selected points of said input space,
a controller, controllably associated with said input space, for selecting said points of said input space such as to maximize information about said input space from a predetermined number of said points, and
a regressor for obtaining a predictive model of said process over said input space by regression from said measurements, thereby to provide said
automatic process control. Preferably, said predictive model comprises a first formula describing
the process.
Preferably, said points comprise at least input boundaries of said
process.
Preferably, said points comprise further desired points across said input space.
Preferably, said points are definable by a geometric spacing across said input space.
Preferably, said geometric spacing is selectable to give an even spread of points across said input space. Preferably, said geometric spacing is selectable to cover at least the input boundaries and a center of the input space.
Preferably, said geometric spacing is in accordance with DOE predetermined placing rules.
Preferably, said predictive model is any one of a group comprising a
linear formula, a linear formula with interaction between inputs, a quadratic formula and a quadratic formula with interaction between inputs.
Preferably, said input space is divisible into discrete regions, and wherein said predictive model comprises predicted process outputs associated with each discrete region.
Preferably, said input space is divisible into discrete regions, and
wherein said predictive model comprises predicted outputs associated with each discrete region.
Preferably, results for said predicted outputs are producible by said predictive model and obtainable from running said process, said results being interchangeable within said empirical model.
A preferred embodiment further comprises an empirical results quantity assessor for interchanging results produced by said predictive model with results obtained from running said process when said results obtained from running said process are assessed to be statistically significant according to at least one predetermined criterion of significance.
A preferred embodiment further comprises a prediction quality assessor for interchanging results obtained by running said process with results obtained from said predictive model when a prediction of said predictive model is assessed to diverge significantly from an outcome of said process according to at least one predetermined criterion of significance.
According to a second aspect of the invention there is provided a method of automatically controlling a process, using a data-based process
model comprising the steps of
generating data for said process model using a data generation formula, and
controlling said process using said generated data in said process model. Preferably, the process has an input space and said data generation
formula is obtained by running said process at preselected points in said input
space.
Preferably, the preselected points are orthogonally placed in said input space.
Preferably, the preselected points are evenly spaced in said input space.
Preferably, at least some of said preselected points are placed at boundaries and a center of said input space.
A preferred embodiment further comprises a step of replacing said generated data with data empirically obtained during the running of the process.
Preferably, the step of replacing said generated data is carried out when said data obtained empirically has reached a threshold of significance according to at least one predetermined significance criterion. A preferred embodiment comprises a further step of reverting to data generated using a data generation formula.
Preferably, said step of reverting is carried out when results predicted by said data-based process model are detected to diverge from empirically
measured process results by an amount exceeding a threshold of significance
according to at least one predetermined significance criterion.
A further preferred embodiment uses an evolutionary approach to find an optimal operating region. The embodiment begins operating at a first input
space, and if unsatisfied with the results achieved finds a further input space. Output results obtained in the second input space are compared with the first
and used to determine whether or not to move to a new operating area or input
space. Such an embodiment comprises the steps of building a formula for a first input space, obtaining process output data for said first input space,
building a formula for a second input space, obtaining process output data for said second input space, comparing said process output data for said second input space with process output data for said first input space, on the basis of said comparison selecting a third input space for obtaining process output data, and operating said process in an optimal one of said input spaces.
It is pointed out that in the present specification the terms "automatic process control" and "advanced process control" are intended to be synonymous.
Brief Description of the Drawings For a better understanding of the invention and to show how the same may be carried into effect, reference will now be made, purely by way of example, to the accompanying drawings.
With specific reference now to the drawings in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative
discussion of the preferred embodiments of the present invention only, and are presented in the cause of providing what is believed to be the most useful and
readily understood description of the principles and conceptual aspects of the
invention. In this regard, no attempt is made to show structural details of the invention in more detail than is necessary for a fundamental understanding of the invention, the description taken with the drawings making apparent to those
skilled in the art how the several forms of the invention may be embodied in practice. In the accompanying drawings:
Fig. 1 is a simplified flow diagram of a process for building a useful model to simulate empirical data, Fig. 2 is a simplified screen display for use in defining inputs and outputs for preparation of a model in the process of Fig. 1,
Fig. 3 is a simplified screen display for use in defining a type of model in the process of Fig. 1,
Fig. 4 is a simplified screen display showing a table of experiments that may typically be recommended for building a model in the process of Fig. 1,
Fig. 5 is a simplified flow diagram showing the continuation of the process of Fig. 1, and detailing the building of a model for simulating empirical data followed by use of the data for building a model for automatic process control. Fig. 6 is a screen display showing a typical model for simulating
empirical data that may be produced by the process of Fig. 5.
Fig. 7 is a typical screen display showing various statistical tools and
data that may be used to study a formula such as that of Fig. 5, Fig. 8 is a simplified graph showing evolutionary operation of DOE over
an input space,
Figs 9 - 13 are simplified graphs illustrating DOE rules for defining the
numbers and contents of experiments, and showing respectively two level two factor, three level two factor, three level three factor, two level two factor
central composite design and three level two factor central composite design.
Description of the Preferred Embodiments
Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of the components set forth in the following description or illustrated in the drawings. The invention is applicable to other embodiments or of being practiced or carried out in various ways.
Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
In the preferred embodiment of the present invention, a process or process step is taken and defined in terms of significant input and output parameters. The parameters are then related using a model type, for example linear, linear with interactions, quadratic, and quadratic with interactions . The
number of parameters plus the model type preferably allows the calculation of how many experiments should be performed. Subsequently the system
suggests input parameters for each of the experiments in such a way that result
data representing the entire spread of the input space may be efficiently obtained. Essentially the process is operated in different combinations of its
extreme operating points for each of the input parameters in such a way as to permit extrapolation across the entire input space.
The user is then encouraged to carry out the recommended experiments and record the results. The results are processed using a mathematical method
called regression to expand the results from the extremes to cover the entire input space in a meaningful manner. The expanded results are then used as the raw data in an empirical method such as POEM.
In this way the empirical method may be used after only a small number of results have been obtained, depending on the number of inputs and the way in which they are related. The generation of a full set of empirical data results with statistically significant data for all sectors of the input space, by contrast, may take a significant length of time.
Reference is now made to Fig. 1, which is a simplified flow diagram showing a procedure for obtaining data suitable for empirical prediction methods, operable in accordance with a first embodiment of the present invention.
In Fig. 1 , a process step is first defined in terms of a series of inputs and outputs. An input is given a name, and is defined to be of any one of a number
of types. The types may be "measurable", meaning that the input can be
measured by the automatic process control (APC) but cannot be altered by it.
Alternatively, the input may be of type "controllable", meaning that not only can it be measured but that it can be controlled by the APC. The input is then
associated with a unit type. For example, fine length measurements may be
defined in terms of angstroms or microns.
Each of the inputs may then be associated with a measurement range. The range is preferably defined in terms of a maximum expected or permitted
level and a minimum expected or permitted level.
If there is more than one output associated with any given input, then the input may be associated independently with each of two different output levels. This is for example achievable by associating the input with different weightings for each of the associated outputs.
Likewise, one or more outputs are defined, again in terms of a measurement unit and a range. The range may be inserted with upper and lower limits as was done with the inputs or alternatively a simple range having a numerical value but not having upper or lower limits may be entered. Reference is now made to Fig. 2, which is a simplified diagram showing the layout of a computer screen for defining a process step as described above. The screen shows definitions being entered for a step, step 1, of a process, process 1. The step comprises a first input, measl, of type "measurable" having units of microns, and a second input, contrl, of type "controllable", having units of angstroms. Lower and upper range limits are not shown.
Likewise, the step comprises two outputs, outl and out2, having units respectively of microns and angstroms, and ranges respectively of 300 microns
and 400 angstroms. Returning now to Fig. 1 , and the step of defining a range for each input and for each output is followed by a step of defining a relationship between the inputs and the outputs. The types of relationships that may typically be available are summarized below in table 1. Other types of relationships are possible, as the skilled person will be aware.
Figure imgf000014_0001
Table 1 - Typically available model types As shown in table 1, a linear model without interactions is the simplest type of relationship between the inputs and the outputs. The model requires the least amount of experimentation to provide statistically significant data. The
most complicated model type shown is the quadratic relationship with interactions. It requires the largest number of experiments in order to obtain sufficient data to determine the model coefficients. The quadratic relationship
with interactions is a particularly preferred mathematical approximation for a typical process and is the model type that is ideally selected when nothing is known about the relationship to be modeled.
In table 1, linear and quadratic models only are shown. It is also possible to use cubic and higher order models should the process to be controlled require it. However, cubic and higher order models are used only rarely in process control.
Following the selection of the most appropriate model type, it is possible to suggest a recommended number of experiments. The recommended number is calculated using predetermined rules based on the selected model type and the number of inputs. The way in which the number of experiments is calculated is part of the DOE procedure and will be described in greater detail at the end of this description with reference to Figures 9 to 13.
Reference is now made to Fig. 3, which shows a generalized screen
display for selecting a model. In the display, the four available model types are shown, and the desired selection is highlighted. Under a heading
"Experiments" is shown a recommended number of experiments that has been
calculated based on the selected model type and the number of inputs defined earlier. In this case, the recommended number shown is 18.
Returning again to Fig. 1 , and the system now recommends input values to be used for each of the recommended experiments. The input levels are
selected so as to be scattered in an effective manner around the whole space. This includes running the process at its extremes for each of the input variables.
The results are preferably provided as a table, each row representing a different experiment. Such a table is shown in Fig. 4, with spaces for entering output values.
The process is preferably carried out for each one of the recommended experiments and the results obtained are entered into the table.
Reference is now made to Fig. 5, which is a simplified flow diagram showing how the data obtained from the experiments described with reference to Fig. 1 may be used to form a lookup table for the POEM empirical method.
In Fig. 5, a mathematical stage of regression is carried out to calculate a formula that describes the process output in terms of the inputs. More precisely, regression involves the taking of the formula of the model type selected previously and deriving coefficients for each of the terms so as best to fit the input data with the observed outputs. Fig. ό.shows a typical series of coefficients that may be generated in this way.
Once the formula is available, it may be used to build a full statistical results database by calculating outputs across the whole of the input space. As
mentioned above, DOE experiments are preferably carried out at least at all of
the extreme points of operation of the process. Thus preferably none of the output calculations involves extrapolation of data outside the area in which
experimentation has been carried out, giving additional validity to the results.
Reference is now briefly made to Fig. 7, which is a simplified diagram
showing statistical data which may be used to verify the quality of the formula obtained. The use of the data shown is apparent to the skilled person and is not
described in further detail.
In the following, the use of the results database for POEM is explained, although it will be appreciated by the reader that the use of the statistical results
database is not restricted thereto, and is particularly applicable to other empirically-based methods such as CART referred to above.
Each of the input ranges is divided into a plurality of discrete regions and the input variable is henceforth described in terms of the discrete regions into which it has been divided. For n input variables, the input space is now describable as a series of n-dimensional vectors which as a whole cover all input combinations. Each vector entry preferably has a corresponding series of results, so that an average can be taken of the corresponding results to produce an average for the vector. Annealing is preferably carried out to improve the precision of the process.
The vectors thus produced are incorporated into a lookup table for control of the process and the process is controlled by reference thereto for selection of the best recipe to control the process. Such a best recipe is
searched for which differs from a current recipe in that the output is more
favorable (meaning closer to the target value), the measurable variables are the same, and only the controllable variables differ.
In a preferred embodiment, once the system begins to operate using data
obtained according to the above procedure, actual process data is obtained.
The actual data may be steadily accumulated into the database or the user may
prefer to wait for a period of time until he has a statistically significant quantity of data
In the following example, use of the invention for improving the yield in a semiconductor manufacture process, is described.
In the process, a silicon wafer is sharpened, that is to say an outer layer, perhaps an oxide layer, is removed.
The process involves the following input parameters:
• The thickness of the wafer before the process starts
• The temperature of the machine while sharpening.
• The pressure within the machine whilst sharpening.
The process has a single output parameter, namely the thickness of the wafer following processing.
The aim of applying the above-described embodiment to the process is to achieve a precise thickness at the end of the process although the relationship between the process's parameters result are initially unknown.
According to the DOE methodology a model type is selected. A number
of experiments is set and input values for each of the experiments are calculated. Then mathematical regression is used to calculate a model, such as the following:
ThicknessAfter = 0.2*ThicknessBefore - 0.09*Temperature +
1.45*Pressure - 38
Using this model we now build a lookup table according to the POEM
algorithm.
In the POEM algorithm each input variable has a range, which is firstly divided into intervals or sub-ranges, for example:
Figure imgf000019_0001
Table 2 Division of Input Ranges Into POEM Discrete Units
The input space now comprises a series of the possible combinations of
the input sub-ranges. Each combination is written as a vector and each of these input vectors defines a finite region of the input space.
For each vector, the model (the formula) is now used to calculate a
corresponding predicted output value of the process.
In applying the model to each vector, preferably a midpoint in the vector is taken to apply values to the formula. A results set as follows may be produced.
Figure imgf000021_0001
Table 3. POEM Results Set Using DOE Data In the wafer example, for the inputs given, the table may contain 4*2*3 = 24 cells in the lookup table. From now on, APC may proceed in the normal way using the POEM methodology as if the vector set represents genuine empirical information.
While using the synthesized data for APC, every run of the process provides experimental data for collection which is genuinely empirical. The data being collected can be used for improving the prediction ability of the empirical method that is being used.
As a rule, the prediction ability of an empirical model improves as the amount of observed data increases.
Updating of the data set from DOE data to genuine empirical data is
shown for purposes of example in conjunction with POEM methodology, but the skilled person will be aware that it may be implemented for any other empirical method.
Returning to the above example of wafer sharpening and as previously mentioned with reference to table 3, a POEM lookup table was created using
data from the DOE formula.
Table 3 is here partly repeated for convenient reference:
Figure imgf000022_0001
Table 3 Partially Repeated for Convenient Reference Actual results obtained during running of the process are preferably stored in a separate but corresponding table, exemplified by Table 4 below.
Figure imgf000023_0001
Table 4 Empirical Results
The above three sets of values are values which belong to the {D, A, C} vector group of table 3 above. In each case, all of the results corresponding to each respective input vector are taken and an average or equivalent statistic calculated. As there are now a number of observed results that belong to the same input vector in the lookup table, it is possible to update the 'output' column belong to that vector to be the average of the respective observed results. In this case the average may be calculated as follows:
193.8 + 192.1 +195 193.6 which differs slightly from the previous
expected output (194.4) obtained using DOE.
In addition to POEM there are many other empirically based mathematical systems that may be used. Furthermore there are numerous methods, in addition to those already described, for incorporating newly
obtained empirical data into the model. For example, when obtaining information, it is possible to enter the data directly into the current lookup
table. Alternatively it is possible to wait until a statistically significant sample has been obtained before altering the look up table. In deciding when to incorporate newly obtained empirical data it should be borne in mind that the
result of a single process may be unrepresentative, and it is preferable to avoid using questionable, that is not statistically meaningful data in the look up table.
The look up table is being used directly to control the process and thus use of
statistically questionable data could, as a worst case, lead to instability in the process being controlled.
In a preferred embodiment of the present invention an APC is able to switch automatically between DOE data and empirical data. Not only is it able, as described above, to replace DOE data with empirical data when there is statistically significant empirical data to be used, but additionally or alternatively, it is able to detect wandering of the actual process outputs from the predictions of the lookup table. Preferably the amount of wandering is tested for statistical significance. Additionally or alternatively it is tested against a threshold. The threshold may be a statistical threshold. If the process is found to have wandered beyond acceptable limits then the current empirical data may be discarded and the DOE process is begun again. Following the building of a DOE based look up table a new set of empirical data is obtained.
In a further embodiment, instead of beginning the DOE process again, a
previously obtained DOE formula is reverted to.
In a further embodiment of the present invention, alternative DOE and empirical processes are built into an APC device. The device is installed and
automatically sets itself to carry out a DOE set of predetermined experiments as described above in an initial learning process. Data obtained from the
formula is then automatically made into a lookup table as described above,
without user intervention and used for APC during a secondary learning process. During the secondary learning process empirical data is obtained, again automatically, and incorporated into the lookup table in one of the ways
described above to replace the DOE data in a final phase in which, preferably, learning continues to occur as the empirically obtained data is continuously updated in the light of more recent results. Additionally, the embodiment may incorporate automatic return to DOE following significant wandering of actual results from predicted results, as described above.
In the above pre-installed embodiment, preferably the process type is known and thus the model type, linear, quadratic etc may be preset. Thus the maximum user intervention that is necessary is preferably arranging the settings for the DOE defined experiments. Reference is now made to Fig. 8, which is a simplified graph of a two- dimensional input region 80, illustrating a mode of using DOE known as evolutionary operation. Two inputs Ii and I2 define between them a total input space 80. Within the total input space 80, a smaller input region 82 is used in a first set of DOE experiments. The smaller region 82 may have been chosen
because it is believed to produce the best results or because it is easiest to run
experiments in this region or because resources for carrying out the
experiments are limited, or for any other reason. In particular, a reason may be a decision on methodology of searching the input area since carrying out DOE on the total area 80 may not detect, or may not be good at detecting, subtle
variations in output in localized parts of the region 80.
DOE results for input region 82 are thus obtained and used in the normal
way. Later on, perhaps because unsatisfactory outputs are achieved, it is then decided to investigate a second, preferably contiguous region 84. The second
region 84 may yield results which are better, worse or indifferent. If the results are better then it will be clear that region 84 is a better region within which to run the process than region 82. Furthermore, if there is an improvement in yield when moving in the direction of region 84, then it makes sense to investigate further regions contiguous to region 84. For example, region 86 may be searched. Again, if region 86 produces an improved yield then it makes sense to investigate further regions contiguous to region 86, such as region 88, until no further improvement in the yield is found.
It will be appreciated that the investigation of contiguous regions is susceptible to ending at a local maximum, and thus in a preferred embodiment investigation is not limited to contiguous regions. A disadvantage of this approach however is in the cost of an increased number of experiments.
Reference is now made to Figs. 9 - 13 which are graphs of typical input regions for DOE analysis. The graphs illustrate the experiment placing
strategies that DOE uses in order to obtain meaningful information about the input space.
Fig. 9 shows a simple two-input system. The A and B axes represent the
two inputs and a square 90 represents the input space that is of practical interest to the experimenters. For each input, experiments, indicated by circles 92, are
carried out for minimum and maximum levels of that input. A total of four experiments is carried out to obtain what is known as a 2-level full factorial
result, that is to say two levels for each input. Reference is now made to Fig. 10, which is the same as Fig. 9 except
that three levels are studied for each one of two inputs to give a three level full factorial result. In general, for k level full factorial the number of experiments needed is
kn, where n is the number of inputs or factors. As will be appreciated, the input conditions for each experiment are as defined by its position in the graph.
As well as full factorial combinations, it is also possible to use fractional factorial combinations. A fractional value is selected such as Vi, and this enables a significant decrease in the number of experiments at the cost of losing information regarding interactions between the different inputs or factors.
Reference is now made to Fig. 11, which is a graph showing a three level full factorial design for three inputs. The input space, now 3 -dimensional, is represented by a cube 94. A total of 33 = 27 experiments are recommended under evenly distributed input conditions.
Reference is now made to Fig. 12, which is a simplified graph showing what is known as central composite design (CCD). Again, a two-dimensional
input space is shown. CCD is efficient for calculating quadratic models, and
comprises taking experimental points 92, calculated according to the full or partial factorial model as required, and adding to this a center point 96 and two radial or star points 98 for each factor.
In a preferred embodiment, instead of taking a single center point 96, two centrally located points are selected.
In Fig. 12 which has two factors, four radial points are taken, and in Fig.
13, which shows the equivalent case for three factors, six radial points 98 are taken.
DOE thus preferably provides an orthogonal array of points geometrically arranged over the input space. The arrangement may be such as to cover the input space evenly or may use a CCD arrangement. If a boundaries only version such as that of Fig. 9 is used for a linear model, it is recommended to take two central points as well to confirm that the process is in fact linear.
In carrying out DOE, it may be borne in mind that the more experiments that are carried out the more accurate the resulting model may be expected to be, on the other hand the longer and more expensive the experimental setup stage becomes. Thus a DOE routine attempts to strike a balance between accuracy and efficiency in selecting the number of experiments. Furthermore the user may choose not to carry out some of the recommended experiments.
Generally, it will still be possible in such a case to generate a model, although accuracy will be lost.
According to the above-described embodiments, APC methods using a process model for control, and requiring empirical data to build the model, which data is difficult, expensive or time consuming to obtain, may be fed with
useful data after a minimal number of experiments in a reduced learning period,
using rigid experimental design techniques such as DOE. Embodiments may gradually or otherwise replace the calculated data with actual empirical data as it becomes available and certain preferred embodiments may revert to existing
or newly obtained DOE data when it becomes apparent that a process being controlled has wandered from an existing process control model.
It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable subcombination.
It will be appreciated by persons skilled in the art that the present invention is not limited to what has been particularly shown and described hereinabove. Rather the scope of the present invention is defined by the appended claims and includes both combinations and subcombinations of the various features described hereinabove as well as variations and modifications thereof which would occur to persons skilled in the art upon reading the foregoing description.

Claims

Claims
1. A system for automatic process control of a process having an
input space comprising input boundaries, the system comprising: a measurement unit for taking measurements of said process at selected
points of said input space, a controller, controllably associated with said input space, for selecting said points of said input space such as to maximize information about said
input space from a predetermined number of said points, and a regressor for obtaining a predictive model of said process over said input space by regression from said measurements, thereby to provide said automatic process control.
2. A system according to claim 1, wherein said predictive model comprises a first formula describing the process.
3. A system according to claim 2, wherein said points comprise at least input boundaries of said process.
4. A system according to claim 3, wherein said points comprise
further desired points across said input space.
5. A system according to claim 4, wherein said points are definable by a geometric spacing across said input space.
6. A system according to claim 5, wherein said geometric spacing is selectable to give an even spread of points across said input space.
7. A system according to claim 5, wherein said geometric spacing is selectable to cover at least the input boundaries and a center of the input space.
8. A system according to claim 5, wherein said geometric spacing is in accordance with DOE predetermined placing rules.
9. A system according to claim 2, wherein said predictive model is any one of a group comprising a linear formula, a linear formula with interaction between inputs, a quadratic formula and a quadratic formula with interaction between inputs.
10. A system according to claim 1, wherein said input space is divisible into discrete regions, and wherein said predictive model comprises predicted process outputs associated with each discrete region.
11. A system according to claim 10, wherein said input space is
divisible into discrete regions, and wherein said predictive model comprises
predicted outputs associated with each discrete region.
12. A system according to claim 11, wherein results for said predicted outputs are producible by said predictive model and obtainable from running said process, said results being interchangeable within said empirical
model.
13. A system according to claim 12, further having an empirical results quantity assessor for interchanging results produced by said predictive model with results obtained from running said process when said results obtained from running said process are assessed to be statistically significant according to at least one predetermined criterion of significance.
14. A system according to claim 12, having a prediction quality assessor for interchanging results obtained by running said process with results obtained from said predictive model when a prediction of said predictive model is assessed to diverge significantly from an outcome of said process according to at least one predetermined criterion of significance.
15. A system for automatic control of a process, comprising a process
model using data and further comprising a data model for generating data for said process model and an empirical data extractor for extracting data from said
process for said model, and wherein said data used by said process model is
interchangeable between data obtained by said data model and data obtained by said extractor.
16. A system according to claim 15, further comprising a prediction quality assessor for interchanging results obtained by said extractor with results obtained from said data model when a prediction of said process model is
assessed to diverge significantly from an outcome of said process according to at least one predetermined criterion of significance.
17. A system according to claim 15, further comprising an empirical results quantity assessor for interchanging results produced by said data model with results obtained by said extractor when results obtained from running said process are assessed to be statistically significant according to at least one predetermined criterion of significance.
18. A system according to claim 15, wherein said process model is a lookup table.
19. A system according to claim 18 wherein said lookup table comprises output values for discrete regions of an input space within which
said process is operable.
20. A system according to claim 15, wherein said data model is a
formula obtainable from outputs of said process associated with geometrically spaced points of an input space within which said process is operable.
21. A system according to claim 20, wherein said formula is any one
of a group comprising a linear formula, a linear formula with interactions, a quadratic formula and a quadratic formula with interactions.
22. A system according to claim 20 wherein said geometrically spaced points are evenly distributable about said input space.
23. A system according to claim 20 wherein said geometrically spaced points comprise points placed on the boundaries of said input space and a point placed at a center of said input space.
24. A method of automatically controlling a process, using a data-
based process model comprising the steps of generating data for said process model using a data generation formula, and controlling said process using said generated data in said process model.
25. A method according to claim 24, wherein said process has an input space and said data generation formula is obtained by running said
process at preselected points in said input space.
26. A method according to claim 25, wherein said preselected points
are orthogonally placed in said input space.
27. A method according to claim 25 wherein said preselected points
are evenly spaced in said input space.
28. A method according to claim 25, wherein at least some of said preselected points are placed at boundaries and a center of said input space.
29. A method according to claim 24, further comprising a step of replacing said generated data with data empirically obtained during the running
of the process.
30. A method according to claim 29, wherein said step of replacing said generated data is carried out when said data obtained empirically has reached a threshold of significance according to at least one predetermined significance criterion.
31. A method according to claim 29 further comprising a step of
reverting to data generated using a data generation formula.
32. A method according to claim 31, wherein said step of reverting is
carried out when results predicted by said data-based process model are detected to diverge from empirically measured process results by an amount
exceeding a threshold of significance according to at least one predetermined
significance criterion.
33. A method according to claim 25, comprising the steps of building a formula for a first input space,
obtaining process output data for said first input space, building a formula for a second input space, obtaining process output data for said second input space, comparing said process output data for said second input space with process output data for said first input space, on the basis of said comparison selecting a third input space for obtaining process output data, and operating said process in an optimal one of said input spaces.
PCT/IL2001/001194 2000-12-26 2001-12-24 Model predictive control (mpc) system using doe based model WO2002052365A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2002217391A AU2002217391A1 (en) 2000-12-26 2001-12-24 Model predictive control (mpc) system using doe based model

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/746,014 US7092863B2 (en) 2000-12-26 2000-12-26 Model predictive control (MPC) system using DOE based model
US09/746,014 2000-12-26

Publications (2)

Publication Number Publication Date
WO2002052365A2 true WO2002052365A2 (en) 2002-07-04
WO2002052365A3 WO2002052365A3 (en) 2002-10-10

Family

ID=24999142

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2001/001194 WO2002052365A2 (en) 2000-12-26 2001-12-24 Model predictive control (mpc) system using doe based model

Country Status (3)

Country Link
US (1) US7092863B2 (en)
AU (1) AU2002217391A1 (en)
WO (1) WO2002052365A2 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110191277A1 (en) * 2008-06-16 2011-08-04 Agundez Dominguez Jose Luis Automatic data mining process control
US8295951B2 (en) 2007-12-21 2012-10-23 The University Of Florida Research Foundation, Inc. Systems and methods for offset-free model predictive control
US8333575B2 (en) 2005-09-24 2012-12-18 Grundfos Management A/S Pump assembly
US8340816B2 (en) 2004-05-19 2012-12-25 Nec Corporation User preference inferring apparatus, user profile inferring apparatus, and robot
CN103310285A (en) * 2013-06-17 2013-09-18 同济大学 Performance prediction method applicable to dynamic scheduling for semiconductor production line
CN104102129A (en) * 2013-04-10 2014-10-15 罗伯特·博世有限公司 Method and device for creating a data-based function model

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6708074B1 (en) 2000-08-11 2004-03-16 Applied Materials, Inc. Generic interface builder
US7188142B2 (en) 2000-11-30 2007-03-06 Applied Materials, Inc. Dynamic subject information generation in message services of distributed object systems in a semiconductor assembly line facility
US7698012B2 (en) 2001-06-19 2010-04-13 Applied Materials, Inc. Dynamic metrology schemes and sampling schemes for advanced process control in semiconductor processing
US7160739B2 (en) 2001-06-19 2007-01-09 Applied Materials, Inc. Feedback control of a chemical mechanical polishing device providing manipulation of removal rate profiles
US7050950B2 (en) * 2001-11-08 2006-05-23 General Electric Company System, method and computer product for incremental improvement of algorithm performance during algorithm development
US20030199112A1 (en) 2002-03-22 2003-10-23 Applied Materials, Inc. Copper wiring module control
US7668702B2 (en) * 2002-07-19 2010-02-23 Applied Materials, Inc. Method, system and medium for controlling manufacturing process using adaptive models based on empirical data
WO2004046835A2 (en) 2002-11-15 2004-06-03 Applied Materials, Inc. Method, system and medium for controlling manufacture process having multivariate input parameters
US20060106637A1 (en) * 2003-01-09 2006-05-18 General Electric Company Business system decisioning framework
US20060111931A1 (en) * 2003-01-09 2006-05-25 General Electric Company Method for the use of and interaction with business system transfer functions
US7333871B2 (en) * 2003-01-21 2008-02-19 Applied Materials, Inc. Automated design and execution of experiments with integrated model creation for semiconductor manufacturing tools
US8036921B2 (en) * 2004-09-16 2011-10-11 International Business Machines Corporation System and method for optimization process repeatability in an on-demand computing environment
US7502715B1 (en) * 2004-09-21 2009-03-10 Asml Netherlands B.V Observability in metrology measurements
US20060079983A1 (en) * 2004-10-13 2006-04-13 Tokyo Electron Limited R2R controller to automate the data collection during a DOE
US7617171B2 (en) * 2005-04-14 2009-11-10 Intercim Process for the iterative construction of an explanatory model
US20070094072A1 (en) * 2005-10-26 2007-04-26 Etica Entertainment, Inc., Dba Position Research Apparatus and method of identifying critical factors in a pay-for-performance advertising network
US7660642B1 (en) 2005-11-04 2010-02-09 Tuszynski Steve W Dynamic control system for manufacturing processes
US20080031433A1 (en) * 2006-08-04 2008-02-07 Dustin Kenneth Sapp System and method for telecommunication audience configuration and handling
US20090228293A1 (en) * 2008-03-10 2009-09-10 Xerox Corporation Minimum correlation design of experiment run order
US7987145B2 (en) * 2008-03-19 2011-07-26 Honeywell Internationa Target trajectory generator for predictive control of nonlinear systems using extended Kalman filter
US7961351B2 (en) * 2008-04-02 2011-06-14 Xerox Corporation Methodology for developing color models and printer sensitivity functions for spot colors and profiles
US8155764B2 (en) * 2009-02-27 2012-04-10 Honeywell International Inc. Multivariable model predictive control for coalbed gas production
CN102830442B (en) * 2012-08-04 2015-09-02 中国矿业大学(北京) A kind of potential coefficient partition method of prediction Coalbed Methane Productivity
US10606254B2 (en) * 2016-09-14 2020-03-31 Emerson Process Management Power & Water Solutions, Inc. Method for improving process/equipment fault diagnosis
JP6778666B2 (en) * 2017-08-24 2020-11-04 株式会社日立製作所 Search device and search method
US11182666B1 (en) * 2017-11-07 2021-11-23 Amazon Technologies, Inc. Artificial neural network architecture based on lookup table
US11761969B2 (en) * 2020-01-21 2023-09-19 Kla Corporation System and method for analyzing a sample with a dynamic recipe based on iterative experimentation and feedback

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5740033A (en) * 1992-10-13 1998-04-14 The Dow Chemical Company Model predictive controller
US5949678A (en) * 1993-12-22 1999-09-07 Telefonaktiebolaget Lm Ericsson Method for monitoring multivariate processes
US20010049595A1 (en) * 2000-04-05 2001-12-06 Plumer Edward Stanley System and method for enterprise modeling, optimization and control

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5251285A (en) * 1988-03-25 1993-10-05 Hitachi, Ltd. Method and system for process control with complex inference mechanism using qualitative and quantitative reasoning
US4970658A (en) * 1989-02-16 1990-11-13 Tesseract Corporation Knowledge engineering tool
US5212765A (en) * 1990-08-03 1993-05-18 E. I. Du Pont De Nemours & Co., Inc. On-line training neural network system for process control
US5121467A (en) * 1990-08-03 1992-06-09 E.I. Du Pont De Nemours & Co., Inc. Neural network/expert system process control system and method
US5282261A (en) * 1990-08-03 1994-01-25 E. I. Du Pont De Nemours And Co., Inc. Neural network process measurement and control
US5325466A (en) * 1992-05-07 1994-06-28 Perceptive Decision Systems, Inc. System for extracting knowledge of typicality and exceptionality from a database of case records
US5483468A (en) * 1992-10-23 1996-01-09 International Business Machines Corporation System and method for concurrent recording and displaying of system performance data
US5546507A (en) * 1993-08-20 1996-08-13 Unisys Corporation Apparatus and method for generating a knowledge base
US5479340A (en) * 1993-09-20 1995-12-26 Sematech, Inc. Real time control of plasma etch utilizing multivariate statistical analysis
US5440478A (en) * 1994-02-22 1995-08-08 Mercer Forge Company Process control method for improving manufacturing operations
US6249712B1 (en) * 1995-09-26 2001-06-19 William J. N-O. Boiquaye Adaptive control process and system
US5691895A (en) * 1995-12-18 1997-11-25 International Business Machines Corporation Mechanism and architecture for manufacturing control and optimization
US5710700A (en) * 1995-12-18 1998-01-20 International Business Machines Corporation Optimizing functional operation in manufacturing control
JP3956057B2 (en) * 1996-01-31 2007-08-08 エイエスエム アメリカ インコーポレイテッド Model reference predictive control of heat treatment
US5781430A (en) * 1996-06-27 1998-07-14 International Business Machines Corporation Optimization method and system having multiple inputs and multiple output-responses
US5787425A (en) * 1996-10-01 1998-07-28 International Business Machines Corporation Object-oriented data mining framework mechanism
US6304836B1 (en) * 1996-10-28 2001-10-16 Advanced Micro Devices Worst case design parameter extraction for logic technologies
US5875285A (en) * 1996-11-22 1999-02-23 Chang; Hou-Mei Henry Object-oriented data mining and decision making system
US5862054A (en) * 1997-02-20 1999-01-19 Taiwan Semiconductor Manufacturing Company, Ltd. Process monitoring system for real time statistical process control
US6134555A (en) * 1997-03-10 2000-10-17 International Business Machines Corporation Dimension reduction using association rules for data mining application
US6032146A (en) * 1997-10-21 2000-02-29 International Business Machines Corporation Dimension reduction for data mining application
US6263255B1 (en) * 1998-05-18 2001-07-17 Advanced Micro Devices, Inc. Advanced process control for semiconductor manufacturing
US6381564B1 (en) * 1998-05-28 2002-04-30 Texas Instruments Incorporated Method and system for using response-surface methodologies to determine optimal tuning parameters for complex simulators
NL1009376C1 (en) * 1998-06-11 1998-07-06 Boardwalk Ag Data system for providing relationship patterns between people.
US6230069B1 (en) 1998-06-26 2001-05-08 Advanced Micro Devices, Inc. System and method for controlling the manufacture of discrete parts in semiconductor fabrication using model predictive control
US6532454B1 (en) * 1998-09-24 2003-03-11 Paul J. Werbos Stable adaptive control using critic designs
US6240329B1 (en) * 1998-11-09 2001-05-29 Chin-Yang Sun Method and apparatus for a semiconductor wafer inspection system using a knowledge-based system
US6546522B1 (en) * 1999-08-06 2003-04-08 United Microelectronics Corp. Signal-to-noise ratio optimization of multiple-response design-of-experiment
US6725112B1 (en) * 1999-10-29 2004-04-20 General Electric Company Method, system and storage medium for optimizing a product design
US6820070B2 (en) * 2000-06-07 2004-11-16 Insyst Ltd. Method and tool for data mining in automatic decision making systems
IL159332A0 (en) * 1999-10-31 2004-06-01 Insyst Ltd A knowledge-engineering protocol-suite
US6766205B1 (en) * 2000-06-15 2004-07-20 General Electric Company Method, system and storage medium for providing network based optimization tools
US6766283B1 (en) * 2000-10-13 2004-07-20 Insyst Ltd. System and method for monitoring process quality control

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5740033A (en) * 1992-10-13 1998-04-14 The Dow Chemical Company Model predictive controller
US5949678A (en) * 1993-12-22 1999-09-07 Telefonaktiebolaget Lm Ericsson Method for monitoring multivariate processes
US20010049595A1 (en) * 2000-04-05 2001-12-06 Plumer Edward Stanley System and method for enterprise modeling, optimization and control

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8340816B2 (en) 2004-05-19 2012-12-25 Nec Corporation User preference inferring apparatus, user profile inferring apparatus, and robot
US8333575B2 (en) 2005-09-24 2012-12-18 Grundfos Management A/S Pump assembly
US8295951B2 (en) 2007-12-21 2012-10-23 The University Of Florida Research Foundation, Inc. Systems and methods for offset-free model predictive control
US20110191277A1 (en) * 2008-06-16 2011-08-04 Agundez Dominguez Jose Luis Automatic data mining process control
CN104102129A (en) * 2013-04-10 2014-10-15 罗伯特·博世有限公司 Method and device for creating a data-based function model
CN103310285A (en) * 2013-06-17 2013-09-18 同济大学 Performance prediction method applicable to dynamic scheduling for semiconductor production line

Also Published As

Publication number Publication date
US7092863B2 (en) 2006-08-15
US20020128805A1 (en) 2002-09-12
AU2002217391A1 (en) 2002-07-08
WO2002052365A3 (en) 2002-10-10

Similar Documents

Publication Publication Date Title
US7092863B2 (en) Model predictive control (MPC) system using DOE based model
Song et al. A general framework for multi-fidelity bayesian optimization with gaussian processes
Jamshidi et al. Learning to sample: Exploiting similarities across environments to learn performance models for configurable systems
KR102144373B1 (en) Search apparatus and search method
KR102139358B1 (en) Process control method using machine learning-based platform, computer program medium for performing same, and process control appratus
US20060010089A1 (en) Hybrid neural network generation system and method
US11619926B2 (en) Information processing device, program, process treatment executing device, and information processing system
US20030171829A1 (en) System and method for complex process optimization and control
EP1400905A1 (en) Method and apparatus for adaptively determining weight factors within the context of an objective function
Covas et al. An optimization approach to practical problems in plasticating single screw extrusion
US20050049913A1 (en) Method and apparatus for automated feature selection
JP2009151383A (en) Analyzer for analyzing relation between operation and quality in production process, analytical method, program, and computer-readable recording medium
JP2005519394A (en) Automatic experiment planning method and system
CN113169044A (en) Normative analysis in highly collinear response space
Salmasnia et al. A robust intelligent framework for multiple response statistical optimization problems based on artificial neural network and Taguchi method
JP4698578B2 (en) Methods and articles for detecting, verifying, and repairing collinearity
Santos et al. Multi-objective iterated local search based on decomposition for job scheduling problems with machine deterioration effect
US20200052635A1 (en) Method for searching excitation signal of motor, and electronic device
Thamarai et al. An evolutionary computation approach for project selection in analogy based software effort estimation
JP5125875B2 (en) PID controller tuning apparatus, PID controller tuning program, and PID controller tuning method
Tesser et al. Selecting efficient VM types to train deep learning models on Amazon SageMaker
JP7188950B2 (en) Data processing method and data processing program
Rigoni et al. Metamodels for fast multi-objective optimization: trading off global exploration and local exploitation
KR102454317B1 (en) Augmenting virtual users and items in collaborative filtering for addressing cold start problems
KR102531077B1 (en) Search device, search program and plasma treatment device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ CZ DE DE DK DK DM DZ EC EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ CZ DE DE DK DK DM DZ EC EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP