US7603328B2 - Dual-phase virtual metrology method - Google Patents

Dual-phase virtual metrology method Download PDF

Info

Publication number
US7603328B2
US7603328B2 US11/879,562 US87956207A US7603328B2 US 7603328 B2 US7603328 B2 US 7603328B2 US 87956207 A US87956207 A US 87956207A US 7603328 B2 US7603328 B2 US 7603328B2
Authority
US
United States
Prior art keywords
phase
process data
model
conjecture
workpiece
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/879,562
Other versions
US20080306625A1 (en
Inventor
Fan-Tien Cheng
Hsien-Cheng Huang
Chi-An Kao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National Cheng Kung University NCKU
Original Assignee
National Cheng Kung University NCKU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National Cheng Kung University NCKU filed Critical National Cheng Kung University NCKU
Assigned to NATIONAL CHENG KUNG UNIVERSITY reassignment NATIONAL CHENG KUNG UNIVERSITY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHENG, FAN-TIEN, HUANG, HSIEN-CHENG, KAO, CHI-AN
Assigned to NATIONAL CHENG KUNG UNIVERSITY reassignment NATIONAL CHENG KUNG UNIVERSITY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KAO, CHI-AN, CHENG, FAN-TIEN, HUANG, HSIEN-CHENG
Publication of US20080306625A1 publication Critical patent/US20080306625A1/en
Application granted granted Critical
Publication of US7603328B2 publication Critical patent/US7603328B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/41875Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by quality surveillance of production
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L22/00Testing or measuring during manufacture or treatment; Reliability measurements, i.e. testing of parts without further processing to modify the parts as such; Structural arrangements therefor
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/32Operator till task planning
    • G05B2219/32191Real time statistical process monitoring
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/32Operator till task planning
    • G05B2219/32195Feedforward quality control
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/32Operator till task planning
    • G05B2219/32206Selection from a lot of workpieces to be inspected
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/37Measurements
    • G05B2219/37224Inspect wafer
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present invention relates to a virtual metrology (VM) method. More particularly, the present invention relates to a dual-phase virtual metrology method having promptness and accuracy.
  • VM virtual metrology
  • R2R control is the technique of modifying recipe parameters or the selection of control parameters between runs to improve processing performance.
  • a run can be a batch, a lot, or an individual workpiece.
  • a workpiece may represent a wafer for the semiconductor industry or a glass for the TFT-LCD industry.
  • L2L control is applied, only a single workpiece in the lot is required to be measured for feedback and feedforward control purposes. However, as device dimension shrinks further, tighter process control is needed.
  • L2L control may not be accurate enough and workpiece-to-workpiece (W2W) control becomes essential for critical stages. As such, each workpiece in the lot should be measured. To accomplish this requirement, large amounts of metrology tools will be required and production cycle time will also be increased significantly. Furthermore, metrology delays, which are inevitable when real measurements are performed, will cause complicated control problems and degrade the APC performance.
  • One aspect of the present invention is to provide a dual-phase virtual metrology method for providing dual-phase metrology values to meet the requirements of promptness and accuracy simultaneously.
  • a dual-phase virtual metrology method in the dual-phase virtual metrology method, at first, a plurality of sets of historical process data belonging to a production equipment are obtained, and a plurality of historical measurement values from a measurement equipment are obtained, wherein the historical measurement values are the measurement values of the workpieces which are manufactured in accordance with the sets of historical process data, respectively. Thereafter, a first conjecture model is established by using the sets of historical process data and the historical measurement values, wherein the first conjecture model is built in accordance with a conjecture algorithm, wherein the conjecture algorithm can be such as a multi-regression algorithm, a neural network (NN) algorithm, or any other prediction algorithm.
  • the conjecture algorithm can be such as a multi-regression algorithm, a neural network (NN) algorithm, or any other prediction algorithm.
  • a first reference model is established by using the aforementioned sets of historical process data and the aforementioned historical measurement values, wherein the first reference model is built in accordance with a reference algorithm, and the reference algorithm is different from the aforementioned conjecture algorithm, and can be such as a multi-regression algorithm, a neural network algorithm, or any other prediction algorithm.
  • a first statistical distance model is established by using the aforementioned sets of historical process data in accordance with a statistical distance algorithm, wherein the statistical distance algorithm can be such as a Mahalanobis distance algorithm.
  • the dual-phase virtual metrology method proceeds to waiting for collecting the process data of a plurality of workpieces from the production equipment.
  • a phase-one conjecture step is promptly performed.
  • the process data of the certain workpiece is inputted into the first conjecture model, thereby computing a phase-one virtual metrology value (VM I ) for meeting the requirement of promptness.
  • the process data of the certain workpiece is inputted into the first reference model, thereby computing a first reference prediction value.
  • the overlap area between the statistical distribution of the phase-one virtual metrology value of the certain workpiece and the statistical distribution of the first reference prediction value is calculated, thereby generating the reliance index (RI) of the phase-one virtual metrology value of the certain workpiece, wherein the reliance index is higher when the overlap area is larger, representing that the reliance level of the phase-one virtual metrology value corresponding thereto is higher.
  • the process data of the certain workpiece obtained from the production equipment is also inputted into the first statistical distance model, thereby computing the global similarity index (GSI) for the process data corresponding to the phase-one virtual metrology value of the certain workpiece.
  • GSI global similarity index
  • a production system will select one workpiece (a selected workpiece) in each cassette, and send the selected workpiece to the measurement equipment for measurement; for example, one of 25 wafers contained in a cassette is selected for spot testing.
  • the actual measurement value of the selected workpiece is obtained from the measurement equipment, a phase-two conjecture step is performed.
  • the process data and actual measurement value of the selected workpiece is added to the aforementioned sets of historical process data and the historical measurement values to retrain the first conjecture model and the first reference model; or the process data and actual measurement value of the selected workpiece is used to tune the first conjecture model and the first reference model, thereby turning the first conjecture model and the first reference model into a second conjecture model and a second reference model.
  • the process data of all the workpieces in the cassette belonging to the selected workpiece is inputted into the second conjecture model and the second reference model, thereby re-computing a phase-two virtual metrology value (VM II ) and a second reference prediction value of each workpiece in the cassette.
  • VM II phase-two virtual metrology value
  • the overlap area between the statistical distribution of the phase-two virtual metrology value of each workpiece in the aforementioned cassette and the statistical distribution of the second reference prediction value is calculated, thereby generating the reliance index of the phase-two virtual metrology value of each workpiece in the cassette, wherein the reliance index is higher when the overlap area is larger, representing that the reliance level of the phase-two virtual metrology value corresponding thereto is higher.
  • the phase-two virtual metrology value re-calculated herein is more accurate than the phase-one virtual metrology value previously calculated, thus meeting the requirement of accuracy.
  • the first conjecture model and the first reference model can be updated with the second conjecture model and the second reference model for computing the phase-one virtual metrology value with its reliance index of the workpiece subsequently manufactured by the production equipment.
  • the process data of the selected workpiece is added to the sets of historical process data to retrain the first statistical distance mode; or the process data of the selected workpiece is used to tune the first statistical distance model, thereby turning the first statistical distance model into a second statistical distance model.
  • the process data of all the workpieces in the cassette belonging to the selected workpiece is inputted into the second statistical distance model, thereby re-computing the global similarity index for the process data corresponding to the phase-two virtual metrology value of each workpiece in the cassette.
  • the first statistical distance model is updated with the second statistical distance model for computing the global similarity index of the process data corresponding to the phase-one virtual metrology value of the workpiece subsequently manufactured by the production equipment.
  • a process data preprocessing step is performed for deleting all the anomalous process data and selecting important parameters from the process data of each of the workpieces obtained from the production equipment.
  • a metrology data preprocessing step is performed for filtering out anomalous data in the actual measurement value of the selected workpiece.
  • the scheme for determining if the conjecture model, the reference model and the statistical distance model need retraining or tuning is based on that: when the production equipment has been idled for a predetermined period of time or an instruction of manual activation is issued, then those models need retraining, otherwise tuning is executed.
  • dual-phase virtual metrology values and their reliance indexes and global similarity indexes are provided for having the features of promptness and accuracy, thus meeting the requirements of W2W control.
  • FIG. 1 is a schematic block diagram showing a dual-phase virtual metrology system according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram for defining the reliance index (RI) according to the embodiment of the present invention
  • FIG. 3 is a schematic diagram for defining the RI threshold (RI T ) according to the embodiment of the present invention.
  • FIG. 4 is a schematic flow chart of a dual-phase virtual metrology conjecture algorithm according to the embodiment of the present invention.
  • FIG. 5 is a schematic diagram showing a R2R control system to which the phase-one virtual metrology values and the phase-two virtual metrology values obtained from the embodiment of the present invention are applied;
  • FIG. 6 is a schematic diagram showing the results of the phase-one virtual metrology values and phase-two virtual metrology values compared to the actual measurement values according to the application of the embodiment of the present invention.
  • FIG. 1 is a schematic block diagram showing a dual-phase virtual metrology system according to an embodiment of the present invention.
  • the dual-phase virtual metrology system 90 of this embodiment comprises a process data preprocessing module 10 , a metrology data preprocessing module 12 , a conjecture model 60 , a reliance index (RI) module 40 and a similarity index (SI) module 50 .
  • the data preprocessing module 10 processes and standardizes raw process data from a piece of production equipment 20 , and selects important parameters from all of the original parameters in process data so as to prevent unimportant parameters from affecting the prediction accuracy.
  • the metrology data preprocessing module 12 process the measurement values from a piece of measurement equipment 30 for filtering out anomalous data therein.
  • the conjecture model 60 uses a dual-phase algorithm 62 and a conjecture algorithm to conjecture phase-one virtual metrology values (VM I ) and phase-two virtual metrology values (VM II ) for a plurality of workpieces (not labeled) in a cassette 80 .
  • the conjecture algorithm can be selected from various prediction algorithms such as a multi-regression algorithm and a neural network algorithm.
  • the reliance index module 40 generates the RI value to estimate the reliance levels of the phase-one and phase-two virtual metrology values (VM I and VM II ).
  • the similarity index module 50 calculates a global similarity index for evaluating the degree of similarity between the input-set process data and all of the sets of historical process data in the conjecture model 60 for training and building the conjecture model, wherein the global similarity index is used for assisting the reliance index in gauging the degree of reliance of the virtual metrology system.
  • a plurality of sets of process data (historical process data) obtained from the production equipment 20 and quality measurement data (historical measurement values) obtained from the measurement equipment 30 are transmitted respectively to the process data preprocessing module 10 and the metrology data preprocessing module 12 for data preprocessing. These preprocessed and standardized process data and quality measurement data are the input data required by the conjecture model 60 . Thereafter, the sets of historical process data and the historical measurement values corresponding thereto are used to train (establish) the conjecture model 60 , such as a neural network (NN) conjecture model.
  • NN neural network
  • the conjecture model 60 has a dual-phase algorithm 62 used for computing the phase-one and phase-two virtual metrology values (VM I and VM II ) with their reliance indexes (RIs) and global similarity indexes (GSIs).
  • RIs indexes
  • GSIs global similarity indexes
  • (m ⁇ n) sets of process data in actual production were also collected, but no actual measurement values are available besides y n+1 . That is, only the first among (m ⁇ n) pieces of the products is selected and actually measured. In the current manufacturing practice, the actual measurement value y n+1 obtained is used to infer and evaluate the quality of the (m ⁇ n ⁇ 1) pieces of the products.
  • y 1 , y 2 , . . . , y n are historical measurement values
  • y n+1 is the actual measurement value of the first piece of the products being manufactured.
  • Their standardized values also called z scores
  • Z y 1 , Z y 2 , . . . , Z y n are thus derived, where each z score has mean zero and standard deviation one, namely Z y i ⁇ N(0, 1).
  • a corresponding Z y i close to 0 indicates that the actual measurement value approaches the central value of the specification.
  • the equations for standardization are listed as follows:
  • the explanation herein adopts a neural-network (NN) algorithm as the conjecture algorithm for establishing the conjecture model performing virtual measurement, and uses such as a multi-regression (MR) algorithm to be the reference algorithm for establishing the reference model that serves as a comparison base for the conjecture model.
  • NN neural-network
  • MR multi-regression
  • the present invention can also apply other algorithms to be the conjecture algorithm or the reference algorithm, provided the reference algorithm differs from the conjecture algorithm, such as a time series algorithm and other related algorithms, and thus the present invention is not limited thereto.
  • the RI is designed to gauge the reliance level of the virtual metrology value.
  • the RI thus should consider the degree of similarity between the statistical distribution Z ⁇ Ni of the virtual metrology value and the statistical distribution Z y i of the actual measurement value.
  • no actual measurement value can be used to verify the trustworthiness of the virtual metrology value. (Notably, virtual metrology becomes unnecessary if actual measurement values are obtained.)
  • the present invention adopts the statistical distribution Z ⁇ ri estimated by the reference algorithm which is such as the MR algorithm to replace Z y i .
  • the reference algorithm also can be such as a time-series algorithm and other related algorithms, and thus the present invention is not limited thereto.
  • FIG. 2 is a schematic diagram for explaining the reliance index (RI) according to the preferred embodiment of the present invention.
  • the RI of the present invention is defined as the intersection-area value (overlap area A) between the statistical distribution Z ⁇ Ni of the virtual metrology value from the conjecture model (built by such as the NN algorithm) and the statistical distribution Z ⁇ ri of the reference prediction value from the reference model (built by such as the MR algorithm).
  • overlap area A the intersection-area value between the statistical distribution Z ⁇ Ni of the virtual metrology value from the conjecture model (built by such as the NN algorithm) and the statistical distribution Z ⁇ ri of the reference prediction value from the reference model (built by such as the MR algorithm).
  • the RI equation is listed below:
  • the RI increases with increasing overlap area A. This phenomenon indicates that the result obtained using the conjecture model is closer to that obtained from the reference model, and thus the corresponding virtual metrology value is more reliable. Otherwise, the reliability of the corresponding measurement value reduces with decreasing RI.
  • the RI value equals 1; and, when those two distributions are almost separate, the RI value approaches 0.
  • Z ⁇ N is the mean of the standardized virtual metrology values.
  • each virtual metrology value can be derived by calculating the intersection area value (overlap area A).
  • the RI threshold value (RI T ) must be defined. If RI>RI T , then the reliance level of the virtual metrology value is acceptable. A systematic approach for determining the RI T is described below.
  • the error of the virtual metrology value is an absolute percentage of the difference between the actual measurement value y i and ⁇ Ni obtained from the NN conjecture model divided by the mean of all the actual measurement values, y , namely
  • RI T is defined as the RI value corresponding to the E L , as shown in FIG. 3 . That is
  • GAI Global Similarity Indexes
  • GSI global similarity index
  • the GSI assesses the degree of similarity between any set of process data and the model set of process data.
  • This model set is derived from all of the sets of historical process data used for building the conjecture model.
  • the present invention may utilize a statistical distance measure, such as Mahalanobis distance, to quantify the degree of similarity.
  • Mahalanobis distance is a distance measure introduced by P.C. Mahalanobis in 1936. This measure is based on correlation between variables to identify and analyze different patterns of sample sets. Mahalanobis distance is a useful way of determining similarity of an unknown sample set to a known one. This method considers the correlation of the data set and is scale-invariant, namely it is not dependent on the scale of measurements. If the data set has high similarity, the calculated Mahalanobis distance calculated will be relatively small.
  • the present invention uses the calculated GSI (applying Mahalanobis distance) size to determine whether the newly input set of process data is similar to the model set of process data. If the calculated GSI is small, the newly input set is relatively similar to the model set. Thus the virtual metrology value of the newly input (high-similarity) set is relatively accurate. On the contrary, if the calculated GSI is too large, the newly input set is somewhat different from the model set. Consequently, the virtual metrology value estimated in accordance with the newly input (low-similarity) set has low reliance level in terms of accuracy.
  • GSI applying Mahalanobis distance
  • Equations (5), (6) and (7) The equations to calculate the standardized process data Z x i,j of the conjecture model are shown in equations (5), (6) and (7).
  • all of the elements in Z M [Z M,1 , Z M,2 , . . . , Z M,p ] T are 0.
  • the correlation coefficients between the standardized model parameters are calculated.
  • the matrix of correlation coefficients can be obtained as
  • the equation for calculating the Mahalanobis distance (D ⁇ 2 ) between the standardized ⁇ -th set process data (Z ⁇ ) and the standardized model set process data (Z M ) is as follows.
  • the GSI of the standardized ⁇ -th set process data is, then, equal to D ⁇ 2 /p.
  • the GSI threshold (GSI T ) should be defined.
  • the default GSI T is assigned to be two to three times the maximal GSI a (the subscript “a” stands for each historical set during the training phase).
  • a virtual metrology step can be performed on the workpieces in the cassette 80 .
  • a virtual metrology step can be performed on the workpieces in the cassette 80 .
  • only one workpiece 82 of the workpieces in the cassette 80 is selected and sent to the measurement equipment 30 for actual measurement, and it generally takes several hours (for example, 6 hours) to obtain the actual measurement result of the selected workpiece 82 .
  • the conjecture model 60 , the reliance index module 40 , and the similarity index module 50 generate virtual metrology values with respect to the workpieces in the cassette 80 in two phases (phase-one and phase-two), wherein the virtual metrology values in each phase are accompanied with reliance indexes and global similarity indexes for assisting in gauging the degree of reliance of the virtual metrology values.
  • the so-called phase-one virtual metrology value and its accompanying reliance index and global similarity index are obtained by promptly inputting the process data of each workpiece into the conjecture model 60 , the reliance index module 40 , and the similarity index module 50 as soon as the collection of the process data thereof is completed.
  • phase-two virtual metrology value is obtained after the actual measurement value of the selected workpiece 82 is obtained from the measurement equipment 30 , wherein the actual measurement value of the workpiece 82 and its related process data are added to the sets of historical process data and the historical measurement values to retrain or tune the conjecture model 60 , the reference model of the reliance index module 40 , and the statistical distance model of the similarity index module 50 , and then a phase-two virtual metrology value and its accompanying reliance index and global similarity index are calculated by those retrained or tuned models.
  • FIG. 4 is a schematic flow chart of the dual-phase algorithm according to the embodiment of the present invention.
  • this embodiment starts waiting for collecting the process data of each workpiece from the production equipment 20 .
  • a phase-one conjecture step 100 is promptly performed (triggered).
  • a phase-two conjecture step 200 is performed (triggered).
  • step 102 is performed for collecting the process data of a certain workpiece (which can be the selected workpiece 82 or any one workpiece in the cassette 80 ). Thereafter, step 110 is performed for checking if the collection of the process data of the certain workpiece is completed. When the result of step 110 is false (i.e. “No”), step 102 is continuously performed; and, when the result of step 110 is true (i.e. “Yes”), step 120 is performed for computing a virtual metrology value for the certain workpiece and its accompanying reliance index and global similarity index, i.e. a phase-one virtual metrology value (VM I ) with its RI/GSI.
  • VM I phase-one virtual metrology value
  • step 202 is performed for collecting the actual measurement value (metrology data) of a certain workpiece (the selected workpiece 82 ). Thereafter, step 210 is performed for checking if the collection of the actual measurement value of the selected workpiece 82 is completed. When the result of step 210 is false (i.e. “No”), step 202 is continuously performed; and, when the result of step 210 is true (i.e. “Yes”), step 220 is performed for checking a correlation between the actual measurement value and the process data to which the selected workpiece 82 is corresponding. Then, step 230 is performed for determining if the correlation is successful, i.e.
  • step 230 is false (i.e. “No”), step 202 is continuously performed; and, when the result of step 230 is true (i.e. “Yes”), step 240 is performed for determining if the production equipment 20 has been idled for a predetermined period of time.
  • step 250 is performed for checking if an instruction of manual activation is issued.
  • step 270 is performed for tuning the conjecture model 60 , the reference model of the reliance index (RI) module 40 , and the statistical distance model of the similarity index (SI) module 50 .
  • the so-called tuning is based on a set of process data and actual measurement value currently obtained for the selected workpiece to adjust the weighting values or parameter values of the respective models, and it only takes several seconds to complete the tuning.
  • step 260 has to be performed for retraining the conjecture model 60 , the reference model of the reliance index module 40 , and the statistical distance model of the similarity index module 50 .
  • the so-called retraining is to add the set of process data and actual measurement value currently obtained for the selected workpiece to the sets of historical process data and the historical measurement values so as to retrain the conjecture model 60 , the reference model of the reliance index module 40 , and the statistical distance model of the similarity index module 50 , and it normally takes several minutes to complete the retraining.
  • step 280 is performed for updating the conjecture model 60 , the reference model of the reliance index module 40 , and the statistical distance model of the similarity index module 50 , and those new conjecture model 60 , reference model, and statistical distance model also are provided to step 120 for computing a VM I with its RI/GSI for the next workpiece that has been subsequently manufactured by the production equipment 20 .
  • step 290 is performed for using the new conjecture model 60 , reference model and statistical distance model to re-compute the virtual metrology value and its accompanying reliance index and global similarity index, i.e. a phase-two virtual metrology value (VM II ) with its RI/GSI, for each workpiece in the entire cassette 80 to which the selected workpiece 82 belongs.
  • VM II phase-two virtual metrology value
  • phase-one virtual metrology value (VM I ) with its accompanying RI/GSI can be obtained promptly for the corresponding workpiece, thus meeting the requirement of promptness in virtual metrology.
  • the conjecture model 60 , the reference model and the statistical distance model can be tuned or retrained accordingly, and then the new models are used to re-compute the phase-two virtual metrology value (VM II ) and its accompanying reliance index and global similarity index for each workpiece in the entire cassette 80 . All of the tuned or retrained models also are used to update the original models for predicting the subsequent phase-one virtual metrology value (VM I ) with its accompanying RI/GSI, thus assuring the requirement of accuracy in virtual metrology.
  • FIG. 5 is a schematic diagram showing a R2R control system to which the phase-one virtual metrology value and the phase-two virtual metrology value obtained from the embodiment of the present invention are applied, wherein a piece of production equipment 20 a is the one on which the current process is being performed, such as a deposition machine; and a piece of production equipment 20 b is the one on which the next process is to be performed, such as a CMP (Chemical Mechanical Polishing) machine.
  • a piece of production equipment 20 a is the one on which the current process is being performed, such as a deposition machine
  • a piece of production equipment 20 b is the one on which the next process is to be performed, such as a CMP (Chemical Mechanical Polishing) machine.
  • CMP Chemical Mechanical Polishing
  • the embodiment of the present invention may be applied to a plurality of R2R control systems 94 a and 94 b in a foundry, for example, wherein the R2R control systems 94 a and 94 b may be L2L control systems or W2W control systems.
  • the R2R control systems 94 a and 94 b are W2W control systems
  • a phase-one virtual metrology value (VM I ) can be promptly generated by a dual-phase VM system 90 a ( 90 b ) used for thickness prediction of each workpiece, for example, and can be provided as feedback input to the W2W control system 94 a ( 94 b ) of the production equipment 20 a ( 20 b ), thereby meeting the requirement of promptness.
  • a phase-two virtual metrology value (VM II ) has excellent accuracy, and thus can be provided for feedforward input to the W2W control system 94 b of the production equipment 20 b of the next process.
  • the phase-two virtual metrology value can be provided as feedback input to the L2L control system 94 a of the production equipment 20 a , and as feedforward input to the L2L control system 94 b of the production equipment 20 b of the next process.
  • FIG. 6 is a schematic diagram showing the results of the phase-one virtual metrology values (VM I ) and phase-two virtual metrology values (VM II ) compared to the actual measurement values according to the application of the embodiment of the present invention, wherein the evaluation indexes, mean absolute percentage error (MAPE) and the maximum error (Max Error), are employed to evaluate the accuracy of VM I and VM II .
  • MAPE and Max Error of the VM I are 1.248% and 0.603%, respectively, and MAPE and Max Error of the VM II are 0.281% and 0.070%, respectively. It can be known from FIG.
  • phase-two virtual metrology values (VM II ) almost conform to the actual measurement values, and the errors of phase-one virtual metrology values (VM I ) also are quite small but still larger than the phase-two virtual metrology values (VM II ).
  • the RI and GSI of a phase-one VM point A (sample 14) are over their respective thresholds, meaning that the VM I of sample 14 has lower reliance level.
  • the dual-phase virtual metrology method of the present invention can have the features of promptness (from VM I ) and accuracy (from VM II ), thus meeting the requirements of W2W control.

Abstract

A dual-phase virtual metrology method is disclosed for considering both promptness and accuracy by generating dual-phase virtual metrology (VM) values, wherein a Phase-I conjecture step emphasizes promptness by immediately calculating the Phase-I virtual metrology value (VMI) of a workpiece once the entire process data of the workpiece are completely collected; and a Phase-II conjecture step intensifies accuracy, which does not re-calculate the Phase-II virtual metrology values (VMII) of all the workpieces in the cassette until an actual metrology value (required for tuning or re-training purposes) of a selected workpiece in the same cassette is collected. Besides, the accompanying reliance index (RI) and global similarity index (GSI) of each VMI and VMII are also generated.

Description

RELATED APPLICATIONS
This application claims priority to Taiwan Application Serial Number 96120862, filed Jun. 8, 2007, which is herein incorporated by reference.
BACKGROUND
1. Field of Invention
The present invention relates to a virtual metrology (VM) method. More particularly, the present invention relates to a dual-phase virtual metrology method having promptness and accuracy.
2. Description of Related Art
In the semiconductor industry, run-to-run (R2R) advanced process control (APC) is widely applied to semiconductor and TFT-LCD factories for improving process capability. As defined in SEMI E133 specification, R2R control is the technique of modifying recipe parameters or the selection of control parameters between runs to improve processing performance. A run can be a batch, a lot, or an individual workpiece. A workpiece may represent a wafer for the semiconductor industry or a glass for the TFT-LCD industry. When L2L control is applied, only a single workpiece in the lot is required to be measured for feedback and feedforward control purposes. However, as device dimension shrinks further, tighter process control is needed. In this case, L2L control may not be accurate enough and workpiece-to-workpiece (W2W) control becomes essential for critical stages. As such, each workpiece in the lot should be measured. To accomplish this requirement, large amounts of metrology tools will be required and production cycle time will also be increased significantly. Furthermore, metrology delays, which are inevitable when real measurements are performed, will cause complicated control problems and degrade the APC performance.
Hence, there is a need to provide a virtual metrology method for providing a (virtual) measurement value with respect to each workpiece without actually measuring each workpiece, thereby performing W2W control, for example, by still using the measurement frequency of L2L control, i.e. only one single workpiece in the entire lot is spot-tested. However, generally speaking, both promptness and accuracy have to be taken into account when the virtual metrology method is used to feed virtual metrology (VM) values into W2W control, or the aforementioned requirements of W2W control cannot be met.
SUMMARY
Hence, there is a need to develop a dual-phase virtual metrology method for meeting the requirements of W2W control.
One aspect of the present invention is to provide a dual-phase virtual metrology method for providing dual-phase metrology values to meet the requirements of promptness and accuracy simultaneously.
In accordance with the aforementioned aspect, a dual-phase virtual metrology method is provided. According to an embodiment of the present invention, in the dual-phase virtual metrology method, at first, a plurality of sets of historical process data belonging to a production equipment are obtained, and a plurality of historical measurement values from a measurement equipment are obtained, wherein the historical measurement values are the measurement values of the workpieces which are manufactured in accordance with the sets of historical process data, respectively. Thereafter, a first conjecture model is established by using the sets of historical process data and the historical measurement values, wherein the first conjecture model is built in accordance with a conjecture algorithm, wherein the conjecture algorithm can be such as a multi-regression algorithm, a neural network (NN) algorithm, or any other prediction algorithm. Further, in the dual-phase virtual metrology method, a first reference model is established by using the aforementioned sets of historical process data and the aforementioned historical measurement values, wherein the first reference model is built in accordance with a reference algorithm, and the reference algorithm is different from the aforementioned conjecture algorithm, and can be such as a multi-regression algorithm, a neural network algorithm, or any other prediction algorithm. Further, in the dual-phase virtual metrology method, a first statistical distance model is established by using the aforementioned sets of historical process data in accordance with a statistical distance algorithm, wherein the statistical distance algorithm can be such as a Mahalanobis distance algorithm.
Thereafter, the dual-phase virtual metrology method proceeds to waiting for collecting the process data of a plurality of workpieces from the production equipment. After the collection of the process data of a certain workpiece from the production equipment is completed, a phase-one conjecture step is promptly performed. In the phase-one conjecture step, the process data of the certain workpiece is inputted into the first conjecture model, thereby computing a phase-one virtual metrology value (VMI) for meeting the requirement of promptness. In the phase-one conjecture step, the process data of the certain workpiece is inputted into the first reference model, thereby computing a first reference prediction value. Then, the overlap area between the statistical distribution of the phase-one virtual metrology value of the certain workpiece and the statistical distribution of the first reference prediction value is calculated, thereby generating the reliance index (RI) of the phase-one virtual metrology value of the certain workpiece, wherein the reliance index is higher when the overlap area is larger, representing that the reliance level of the phase-one virtual metrology value corresponding thereto is higher. In the phase-one conjecture step, the process data of the certain workpiece obtained from the production equipment is also inputted into the first statistical distance model, thereby computing the global similarity index (GSI) for the process data corresponding to the phase-one virtual metrology value of the certain workpiece.
Commonly, a production system will select one workpiece (a selected workpiece) in each cassette, and send the selected workpiece to the measurement equipment for measurement; for example, one of 25 wafers contained in a cassette is selected for spot testing. When the actual measurement value of the selected workpiece is obtained from the measurement equipment, a phase-two conjecture step is performed. In the phase-two conjecture step, the process data and actual measurement value of the selected workpiece is added to the aforementioned sets of historical process data and the historical measurement values to retrain the first conjecture model and the first reference model; or the process data and actual measurement value of the selected workpiece is used to tune the first conjecture model and the first reference model, thereby turning the first conjecture model and the first reference model into a second conjecture model and a second reference model. Thereafter, the process data of all the workpieces in the cassette belonging to the selected workpiece is inputted into the second conjecture model and the second reference model, thereby re-computing a phase-two virtual metrology value (VMII) and a second reference prediction value of each workpiece in the cassette. Then, the overlap area between the statistical distribution of the phase-two virtual metrology value of each workpiece in the aforementioned cassette and the statistical distribution of the second reference prediction value is calculated, thereby generating the reliance index of the phase-two virtual metrology value of each workpiece in the cassette, wherein the reliance index is higher when the overlap area is larger, representing that the reliance level of the phase-two virtual metrology value corresponding thereto is higher. The phase-two virtual metrology value re-calculated herein is more accurate than the phase-one virtual metrology value previously calculated, thus meeting the requirement of accuracy. Meanwhile, the first conjecture model and the first reference model can be updated with the second conjecture model and the second reference model for computing the phase-one virtual metrology value with its reliance index of the workpiece subsequently manufactured by the production equipment.
In the phase-two conjecture step, the process data of the selected workpiece is added to the sets of historical process data to retrain the first statistical distance mode; or the process data of the selected workpiece is used to tune the first statistical distance model, thereby turning the first statistical distance model into a second statistical distance model. Then, the process data of all the workpieces in the cassette belonging to the selected workpiece is inputted into the second statistical distance model, thereby re-computing the global similarity index for the process data corresponding to the phase-two virtual metrology value of each workpiece in the cassette. Meanwhile, the first statistical distance model is updated with the second statistical distance model for computing the global similarity index of the process data corresponding to the phase-one virtual metrology value of the workpiece subsequently manufactured by the production equipment.
Further, in the dual-phase virtual metrology method, a process data preprocessing step is performed for deleting all the anomalous process data and selecting important parameters from the process data of each of the workpieces obtained from the production equipment.
Further, in the dual-phase virtual metrology method, a metrology data preprocessing step is performed for filtering out anomalous data in the actual measurement value of the selected workpiece.
According to another embodiment of the present invention, in the phase-two conjecture step, the scheme for determining if the conjecture model, the reference model and the statistical distance model need retraining or tuning is based on that: when the production equipment has been idled for a predetermined period of time or an instruction of manual activation is issued, then those models need retraining, otherwise tuning is executed.
Hence, with the application of the embodiments of the present invention, dual-phase virtual metrology values and their reliance indexes and global similarity indexes are provided for having the features of promptness and accuracy, thus meeting the requirements of W2W control.
It is to be understood that both the foregoing general description and the following detailed description are examples, and are intended to provide further explanation of the invention as claimed.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:
FIG. 1 is a schematic block diagram showing a dual-phase virtual metrology system according to an embodiment of the present invention;
FIG. 2 is a schematic diagram for defining the reliance index (RI) according to the embodiment of the present invention;
FIG. 3 is a schematic diagram for defining the RI threshold (RIT) according to the embodiment of the present invention;
FIG. 4 is a schematic flow chart of a dual-phase virtual metrology conjecture algorithm according to the embodiment of the present invention;
FIG. 5 is a schematic diagram showing a R2R control system to which the phase-one virtual metrology values and the phase-two virtual metrology values obtained from the embodiment of the present invention are applied; and
FIG. 6 is a schematic diagram showing the results of the phase-one virtual metrology values and phase-two virtual metrology values compared to the actual measurement values according to the application of the embodiment of the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts.
Referring to FIG. 1, FIG. 1 is a schematic block diagram showing a dual-phase virtual metrology system according to an embodiment of the present invention. The dual-phase virtual metrology system 90 of this embodiment comprises a process data preprocessing module 10, a metrology data preprocessing module 12, a conjecture model 60, a reliance index (RI) module 40 and a similarity index (SI) module 50. The data preprocessing module 10 processes and standardizes raw process data from a piece of production equipment 20, and selects important parameters from all of the original parameters in process data so as to prevent unimportant parameters from affecting the prediction accuracy. The metrology data preprocessing module 12 process the measurement values from a piece of measurement equipment 30 for filtering out anomalous data therein. The conjecture model 60 uses a dual-phase algorithm 62 and a conjecture algorithm to conjecture phase-one virtual metrology values (VMI) and phase-two virtual metrology values (VMII) for a plurality of workpieces (not labeled) in a cassette 80. The conjecture algorithm can be selected from various prediction algorithms such as a multi-regression algorithm and a neural network algorithm. The reliance index module 40 generates the RI value to estimate the reliance levels of the phase-one and phase-two virtual metrology values (VMI and VMII). The similarity index module 50 calculates a global similarity index for evaluating the degree of similarity between the input-set process data and all of the sets of historical process data in the conjecture model 60 for training and building the conjecture model, wherein the global similarity index is used for assisting the reliance index in gauging the degree of reliance of the virtual metrology system.
Prior to the operation of the conjecture model 60, a plurality of sets of process data (historical process data) obtained from the production equipment 20 and quality measurement data (historical measurement values) obtained from the measurement equipment 30 are transmitted respectively to the process data preprocessing module 10 and the metrology data preprocessing module 12 for data preprocessing. These preprocessed and standardized process data and quality measurement data are the input data required by the conjecture model 60. Thereafter, the sets of historical process data and the historical measurement values corresponding thereto are used to train (establish) the conjecture model 60, such as a neural network (NN) conjecture model. The conjecture model 60 has a dual-phase algorithm 62 used for computing the phase-one and phase-two virtual metrology values (VMI and VMII) with their reliance indexes (RIs) and global similarity indexes (GSIs). The operation method of the dual-phase algorithm 62 will be described after the algorithms related to the RI and GSI are explained.
The following presents the algorithms related to the RI and GSI and explains their operating procedures.
Reliance Index (RI)
Referring to Table 1, n sets of historical data are assumed to be collected, including process data (Xi, i=1, 2, . . . , n) and the corresponding actual measurement values (yi, i=1, 2, . . . , n), where each set of process data contains p individual parameters (from parameter 1 to parameter p), namely Xi=[xi,1, xi,2, . . . , xi,p]T. Additionally, (m−n) sets of process data in actual production were also collected, but no actual measurement values are available besides yn+1. That is, only the first among (m−n) pieces of the products is selected and actually measured. In the current manufacturing practice, the actual measurement value yn+1 obtained is used to infer and evaluate the quality of the (m−n−1) pieces of the products.
TABLE 1
Sample Parameter Parameter Parameter Actual
Data Set
1 2 p Measurement Value
1 x1,1 x1,2 . . . x1,p y1
2 x2,1 x2,2 . . . x2,p y2
. . . . . . . . . . . . . . . . . .
n xn,1 xn,2 . . . xn,p yn
n + 1 xn+1,1 xn+1,2 . . . xn+1,p yn+1
n + 2 xn+2,1 xn+2,2 . . . xn+2,p Zip
. . . . . . . . . . . . . . . . . .
m xm,1 xm,2 . . . xm,p Zip
As shown in Table 1, y1, y2, . . . , yn are historical measurement values, and yn+1 is the actual measurement value of the first piece of the products being manufactured. Generally, a set of actual measurement values (yi, i=1, 2, . . . , n) is a normal distribution with mean μ and standard deviation σ, namely yi˜N(μ, σ2).
All the actual measurement values can be standardized in terms of the mean and standard deviation of the sample set (yi, i=1, 2, . . . , n). Their standardized values (also called z scores) Zy 1 , Zy 2 , . . . , Zy n are thus derived, where each z score has mean zero and standard deviation one, namely Zy i ˜N(0, 1). Regarding the actual measurement data, a corresponding Zy i close to 0 indicates that the actual measurement value approaches the central value of the specification. The equations for standardization are listed as follows:
Z y i = y i - y _ σ y , i = 1 , 2 , , n ( 1 ) y _ = 1 n ( y 1 + y 2 + + y n ) ( 2 ) σ y = 1 n - 1 [ ( y 1 - y _ ) 2 + ( y 2 - y _ ) 2 + + ( y n - y _ ) 2 ] ( 3 )
wherein yi is the i-th actual measurement value,
    • Zy i is the standardized i-th actual measurement value,
    • y is the mean of all the actual measurement values, and
    • σy is the standard deviation of all the actual measurement values.
The explanation herein adopts a neural-network (NN) algorithm as the conjecture algorithm for establishing the conjecture model performing virtual measurement, and uses such as a multi-regression (MR) algorithm to be the reference algorithm for establishing the reference model that serves as a comparison base for the conjecture model. However, the present invention can also apply other algorithms to be the conjecture algorithm or the reference algorithm, provided the reference algorithm differs from the conjecture algorithm, such as a time series algorithm and other related algorithms, and thus the present invention is not limited thereto.
When the NN and MR algorithms are utilized, if their convergence conditions both are that SSE (Sum of Square Error) is minimized with n→∞, their standardized predictive measurement values (defined as
Z y N i and Z y r i
respectively) should be the same as the standardized actual measurement value Zy i . Restated, when n→∞,
Z y i = Z y N i = Z y r i
all represent the standardized actual measurement value, but they have different names due to having different purposes and different estimating models. Hence,
Z y N i ~ N ( μ Z y i , σ Z y 2 ) and Z y r i ~ N ( μ Z y i , σ Z y 2 )
indicate that
Z y N i and Z y r i
share the same statistical distribution. However, owing to the existence of different estimating models, the estimations of mean and standard deviation differ between those two prediction algorithms. Namely the standardized mean-estimating equation
( μ ^ Z y i = Z y ^ N i )
and standard-deviation-estimating equation
( σ ^ Z y = σ ^ Z y ^ N )
with respect to the NN conjecture model differ from the standardized mean-estimating equation
( μ ^ Z y i = Z y ^ r i )
and standard-deviation-estimating equation
( σ ^ Z y = σ ^ Z y ^ r )
with respect to the MR reference model.
The RI is designed to gauge the reliance level of the virtual metrology value. The RI thus should consider the degree of similarity between the statistical distribution Zŷ Ni of the virtual metrology value and the statistical distribution Zy i of the actual measurement value. However, when virtual metrology is applied, no actual measurement value can be used to verify the trustworthiness of the virtual metrology value. (Notably, virtual metrology becomes unnecessary if actual measurement values are obtained.) Instead, the present invention adopts the statistical distribution Zŷ ri estimated by the reference algorithm which is such as the MR algorithm to replace Zy i . The reference algorithm also can be such as a time-series algorithm and other related algorithms, and thus the present invention is not limited thereto.
Referring to FIG. 2, FIG. 2 is a schematic diagram for explaining the reliance index (RI) according to the preferred embodiment of the present invention. The RI of the present invention is defined as the intersection-area value (overlap area A) between the statistical distribution Zŷ Ni of the virtual metrology value from the conjecture model (built by such as the NN algorithm) and the statistical distribution Zŷ ri of the reference prediction value from the reference model (built by such as the MR algorithm). As such, the RI equation is listed below:
RI = 2 Z y ^ Ni + Z y ^ ri 2 1 2 π σ - 1 2 ( x - μ σ ) 2 x with μ = Z y ^ N i if Z y ^ Ni < Z y ^ ri μ = Z y ^ r i if Z y ^ ri < Z y ^ Ni ( 4 )
and σ is set to be 1.
The RI increases with increasing overlap area A. This phenomenon indicates that the result obtained using the conjecture model is closer to that obtained from the reference model, and thus the corresponding virtual metrology value is more reliable. Otherwise, the reliability of the corresponding measurement value reduces with decreasing RI. When the distribution Zŷ Ni estimated from Zy Ni is fully overlapped with the distribution Zŷ ri estimated from Zy ri , then according to the distribution theory of statistics, the RI value equals 1; and, when those two distributions are almost separate, the RI value approaches 0.
Hereinafter, the method for calculating the statistical distribution of the virtual metrology values (Zŷ Ni and {circumflex over (σ)}Z ŷN ) from the conjecture model is explained.
In the NN conjecture model, if the convergence condition is to minimize SSE, then it can be assumed that “for given Zx i,j , Zy Ni is the distribution with mean μZ yi and standard deviation σZ y ”, namely for given Zx i,j , Zy Ni ˜N(μZ yi , σZ y 2), where the NN estimating equation of μZ yi is {circumflex over (μ)}Z yi =Zŷ Ni , and the NN estimating equation of σZ y 2 is {circumflex over (σ)}Z y 2={circumflex over (σ)}Z ŷN 2.
Before the NN conjecture model is constructed, the process data must be standardized. The equations for standardizing the process data are presented below:
Z x i , j = x i , j - x _ j σ x j , i = 1 , 2 , , n , n + 1 , , m ; j = 1 , 2 , , p ( 5 ) x _ j = 1 n ( x 1 , j + x 2 , j + + x n , j ) ( 6 ) σ x j = 1 n - 1 [ ( x 1 , j - x _ j ) 2 + ( x 2 , j - x _ j ) 2 + + ( x n , j - x _ j ) 2 ] ( 7 )
wherein xi,j is the j-th process parameter in the i-th set of process data,
    • Zx i,j is the standardized j-th process parameter in the i-th set of process data;
    • x j is the mean of the j-th process data;
    • σx j is the standard deviation of the j-th process data.
The n sets of standardized process data (Zx i,j , i=1,2, . . . , n; j=1,2, . . . , p) and the n standardized actual measurement values (Zy i , i=1,2, . . . , n) are utilized to build the NN conjecture model. The m sets of standardized process data (Zx i,j , i=1,2, . . . , m; j=1,2, . . . , p) are then inputted into the NN conjecture model to obtain the corresponding standardized virtual metrology values: Zŷ N1 , Zŷ N2 , . . . , Zŷ Nn , Zŷ Nn+1 , . . . , Zŷ Nm .
Accordingly, the estimated value of μZ yi (i.e. {circumflex over (μ)}Z yi =Zŷ Ni ) and the estimated value of σZ y (i.e. {circumflex over (σ)}Z y ={circumflex over (σ)}Z ŷN ) can be computed as follows:
μ ^ Z y i = Z y ^ N i , i = 1 , 2 , , n , n + 1 , , m ( 8 ) σ ^ Z y ^ N = 1 n - 1 [ ( Z y ^ N 1 - Z _ y ^ N ) 2 + ( Z y ^ N 2 - Z _ y ^ N ) 2 + + ( Z y ^ N n - Z _ y ^ N ) 2 ] ( 9 ) Z _ y ^ N = 1 n ( Z y ^ N 1 + Z y ^ N 2 + + Z y ^ N n ) ( 10 )
wherein Z ŷ N is the mean of the standardized virtual metrology values.
Hereinafter, the method for calculating the reference predication values
( Z y ^ r i and σ ^ Z y ^ r )
from the MR model is explained.
The basic assumption of the MR is that “for given Zx i,j , Zy ri is the distribution with mean μZ yi and standard deviation σZ y ”, namely for given Zx i,j , Zy ri ˜N(μZ yi , σZ y 2), wherein the MR estimating equation of μZ yi is {circumflex over (μ)}Z yi =Zŷ ri , and the MR estimating equation of σZ y 2 is {circumflex over (σ)}Z y 2={circumflex over (σ)}Z ŷr 2.
To obtain the MR relationship between the n sets of standardized process data (Zx i,j , i=1,2, . . . , n; j=1,2, . . . , p) and the n standardized actual measurement values, (Zyi, i=1,2, . . . , n), the weighting factors βr=[βr0, βr1, βr2, . . . , βrp]T corresponding to those p parameters must be defined by using the MR analysis. The relationship between Zy i and Zx i,j thus is constructed as follows:
β r 0 + β r 1 Z x 1 , 1 + β r 2 Z x 1 , 2 + + β r p Z x 1 , p = Z y 1 β r 0 + β r 1 Z x 2 , 1 + β r 2 Z x 2 , 2 + + β r p Z x 2 , p = Z y 2 β r 0 + β r 1 Z x n , 1 + β r 2 Z x n , 2 + + β r p Z x n , p = Z y n Let ( 11 ) Z y = ( Z y 1 Z y 2 Z y n ) and ( 12 ) Z x = ( 1 Z x 1 , 1 Z x 1 , p 1 Z x 2 , 1 Z x 2 , p 1 Z x n , 1 Z x n , p ) ( 13 )
The least square method can obtain the estimating equation of βr, {circumflex over (β)}r=[{circumflex over (β)}r0, {circumflex over (β)}r1, . . . {circumflex over (β)}rp]T as
{circumflex over (β)}r=(Z x T Z x)−1 Z x T Z y  (14)
Therefore, the MR reference model can be obtained as
Z ŷr i ={circumflex over (β)}r0+{circumflex over (β)}r1 Z x i,1 +{circumflex over (β)}r2 Z x i,2 + . . . +{circumflex over (β)}rp Z x i,p
i=1,2, . . . ,n,n+1, . . . , m  (15)
Hence, during the conjecture phase, after inputting a set of process data, its MR estimating value Zŷ ri corresponding thereto can be obtained via equation (15). The MR estimating equation of the standard deviation σZ y is
σ ^ Z y ^ r
with
σ ^ Z y ^ r = 1 n - 1 [ ( Z y ^ r 1 - Z _ y ^ r ) 2 + ( Z y ^ r 2 - Z _ y ^ r ) 2 + + ( Z y ^ r n - Z _ y ^ r ) 2 ] ( 16 ) Z _ y ^ r = 1 n ( Z y ^ r 1 + Z y ^ r 2 + + Z y ^ r n ) ( 17 )
After obtaining the NN estimating equations
( Z y ^ N i and σ ^ Z y ^ N )
and the MR estimating equations
( Z y ^ r i and σ ^ Z y ^ r ) ,
their normal distribution curves can be depicted, as illustrated in FIG. 2. Thus, the RI of each virtual metrology value can be derived by calculating the intersection area value (overlap area A).
After obtaining the RI, the RI threshold value (RIT) must be defined. If RI>RIT, then the reliance level of the virtual metrology value is acceptable. A systematic approach for determining the RIT is described below.
Before determining the RIT, it is necessary to define a maximal tolerable error limit (EL). The error of the virtual metrology value is an absolute percentage of the difference between the actual measurement value yi and ŷNi obtained from the NN conjecture model divided by the mean of all the actual measurement values, y, namely
Error i = y i - y ^ Ni y _ × 100 % ( 18 )
The EL can then be specified based on the error defined in equation (18) and the accuracy specification of virtual metrology (VM). Consequently, RIT is defined as the RI value corresponding to the EL, as shown in FIG. 3. That is
RI T = 2 Z Center 1 2 π σ - 1 2 ( x - μ σ ) 2 x ( 19 )
with μ and σ defined in equation (4) and
Z Center =Z ŷ Ni +[ y ×(E L/2)]/σy  (20)
where σy is specified in equation (3).
Global Similarity Indexes (GSI)
As mentioned above, when virtual metrology is applied, no actual measurement value is available to verify the accuracy of the virtual metrology value. Therefore, instead of the standardized actual measurement value Zy i , the standardized MR prediction value
Z y ^ r i
is adopted to calculate the RI. This substitution may cause inevitable gauging errors in the RI. To compensate for this unavoidable substitution, a global similarity index (GSI) is provided to help the RI gauge the reliance level of virtual metrology and identifying the key process parameters with large deviations (z score values).
The GSI assesses the degree of similarity between any set of process data and the model set of process data. This model set is derived from all of the sets of historical process data used for building the conjecture model.
The present invention may utilize a statistical distance measure, such as Mahalanobis distance, to quantify the degree of similarity. Mahalanobis distance is a distance measure introduced by P.C. Mahalanobis in 1936. This measure is based on correlation between variables to identify and analyze different patterns of sample sets. Mahalanobis distance is a useful way of determining similarity of an unknown sample set to a known one. This method considers the correlation of the data set and is scale-invariant, namely it is not dependent on the scale of measurements. If the data set has high similarity, the calculated Mahalanobis distance calculated will be relatively small.
The present invention uses the calculated GSI (applying Mahalanobis distance) size to determine whether the newly input set of process data is similar to the model set of process data. If the calculated GSI is small, the newly input set is relatively similar to the model set. Thus the virtual metrology value of the newly input (high-similarity) set is relatively accurate. On the contrary, if the calculated GSI is too large, the newly input set is somewhat different from the model set. Consequently, the virtual metrology value estimated in accordance with the newly input (low-similarity) set has low reliance level in terms of accuracy.
The equations to calculate the standardized process data Zx i,j of the conjecture model are shown in equations (5), (6) and (7). At first, the model set of the process parameters is defined as XM=[xM,1, xM,2, . . . , xM,p]T, where xM,j equals x j, j=1,2, . . . , p, so that each element in the model set after standardization (also denoted as the standardized model parameter, ZM,j) has a value of 0. Restated, all of the elements in ZM=[ZM,1, ZM,2, . . . , ZM,p]T are 0. Thereafter, the correlation coefficients between the standardized model parameters are calculated.
Assuming that the correlation coefficient between the s-th parameter and the t-th parameter is rst and that there are k sets of data, then
r st = 1 k - 1 l = 1 k z sl · z tl = 1 k - 1 ( z s 1 · z t 1 + z s 2 · z t 2 + + z sk · z tk ) ( 21 )
After calculating the correlation coefficients between the standardized model parameters, the matrix of correlation coefficients can be obtained as
R = [ 1 r 12 r 1 p r 21 1 r 2 p r p 1 r p 2 1 ] ( 22 )
Assuming that the inverse matrix (R−1) of R is defined as A, then
A = R - 1 = [ a 11 a 12 a 1 p a 21 a 22 a 2 p a p 1 a p 2 a pp ] ( 23 )
Hence, the equation for calculating the Mahalanobis distance (Dλ 2) between the standardized λ-th set process data (Zλ) and the standardized model set process data (ZM) is as follows.
D λ 2 = ( Z λ - Z M ) T R - 1 ( Z λ - Z M ) = Z λ T R - 1 Z λ ( 24 )
Finally, we have
D λ 2 = j = 1 p i = 1 p a ij z i λ z j λ ( 25 )
The GSI of the standardized λ-th set process data is, then, equal to Dλ 2/p.
After obtaining the GSI, the GSI threshold (GSIT) should be defined. Generally, the default GSIT is assigned to be two to three times the maximal GSIa (the subscript “a” stands for each historical set during the training phase).
After presenting the algorithms related to the RI and GSI, the operating procedure of the dual-phase virtual metrology system of the present invention is explained below.
Please continuously refer to FIG. 1. After the conjecture model 60, the reference model of the reliance index module 40, and the statistical distance model of the similarity index module 50 are built, a virtual metrology step can be performed on the workpieces in the cassette 80. In general, only one workpiece 82 of the workpieces in the cassette 80 is selected and sent to the measurement equipment 30 for actual measurement, and it generally takes several hours (for example, 6 hours) to obtain the actual measurement result of the selected workpiece 82. The conjecture model 60, the reliance index module 40, and the similarity index module 50 generate virtual metrology values with respect to the workpieces in the cassette 80 in two phases (phase-one and phase-two), wherein the virtual metrology values in each phase are accompanied with reliance indexes and global similarity indexes for assisting in gauging the degree of reliance of the virtual metrology values. The so-called phase-one virtual metrology value and its accompanying reliance index and global similarity index are obtained by promptly inputting the process data of each workpiece into the conjecture model 60, the reliance index module 40, and the similarity index module 50 as soon as the collection of the process data thereof is completed. The so-called phase-two virtual metrology value is obtained after the actual measurement value of the selected workpiece 82 is obtained from the measurement equipment 30, wherein the actual measurement value of the workpiece 82 and its related process data are added to the sets of historical process data and the historical measurement values to retrain or tune the conjecture model 60, the reference model of the reliance index module 40, and the statistical distance model of the similarity index module 50, and then a phase-two virtual metrology value and its accompanying reliance index and global similarity index are calculated by those retrained or tuned models.
Hereinafter, the steps of dual-phase algorithm 62 are explained below.
Referring to FIG. 1 and FIG. 4, FIG. 4 is a schematic flow chart of the dual-phase algorithm according to the embodiment of the present invention. After the conjecture model 60, the reference model of the reliance index module 40, and the statistical distance model of the similarity index module 50 are built, this embodiment starts waiting for collecting the process data of each workpiece from the production equipment 20. As soon as the collection of the process data of a certain workpiece is completed, a phase-one conjecture step 100 is promptly performed (triggered). When the actual measurement of the selected workpiece 82 is obtained from the measurement equipment 30, a phase-two conjecture step 200 is performed (triggered).
Hereinafter, an illustrative example related to the entire workpieces in one single cassette 80 is presented for explaining the phase-one conjecture step 100 and the phase-two conjecture step 200. However, this embodiment is also applicable to the workpieces in a plurality of cassettes, and thus is not limited thereto.
In the phase-one conjecture step 100, step 102 is performed for collecting the process data of a certain workpiece (which can be the selected workpiece 82 or any one workpiece in the cassette 80). Thereafter, step 110 is performed for checking if the collection of the process data of the certain workpiece is completed. When the result of step 110 is false (i.e. “No”), step 102 is continuously performed; and, when the result of step 110 is true (i.e. “Yes”), step 120 is performed for computing a virtual metrology value for the certain workpiece and its accompanying reliance index and global similarity index, i.e. a phase-one virtual metrology value (VMI) with its RI/GSI.
In the phase-two conjecture step 200, step 202 is performed for collecting the actual measurement value (metrology data) of a certain workpiece (the selected workpiece 82). Thereafter, step 210 is performed for checking if the collection of the actual measurement value of the selected workpiece 82 is completed. When the result of step 210 is false (i.e. “No”), step 202 is continuously performed; and, when the result of step 210 is true (i.e. “Yes”), step 220 is performed for checking a correlation between the actual measurement value and the process data to which the selected workpiece 82 is corresponding. Then, step 230 is performed for determining if the correlation is successful, i.e. if the actual measurement value and the process data belong to the same workpiece (i.e. the selected workpiece 82). When the result of step 230 is false (i.e. “No”), step 202 is continuously performed; and, when the result of step 230 is true (i.e. “Yes”), step 240 is performed for determining if the production equipment 20 has been idled for a predetermined period of time. When the result of step 240 is false (i.e. “No”), step 250 is performed for checking if an instruction of manual activation is issued. When the result of step 250 is false (i.e. “No”), step 270 is performed for tuning the conjecture model 60, the reference model of the reliance index (RI) module 40, and the statistical distance model of the similarity index (SI) module 50. The so-called tuning is based on a set of process data and actual measurement value currently obtained for the selected workpiece to adjust the weighting values or parameter values of the respective models, and it only takes several seconds to complete the tuning. When the result of step 250 or step 240 is true (i.e. “Yes”), meaning that the instruction of manual activation is issued (generally during maintenance or part replacement); or the properties of the production equipment 20 have relatively large changes, then step 260 has to be performed for retraining the conjecture model 60, the reference model of the reliance index module 40, and the statistical distance model of the similarity index module 50. The so-called retraining is to add the set of process data and actual measurement value currently obtained for the selected workpiece to the sets of historical process data and the historical measurement values so as to retrain the conjecture model 60, the reference model of the reliance index module 40, and the statistical distance model of the similarity index module 50, and it normally takes several minutes to complete the retraining.
After step 260 or 270, step 280 is performed for updating the conjecture model 60, the reference model of the reliance index module 40, and the statistical distance model of the similarity index module 50, and those new conjecture model 60, reference model, and statistical distance model also are provided to step 120 for computing a VMI with its RI/GSI for the next workpiece that has been subsequently manufactured by the production equipment 20. Meanwhile, step 290 is performed for using the new conjecture model 60, reference model and statistical distance model to re-compute the virtual metrology value and its accompanying reliance index and global similarity index, i.e. a phase-two virtual metrology value (VMII) with its RI/GSI, for each workpiece in the entire cassette 80 to which the selected workpiece 82 belongs.
Since the generation of the phase-one virtual metrology value (VMI) with its accompanying RI/GSI does not need to wait for the arrival of the actual measurement value of the selected workpiece and merely requires the process data of the corresponding workpiece, the phase-one virtual metrology value (VMI) with its accompanying RI/GSI can be obtained promptly for the corresponding workpiece, thus meeting the requirement of promptness in virtual metrology. When the actual measurement value of the selected workpiece arrives, the conjecture model 60, the reference model and the statistical distance model can be tuned or retrained accordingly, and then the new models are used to re-compute the phase-two virtual metrology value (VMII) and its accompanying reliance index and global similarity index for each workpiece in the entire cassette 80. All of the tuned or retrained models also are used to update the original models for predicting the subsequent phase-one virtual metrology value (VMI) with its accompanying RI/GSI, thus assuring the requirement of accuracy in virtual metrology.
Referring to FIG. 5, FIG. 5 is a schematic diagram showing a R2R control system to which the phase-one virtual metrology value and the phase-two virtual metrology value obtained from the embodiment of the present invention are applied, wherein a piece of production equipment 20 a is the one on which the current process is being performed, such as a deposition machine; and a piece of production equipment 20 b is the one on which the next process is to be performed, such as a CMP (Chemical Mechanical Polishing) machine. The embodiment of the present invention may be applied to a plurality of R2R control systems 94 a and 94 b in a foundry, for example, wherein the R2R control systems 94 a and 94 b may be L2L control systems or W2W control systems. When the R2R control systems 94 a and 94 b are W2W control systems, since a phase-one virtual metrology value (VMI) can be promptly generated by a dual-phase VM system 90 a (90 b) used for thickness prediction of each workpiece, for example, and can be provided as feedback input to the W2W control system 94 a (94 b) of the production equipment 20 a (20 b), thereby meeting the requirement of promptness. On the other hand, a phase-two virtual metrology value (VMII) has excellent accuracy, and thus can be provided for feedforward input to the W2W control system 94 b of the production equipment 20 b of the next process.
Further, when the R2R control systems 94 a and 94 b are L2L control systems, since the L2L control system does not have the promptness requirement of workpiece-by-workpiece measurement required by such as the W2W control system, the phase-two virtual metrology value (VMII) can be provided as feedback input to the L2L control system 94 a of the production equipment 20 a, and as feedforward input to the L2L control system 94 b of the production equipment 20 b of the next process.
Following the operating procedure shown in FIG. 4, the results of the illustrative example compared to the actual measurement values are presented as follows.
Referring to FIG. 6, FIG. 6 is a schematic diagram showing the results of the phase-one virtual metrology values (VMI) and phase-two virtual metrology values (VMII) compared to the actual measurement values according to the application of the embodiment of the present invention, wherein the evaluation indexes, mean absolute percentage error (MAPE) and the maximum error (Max Error), are employed to evaluate the accuracy of VMI and VMII. MAPE and Max Error of the VMI are 1.248% and 0.603%, respectively, and MAPE and Max Error of the VMII are 0.281% and 0.070%, respectively. It can be known from FIG. 6 that the phase-two virtual metrology values (VMII) almost conform to the actual measurement values, and the errors of phase-one virtual metrology values (VMI) also are quite small but still larger than the phase-two virtual metrology values (VMII). Besides, the RI and GSI of a phase-one VM point A (sample 14) are over their respective thresholds, meaning that the VMI of sample 14 has lower reliance level.
It can be known from the preferred embodiment of the present invention that: the dual-phase virtual metrology method of the present invention can have the features of promptness (from VMI) and accuracy (from VMII), thus meeting the requirements of W2W control.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present invention without departing from the scope or spirit of the invention. In view of the foregoing, it is intended that the present invention cover modifications and variations of this invention provided they fall within the scope of the following claims and their equivalents.

Claims (17)

1. A dual-phase virtual metrology method, comprising:
obtaining a plurality of sets of historical process data belonging to a production equipment;
obtaining a plurality of historical measurement values from a measurement equipment, wherein said historical measurement values are the measurement values of the workpieces which are manufactured in accordance with said sets of historical process data respectively;
establishing a first conjecture model by using said sets of historical process data and said historical measurement values, wherein said first conjecture model is built in accordance with a conjecture algorithm;
waiting for collecting the process data of a plurality of workpieces from said production equipment;
After the collection of the process data of one of said workpieces from said production equipment is completed, promptly performing a phase-one conjecture step, wherein said phase-one conjecture step comprises;
Inputting the process data of said one of said workpieces into said first conjecture model, thereby computing a phase-one virtual metrology value (VMI); and
when the actual measurement value of a selected workpiece of said workpieces is obtained from said measurement equipment, performing a phase-two conjecture step, wherein said phase-two conjecture step comprises:
retraining said first conjecture model by adding the set of the process data and actual measurement value of said selected workpiece to said sets of historical process data and said historical measurement values; or tuning said first conjecture model by using the set of the process data and actual measurement value of said selected workpiece, thereby turning said first conjecture model into a second conjecture model;
inputting the process data of all the workpieces in a cassette belonging to said selected workpiece into said second conjecture model, thereby re-computing a phase-two virtual metrology value (VMII) of each workpiece in said cassette; and
updating said first conjecture model with said second conjecture model for computing the phase-one virtual metrology value of the workpiece subsequently manufactured by said production equipment.
2. The method as claimed in claim 1, wherein said conjecture algorithm is selected from the group consisting of a multi-regression algorithm and a neural network (NN) algorithm.
3. The method as claimed in claim 1, further comprising:
establishing a first reference model by using said sets of historical process data and said historical measurement values, wherein said first reference model is built in accordance with a reference algorithm, and said conjecture algorithm is different from said reference algorithm; and
said phase-one conjecture step further comprising:
Inputting the process data of said one of said workpieces into said first reference model, thereby computing a first reference prediction value; and
calculating the overlap area between the statistical distribution of said phase-one virtual metrology value of said one of said workpieces and the statistical distribution of said first reference prediction value, thereby generating the reliance index (RI) of said phase-one virtual metrology value of said one of said workpieces, wherein the reliance index is higher when the overlap area is larger, representing that the reliance level of said phase-one virtual metrology value corresponding to the reliance index is higher.
4. The method as claimed in claim 3, wherein said reference algorithm is selected from the group consisting of a multi-regression algorithm and a neural network algorithm.
5. The method as claimed in claim 3, wherein said phase-two conjecture step comprises:
retraining said first reference model by adding the set of the process data and actual measurement value of said selected workpiece to said sets of historical process data and said historical measurement values; or tuning said first reference model by using the set of the process data and actual measurement value of said selected workpiece, thereby turning said first reference model into a second reference model; and
inputting the process data of all the workpieces in said cassette belonging to said selected workpiece into said second reference model, thereby re-computing a second reference prediction value of each workpiece in said cassette; and
respectively calculating the overlap area between the statistical distribution of said phase-two virtual metrology value of each workpiece in said cassette and the statistical distribution of said second reference prediction value, thereby generating the reliance index of said phase-two virtual metrology value of each workpiece in said cassette, wherein the reliance index is higher when the overlap area is larger, representing that the reliance level of said phase-two virtual metrology value corresponding to the reliance index is higher.
6. The method as claimed in claim 5, further comprising;
updating said first reference model with said second reference model for computing the reliance index of the phase-one virtual metrology value of the workpiece subsequently manufactured by said production equipment.
7. The method as claimed in claim 5, wherein when said production equipment has been idled for a predetermined period of time, retraining said first conjecture model and said first reference model by adding the set of the process data and actual measurement value of said selected workpiece to said sets of historical process data and said historical measurement values, thereby turning said first conjecture model and said first reference model into said second conjecture and said second reference model.
8. The method as claimed in claim 1, further comprising:
establishing a first statistical distance model by using said sets of historical process data in accordance with a statistical distance algorithm; and
inputting the process data of said one of said workpieces obtained from said production equipment into said first statistical distance model, thereby computing the global similarity index (GSI) for the process data corresponding to said phase-one virtual metrology value of said one of said workpieces.
9. The method as claimed in claim 8, wherein said statistical distance algorithm is a Mahalanobis distance algorithm.
10. The method as claimed in claim 8, wherein said phase-two conjecture step comprises:
retraining said first statistical distance model by adding the process data of said selected workpiece to said sets of historical process data; or tuning said first statistical distance model by using the process data of said selected workpiece, thereby turning said first statistical distance model into a second statistical distance model; and
inputting the process data of all the workpieces in said cassette belonging to said selected workpiece into said second statistical distance model, thereby re-computing the global similarity index for the process data corresponding to said phase-two virtual metrology value of each workpiece in said cassette.
11. The method as claimed in claim 10, wherein when said production equipment has been idled for a predetermined period of time, retraining said first statistical distance model by adding the process data of said selected workpiece to said sets of historical process data, thereby turning said first statistical distance model into said second conjecture and said second statistical distance model.
12. The method as claimed in claim 10, further comprising;
updating said first statistical distance model with said second statistical distance model for computing the global similarity index for the process data corresponding to the phase-one virtual metrology value of the workpiece subsequently manufactured by said production equipment.
13. The method as claimed in claim 1, further comprising;
performing a process data preprocessing step for deleting all the anomalous process data and selecting important parameters from the process data of each of said workpieces obtained from said production equipment.
14. The method as claimed in claim 1, further comprising;
performing a metrology data preprocessing step for filtering out anomalous data in the actual measurement value of said selected workpiece.
15. The method as claimed in claim 1, wherein the phase-one virtual metrology value and phase-two virtual metrology value of each workpiece in said cassette are applied in a R2R (Run-to-Run) control system of a foundry.
16. The method as claimed in claim 15, wherein said R2R control system comprises:
a first W2W (Workpiece-to-Workpiece) control system and a second W2W control system, wherein the phase-one virtual metrology value of each workpiece in said cassette is provided as feedback input to said first W2W control system of said production equipment, and the phase-two virtual metrology value of each workpiece in said cassette is provided as feedforward input to said second W2W control system of the production equipment on which the process performed is next to the process on said production equipment.
17. The method as claimed in claim 15, wherein said R2R control system comprises:
a first L2L (Lot-to-Lot) control system and a second L2L control system, wherein the phase-two virtual metrology value of each workpiece in said cassette is provided as feedback input to said first L2L control system of said production equipment and feedforward input to said second L2L control system of the production equipment on which the process performed is next to the process on said production equipment.
US11/879,562 2007-06-08 2007-07-18 Dual-phase virtual metrology method Active 2028-06-11 US7603328B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW096120862A TWI338916B (en) 2007-06-08 2007-06-08 Dual-phase virtual metrology method
TW96120862 2007-06-08

Publications (2)

Publication Number Publication Date
US20080306625A1 US20080306625A1 (en) 2008-12-11
US7603328B2 true US7603328B2 (en) 2009-10-13

Family

ID=40096614

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/879,562 Active 2028-06-11 US7603328B2 (en) 2007-06-08 2007-07-18 Dual-phase virtual metrology method

Country Status (4)

Country Link
US (1) US7603328B2 (en)
JP (1) JP4584295B2 (en)
KR (1) KR100915339B1 (en)
TW (1) TWI338916B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120029662A1 (en) * 2010-08-02 2012-02-02 Foresight Technology Company, Ltd. Advanced process control system and method utilizing virtual metrology with reliance index
US8862525B2 (en) 2011-12-20 2014-10-14 National Cheng Kung University Method for screening samples for building prediction model and computer program product thereof
US8983644B2 (en) 2010-04-13 2015-03-17 National Cheng Kung University Manufacturing execution system with virtual-metrology capabilities and manufacturing system including the same
TWI481978B (en) * 2012-11-05 2015-04-21 Univ Nat Cheng Kung Method for predicting machining quality of machine tool
US9153506B2 (en) 2012-07-06 2015-10-06 Taiwan Semiconductor Manufacturing Company, Ltd. System and method for through silicon via yield
US10261504B2 (en) 2014-08-05 2019-04-16 United Microelectronics Corp. Virtual metrology system and method
US10269660B2 (en) 2015-05-27 2019-04-23 National Cheng Kung University Metrology sampling method with sampling rate decision scheme and computer program product thereof
US10460531B2 (en) 2014-05-12 2019-10-29 Industry-University Cooperation Foundation Hanyang University System and method for generating facility abnormality prediction model, and computer-readable recording medium storing program for executing the method
US11378946B2 (en) 2019-04-26 2022-07-05 National Cheng Kung University Predictive maintenance method for component of production tool and computer program product thererof
TWI776444B (en) * 2020-07-23 2022-09-01 國立成功大學 Virtual metrology method using convolutional neural network and computer program product thereof
US11829124B2 (en) 2020-06-04 2023-11-28 National Cheng Kung University Method for predicting occurrence of tool processing event and virtual metrology application and computer program product thereof

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8437870B2 (en) * 2009-06-05 2013-05-07 Taiwan Semiconductor Manufacturing Company, Ltd. System and method for implementing a virtual metrology advanced process control platform
US9002492B2 (en) * 2010-02-16 2015-04-07 Applied Materials, Inc. Methods and apparatuses for utilizing adaptive predictive algorithms and determining when to use the adaptive predictive algorithms for virtual metrology
TWI427487B (en) * 2010-04-02 2014-02-21 Foresight Technology Company Ltd Method for sampling workpiece for inspection and computer program product performing the same
US9164398B2 (en) * 2013-02-27 2015-10-20 Taiwan Semiconductor Manufacturing Co., Ltd. Overlay metrology method
US10935962B2 (en) * 2015-11-30 2021-03-02 National Cheng Kung University System and method for identifying root causes of yield loss
TWI625615B (en) * 2016-11-29 2018-06-01 財團法人工業技術研究院 Prediction model building method and associated predicting method and computer software product

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6700648B2 (en) * 2001-07-03 2004-03-02 Samsung Electronics, Co., Ltd. Method for controlling a processing apparatus
US7092922B2 (en) * 2003-05-23 2006-08-15 Computer Associates Think, Inc. Adaptive learning enhancement to automated model maintenance
US7209798B2 (en) * 2004-09-20 2007-04-24 Tokyo Electron Limited Iso/nested cascading trim control with model feedback updates
US7324193B2 (en) * 2006-03-30 2008-01-29 Tokyo Electron Limited Measuring a damaged structure formed on a wafer using optical metrology
US7328418B2 (en) * 2005-02-01 2008-02-05 Tokyo Electron Limited Iso/nested control for soft mask processing
US7359759B2 (en) * 2005-10-31 2008-04-15 Taiwan Semiconductor Manufacturing Company Method and system for virtual metrology in semiconductor manufacturing
US7437199B2 (en) * 2003-05-30 2008-10-14 Tokyo Electron Limited Method for data pre-population
US7477960B2 (en) * 2005-02-16 2009-01-13 Tokyo Electron Limited Fault detection and classification (FDC) using a run-to-run controller
US7493185B2 (en) * 2004-06-03 2009-02-17 National Cheng Kung University Quality prognostics system and method for manufacturing processes
US7502709B2 (en) * 2006-03-28 2009-03-10 Tokyo Electron, Ltd. Dynamic metrology sampling for a dual damascene process
US7533006B2 (en) * 2002-04-19 2009-05-12 Computer Associates Think, Inc. Method and apparatus for discovering evolutionary changes within a system
US7567700B2 (en) * 2006-03-28 2009-07-28 Tokyo Electron Limited Dynamic metrology sampling with wafer uniformity control

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0566805A (en) * 1990-03-09 1993-03-19 Internatl Business Mach Corp <Ibm> Computer-integrated manufacturing system
JP3037908B2 (en) * 1997-03-14 2000-05-08 核燃料サイクル開発機構 Variable distribution estimation method
JP3795055B1 (en) * 2005-04-26 2006-07-12 株式会社半導体理工学研究センター Value prediction apparatus, multiprocessor system, and value prediction method
JP2007052739A (en) * 2005-08-19 2007-03-01 Sumitomo Metal Ind Ltd Method and device for generating model, method and device for predicting state, and method and system for adjusting state

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6700648B2 (en) * 2001-07-03 2004-03-02 Samsung Electronics, Co., Ltd. Method for controlling a processing apparatus
US7533006B2 (en) * 2002-04-19 2009-05-12 Computer Associates Think, Inc. Method and apparatus for discovering evolutionary changes within a system
US7092922B2 (en) * 2003-05-23 2006-08-15 Computer Associates Think, Inc. Adaptive learning enhancement to automated model maintenance
US7437199B2 (en) * 2003-05-30 2008-10-14 Tokyo Electron Limited Method for data pre-population
US7493185B2 (en) * 2004-06-03 2009-02-17 National Cheng Kung University Quality prognostics system and method for manufacturing processes
US7209798B2 (en) * 2004-09-20 2007-04-24 Tokyo Electron Limited Iso/nested cascading trim control with model feedback updates
US7328418B2 (en) * 2005-02-01 2008-02-05 Tokyo Electron Limited Iso/nested control for soft mask processing
US7477960B2 (en) * 2005-02-16 2009-01-13 Tokyo Electron Limited Fault detection and classification (FDC) using a run-to-run controller
US7359759B2 (en) * 2005-10-31 2008-04-15 Taiwan Semiconductor Manufacturing Company Method and system for virtual metrology in semiconductor manufacturing
US7502709B2 (en) * 2006-03-28 2009-03-10 Tokyo Electron, Ltd. Dynamic metrology sampling for a dual damascene process
US7567700B2 (en) * 2006-03-28 2009-07-28 Tokyo Electron Limited Dynamic metrology sampling with wafer uniformity control
US7324193B2 (en) * 2006-03-30 2008-01-29 Tokyo Electron Limited Measuring a damaged structure formed on a wafer using optical metrology

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
Accuracy and Real-Time Considerations for Implementing Various Virtual Metrology Algorithms Yu-Chuan Su; Tung-Ho Lin; Fan-Tien Cheng; Wei-Ming Wu; Semiconductor Manufacturing, IEEE Transactions on vol. 21, Issue 3, Aug. 2008 pp. 426-434 Digital Object Identifier 10.1109/TSM.2008.2001219. *
An Approach for Factory-Wide Control Utilizing Virtual Metrology Khan, A.A.; Moyne, JR.; Tilbury, D.M.; Semiconductor Manufacturing, IEEE Transactions on vol. 20, Issue 4, Nov. 2007 pp. 364-375 Digital Object Identifier 10.1109/TSM.2007.907609. *
Automatic virtual metrology system design and implementation Yi-Ting Huang; Hsien-Cheng Huang; Fan-Tien Cheng; Tai-Siang Liao; Fu-Chien Chang; Automation Science and Engineering, 2008. Case 2008. IEEE International Conference on Aug. 23-26, 2008 pp. 223-229 Digital Object Identifier 10.1109/COASE.2008.4626524. *
Developing a selection scheme for dual virtual-metrology outputs Wei-Ming Wu; Fan-Tien Cheng; Deng-Lin Zeng; Tung-Ho Lin; Jyun-fang Chen; Automation Science and Engineering, 2008. Case 2008. IEEE International Conference on Aug. 23-26, 2008 pp. 230-235 Digital Object Identifier 10.1109/COASE.2008.4626525. *
Dual-Phase Virtual Metrology Scheme Fan-Tien Cheng; Hsien-Cheng Huang; Chi-An Kao; Semiconductor Manufacturing, IEEE Transactions on vol. 20, Issue 4, Nov. 2007 pp. 566-571 Digital Object Identifier 10.1109/TSM.2007.907633. *
Evaluating Reliance Level of a Virtual Metrology System Fan-Tien Cheng; Yeh-Tung Chen; Yu-Chuan Su; Deng-Lin Zeng; Semiconductor Manufacturing, IEEE Transactions on vol. 21, Issue 1, Feb. 2008 pp. 92-103 Digital Object Identifier 10.1109/TSM.2007.914373. *
NN-Based Key-Variable Selection Method for Enhancing Virtual Metrology Accuracy Tung-Ho Lin; Fan-Tien Cheng; Wei-Ming Wu; Chi-An Kao; Aeo-Juo Ye; Fu-Chien Chang; Semiconductor Manufacturing, IEEE Transactions on vol. 22, Issue 1, Feb. 2009 pp. 204-211 Digital Object Identifier 10.1109/TSM.2008.2011185. *
Virtual Metrology models for predicting physical measurement in semiconductor manufacturing Ferreira, A.; Roussy, A.; Conde, L.; Advanced Semiconductor Manufacturing Conference, 2009. ASMC '09. IEEE/SEMI May 10-12, 2009 pp. 149-154 Digital Object Identifier 10.1109/ASMC.2009.5155973. *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8983644B2 (en) 2010-04-13 2015-03-17 National Cheng Kung University Manufacturing execution system with virtual-metrology capabilities and manufacturing system including the same
US8688256B2 (en) * 2010-08-02 2014-04-01 National Cheng Kung University Advanced process control system and method utilizing virtual metrology with reliance index
US20120029662A1 (en) * 2010-08-02 2012-02-02 Foresight Technology Company, Ltd. Advanced process control system and method utilizing virtual metrology with reliance index
US8862525B2 (en) 2011-12-20 2014-10-14 National Cheng Kung University Method for screening samples for building prediction model and computer program product thereof
US9153506B2 (en) 2012-07-06 2015-10-06 Taiwan Semiconductor Manufacturing Company, Ltd. System and method for through silicon via yield
TWI481978B (en) * 2012-11-05 2015-04-21 Univ Nat Cheng Kung Method for predicting machining quality of machine tool
US10460531B2 (en) 2014-05-12 2019-10-29 Industry-University Cooperation Foundation Hanyang University System and method for generating facility abnormality prediction model, and computer-readable recording medium storing program for executing the method
US10261504B2 (en) 2014-08-05 2019-04-16 United Microelectronics Corp. Virtual metrology system and method
US10935969B2 (en) 2014-08-05 2021-03-02 United Microelectronics Corp. Virtual metrology system and method
US10269660B2 (en) 2015-05-27 2019-04-23 National Cheng Kung University Metrology sampling method with sampling rate decision scheme and computer program product thereof
US11378946B2 (en) 2019-04-26 2022-07-05 National Cheng Kung University Predictive maintenance method for component of production tool and computer program product thererof
US11829124B2 (en) 2020-06-04 2023-11-28 National Cheng Kung University Method for predicting occurrence of tool processing event and virtual metrology application and computer program product thereof
TWI776444B (en) * 2020-07-23 2022-09-01 國立成功大學 Virtual metrology method using convolutional neural network and computer program product thereof

Also Published As

Publication number Publication date
KR20080107962A (en) 2008-12-11
JP4584295B2 (en) 2010-11-17
KR100915339B1 (en) 2009-09-03
US20080306625A1 (en) 2008-12-11
JP2008305373A (en) 2008-12-18
TW200849345A (en) 2008-12-16
TWI338916B (en) 2011-03-11

Similar Documents

Publication Publication Date Title
US7603328B2 (en) Dual-phase virtual metrology method
US10269660B2 (en) Metrology sampling method with sampling rate decision scheme and computer program product thereof
US9829415B2 (en) Metrology sampling method and computer program product thereof
US8095484B2 (en) System and method for automatic virtual metrology
US8688256B2 (en) Advanced process control system and method utilizing virtual metrology with reliance index
US7593912B2 (en) Method for evaluating reliance level of a virtual metrology system in product manufacturing
US9240360B2 (en) Run-to-run control utilizing virtual metrology in semiconductor manufacturing
US8437870B2 (en) System and method for implementing a virtual metrology advanced process control platform
Cheng et al. Evaluating reliance level of a virtual metrology system
US8983644B2 (en) Manufacturing execution system with virtual-metrology capabilities and manufacturing system including the same
US6970857B2 (en) Intelligent control for process optimization and parts maintenance
Su et al. Accuracy and real-time considerations for implementing various virtual metrology algorithms
Cheng et al. Dual-phase virtual metrology scheme
US10345794B2 (en) Product quality prediction method for mass customization
Chien et al. A novel approach to hedge and compensate the critical dimension variation of the developed-and-etched circuit patterns for yield enhancement in semiconductor manufacturing
CN101118422A (en) Virtual measurement prediction generated by semi-conductor, method for establishing prediction model and system
US8155770B2 (en) Method and apparatus for dispatching workpieces to tools based on processing and performance history
CN102299044A (en) System and method for data mining and feature tracking for fab-wide prediction and control
CN101341449B (en) Enhanced state estimation based upon information credibility
CN102854848B (en) Data representation relating to a non-sampled workpiece
Kurz et al. Monitoring virtual metrology reliability in a sampling decision system
CN105895563A (en) Method and system of predicting electrical parameters of semiconductor device during manufacturing process
TWI802334B (en) Multiple-variable predictive maintenance method for component of production tool and computer program product thereof
Cheng et al. Development of a dual-phase virtual metrology scheme
Mozumder et al. Statistical control of VLSI fabrication processes

Legal Events

Date Code Title Description
AS Assignment

Owner name: NATIONAL CHENG KUNG UNIVERSITY, TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHENG, FAN-TIEN;HUANG, HSIEN-CHENG;KAO, CHI-AN;REEL/FRAME:019632/0312

Effective date: 20070702

AS Assignment

Owner name: NATIONAL CHENG KUNG UNIVERSITY, TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHENG, FAN-TIEN;HUANG, HSIEN-CHENG;KAO, CHI-AN;REEL/FRAME:019686/0845;SIGNING DATES FROM 20070702 TO 20070703

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2553); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 12