Accounting for Both Random Errors and Systematic Errors in Uncertainty Propagation Analysis of Computer Models Involving Experimental Measurements with Monte Carlo Methods
Authors:
- Victor R. VasquezVVVictor R. Vasquez
- Wallace B. WhitingWWWallace B. Whiting
- 13 December 2005
- journal article
- Published by Wiley in Risk Analysis
- Vol. 25 (6) , 1669-1681
Abstract
A Monte Carlo method is presented to study the effect of systematic and random errors on computer models mainly dealing with experimental data. It is a common assumption in this type of models (linear and nonlinear regression, and nonregression computer models) involving experimental measurements that the error sources are mainly random and independent with no constant background errors (systematic errors). However, from comparisons of different experimental data sources evidence is often found of significant bias or calibration errors. The uncertainty analysis approach presented in this work is based on the analysis of cumulative probability distributions for output variables of the models involved taking into account the effect of both types of errors. The probability distributions are obtained by performing Monte Carlo simulation coupled with appropriate definitions for the random and systematic errors. The main objectives are to detect the error source with stochastic dominance on the uncertainty propagation and the combined effect on output variables of the models. The results from the case studies analyzed show that the approach is able to distinguish which error type has a more significant effect on the performance of the model. Also, it was found that systematic or calibration errors, if present, cannot be neglected in uncertainty analysis of models dependent on experimental measurements such as chemical and physical properties. The approach can be used to facilitate decision making in fields related to safety factors selection, modeling, experimental data measurement, and experimental design.Keywords
This publication has 28 references indexed in Scilit:
- Uncertainty and sensitivity analysis in the presence of stochastic and subjective uncertaintyJournal of Statistical Computation and Simulation, 1997
- Modeling of Covalent Bonding in Solids by Inversion of Cohesive Energy CurvesPhysical Review Letters, 1996
- Random error bias in principal component analysis. Part II. Application of theoretical predictions to multivariate problemsAnalytica Chimica Acta, 1995
- Random error bias in principal component analysis. Part I. derivation of theoretical predictionsAnalytica Chimica Acta, 1995
- Treatment of Uncertainty in Performance Assessments for Complex SystemsRisk Analysis, 1994
- Parameter bias elimination for log-transformed data with arbitrary error characteristicsAmerican Journal of Physics, 1993
- Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposalReliability Engineering & System Safety, 1993
- Summary description of the methods used in the probabilistic risk assessments for NUREG-1150Nuclear Engineering and Design, 1992
- Uncertainty1990
- Maximum likelihood estimation of the general nonlinear functional relationship with replicated observations and correlated errorsBiometrika, 1972