Models, Uncertainty, and the Sandia V&V Challenge Problem
- 1 March 2020
- journal article
- research article
- Published by ASME International in Journal of Verification, Validation and Uncertainty Quantification
- Vol. 5 (1)
Abstract
The purpose of this paper is not to present new results; rather, it is to show that the current approach to model validation is not consistent with the accepted mathematics of probability theory. Specifically, we argue that the Sandia V&V Challenge Problem is ill-posed in that the answers sought do not, mathematically, exist. We apply our arguments to show the types of mistakes present in the papers presented in the Journal of Verification, Validation and Uncertainty Quantification, Volume 1,1 along with the challenge problem. Further, we argue that, when the problem is properly posed, both the applicable methodology and the solution techniques are easily drawn from the well-developed mathematics of probability and decision theory. The unfortunate aspect of the challenge problem as currently stated is that it leads to incorrect and inappropriate mathematical approaches that should be avoided and corrected in the current literature.Keywords
This publication has 13 references indexed in Scilit:
- The 2014 Sandia Verification and Validation Challenge: Problem StatementJournal of Verification, Validation and Uncertainty Quantification, 2016
- Sandia Verification and Validation Challenge Problem: A PCMM-Based Approach to Assessing Prediction CredibilityJournal of Verification, Validation and Uncertainty Quantification, 2016
- Economic Analysis of Model Validation for a Challenge ProblemJournal of Verification, Validation and Uncertainty Quantification, 2016
- Bayesian Uncertainty Integration for Model Calibration, Validation, and PredictionJournal of Verification, Validation and Uncertainty Quantification, 2016
- Integrating Bayesian Calibration, Bias Correction, and Machine Learning for the 2014 Sandia Verification and Validation Challenge ProblemJournal of Verification, Validation and Uncertainty Quantification, 2016
- Probability Bounds Analysis Applied to the Sandia Verification and Validation Challenge ProblemJournal of Verification, Validation and Uncertainty Quantification, 2016
- Reliability Analysis With Model Uncertainty Coupling With Parameter and Experiment Uncertainties: A Case Studyof 2014 Verification and Validation Challenge ProblemJournal of Verification, Validation and Uncertainty Quantification, 2015
- The Cheshire Cat on engineering designQuality and Reliability Engineering International, 2009
- Verification, Validation, and Confirmation of Numerical Models in the Earth SciencesScience, 1994
- Economic Viability of Pursuing a Space Power System ConceptJournal of Energy, 1977