Investigation of Model Falsification Using Error and Likelihood Bounds with Application to a Structural System
- 1 September 2018
- journal article
- research article
- Published by American Society of Civil Engineers (ASCE) in Journal of Engineering Mechanics
- Vol. 144 (9)
Abstract
Models are used to represent and characterize physical phenomena. When there are many plausible models for a particular phenomenon, the modeler can exploit the computational tool called model falsification to systematically eliminate models that do not reasonably fit measured data. Model falsification typically compares measurements and their predictions by different models, and rejects a model if some metric of the difference between them is outside some prescribed bounds. This paper compares two model falsification approaches: a conventional bounds on residual errors and a proposed bounds on a model’s prediction of the likelihood of the residual errors. The bounds in both approaches are selected based on two error control criteria: the more commonly used familywise error rate (FWER) and—proposed herein for model falsification—the false discovery rate (FDR). Because FDR control significantly increases the likelihood of rejecting an invalid model when there are many measurements, FDR provides advantages over FWER in exploratory studies. A variant of the second approach, using likelihood bounds specified by a constant probability mass contained within those bounds, is also investigated. Unlike many model falsification studies, the focus herein is on systems with many measurements, spread across spatial and/or temporal dimensions, such as dynamical systems. An elementary example is used to show the principles of each approach. A second example considers a series of four-degree-of-freedom models of a structure subjected to an earthquake excitation. The results from these examples show that FDR does indeed increase the number of falsified models, whereas the use of likelihood bounds additionally gives unfalsified models confidence values, which can also be used for maximum likelihood parameter estimation.Keywords
This publication has 42 references indexed in Scilit:
- PRIOR AND POSTERIOR ROBUST STOCHASTIC PREDICTIONS FOR DYNAMICAL SYSTEMS USING PROBABILITY LOGICInternational Journal for Uncertainty Quantification, 2013
- Selective inference in complex researchPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2009
- Robust identification/invalidation in an LPV frameworkInternational Journal of Robust and Nonlinear Control, 2009
- Hydrological forecasting uncertainty assessment: Incoherence of the GLUE methodologyJournal of Hydrology, 2006
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodologyJournal of Hydrology, 2001
- Model validation for dynamically uncertain systemsMathematical Modelling of Systems, 1997
- Recursive state estimation: Unknown but bounded errors and system inputsIEEE Transactions on Automatic Control, 1968
- Multiple Comparisons among MeansJournal of the American Statistical Association, 1961
- Information Theory and Statistical MechanicsPhysical Review B, 1957