Multimodel Validity Assessment of Groundwater Flow Simulation Models Using Area Metric Approach
- 5 October 2016
- journal article
- Published by Wiley in Groundwater
- Vol. 55 (2) , 219-226
Abstract
We demonstrate the application of the Area Metric developed by Ferson et al. (2008) for multimodel validity assessment. The Area Metric quantified the degree of models' replicative validity: the degree of agreement between the observed data and the corresponding simulated outputs represented as their empirical cumulative distribution functions (ECDFs). This approach was used to rank multiple representations of a case study groundwater flow model of a landfill by their Area Metric scores. A multimodel approach allows to account for uncertainties that may either be epistemic (from lack of knowledge) or aleatory (from variability inherent in the system). The Area Metric approach enables explicit incorporation of model uncertainties, epistemic as well as aleatory, into validation assessment. The proposed approach informs understanding of the collected data and that of the model domain. It avoids model overfitting to a particular system state, and in fact is a blind assessment of the models' validity: models are not adjusted, or updated, to achieve a better numerical fit. This approach assesses the degree of models' validity, in place of the typical binary model validation/invalidation process. Collectively, this increases confidence in the model's representativeness that, in turn, reduces risk to model users.Keywords
This publication has 14 references indexed in Scilit:
- Causal models as multiple working hypotheses about environmental processesComptes Rendus. Géoscience, 2012
- Review of strategies for handling geological uncertainty in groundwater flow and transport modelingAdvances in Water Resources, 2012
- Model Averaging Techniques for Quantifying Conceptual Model UncertaintyGroundwater, 2010
- Model validation and predictive capability for the thermal challenge problemComputer Methods in Applied Mechanics and Engineering, 2008
- Measures of agreement between computation and experiment: Validation metricsJournal of Computational Physics, 2006
- Model identification for hydrological forecasting under uncertaintyStochastic Environmental Research and Risk Assessment, 2005
- Multimodel Ranking and Inference in Ground Water ModelingGroundwater, 2005
- Multi-objective global optimization for hydrologic modelsJournal of Hydrology, 1998
- Verification, Validation, and Confirmation of Numerical Models in the Earth SciencesScience, 1994
- The future of distributed models: Model calibration and uncertainty predictionHydrological Processes, 1992