Testing Alternative Ground Water Models Using Cross‐Validation and Other Methods
- 26 June 2007
- journal article
- research article
- Published by Wiley in Groundwater
- Vol. 45 (5) , 627-641
Abstract
Many methods can be used to test alternative ground water models. Of concern in this work are methods able to (1) rank alternative models (also called model discrimination) and (2) identify observations important to parameter estimates and predictions (equivalent to the purpose served by some types of sensitivity analysis). Some of the measures investigated are computationally efficient; others are computationally demanding. The latter are generally needed to account for model nonlinearity. The efficient model discrimination methods investigated include the information criteria: the corrected Akaike information criterion, Bayesian information criterion, and generalized cross‐validation. The efficient sensitivity analysis measures used are dimensionless scaled sensitivity (DSS), composite scaled sensitivity, and parameter correlation coefficient (PCC); the other statistics are DFBETAS, Cook’s D, and observation‐prediction statistic. Acronyms are explained in the introduction. Cross‐validation (CV) is a computationally intensive nonlinear method that is used for both model discrimination and sensitivity analysis. The methods are tested using up to five alternative parsimoniously constructed models of the ground water system of the Maggia Valley in southern Switzerland. The alternative models differ in their representation of hydraulic conductivity. A new method for graphically representing CV and sensitivity analysis results for complex models is presented and used to evaluate the utility of the efficient statistics. The results indicate that for model selection, the information criteria produce similar results at much smaller computational cost than CV. For identifying important observations, the only obviously inferior linear measure is DSS; the poor performance was expected because DSS does not include the effects of parameter correlation and PCC reveals large parameter correlations.Keywords
This publication has 32 references indexed in Scilit:
- The Practical Use of Simplicity in Developing Ground Water ModelsGroundwater, 2006
- The importance of diverse data types to calibrate a watershed model of the Trout Lake Basin, Northern Wisconsin, USAJournal of Hydrology, 2006
- Multimodel Ranking and Inference in Ground Water ModelingGroundwater, 2005
- Multimodel InferenceSociological Methods & Research, 2004
- Evaluation of prediction intervals for expressing uncertainties in groundwater flow model predictionsWater Resources Research, 1999
- Detecting influential observations in nonlinear regression modeling of groundwater flowWater Resources Research, 1998
- Linear Model Selection by Cross-ValidationJournal of the American Statistical Association, 1993
- Jackknife, Bootstrap and Other Resampling Methods in Regression AnalysisThe Annals of Statistics, 1986
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974