Skill of Multimodel ENSO Probability Forecasts
- 1 October 2008
- journal article
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 136 (10) , 3933-3946
Abstract
The cross-validated hindcast skills of various multimodel ensemble combination strategies are compared for probabilistic predictions of monthly SST anomalies in the ENSO-related Niño-3.4 region of the tropical Pacific Ocean. Forecast data from seven individual models of the Development of a European Multimodel Ensemble System for Seasonal-to-Interannual Prediction (DEMETER) project are used, spanning the 22-yr period of 1980–2001. Skill of the probabilistic forecasts is measured using the ranked probability skill score and rate of return, the latter being an information theory–based measure. Although skill is generally low during boreal summer relative to other times of the year, the advantage of the model forecasts over simple historical frequencies is greatest at this time. Multimodel ensemble predictions, even those using simple combination methods, generally have higher skill than single model predictions, and this advantage is greater than that expected as a result of an increase in ensemble size. Overall, slightly better performance was obtained using combination methods based on individual model skill relative to methods based on the complete joint behavior of the models. This finding is attributed to the comparatively large expected sampling error in the estimation of the relations between model errors based on the short history. A practical conclusion is that, unless some models have grossly low skill relative to the others, and until the history is much longer than two to three decades, equal, independent, or constrained joint weighting are reasonable courses.Keywords
This publication has 40 references indexed in Scilit:
- Predictability: Recent insights from information theoryReviews of Geophysics, 2007
- A Bayesian Framework for Multimodel RegressionJournal of Climate, 2007
- Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS EstimationMonthly Weather Review, 2005
- The rationale behind the success of multi-model ensembles in seasonal forecasting - I. Basic conceptTellus, 2005
- Predictability and Information Theory. Part I: Measures of PredictabilityJournal of the Atmospheric Sciences, 2004
- Ensemble Reforecasting: Improving Medium-Range Forecast Skill Using Retrospective ForecastsMonthly Weather Review, 2004
- Documentation of a highly ENSO‐related sst region in the equatorial pacific: Research noteAtmosphere-Ocean, 1997
- The Use of Model Output Statistics (MOS) in Objective Weather ForecastingJournal of Applied Meteorology, 1972
- A Scoring System for Probability Forecasts of Ranked CategoriesJournal of Applied Meteorology, 1969
- Rational DecisionsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1952