Measuring the Ensemble Spread–Error Relationship with a Probabilistic Approach: Stochastic Ensemble Results
Authors:
- 1 January 2007
- journal article
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 135 (1) , 203-221
Abstract
One widely accepted measure of the utility of ensemble prediction systems is the relationship between ensemble spread and deterministic forecast accuracy. Unfortunately, this relationship is often characterized by spread–error linear correlations, which oversimplify the true spread–error relationship and ignore the possibility that some end users have categorical sensitivities to forecast error. In the present paper, a simulation study is undertaken to estimate the idealized spread–error statistics for stochastic ensemble prediction systems of a finite size. Under a variety of spread–error metrics, the stochastic ensemble spread–error joint distributions are characterized by increasing scatter as the ensemble spread grows larger. A new method is introduced that recognizes the inherent nonlinearity of spread–error joint distributions and capitalizes on the fact that the probability of large forecast errors increases with ensemble spread. The ensemble spread–error relationship is measured by the skill of probability forecasts that are constructed from a history of ensemble-mean forecast errors using only cases with similar ensemble spread. Thus, the value of ensemble spread information is quantified by the ultimate benefit that is realized by end users of the probability forecasts based on these conditional-error climatologies. It is found that the skill of conditional-error-climatology forecasts based on stochastic ensemble spread is nearly equal to the skill of probability forecasts constructed directly from the raw ensemble statistics. The skill is largest for cases with anomalous spread and smallest for cases with near-normal spread. These results reinforce the findings of earlier studies and affirm that the temporal variability of ensemble spread controls its potential value as a predictor. Additionally, it is found that the skill of spread-based error probability forecasts is maximized when the chosen spread metric is consistent with the end user’s cost function.Keywords
This publication has 34 references indexed in Scilit:
- Test of a Poor Man’s Ensemble Prediction System for Short-Range Probability ForecastingMonthly Weather Review, 2005
- Aspects of Effective Mesoscale, Short-Range Ensemble ForecastingWeather and Forecasting, 2005
- A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction SystemsMonthly Weather Review, 2005
- Diversity in Interpretations of Probability: Implications for Weather ForecastingMonthly Weather Review, 2005
- Analog Ensemble Forecasts of Tropical Cyclone Tracks in the Australian RegionWeather and Forecasting, 2003
- The Skill of Ensemble Prediction SystemsMonthly Weather Review, 1999
- Vorhersage der Unsicherheit numerischer Wetterprognosen: eine ÜbersichtMeteorologische Zeitschrift, 1997
- Potential Forecast Skill of Ensemble Prediction and Spread and Skill Distributions of the ECMWF Ensemble Prediction SystemMonthly Weather Review, 1997
- A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model IntegrationsJournal of Climate, 1996
- The Relationship between Spread and Forecast Error in Extended-range ForecastsJournal of Climate, 1991