Objective Limits on Forecasting Skill of Rare Events
- 1 April 2013
- journal article
- research article
- Published by American Meteorological Society in Weather and Forecasting
- Vol. 28 (2) , 525-534
Abstract
A method for determining baselines of skill for the purpose of the verification of rare-event forecasts is described and examples are presented to illustrate the sensitivity to parameter choices. These “practically perfect” forecasts are designed to resemble a forecast that is consistent with that which a forecaster would make given perfect knowledge of the events beforehand. The Storm Prediction Center’s convective outlook slight risk areas are evaluated over the period from 1973 to 2011 using practically perfect forecasts to define the maximum values of the critical success index that a forecaster could reasonably achieve given the constraints of the forecast, as well as the minimum values of the critical success index that are considered the baseline for skillful forecasts. Based on these upper and lower bounds, the relative skill of convective outlook areas shows little to no skill until the mid-1990s, after which this value increases steadily. The annual frequency of skillful daily forecasts continues to increase from the beginning of the period of study, and the annual cycle shows maxima of the frequency of skillful daily forecasts occurring in May and June.Keywords
This publication has 9 references indexed in Scilit:
- Evaluation of the Storm Prediction Center’s Day 1 Convective OutlooksWeather and Forecasting, 2012
- Visualizing Multiple Measures of Forecast QualityWeather and Forecasting, 2009
- Verification of Nowcasts from the WWRP Sydney 2000 Forecast Demonstration ProjectWeather and Forecasting, 2004
- Summary of the 1998 Workshop on Mesoscale Model VerificationBulletin of the American Meteorological Society, 2000
- Intercomparison of In-Flight Icing Algorithms. Part II: Statistical Verification ResultsWeather and Forecasting, 1997
- What Is a Good Forecast? An Essay on the Nature of Goodness in Weather ForecastingWeather and Forecasting, 1993
- On Summary Measures of Skill in Rare Event Forecasting Based on Contingency TablesWeather and Forecasting, 1990
- Density Estimation for Statistics and Data Analysis1986
- The numerical measure of the success of predictionsScience, 1884