Cross-calibration of probabilistic forecasts
Authors:
- Christof StrählCSChristof Strähl
- Johanna ZiegelJZJohanna Ziegel
Open Access
- 1 January 2017
- journal article
- research article
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 11 (1) , 608-639
Abstract
When providing probabilistic forecasts for uncertain future events, it is common to strive for calibrated forecasts, that is, the predictive distribution should be compatible with the observed outcomes. Often, there are several competing forecasters of different skill. We extend common notions of calibration where each forecaster is analyzed individually, to stronger notions of cross-calibration where each forecaster is analyzed with respect to the other forecasters. In particular, cross-calibration distinguishes forecasters with respect to increasing information sets. We provide diagnostic tools and statistical tests to assess cross-calibration. The methods are illustrated in simulation examples and applied to probabilistic forecasts for inflation rates by the Bank of England. Computer code and supplementary material (Strähl and Ziegel, 2017a,b) are available online.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- Evaluation of Probabilistic Forecasts: Proper Scoring Rules and MomentsSSRN Electronic Journal, 2013
- Comparisons of various types of normality testsJournal of Statistical Computation and Simulation, 2011
- Evaluating density forecasts: forecast combinations, model mixtures, calibration and sharpnessJournal of Applied Econometrics, 2010
- Reliability, sufficiency, and the decomposition of proper scoresQuarterly Journal of the Royal Meteorological Society, 2009
- Strictly Proper Scoring Rules, Prediction, and EstimationJournal of the American Statistical Association, 2007
- Evaluating the Bank of England Density Forecasts of InflationThe Economic Journal, 2004
- Interpretation of Rank Histograms for Verifying Ensemble ForecastsMonthly Weather Review, 2001
- Evaluating Density Forecasts with Applications to Financial Risk ManagementInternational Economic Review, 1998
- Calibration-Based Empirical ProbabilityThe Annals of Statistics, 1985
- A Test of Goodness of FitJournal of the American Statistical Association, 1954