Averaging Probability Forecasts: Back to the Future
Preprint
- 1 October 2018
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
The use and aggregation of probability forecasts in practice is on the rise. In this position piece, we explore some recent, and not so recent, developments concerning the use of probability forecasts in decision making. Despite these advances, challenges still exist. We expand on some important challenges such as miscalibration, dependence among forecasters, and selecting an appropriate evaluation measure, while connecting the processes of aggregating and evaluating forecasts to decision making. Through three important applications from the domains of meteorology, economics, and political science, we illustrate state-of-the-art usage of probability forecasts: how they are aggregated, evaluated, and communicated to stakeholders. We expect to see greater use and aggregation of probability forecasts, especially given developments in statistical modeling, machine learning, and expert forecasting; the popularity of forecasting competitions; and the increased reporting of probabilities in the media. Our vision is that increased exposure to and improved visualizations of probability forecasts will enhance the public’s understanding of probabilities and how they can contribute to better decisions.Keywords
This publication has 68 references indexed in Scilit:
- Combining Probability ForecastsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Probabilistic Forecasts, Calibration and SharpnessJournal of the Royal Statistical Society Series B: Statistical Methodology, 2007
- Strictly Proper Scoring Rules, Prediction, and EstimationJournal of the American Statistical Association, 2007
- If You're so Smart, why Aren't You Rich? Belief Selection in Complete and Incomplete MarketsEconometrica, 2006
- Do Markets Favor Agents able to Make Accurate Predictions?Econometrica, 2000
- Combining Probability Distributions From Experts in Risk AnalysisRisk Analysis, 1999
- Probability Forecasting in MeteorologyJournal of the American Statistical Association, 1984
- Elicitation of Personal Probabilities and ExpectationsJournal of the American Statistical Association, 1971
- The Opinion PoolThe Annals of Mathematical Statistics, 1961
- VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITYMonthly Weather Review, 1950