OPTIMIZING POLICYMAKERS’ LOSS FUNCTIONS IN CRISIS PREDICTION: BEFORE, WITHIN OR AFTER?
Open Access
- 21 February 2019
- journal article
- research article
- Published by Cambridge University Press (CUP) in Macroeconomic Dynamics
- Vol. 25 (1) , 100-123
Abstract
Recurring financial instabilities have led policymakers to rely on early-warning models to signal financial vulnerabilities. These models rely on ex-post optimization of signaling thresholds on crisis probabilities accounting for preferences between forecast errors, but come with the crucial drawback of unstable thresholds in recursive estimations. We propose two alternatives for threshold setting with similar or better out-of-sample performance: (i) including preferences in the estimation itself and (ii) setting thresholds ex-ante according to preferences only. Given probabilistic model output, it is intuitive that a decision rule is independent of the data or model specification, as thresholds on probabilities represent a willingness to issue a false alarm vis-à-vis missing a crisis. We provide real-world and simulation evidence that this simplification results in stable thresholds, while keeping or improving on out-of-sample performance. Our solution is not restricted to binary-choice models, but directly transferable to the signaling approach and all probabilistic early-warning models.Keywords
This publication has 28 references indexed in Scilit:
- EditorialACM SIGKDD Explorations Newsletter, 2004
- Statistical Methods in the Atmospheric SciencesJournal of the American Statistical Association, 2000
- Bootstrap tests: how many bootstraps?Econometric Reviews, 2000
- What Caused the Asian Crises: An Early Warning System ApproachEconomic Notes, 1999
- The Twin Crises: The Causes of Banking and Balance-of-Payments ProblemsAmerican Economic Review, 1999
- Currency crashes in emerging markets: An empirical treatmentJournal of International Economics, 1996
- Logistic disease incidence models and case-control studiesBiometrika, 1979
- The Estimation of Choice Probabilities from Choice Based SamplesEconometrica, 1977
- The Theory of Statistical DecisionJournal of the American Statistical Association, 1951
- Statistical Decision FunctionsThe Annals of Mathematical Statistics, 1949