True Overconfidence in Interval Estimates: Evidence Based on a New Measure of Miscalibration
Authors:
- 12 October 2012
- journal article
- research article
- Published by Wiley in Journal of Behavioral Decision Making
- Vol. 26 (5) , 405-417
Abstract
Overconfidence is often regarded as one of the most prevalent judgment biases. Several studies show that overconfidence can lead to suboptimal decisions of investors, managers, or politicians. Recent research, however, questions whether overconfidence should be regarded as a bias and shows that standard “overconfidence” findings can easily be explained by different degrees of knowledge of agents plus a random error in predictions. We contribute to the current literature and ongoing research by extensively analyzing interval estimates for knowledge questions, for real financial time series, and for artificially generated charts. We thereby suggest a new method to measure overconfidence in interval estimates, which is based on the implied probability mass behind a stated prediction interval. We document overconfidence patterns, which are difficult to reconcile with rationality of agents and which cannot be explained by differences in knowledge as differences in knowledge do not exist in our task. Furthermore, we show that overconfidence measures are reliable in the sense that there exist stable individual differences in the degree of overconfidence in interval estimates, thereby testing an important assumption of behavioral economics and behavioral finance models: stable individual differences in the degree of overconfidence across people. We do this in a “field experiment,” for different levels of expertise of subjects (students on the one hand and professional traders and investment bankers on the other hand), over time, by using different miscalibration metrics, and for tasks that avoid common weaknesses such as a non‐representative selection of trick questions. Copyright © 2012 John Wiley & Sons, Ltd.Keywords
This publication has 55 references indexed in Scilit:
- Overconfidence in interval estimates: What does expertise buy you?Organizational Behavior and Human Decision Processes, 2008
- Social comparison and confidence: When thinking you’re better than average predicts overconfidence (and when it does not)Organizational Behavior and Human Decision Processes, 2007
- Do Professional Traders Exhibit Myopic Loss Aversion? An Experimental AnalysisThe Journal of Finance, 2005
- The Psychology of Financial Decision-Making: Applications to Trading, Dealing, and Investment AnalysisJournal of Psychology and Financial Markets, 2001
- Home Bias in International Stock Return ExpectationsJournal of Psychology and Financial Markets, 2000
- Naive empiricism and dogmatism in confidence research: A critical examination of the hard–easy effect.Psychological Review, 2000
- Overconfidence: It Depends on How, What, and Whom You AskOrganizational Behavior and Human Decision Processes, 1999
- Aggressiveness and survival of overconfident tradersJournal of Financial Markets, 1998
- Determinants of Overconfidence and Miscalibration: The Roles of Random Error and Ecological StructureOrganizational Behavior and Human Decision Processes, 1996
- The Overconfidence Phenomenon as a Consequence of Informal Experimenter-Guided Selection of Almanac ItemsOrganizational Behavior and Human Decision Processes, 1994