Preference for human or algorithmic forecasting advice does not predict if and how it is used
Open Access
- 20 May 2022
- journal article
- research article
- Published by Wiley in Journal of Behavioral Decision Making
- Vol. 36 (1)
Abstract
Past research has found that people treat advice differently depending on its source. In many cases, people seem to prefer human advice to algorithms, but in others, there is a reversal, and people seem to prefer algorithmic advice. Across two studies, we examine the persuasiveness of, and judges' preferences for, advice from different sources when forecasting geopolitical events. We find that judges report domain‐specific preferences, preferring human advice in the domain of politics and algorithmic advice in the domain of economics. In Study 2, participants report a preference for hybrid advice, that combines human and algorithmic sources, to either one on it's own regardless of domain. More importantly, we find that these preferences did not affect persuasiveness of advice from these different sources, regardless of domain. Judges were primarily sensitive to quantitative features pertaining to the similarity between their initial beliefs and the advice they were offered, such as the distance between them and the relative advisor confidence, when deciding whether to revise their initial beliefs in light of advice, rather than the source that generated the advice.Keywords
Funding Information
- Intelligence Advanced Research Projects Activity (2017‐17071900005)
This publication has 61 references indexed in Scilit:
- Construal-level theory of psychological distance.Psychological Review, 2010
- Using advice from multiple sources to revise and improve judgmentsOrganizational Behavior and Human Decision Processes, 2007
- Intraclass Correlation Values for Planning Group-Randomized Trials in EducationEducational Evaluation and Policy Analysis, 2007
- Advice taking and decision-making: An integrative literature review, and implications for the organizational sciencesOrganizational Behavior and Human Decision Processes, 2006
- Aggregation of opinions based on correlated cues and advisorsJournal of Behavioral Decision Making, 2006
- A hybrid ARIMA and support vector machines model in stock price forecastingOmega, 2005
- Receiving other people’s advice: Influence and benefitOrganizational Behavior and Human Decision Processes, 2004
- Trust, Confidence, and Expertise in a Judge-Advisor SystemOrganizational Behavior and Human Decision Processes, 2001
- Cueing and Cognitive Conflict in Judge-Advisor Decision MakingOrganizational Behavior and Human Decision Processes, 1995
- VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITYMonthly Weather Review, 1950