Incentives, Framing, and Reliance on Algorithmic Advice: An Experimental Study
Top Cited Papers
- 1 January 2026
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 72 (1) , 302-322
Abstract
Managerial decision makers are increasingly supported by advanced data analytics and other artificial intelligence (AI)-based technologies, but they are often found to be hesitant to follow the algorithmic advice. We examine how compensation contract design and framing of an AI algorithm influence decision makers’ reliance on algorithmic advice and performance in a price estimation task. Based on a large sample of almost 1,500 participants, we find that compared with a fixed compensation, both compensation contracts based on individual performance and tournament contracts lead to an increase in effort duration and to more reliance on algorithmic advice. We further find that using an AI algorithm that is framed as also incorporating human expertise has positive effects on advice utilization, especially for decision makers with fixed pay contracts. By showing how widely used control practices, such as incentives and task framing, influence the interaction of human decision makers with AI algorithms, our findings have direct implications for managerial practice. This paper was accepted by David Simchi-Levi, Special Issue on the Human-Algorithm Connection. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2022.02777 .Keywords
This publication has 69 references indexed in Scilit:
- Training with AI: Evidence from chess computersStrategic Management Journal, 2023
- Artificial intelligence and the changing sources of competitive advantageStrategic Management Journal, 2022
- Towards a better understanding on mitigating algorithm aversion in forecasting: an experimental studyJournal of Management Control, 2021
- Machine learning and human capital complementarities: Experimental evidence on bias mitigationStrategic Management Journal, 2020
- A systematic review of algorithm aversion in augmented decision makingJournal of Behavioral Decision Making, 2019
- Human-Machine Collaboration in Cancer and BeyondJAMA Oncology, 2017
- Understanding algorithm aversion: When is advice from automation discounted?Journal of Forecasting, 2017
- A penny for your thoughts: a survey of methods for eliciting beliefsExperimental Economics, 2015
- An effort based analysis of the paradoxical effects of incentives on decision‐aided performanceJournal of Behavioral Decision Making, 2011
- Taking Advice: Accepting Help, Improving Judgment, and Sharing ResponsibilityOrganizational Behavior and Human Decision Processes, 1997