AI Reliance in the Fantasy American Football Lineup-Setting Task
Open Access
- 15 November 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Abstract
Analysts, athletes and coaches have long relied upon decision support tools, but new AI capabilities raise questions of whether they can “appropriately rely” on these models. In this work, we explore the starting lineup decisions of fantasy American football managers in the presence of projected points. Across more than 2.5 million lineup-weeks from a single fantasy platform during the 2025 NFL season, we find that fantasy managers’ starting lineups appropriately rely on AI advice in only 15.8% to 26.8% of cases. Despite managers’ observed near complete reliance, limited deviation from AI advice is often harmful to their decision-making. Bridging literature from critical data studies and AI reliance, we discuss possible explanations for this behavior, and offer design directions towards complementarity in this setting. Finally, we highlight tensions revealed by the case of fantasy football, and invite researchers to consider SportsHCI as a site to bridge social desirability and technical possibility in and beyond sports.Keywords
Funding Information
- National Science Foundation (2313998)
This publication has 73 references indexed in Scilit:
- Analytics, Have Some Humility: A Statistical View of Fourth-Down Decision MakingThe American Statistician, 2025
- The Quantified Worker2023
- A framework for the fine-grained evaluation of the instantaneous expected value of soccer possessionsMachine Learning, 2021
- Algorithm appreciation: People prefer algorithmic to human judgmentOrganizational Behavior and Human Decision Processes, 2019
- Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?European Journal of Operational Research, 2016
- Algorithm aversion: People erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology: General, 2015
- Future Interaction Design II2009
- Clinical versus mechanical prediction: A meta-analysis.Psychological Assessment, 2000
- Cueing and Cognitive Conflict in Judge-Advisor Decision MakingOrganizational Behavior and Human Decision Processes, 1995
- From Human Factors to Human Actors: The Role of Psychology and Human-Computer Interaction Studies in System Design1995