Perceptions of Fairness in Algorithmic Decision-Making
Authors:
- Bethany HsiaoBHBethany Hsiao
- Hamsa BastaniHBHamsa Bastani
- Michael KearnsMKMichael Kearns
- Aaron RothARAaron Roth
- Duncan WattsDWDuncan Watts
Preprint
- 29 December 2025
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
In algorithmic decision-making, it is often mathematically impossible to satisfy competing definitions of fairness simultaneously. This impossibility makes assessing stakeholders' fairness preferences a challenging but crucial exercise. In this paper, we develop an interactive tool to elicit fairness preferences by projecting the complex decision space into a simple one-dimensional choice: setting risk thresholds. This design allows individuals to directly manipulate algorithm parameters and visualize the resulting tradeoffs between competing fairness metrics. Across two preregistered online experiments (n = 1, 563) in a healthcare context, we demonstrate that lay participants consistently identify efficient, near-optimal trade-offs that approach the Pareto frontier. Yet, their specific preferences are fragile: they shift significantly based on seemingly innocuous details of the information design, such as the order in which metrics are presented. These findings show that (1) our framework can effectively reveal fairness preferences and (2) the design of the elicitation process itself can fundamentally shape how fairness is perceived.Keywords
This publication has 35 references indexed in Scilit:
- A Nationwide Network of Health AI Assurance LaboratoriesJAMA, 2024
- Applicants’ Fairness Perceptions of Algorithm-Driven Hiring ProceduresJournal of Business Ethics, 2023
- Blinding curiosity: Exploring preferences for “blinding” one’s own judgmentOrganizational Behavior and Human Decision Processes, 2022
- Consumers Object to Algorithms Making Morally Relevant Tradeoffs Because of Algorithms’ Consequentialist Decision StrategiesJournal of Consumer Psychology, 2021
- Accuracy of Practitioner Estimates of Probability of Diagnosis Before and After TestingJAMA Internal Medicine, 2021
- In AI we trust? Perceptions about automated decision-making by artificial intelligenceAI & SOCIETY, 2020
- The “identified victim” effect: an identified group, or just a single individual?Journal of Behavioral Decision Making, 2005
- The Fairness of Decision RulesJournal of Management, 2004
- Perceived fairness of web‐based applicant screening procedures: Weighing the rules of justice and the role of individual differencesHuman Resource Management, 2004
- Explaining the Identifiable Victim EffectJournal of Risk and Uncertainty, 1997