Perceptions of Fairness in Algorithmic Decision-Making

Authors:
  • BHBethany Hsiao
    Bethany Hsiao
  • HBHamsa Bastani
    Hamsa Bastani
  • MKMichael Kearns
    Michael Kearns
  • DWDuncan Watts
    Duncan Watts

Abstract
In algorithmic decision-making, it is often mathematically impossible to satisfy competing definitions of fairness simultaneously. This impossibility makes assessing stakeholders' fairness preferences a challenging but crucial exercise. In this paper, we develop an interactive tool to elicit fairness preferences by projecting the complex decision space into a simple one-dimensional choice: setting risk thresholds. This design allows individuals to directly manipulate algorithm parameters and visualize the resulting tradeoffs between competing fairness metrics. Across two preregistered online experiments (n = 1, 563) in a healthcare context, we demonstrate that lay participants consistently identify efficient, near-optimal trade-offs that approach the Pareto frontier. Yet, their specific preferences are fragile: they shift significantly based on seemingly innocuous details of the information design, such as the order in which metrics are presented. These findings show that (1) our framework can effectively reveal fairness preferences and (2) the design of the elicitation process itself can fundamentally shape how fairness is perceived.

This publication has 35 references indexed in Scilit: