Fairness through Aleatoric Uncertainty
Preprint
Abstract
We propose a simple yet effective solution to tackle the often-competing goals of fairness and utility in classification tasks. While fairness ensures that the model's predictions are unbiased and do not discriminate against any particular group or individual, utility focuses on maximizing the model's predictive performance. This work introduces the idea of leveraging aleatoric uncertainty (e.g., data ambiguity) to improve the fairness-utility trade-off. Our central hypothesis is that aleatoric uncertainty is a key factor for algorithmic fairness and samples with low aleatoric uncertainty are modeled more accurately and fairly than those with high aleatoric uncertainty. We then propose a principled model to improve fairness when aleatoric uncertainty is high and improve utility elsewhere. Our approach first intervenes in the data distribution to better decouple aleatoric uncertainty and epistemic uncertainty. It then introduces a fairness-utility bi-objective loss defined based on the estimated aleatoric uncertainty. Our approach is theoretically guaranteed to improve the fairness-utility trade-off. Experimental results on both tabular and image datasets show that the proposed approach outperforms state-of-the-art methods w.r.t. the fairness-utility trade-off and w.r.t. both group and individual fairness metrics. This work presents a fresh perspective on the trade-off between utility and algorithmic fairness and opens a key avenue for the potential of using prediction uncertainty in fair machine learning.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- A review of uncertainty quantification in deep learning: Techniques, applications and challengesInformation Fusion, 2021
- Socially Responsible AI Algorithms: Issues, Purposes, and ChallengesJournal of Artificial Intelligence Research, 2021
- A Survey on Bias and Fairness in Machine LearningACM Computing Surveys, 2021
- Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methodsMachine Learning, 2021
- An Introductory Guide to Fano’s Inequality with Applications in Statistical Estimation2021
- Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction InstrumentsBig Data, 2017
- Decision Theory for Discrimination-Aware Classification2012
- Data preprocessing techniques for classification without discriminationKnowledge and Information Systems, 2011
- Coalition-Proof Nash Equilibria I. ConceptsJournal of Economic Theory, 1987