On the Applicability of ML Fairness Notions
Preprint
Abstract
ML-based predictive systems are increasingly used to support decisions with a critical impact on individuals' lives such as college admission, job hiring, child custody, criminal risk assessment, etc. As a result, fairness emerged as an important requirement to guarantee that predictive systems do not discriminate against specific individuals or entire sub-populations, in particular, minorities. Given the inherent subjectivity of viewing the concept of fairness, several notions of fairness have been introduced in the literature. This paper is a survey of fairness notions that, unlike other surveys in the literature, addresses the question of "which notion of fairness is most suited to a given real-world scenario and why?". Our attempt to answer this question consists in (1) identifying the set of fairness-related characteristics of the real-world scenario at hand, (2) analyzing the behavior of each fairness notion, and then (3) fitting these two elements to recommend the most suitable fairness notion in every specific setup. The results are summarized in a decision diagram that can be used by practitioners and policy makers to navigate the relatively large catalogue of fairness notions.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Machine Bias *2022
- A Survey on Bias and Fairness in Machine LearningACM Computing Surveys, 2021
- Dissecting racial bias in an algorithm used to manage the health of populationsScience, 2019
- Fairness in Criminal Justice Risk Assessments: The State of the ArtSociological Methods & Research, 2018
- Fairness definitions explained2018
- The problem of infra-marginality in outcome tests for discriminationThe Annals of Applied Statistics, 2017
- Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction InstrumentsBig Data, 2017
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Productivity and Selection of Human Capital with Machine LearningAmerican Economic Review, 2016
- A blot on the professionBMJ, 1988