Preserving the Fairness Guarantees of Classifiers in Changing Environments: A Survey
Open Access
- 10 February 2025
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 57 (6) , 1-32
Abstract
The impact of automated decision-making systems on human lives is growing, emphasizing the need for these systems to be not only accurate but also fair. The field of algorithmic fairness has expanded significantly in the past decade, with most approaches assuming that training and testing data are drawn independently and identically from the same distribution. However, in practice, differences between the training and deployment environments exist, compromising both the performance and fairness of the decision-making algorithms in real-world scenarios. A new area of research has emerged to address how to maintain fairness guarantees in classification tasks when the data generation processes differ between the source (training) and target (testing) domains. The objective of this survey is to offer a comprehensive examination of fair classification under distribution shift by presenting a taxonomy of current approaches. The latter is formulated based on the available information from the target domain, distinguishing between adaptive methods, which adapt to the target environment based on available information, and robust methods, which make minimal assumptions about the target environment. Additionally, this study emphasizes alternative benchmarking methods, investigates the interconnection with related research fields, and identifies potential avenues for future research.Keywords
This publication has 71 references indexed in Scilit:
- Themis-ml: A Fairness-Aware Machine Learning Interface for End-To-End Discrimination Discovery and MitigationJournal of Technology in Human Services, 2018
- Algorithmic Decision Making and the Cost of Fairness2017
- Fairness Beyond Disparate Treatment & Disparate Impact2017
- Certifying and Removing Disparate Impact2015
- Predictive Modeling for Public Health2015
- Automated Experiments on Ad Privacy SettingsProceedings on Privacy Enhancing Technologies, 2015
- A study in transfer learning: leveraging data from multiple hospitals to enhance hospital-specific predictionsJournal of the American Medical Informatics Association, 2014
- Fairness through awareness2012
- Fairness-Aware Classifier with Prejudice Remover Regularizer2012
- Consumer credit-risk models via machine-learning algorithmsJournal of Banking & Finance, 2010