Fairness for AUC via Feature Augmentation
Authors:
Preprint
Abstract
We study fairness in the context of classification where the performance is measured by the area under the curve (AUC) of the receiver operating characteristic. AUC is commonly used to measure the performance of prediction models. The same classifier can have significantly varying AUCs for different protected groups and, in real-world applications, it is often desirable to reduce such cross-group differences. We address the problem of how to acquire additional features to most greatly improve AUC for the disadvantaged group. We develop a novel approach, fairAUC, based on feature augmentation (adding features) to mitigate bias between identifiable groups. The approach requires only a few summary statistics to offer provable guarantees on AUC improvement, and allows managers flexibility in determining where in the fairness-accuracy tradeoff they would like to be. We evaluate fairAUC on synthetic and real-world datasets and find that it significantly improves AUC for the disadvantaged group relative to benchmarks maximizing overall AUC and minimizing bias between groups.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Adaptive Sampling Strategies to Construct Equitable Training Datasets2022
- A survey on datasets for fairness‐aware machine learningWIREs Data Mining and Knowledge Discovery, 2022
- On fair selection in the presence of implicit and differential varianceArtificial Intelligence, 2022
- Dissecting racial bias in an algorithm used to manage the health of populationsScience, 2019
- Active Fairness in Algorithmic Decision Making2019
- Fairness in Criminal Justice Risk Assessments: The State of the ArtSociological Methods & Research, 2018
- Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction InstrumentsBig Data, 2017
- Distribution of random correlation matrices: Hyperspherical parameterization of the Cholesky factorStatistics & Probability Letters, 2015
- Certifying and Removing Disparate Impact2015
- THE USE OF THE ‘BINORMAL’ MODEL FOR PARAMETRIC ROC ANALYSIS OF QUANTITATIVE DIAGNOSTIC TESTSStatistics in Medicine, 1996