Fairness in Semi-Supervised Learning: Unlabeled Data Help to Reduce Discrimination
- 15 June 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 34 (4) , 1763-1774
Abstract
A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for building fair models with sacrifice in accuracy, most are geared toward either supervised or unsupervised learning. Yet two observations inspired us to wonder whether semi-supervised learning might be useful to solve discrimination problems. First, previous study showed that increasing the size of the training set may lead to a better trade-off between fairness and accuracy. Second, the most powerful models today require an enormous of data to train which, in practical terms, is likely possible from a combination of labeled and unlabeled data. Hence, in this paper, we present a framework of fair semi-supervised learning in the pre-processing phase, including pseudo labeling to predict labels for unlabeled data, a re-sampling method to obtain multiple fair datasets and lastly, ensemble learning to improve accuracy and decrease discrimination. A theoretical decomposition analysis of bias, variance and noise highlights the different sources of discrimination and the impact they have on fairness in semi-supervised learning. A set of experiments on real-world and synthetic datasets show that our method is able to use unlabeled data to achieve a better trade-off between accuracy and discrimination.Keywords
All Related Versions
Funding Information
- ARC Discovery (DP190100981)
- Australian Research Council
- National Science Foundation (III-1526499, III-1763325, III-1909323, CNS-1930941)
This publication has 14 references indexed in Scilit:
- Bias Mitigation Post-processing for Individual and Group Fairness2019
- Costs and Benefits of Fair Representation Learning2019
- Mitigating Unwanted Biases with Adversarial Learning2018
- Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction InstrumentsBig Data, 2017
- Fairness Beyond Disparate Treatment & Disparate Impact2017
- Fairness through awareness2012
- Fairness-Aware Classifier with Prejudice Remover Regularizer2012
- Data preprocessing techniques for classification without discriminationKnowledge and Information Systems, 2011
- Building Classifiers with Independency Constraints2009
- Bagging predictorsMachine Learning, 1996