Survey on Machine Learning Biases and Mitigation Techniques
Open Access
Abstract
Machine learning (ML) has become increasingly prevalent in various domains. However, ML algorithms sometimes give unfair outcomes and discrimination against certain groups. Thereby, bias occurs when our results produce a decision that is systematically incorrect. At various phases of the ML pipeline, such as data collection, pre-processing, model selection, and evaluation, these biases appear. Bias reduction methods for ML have been suggested using a variety of techniques. By changing the data or the model itself, adding more fairness constraints, or both, these methods try to lessen bias. The best technique relies on the particular context and application because each technique has advantages and disadvantages. Therefore, in this paper, we present a comprehensive survey of bias mitigation techniques in machine learning (ML) with a focus on in-depth exploration of methods, including adversarial training. We examine the diverse types of bias that can afflict ML systems, elucidate current research trends, and address future challenges. Our discussion encompasses a detailed analysis of pre-processing, in-processing, and post-processing methods, including their respective pros and cons. Moreover, we go beyond qualitative assessments by quantifying the strategies for bias reduction and providing empirical evidence and performance metrics. This paper serves as an invaluable resource for researchers, practitioners, and policymakers seeking to navigate the intricate landscape of bias in ML, offering both a profound understanding of the issue and actionable insights for responsible and effective bias mitigation.Keywords
Funding Information
- NSF (2306109, P116Z220008)
- DoED (2306109, P116Z220008)
This publication has 85 references indexed in Scilit:
- Berkson's Bias, Selection Bias, and Missing DataEpidemiology, 2012
- Selection Bias and Information Bias in Clinical ResearchNephron Clinical Practice, 2010
- A grid-based Bader analysis algorithm without lattice biasJournal of Physics: Condensed Matter, 2009
- EDUCATION AND ENTREPRENEURSHIP SELECTION AND PERFORMANCE: A REVIEW OF THE EMPIRICAL LITERATUREJournal of Economic Surveys, 2008
- Sampling Bias and Logistic ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Correcting for the Sampling Bias Problem in Spike Train Information MeasuresJournal of Neurophysiology, 2007
- Estimating Models with Sample Selection Bias: A SurveyThe Journal of Human Resources, 1998
- Costs and benefits of judgment errors: Implications for debiasing.Psychological Bulletin, 1991
- An analysis of Berkson's bias in case-control studiesJournal of Chronic Diseases, 1986
- Sample Selection Bias as a Specification ErrorEconometrica, 1979