Interactive Mitigation of Biases in Machine Learning Models for Undergraduate Student Admissions
Open Access
Abstract
Bias and fairness issues in artificial intelligence (AI) algorithms are major concerns, as people do not want to use software they cannot trust. Because these issues are intrinsically subjective and context-dependent, creating trustworthy software requires human input and feedback. (1) Introduction: This work introduces an interactive method for mitigating the bias introduced by machine learning models by allowing the user to adjust bias and fairness metrics iteratively to make the model more fair in the context of undergraduate student admissions. (2) Related Work: The social implications of bias in AI systems used in education are nuanced and can affect university reputation and student retention rates motivating a need for the development of fair AI systems. (3) Methods and Dataset: Admissions data over six years from a large urban research university was used to create AI models to predict admissions decisions. These AI models were analyzed to detect biases they may carry with respect to three variables chosen to represent sensitive populations: gender, race, and first-generation college students. We then describe a method for bias mitigation that uses a combination of machine learning and user interaction. (4) Results and Discussion: We use three scenarios to demonstrate that this interactive bias mitigation approach can successfully decrease the biases towards sensitive populations. (5) Conclusion: Our approach allows the user to examine a model and then iteratively and incrementally adjust bias and fairness metrics to change the training dataset and generate a modified AI model that is more fair, according to the user’s own determination of fairness.Keywords
This publication has 38 references indexed in Scilit:
- Bias analysis of AI models for undergraduate student admissionsNeural Computing and Applications, 2024
- Fairness, Accountability, Transparency, and Ethics (FATE) in Artificial Intelligence (AI) and higher education: A systematic reviewComputers and Education: Artificial Intelligence, 2023
- AI bias: exploring discriminatory algorithmic decision-making models and the application of possible machine-centric solutions adapted from the pharmaceutical industryAI and Ethics, 2022
- Hitting where it hurts most: COVID-19 and low-income urban college studentsEconomics of Education Review, 2022
- When students are house-poor: Urban universities, student marginality, and the hidden curriculum of student housingCities, 2022
- Predicting Student Admissions Rate into University Using Machine Learning Models2021
- A Causal Bayesian Networks Viewpoint on Fairness2019
- Data preprocessing techniques for classification without discriminationKnowledge and Information Systems, 2011
- Interactive machine learning: letting users build classifiersInternational Journal of Human-Computer Studies, 2001
- The Conflicting Demands of Work, Family, and School Among Students at an Urban UniversityThe Journal of Psychology, 1998