Fair Inference for Discrete Latent Variable Models: An Intersectional Approach
Open Access
- 4 September 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 188-196
Abstract
It is now widely acknowledged that machine learning models, trained on data without due care, often exhibit discriminatory behavior. Traditional fairness research has mainly focused on supervised learning tasks, particularly classification. While fairness in unsupervised learning has received some attention, the literature has primarily addressed fair representation learning of continuous embeddings. This paper, however, takes a different approach by investigating fairness in unsupervised learning using graphical models with discrete latent variables. We develop a fair stochastic variational inference method for discrete latent variables. Our approach uses a fairness penalty on the variational distribution that reflects the principles of intersectionality, a comprehensive perspective on fairness from the fields of law, social sciences, and humanities. Intersectional fairness brings the challenge of data sparsity in minibatches, which we address via a stochastic approximation approach. We first show the utility of our method in improving equity and fairness for clustering using naïve Bayes and Gaussian mixture models on benchmark datasets. To demonstrate the generality of our approach and its potential for real-world impact, we then develop a specialized graphical model for criminal justice risk assessments, and use our fairness approach to prevent the inferences from encoding unfair societal biases.Keywords
Funding Information
- NSF (IIS1927486, IIS1850023, IIS2046381)
- NIST (60NANB18D227)
This publication has 24 references indexed in Scilit:
- Debiasing Career Recommendations with Neural Fair Collaborative Filtering2021
- Equitable Allocation of Healthcare Resources with Fair Survival Models2021
- An Intersectional Definition of Fairness2020
- Bayesian Modeling of Intersectional Fairness: The Variance of Bias2020
- Machine Learning Risk Assessments in Criminal Justice Settings2019
- Fairness Beyond Disparate Treatment & Disparate Impact2017
- DRIVING WHILE BLACK: BIAS PROCESSES AND RACIAL DISPARITY IN POLICE STOPS*Criminology, 2006
- An Introduction to Variational Methods for Graphical ModelsMachine Learning, 1999
- A Cluster Separation MeasureIEEE Transactions on Pattern Analysis and Machine Intelligence, 1979
- A Dendrite Method for Cluster AnalysisCommunications in Statistics - Simulation and Computation, 1974