FGCE: Feasible Group Counterfactual Explanations for Auditing Fairness
Preprint
Abstract
This paper introduces the first graph-based framework for generating group counterfactual explanations to audit model fairness, a crucial aspect of trustworthy machine learning. Counterfactual explanations are instrumental in understanding and mitigating unfairness by revealing how inputs should change to achieve a desired outcome. Our framework, named Feasible Group Counterfactual Explanations (FGCEs), captures real-world feasibility constraints and constructs subgroups with similar counterfactuals, setting it apart from existing methods. It also addresses key trade-offs in counterfactual generation, including the balance between the number of counterfactuals, their associated costs, and the breadth of coverage achieved. To evaluate these trade-offs and assess fairness, we propose measures tailored to group counterfactual generation. Our experimental results on benchmark datasets demonstrate the effectiveness of our approach in managing feasibility constraints and trade-offs, as well as the potential of our proposed metrics in identifying and quantifying fairness issues.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Benchmarking and survey of explanation methods for black box modelsData Mining and Knowledge Discovery, 2023
- Counterfactual explanations and how to find them: literature review and benchmarkingData Mining and Knowledge Discovery, 2022
- A clarification of the nuances in the fairness metrics landscapeScientific Reports, 2022
- A survey on datasets for fairness‐aware machine learningWIREs Data Mining and Knowledge Discovery, 2022
- Fairness in rankings and recommendations: an overviewThe VLDB Journal, 2021
- A Survey on Bias and Fairness in Machine LearningACM Computing Surveys, 2021
- CERTIFAI2020
- Factual and Counterfactual Explanations for Black Box Decision MakingIEEE Intelligent Systems, 2019
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)IEEE Access, 2018
- Network and Discrete Location: Models, Algorithms and ApplicationsJournal of the Operational Research Society, 1997