How fair are we? From conceptualization to automated assessment of fairness definitions
Open Access
- 28 February 2025
- journal article
- research article
- Published by Springer Nature in Software and Systems Modeling
- Vol. 25 (1) , 189-215
Abstract
Fairness is a critical concept in ethics and social domains, but it is also a challenging property to engineer in software systems. With the increasing use of machine learning in software systems, researchers have been developing techniques to assess the fairness of software systems automatically. Nonetheless, many of these techniques rely upon pre-established fairness definitions, metrics, and criteria, which may fail to encompass the wide-ranging needs and preferences of users and stakeholders. To overcome this limitation, we propose a novel approach, called MODNESS, that enables users to customize and define their fairness concepts using a dedicated modeling environment. Our approach guides the user through the definition of new fairness concepts also in emerging domains, and the specification and composition of metrics for its evaluation through a dedicated domain-specific language. Ultimately, MODNESS generates the source code to implement fair assessment based on these custom definitions. In addition, we elucidate the process we followed to collect and analyze relevant literature on fairness assessment in software engineering (SE). We compare MODNESS with the selected approaches and evaluate how they support the distinguishing features identified by our study. Our findings reveal that i) most of the current approaches do not support user-defined fairness concepts; ii) our approach can cover additional application domains not addressed by currently available tools, e.g., mitigating bias in recommender systems for software engineering and Arduino software component recommendations; iii) MODNESS demonstrates the capability to overcome the limitations of the only two other model-driven engineering-based approaches for fairness assessment.Keywords
Funding Information
- Ministero dell’Università e della Ricerca (2020W3A5FY)
- European Union - NextGenerationEU - National Recovery and Resilience Plan (IR0000013)
- European Union - NextGenerationEU - National Recovery and Resilience Plan (P2022553SL)
This publication has 62 references indexed in Scilit:
- Fairness in recommender systems: research landscape and future directionsUser Modeling and User-Adapted Interaction, 2023
- Democratizing Quality-Based Machine Learning Development through Extended Feature Models2023
- Democratizing artificial intelligence: How no-code AI can leverage machine learning operationsBusiness Horizons, 2023
- Debiaser for Multiple Variables to enhance fairness in classification tasksInformation Processing & Management, 2022
- Search-based fairness testing for regression-based machine learning systemsEmpirical Software Engineering, 2022
- AequeVox: Automated Fairness Testing of Speech Recognition Systems2022
- CrossRec: Supporting software developers by recommending third-party librariesJournal of Systems and Software, 2020
- A data-driven approach to predict the success of bank telemarketingDecision Support Systems, 2014
- Data preprocessing techniques for classification without discriminationKnowledge and Information Systems, 2011
- Identifying relevant studies in software engineeringInformation and Software Technology, 2011