ImageBiTe: A Framework for Evaluating Representational Harms in Text-to-Image Models
Open Access
- 27 April 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 95-106
Abstract
Advances in online text-to-image (T2I) generator models allow users and organizations alike to generate millions of images from text prompts. Unfortunately, recent studies have demonstrated how elementary prompts result in displaying noticeable social biases in the models' output imagery. The potential representational harm of T2I models could lead to further marginalize minority groups. Thus, a systematic approach is required to comprehensively and continuously assess the absence of bias in T2I generators. In this paper, we present ImageBiTe, a framework to systematically and thoroughly evaluate representational discrimination in T2I-generated images, seamlessly integrable into AI engineering processes. ImageBiTe enables development teams to customize their test scenarios and automatically create and run test cases based on user-defined non-discrimination requirements. We have implemented an open-source tool, available on GitHub, to support the application of our approach.Keywords
This publication has 33 references indexed in Scilit:
- OpenBias: Open-Set Bias Detection in Text-to-Image Generative Models2024
- DALL-EVAL: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models2023
- Operationalising AI ethics: barriers, enablers and next stepsAI & SOCIETY, 2021
- Putting AI ethics to work: are the tools fit for purpose?AI and Ethics, 2021
- Operationalising AI ethics: how are companies bridging the gap between practice and principles? An exploratory studyAI & SOCIETY, 2021
- Ethics as a Service: A Pragmatic Operationalisation of AI EthicsMinds and Machines, 2021
- FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age for Bias Measurement and Mitigation2021
- The ABC of stereotypes about groups: Agency/socioeconomic success, conservative–progressive beliefs, and communion.Journal of Personality and Social Psychology, 2016
- Unequal Representation and Gender Stereotypes in Image Search Results for Occupations2015
- Skin colour typology and suntanning pathwaysInternational Journal of Cosmetic Science, 1991