Examining Gender and Racial Bias in Vision-language Models within Colonial Contexts
Open Access
- 25 May 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 70-74
Abstract
Vision-language models (VLMs) are increasingly used for image retrieval in cultural heritage collections. Yet these models are trained and evaluated on modern web-scraped data which might cause unobserved biases when applied to historical imagery. While prior work has documented biases related to gender and skin tone in VLMs using contemporary datasets, no evaluation datasets exist for historical archives. In this paper, we address this gap by introducing a new dataset for evaluating demographic bias in VLMs on photograph collections from colonial contexts. Our dataset comprises annotated photographs for demographic queries spanning gender and race. Using this dataset, we examine bias in multiple VLMs through retrieval performance across queries, measuring disparities using established information retrieval metrics. Experimental results show that gender biases documented in contemporary datasets persist on historical imagery, with all tested models retrieving certain demographic groups substantially better than others. Notably, models specifically trained for debiasing fail to mitigate bias on historical images and can introduce new disparities across skin tones. These findings underscore the need for domain-specific debiasing approaches and caution against deploying off-the-shelf VLMs in archival contexts without proper evaluation.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) (531013489)
This publication has 14 references indexed in Scilit:
- FACET: Fairness in Computer Vision Evaluation Benchmark2023
- Markedness in Visual Semantic AI2022
- Implicit Stereotypes in Pre-Trained ClassifiersIEEE Access, 2021
- A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle2021
- FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age for Bias Measurement and Mitigation2021
- Reducing Disparate Exposure in Ranking: A Learning To Rank Approach2020
- The visual digital turn: Using neural networks to study historical imagesDigital Scholarship in the Humanities, 2019
- Fairness of Exposure in Rankings2018
- Content-based video retrieval in historical collections of the German Broadcasting ArchiveInternational Journal on Digital Libraries, 2018
- (Un)Reliability of video concept detection2008