Improving Gender-Related Fairness in Sentence Encoders: A Semantics-Based Approach
Open Access
- 15 April 2023
- journal article
- research article
- Published by Springer Nature in Data Science and Engineering
- Vol. 8 (2) , 177-195
Abstract
The ever-increasing number of systems based on semantic text analysis is making natural language understanding a fundamental task: embedding-based language models are used for a variety of applications, such as resume parsing or improving web search results. At the same time, despite their popularity and widespread use, concern is rapidly growing due to their display of social bias and lack of transparency. In particular, they exhibit a large amount of gender bias, favouring the consolidation of social stereotypes. Recently, sentence embeddings have been introduced as a novel and powerful technique to represent entire sentences as vectors. We propose a new metric to estimate gender bias in sentence embeddings, named bias score. Our solution leverages semantic importance of words and previous research on bias in word embeddings, and it is able to discern between neutral and biased gender information at sentence level. Experiments on a real-world dataset demonstrate that our novel metric can identify gender stereotyped sentences. Furthermore, we employ bias score to detect and then remove or compensate for the more stereotyped entries in text corpora used to train sentence encoders, improving their degree of fairness. Finally, we prove that models retrained on fairer corpora are less prone to make stereotypical associations compared to their original counterpart, while preserving accuracy in natural language understanding tasks. Additionally, we compare our experiments with traditional methods for reducing bias in embedding-based language models.Keywords
This publication has 45 references indexed in Scilit:
- Semantics derived automatically from language corpora contain human-like biasesScience, 2017
- A large annotated corpus for learning natural language inference2015
- Computational Analysis of Persuasiveness in Social Multimedia2014
- SemEval-2014 Task 10: Multilingual Semantic Textual Similarity2014
- Glove: Global Vectors for Word Representation2014
- Annotating Expressions of Opinions and Emotions in LanguageLanguage Resources and Evaluation, 2005
- Seeing stars2005
- Mining and summarizing customer reviews2004
- A sentimental education2004
- Building a question answering test collection2000