VERB: Visualizing and Interpreting Bias Mitigation Techniques Geometrically for Word Representations
Open Access
- 9 January 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 14 (1) , 1-34
Abstract
Word vector embeddings have been shown to contain and amplify biases in the data they are extracted from. Consequently, many techniques have been proposed to identify, mitigate, and attenuate these biases in word representations. In this article, we utilize interactive visualization to increase the interpretability and accessibility of a collection of state-of-the-art debiasing techniques. To aid this, we present the Visualization of Embedding Representations for deBiasing (VERB) system, an open-source web-based visualization tool that helps users gain a technical understanding and visual intuition of the inner workings of debiasing techniques, with a focus on their geometric properties. In particular, VERB offers easy-to-follow examples that explore the effects of these debiasing techniques on the geometry of high-dimensional word vectors. To help understand how various debiasing techniques change the underlying geometry, VERB decomposes each technique into interpretable sequences of primitive transformations and highlights their effect on the word vectors using dimensionality reduction and interactive visual exploration. VERB is designed to target natural language processing (NLP) practitioners who are designing decision-making systems on top of word embeddings and researchers working with the fairness and ethics of machine learning systems in NLP. It can also serve as a visual medium for education, which helps an NLP novice understand and mitigate biases in word embeddings.Keywords
All Related Versions
Funding Information
- Utah Board of Higher Education’s Deep Technology Initiative
- Bringing Fairness in AI to the Forefront of Education
- VISA Research, and National Science Foundation (1514520, 1564287, 1350888, 2115677, 1816149, 1822877, 2134223, 1661375, 2007398, 1822877, 2007398, 2205418)
This publication has 39 references indexed in Scilit:
- Visualizing High-Dimensional Data: Advances in the Past DecadeIEEE Transactions on Visualization and Computer Graphics, 2016
- "Why Should I Trust You?"2016
- Visualizing the Hidden Activity of Artificial Neural NetworksIEEE Transactions on Visualization and Computer Graphics, 2016
- Online Visual Analytics of Text StreamsIEEE Transactions on Visualization and Computer Graphics, 2015
- INFUSE: Interactive Feature Selection for Predictive Modeling of High Dimensional DataIEEE Transactions on Visualization and Computer Graphics, 2014
- Hiearchie: Visualization for Hierarchical Topic Models2014
- Concurrent Visualization of Relationships between Words and Topics in Topic Models2014
- StoryFlow: Tracking the Evolution of StoriesIEEE Transactions on Visualization and Computer Graphics, 2013
- A Systematic Review on the Practice of Evaluating VisualizationIEEE Transactions on Visualization and Computer Graphics, 2013
- Termite2012