Interactive Analysis of Word Vector Embeddings
Authors:
- 1 June 2018
- journal article
- conference paper
- Published by Wiley in Computer Graphics Forum
- Vol. 37 (3) , 253-265
Abstract
Word vector embeddings are an emerging tool for natural language processing. They have proven beneficial for a wide variety of language processing tasks. Their utility stems from the ability to encode word relationships within the vector space. Applications range from components in natural language processing systems to tools for linguistic analysis in the study of language and literature. In many of these applications, interpreting embeddings and understanding the encoded grammatical and semantic relations between words is useful, but challenging. Visualization can aid in such interpretation of embeddings. In this paper, we examine the role for visualization in working with word vector embeddings. We provide a literature survey to catalogue the range of tasks where the embeddings are employed across a broad range of applications. Based on this survey, we identify key tasks and their characteristics. Then, we present visual interactive designs that address many of these tasks. The designs integrate into an exploration and analysis environment for embeddings. Finally, we provide example use cases for them and discuss domain user feedback.Keywords
This publication has 40 references indexed in Scilit:
- Task-Driven Comparison of Topic ModelsIEEE Transactions on Visualization and Computer Graphics, 2015
- InterAxis: Steering Scatterplot Axes via Observation-Level InteractionIEEE Transactions on Visualization and Computer Graphics, 2015
- Linguistic Regularities in Sparse and Explicit Word Representations2014
- A Design Space of Visualization TasksIEEE Transactions on Visualization and Computer Graphics, 2013
- UTOPIAN: User-Driven Topic Modeling Based on Interactive Nonnegative Matrix FactorizationIEEE Transactions on Visualization and Computer Graphics, 2013
- Explainers: Expert Explorations with Crafted ProjectionsIEEE Transactions on Visualization and Computer Graphics, 2013
- DocuBurst: Visualizing Document Content using Language StructureComputer Graphics Forum, 2009
- Jigsaw: Supporting Investigative Analysis through Interactive VisualizationInformation Visualization, 2008
- Toolglass and magic lenses1993
- Contextual correlates of synonymyCommunications of the ACM, 1965