Chart2Vec: A Universal Embedding of Context-Aware Visualizations
Authors:
- Qing ChenQCQing Chen
- Ying ChenYCYing Chen
- Wei ShuaiWSWei Shuai
- Ruishi ZouRZRuishi Zou
- Yi GuoYGYi Guo
- Jiazhe WangJWJiazhe Wang
- Nan CaoNCNan Cao
Preprint
Abstract
The advances in AI-enabled techniques have accelerated the creation and automation of visualizations in the past decade. However, presenting visualizations in a descriptive and generative format is still challenging. Moreover, current visualization embedding methods focus on standalone visualizations, neglecting the importance of contextual information for multi-view visualizations. To address this issue, we propose a new representation model, Chart2Vec, to learn a universal embedding of visualizations with context-aware information. Chart2Vec aims to support a wide range of downstream visualization tasks such as recommendation and storytelling. Our model considers both structural and semantic information of visualizations in declarative specifications. To enhance the context-aware capability, Chart2Vec employs multi-task learning on both supervised and unsupervised tasks concerning the co-occurrence of visualizations. We evaluate our method through an ablation study, a user study, and a quantitative comparison. The results verified the consistency of our embedding method with human cognition and showed its advantages over existing methods.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Masked Autoencoders Are Scalable Vision Learners2022
- Context-Aware Service Recommendation Based on Knowledge Graph EmbeddingIEEE Transactions on Knowledge and Data Engineering, 2021
- Steerable Self-Driving Data VisualizationIEEE Transactions on Knowledge and Data Engineering, 2020
- Meta-Transfer Learning for Few-Shot Learning2019
- DeepEye: Towards Automatic Data Visualization2018
- Identifying the Relationships Between the Visualization Context and Representation Components to Enable Recommendations for Designing New Visualizations2017
- Visual Embedding: A Model for VisualizationIEEE Computer Graphics and Applications, 2014
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- On encouraging multiple views for visualization2002
- Bidirectional recurrent neural networksIEEE Transactions on Signal Processing, 1997