Interactive Visual Cluster Analysis by Contrastive Dimensionality Reduction
- 27 September 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. PP (10772626) , 1-11
Abstract
We propose a contrastive dimensionality reduction approach (CDR) for interactive visual cluster analysis. Although dimensionality reduction of high-dimensional data is widely used in visual cluster analysis in conjunction with scatterplots, there are several limitations on effective visual cluster analysis. First, it is non-trivial for an embedding to present clear visual cluster separation when keeping neighborhood structures. Second, as cluster analysis is a subjective task, user steering is required. However, it is also non-trivial to enable interactions in dimensionality reduction. To tackle these problems, we introduce contrastive learning into dimensionality reduction for high-quality embedding. We then redefine the gradient of the loss function to the negative pairs to enhance the visual cluster separation of embedding results. Based on the contrastive learning scheme, we employ link-based interactions to steer embeddings. After that, we implement a prototype visual interface that integrates the proposed algorithms and a set of visualizations. Quantitative experiments demonstrate that CDR outperforms existing techniques in terms of preserving correct neighborhood structures and improving visual cluster separation. The ablation experiment demonstrates the effectiveness of gradient redefinition. The user study verifies that CDR outperforms t-SNE and UMAP in the task of cluster identification. We also showcase two use cases on real-world datasets to present the effectiveness of link-based interactions.Keywords
This publication has 67 references indexed in Scilit:
- CheckViz: Sanity Check and Topological Clues for Linear and Non‐Linear MappingsComputer Graphics Forum, 2010
- Selecting good views of high‐dimensional data using class consistencyComputer Graphics Forum, 2009
- iPCA: An Interactive System for PCA‐based Visual AnalyticsComputer Graphics Forum, 2009
- K-nearest neighborScholarpedia, 2009
- iVIBRATEACM Transactions on Information Systems, 2006
- Interactively exploring hierarchical clustering results [gene identification]Computer, 2002
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- A database for handwritten text recognition researchIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987