Class-constrained t-SNE: Combining Data Features and Class Probabilities
Authors:
- Linhao MengLMLinhao Meng
- Stef van Den ElzenSEStef van Den Elzen
- Nicola PezzottiNPNicola Pezzotti
- Anna VilanovaAVAnna Vilanova
Preprint
Abstract
Data features and class probabilities are two main perspectives when, e.g., evaluating model results and identifying problematic items. Class probabilities represent the likelihood that each instance belongs to a particular class, which can be produced by probabilistic classifiers or even human labeling with uncertainty. Since both perspectives are multi-dimensional data, dimensionality reduction (DR) techniques are commonly used to extract informative characteristics from them. However, existing methods either focus solely on the data feature perspective or rely on class probability estimates to guide the DR process. In contrast to previous work where separate views are linked to conduct the analysis, we propose a novel approach, class-constrained t-SNE, that combines data features and class probabilities in the same DR result. Specifically, we combine them by balancing two corresponding components in a cost function to optimize the positions of data points and iconic representation of classes -- class landmarks. Furthermore, an interactive user-adjustable parameter balances these two components so that users can focus on the weighted perspectives of interest and also empowers a smooth visual transition between varying perspectives to preserve the mental map. We illustrate its application potential in model evaluation and visual-interactive labeling. A comparative analysis is performed to evaluate the DR results.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Integrating Constraints Into Dimensionality Reduction for Visualization: A SurveyIEEE Transactions on Artificial Intelligence, 2022
- HCt-SNE: Hierarchical Constraints with t-SNE2021
- Initialization is critical for preserving global data structure in both t-SNE and UMAPNature Biotechnology, 2021
- An Interactive Visual Analytics System for Incremental Classification Based on Semi-supervised Topic Modeling2019
- Interactive labelling of a multivariate dataset for supervised machine learning using linked visualisations, clustering, and active learningVisual Informatics, 2019
- VISTopic: A visual analytics system for making sense of large document collections using hierarchical topic modelingVisual Informatics, 2017
- Interactive feature space extension for multidimensional data projectionNeurocomputing, 2015
- Improved Similarity Trees and their Application to Visual Data ClassificationIEEE Transactions on Visualization and Computer Graphics, 2011
- User-Based Active Learning2010
- A Novel Visualization Approach for Data-Mining-Related Classification2009