cVIL: Class-Centric Visual Interactive Labeling
Preprint
Abstract
We present cVIL, a class-centric approach to visual interactive labeling, which facilitates human annotation of large and complex image data sets. cVIL uses different property measures to support instance labeling for labeling difficult instances and batch labeling to quickly label easy instances. Simulated experiments reveal that cVIL with batch labeling can outperform traditional labeling approaches based on active learning. In a user study, cVIL led to better accuracy and higher user preference compared to a traditional instance-based visual interactive labeling approach based on 2D scatterplots.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- VisGIL: machine learning-based visual guidance for interactive labelingThe Visual Computer, 2022
- A Taxonomy of Property Measures to Unify Active Learning and Human-centered Approaches to Data LabelingACM Transactions on Interactive Intelligent Systems, 2021
- Semi-automatic data annotation guided by feature space projectionPattern Recognition, 2021
- Interactive labelling of a multivariate dataset for supervised machine learning using linked visualisations, clustering, and active learningVisual Informatics, 2019
- Multidimensional Projection for Visual Analytics: Linking Techniques with Distortions, Tasks, and Layout EnrichmentIEEE Transactions on Visualization and Computer Graphics, 2018
- VIAL: a unified process for visual interactive labelingThe Visual Computer, 2018
- Comparing Visual-Interactive Labeling with Active Learning: An Experimental StudyIEEE Transactions on Visualization and Computer Graphics, 2018
- Deep Learning Face Attributes in the Wild2015
- A survey on instance selection for active learningKnowledge and Information Systems, 2012
- Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile MethodsApplied Psychology, 2003