VA2: A Visual Analytics Approach for Evaluating Visual Analytics Applications
Authors:
- 12 August 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 22 (1) , 61-70
Abstract
Evaluation has become a fundamental part of visualization research and researchers have employed many approaches from the field of human-computer interaction like measures of task performance, thinking aloud protocols, and analysis of interaction logs. Recently, eye tracking has also become popular to analyze visual strategies of users in this context. This has added another modality and more data, which requires special visualization techniques to analyze this data. However, only few approaches exist that aim at an integrated analysis of multiple concurrent evaluation procedures. The variety, complexity, and sheer amount of such coupled multi-source data streams require a visual analytics approach. Our approach provides a highly interactive visualization environment to display and analyze thinking aloud, interaction, and eye movement data in close relation. Automatic pattern finding algorithms allow an efficient exploratory search and support the reasoning process to derive common eye-interaction-thinking patterns between participants. In addition, our tool equips researchers with mechanisms for searching and verifying expected usage patterns. We apply our approach to a user study involving a visual analytics application and we discuss insights gained from this joint analysis. We anticipate our approach to be applicable to other combinations of evaluation techniques and a broad class of visualization applications.Keywords
Funding Information
- German Federal Ministry of Education and Research
- German Science Foundation
This publication has 39 references indexed in Scilit:
- ScanMatch: A novel method for comparing fixation sequencesBehavior Research Methods, 2010
- Evaluating Information Visualizations2008
- An Insight-Based Methodology for Evaluating Bioinformatics VisualizationsIEEE Transactions on Visualization and Computer Graphics, 2005
- ColorBrewer.org: An Online Tool for Selecting Colour Schemes for MapsThe Cartographic Journal, 2003
- The state of the art in automating usability evaluation of user interfacesACM Computing Surveys, 2001
- Empirical studies of information visualization: a meta-analysisInternational Journal of Human-Computer Studies, 2000
- Algorithms for defining visual regions-of-interest: comparison with eye fixationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Basic Local Alignment Search ToolJournal of Molecular Biology, 1990
- A theory of reading: From eye fixations to comprehension.Psychological Review, 1980
- A general method applicable to the search for similarities in the amino acid sequence of two proteinsJournal of Molecular Biology, 1970