Do You See What I See? A Qualitative Study Eliciting High-Level Visualization Comprehension
Authors:
- Ghulam Jilani QuadriGQGhulam Jilani Quadri
- Arran Zeyu WangAWArran Zeyu Wang
- Zhehao WangZWZhehao Wang
- Jennifer AdornoJAJennifer Adorno
- Paul RosenPRPaul Rosen
- Danielle Albers SzafirDSDanielle Albers Szafir
Preprint
Abstract
Designers often create visualizations to achieve specific high-level analytical or communication goals. These goals require people to naturally extract complex, contextualized, and interconnected patterns in data. While limited prior work has studied general high-level interpretation, prevailing perceptual studies of visualization effectiveness primarily focus on isolated, predefined, low-level tasks, such as estimating statistical quantities. This study more holistically explores visualization interpretation to examine the alignment between designers' communicative goals and what their audience sees in a visualization, which we refer to as their comprehension. We found that statistics people effectively estimate from visualizations in classical graphical perception studies may differ from the patterns people intuitively comprehend in a visualization. We conducted a qualitative study on three types of visualizations -- line graphs, bar graphs, and scatterplots -- to investigate the high-level patterns people naturally draw from a visualization. Participants described a series of graphs using natural language and think-aloud protocols. We found that comprehension varies with a range of factors, including graph complexity and data distribution. Specifically, 1) a visualization's stated objective often does not align with people's comprehension, 2) results from traditional experiments may not predict the knowledge people build with a graph, and 3) chart type alone is insufficient to predict the information people extract from a graph. Our study confirms the importance of defining visualization effectiveness from multiple perspectives to assess and inform visualization practices.Keywords
All Related Versions
- Version 1, 2024-02-23, ArXiv
- Published version: , 1.
This publication has 55 references indexed in Scilit:
- Subjectivity in personal storytelling with visualizationInformation Design Journal, 2022
- A rapidly deployed, interactive, online visualization system to support fatality management during the coronavirus disease 2019 (COVID-19) pandemicJournal of the American Medical Informatics Association, 2020
- Uncertainty-Aware Visualization for Analyzing Heterogeneous Wildfire DetectionsIEEE Computer Graphics and Applications, 2019
- Evaluating the impact of visualization of wildfire hazard upon decision-making under uncertaintyInternational Journal of Geographical Information Science, 2016
- Non-expert interpretations of hurricane forecast uncertainty visualizationsSpatial Cognition & Computation, 2016
- Defining Insight for Visual AnalyticsIEEE Computer Graphics and Applications, 2009
- Creation and Collaboration: Engaging New Audiences for Information Visualization2008
- Toward measuring visualization insightIEEE Computer Graphics and Applications, 2006
- Bottom-up and Top-down Control in Visual SearchPerception, 2004
- THE VISUAL DISPLAY OF QUANTITATIVE INFORMATIONJournal for Healthcare Quality, 1985