Do You See What I See? A Qualitative Study Eliciting High-Level Visualization Comprehension
Open Access
- 11 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-26
Abstract
Designers often create visualizations to achieve specific high-level analytical or communication goals. These goals require people to naturally extract complex, contextualized, and interconnected patterns in data. While limited prior work has studied general high-level interpretation, prevailing perceptual studies of visualization effectiveness primarily focus on isolated, predefined, low-level tasks, such as estimating statistical quantities. This study more holistically explores visualization interpretation to examine the alignment between designers’ communicative goals and what their audience sees in a visualization, which we refer to as their comprehension. We found that statistics people effectively estimate from visualizations in classical graphical perception studies may differ from the patterns people intuitively comprehend in a visualization. We conducted a qualitative study on three types of visualizations—line graphs, bar graphs, and scatterplots—to investigate the high-level patterns people naturally draw from a visualization. Participants described a series of graphs using natural language and think-aloud protocols. We found that comprehension varies with a range of factors, including graph complexity and data distribution. Specifically, 1) a visualization’s stated objective often does not align with people’s comprehension, 2) results from traditional experiments may not predict the knowledge people build with a graph, and 3) chart type alone is insufficient to predict the information people extract from a graph. Our study confirms the importance of defining visualization effectiveness from multiple perspectives to assess and inform visualization practices.Keywords
All Related Versions
Funding Information
- National Science Foundation (NSF IIS-1764089,NSF IIS-2320920, NSF CRA - 2127309)
This publication has 92 references indexed in Scilit:
- Visualization Psychology2023
- A rapidly deployed, interactive, online visualization system to support fatality management during the coronavirus disease 2019 (COVID-19) pandemicJournal of the American Medical Informatics Association, 2020
- Dataset to support the adoption of social media and emerging technologies for students’ continuous engagementData in Brief, 2020
- Non-expert interpretations of hurricane forecast uncertainty visualizationsSpatial Cognition & Computation, 2016
- Top-down versus bottom-up attentional control: a failed theoretical dichotomyTrends in Cognitive Sciences, 2012
- Perceiving Relationships: A Physiological Examination of the Perception of ScatterplotsLecture Notes in Computer Science, 2006
- Visual Attention: Bottom-Up Versus Top-DownCurrent Biology, 2004
- Bottom-up and Top-down Control in Visual SearchPerception, 2004
- An experiment in graphical perceptionInternational Journal of Man-Machine Studies, 1986
- Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical MethodsJournal of the American Statistical Association, 1984