Evaluating convergence between two data visualization literacy assessments
Authors:
Open Access
- 5 April 2025
- journal article
- Published by Springer Nature in Cognitive Research: Principles and Implications
- Vol. 10 (1) , 15
Abstract
Data visualizations play a crucial role in communicating patterns in quantitative data, making data visualization literacy a key target of STEM education. However, it is currently unclear to what degree different assessments of data visualization literacy measure the same underlying constructs. Here, we administered two widely used graph comprehension assessments (Galesic and Garcia-Retamero in Med Dec Mak 31:444–457, 2011; Lee et al. in IEEE Trans Vis Comput Graph 235:51–560, 2016) to both a university-based convenience sample and a demographically representative sample of adult participants in the USA (N=1,113). Our analysis of individual variability in test performance suggests that overall scores are correlated between assessments and associated with the amount of prior coursework in mathematics. However, further exploration of individual error patterns suggests that these assessments probe somewhat distinct components of data visualization literacy, and we do not find evidence that these components correspond to the categories that guided the design of either test (e.g., questions that require retrieving values rather than making comparisons). Together, these findings suggest opportunities for development of more comprehensive assessments of data visualization literacy that are organized by components that better account for detailed behavioral patterns.Keywords
All Related Versions
Funding Information
- Division of Research on Learning in Formal and Informal Settings (2400471)
- Division of Behavioral and Cognitive Sciences (2047191)
- Division of Information and Intelligent Systems (2238175)
- Division of Behavioral and Cognitive Sciences (2122174)
- Division of Behavioral and Cognitive Sciences (2404706)
This publication has 57 references indexed in Scilit:
- Uncovering the structure of self-regulation through data-driven ontology discoveryNature Communications, 2019
- Using the Short Graph Literacy Scale to Predict Precursors of Health Behavior ChangeMedical Decision Making, 2019
- Measuring Graph Literacy without a TestMedical Decision Making, 2016
- A Multi-Level Typology of Abstract Visualization TasksIEEE Transactions on Visualization and Computer Graphics, 2013
- Choosing the Optimal Number of Factors in Exploratory Factor Analysis: A Model Selection PerspectiveMultivariate Behavioral Research, 2013
- Bar and Line Graph Comprehension: An Interaction of Top‐Down and Bottom‐Up ProcessesTopics in Cognitive Science, 2011
- Graph LiteracyMedical Decision Making, 2010
- Design Features of Graphs in Health Risk Communication: A Systematic ReviewJournal of the American Medical Informatics Association, 2006
- Exploratory Factor Analysis, Theory Generation, and Scientific MethodMultivariate Behavioral Research, 2005
- A Componential Model of Human Interaction with Graphs: 1. Linear Regression ModelingHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1994