VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour
Open Access
- 20 May 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 8 (ETRA) , 1-18
Abstract
Question answering has recently been proposed as a promising means to assess the recallability of information visualisations. However, prior works are yet to study the link between visually encoding a visualisation in memory and recall performance. To fill this gap, we propose VisRecall++ -- a novel 40-participant recallability dataset that contains gaze data on 200 visualisations and 1,000 questions, including identifying the title and retrieving values. We measured recallability by asking participants questions after they observed the visualisation for 10 seconds. Our analyses reveal several insights, such as saccade amplitude, number of fixations, and fixation duration significantly differ between high and low recallability groups. Finally, we propose GazeRecallNet -- a novel computational method to predict recallability from gaze behaviour that outperforms the state-of-the-art model RecallNet and three other baselines on this task. Taken together, our results shed light on assessing recallability from gaze behaviour and inform future work on recallability-based visualisation optimisation.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy (EXC 2075 -- 390740016)
- European Research Council (801708)
- Deutsche Forschungsgemeinschaft (Project-ID 251654672 -- TRR 161)
- Swiss National Science Foundation (SNSF) through a Postdoc.Mobility Fellowship (214434)
- Research Council of Finland ((Subjective Functions, grant 357578))
This publication has 61 references indexed in Scilit:
- Understanding Image MemorabilityTrends in Cognitive Sciences, 2020
- Deep gaze pooling: Inferring and visually decoding search intents from human gaze fixationsNeurocomputing, 2020
- Adaptive feature guidance: Modelling visual search with graphical layoutsInternational Journal of Human-Computer Studies, 2020
- How to Fine-Tune BERT for Text Classification?2019
- Exploring visual attention and saliency modeling for task-based visual analysisComputers & Graphics, 2018
- Predicting task from eye movements: On the importance of spatial distribution, dynamics, and image featuresNeurocomputing, 2016
- A comparison of selected simple supervised learning algorithms to predict driver intent based on gaze dataNeurocomputing, 2013
- N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studiesHuman Brain Mapping, 2005
- Eye fixations and memory for emotional events.Journal of Experimental Psychology: Learning, Memory, and Cognition, 1991
- Cognitive determinants of fixation location during picture viewing.Journal of Experimental Psychology: Human Perception and Performance, 1978