Attention-Aware Visualization: Tracking and Responding to User Perception Over Time
- 9 September 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (1) , 1017-1027
Abstract
We propose the notion of attention-aware visualizations (AAVs) that track the user's perception of a visual representation over time and feed this information back to the visualization. Such context awareness is particularly useful for ubiquitous and immersive analytics where knowing which embedded visualizations the user is looking at can be used to make visualizations react appropriately to the user's attention: for example, by highlighting data the user has not yet seen. We can separate the approach into three components: (1) measuring the user's gaze on a visualization and its parts; (2) tracking the user's attention over time; and (3) reactively modifying the visual representation based on the current attention metric. In this paper, we present two separate implementations of AAV: a 2D data-agnostic method for web-based visualizations that can use an embodied eyetracker to capture the user's gaze, and a 3D data-aware one that uses the stencil buffer to track the visibility of each individual mark in a visualization. Both methods provide similar mechanisms for accumulating attention over time and changing the appearance of marks in response. We also present results from a qualitative evaluation studying visual feedback and triggering mechanisms for capturing and revisualizing attention.Keywords
All Related Versions
Funding Information
- VILLUM Investigator (VL-54492)
This publication has 49 references indexed in Scilit:
- VETA: Visual eye-tracking analytics for the exploration of gaze patterns and behavioursVisual Informatics, 2022
- Exploring visual attention and saliency modeling for task-based visual analysisComputers & Graphics, 2018
- Engineering context-aware systems and applications: A surveyJournal of Systems and Software, 2016
- An Empirical Investigation of Gaze Selection in Mid-Air Gestural 3D Manipulation2015
- Eye Pull, Eye Push: Moving Objects between Large Screens and Personal Devices with Gaze and TouchLecture Notes in Computer Science, 2013
- Context Awareness in Mobile Computing EnvironmentsWireless Personal Communications, 2006
- Understanding and Using ContextPersonal and Ubiquitous Computing, 2001
- Context-awareness in wearable and ubiquitous computingVirtual Reality, 1998
- The Computer for the 21st CenturyScientific American, 1991
- A feature-integration theory of attentionCognitive Psychology, 1980