Evaluating the Feasibility of Predicting Information Relevance During Sensemaking with Eye Gaze Data
Authors:
- 16 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 713-722
Abstract
Eye gaze patterns vary based on reading purpose and complexity, and can provide insights into a reader’s perception of the content. We hypothesize that during a complex sensemaking task with many text-based documents, we will be able to use eye-tracking data to predict the importance of documents and words, which could be the basis for intelligent suggestions made by the system to an analyst. We introduce a novel eye-gaze metric called ‘GazeScore’ that predicts an analyst’s perception of the relevance of each document and word when they perform a sensemaking task. We conducted a user study to assess the effectiveness of this metric and found strong evidence that documents and words with high GazeScores are perceived as more relevant, while those with low GazeScores were considered less relevant. We explore potential real-time applications of this metric to facilitate immersive sensemaking tasks by offering relevant suggestions.Keywords
This publication has 63 references indexed in Scilit:
- An implicit feedback approach for interactive information retrievalInformation Processing & Management, 2006
- Uncovering the Problem-Solving Process: Cued Retrospective Reporting Versus Concurrent and Retrospective Reporting.Journal of Experimental Psychology: Applied, 2005
- Inspecting Pictures for Information to Verify a Sentence: Eye Movements in General Encoding and in Focused SearchThe Quarterly Journal of Experimental Psychology Section A, 2004
- Patterns between interactive intentions and information-seeking strategiesInformation Processing & Management, 2002
- Information foraging.Psychological Review, 1999
- Toward a model of eye movement control in reading.Psychological Review, 1998
- Eye movements in reading and information processing: 20 years of research.Psychological Bulletin, 1998
- Cognitive process as a basis for intelligent retrieval systems designInformation Processing & Management, 1991
- A theory of reading: From eye fixations to comprehension.Psychological Review, 1980
- Eye fixations and cognitive processesCognitive Psychology, 1976