Modeling Attentive Interaction Behavior for Web Content Identification in Exploratory Information Seeking
Open Access
- 21 November 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (4) , 1-28
Abstract
Extracting and collecting information during web exploration is an arduous process, demanding substantial cognitive and physical effort from users. Users must not only determine which content is worth capturing but also manually extract and save it, often disrupting the flow of their learning and exploration. To mitigate it, we propose AIbM (Attentive Interaction Behavior Modeling), which encodes and integrates multiple implicit interaction data to identify fine-grained helpful web content, providing an algorithmic foundation to facilitate automatic information extraction and collection. AIbM captures dynamic patterns of user interactions---specifically eye and mouse movements---by encoding these into images and time series. It further employs graph modeling to exploit relationships between a content block and its adjacent blocks. By incorporating graph attention networks, AIbM efficiently processes both intra-block and inter-block features, improving the identification of helpful web content. Experimental results demonstrate that AIbM achieves the highest F1 score of 82.80% in general helpful content identification, marking improvements of 10.86% over state-of-the-art models like GBT and at least 2.49% over individual modality inputs. These results underscore the potential of our approach to advance tools and systems designed for automated information extraction and collection to facilitate more effective exploratory search experiences.Keywords
Funding Information
- National Natural Science Foundation of China (62102308)
- Research on Fundamental Technologies of Power Science Computing through the Integration of Mechanism, Data, and Knowledg (5700-202440332A-2-1-ZX)
This publication has 75 references indexed in Scilit:
- Exploring visual representations of computer mouse movements for bot detection using deep learning approachesExpert Systems with Applications, 2023
- A study of visually linked keywords to support exploratory browsing in academic searchJournal of the Association for Information Science and Technology, 2022
- Comparing and Combining Interaction Data and Eye-tracking Data for the Real-time Prediction of User Cognitive Abilities in Visualization TasksACM Transactions on Interactive Intelligent Systems, 2020
- A survey of trajectory distance measures and performance evaluationThe VLDB Journal, 2019
- Investigating the role of eye movements and physiological signals in search satisfaction prediction using geometric analysisJournal of the Association for Information Science and Technology, 2019
- Modeling the usefulness of search results as measured by information useInformation Processing & Management, 2019
- Combining eye tracking, pupil dilation and EEG analysis for predicting web users click intentionInformation Fusion, 2017
- Modeling user interests from web browsing activitiesData Mining and Knowledge Discovery, 2016
- Attentive documentsACM Transactions on Interactive Intelligent Systems, 2012
- Exploratory searchCommunications of the ACM, 2006