Interactive Fixation-to-AOI Mapping for Mobile Eye Tracking Data based on Few-Shot Image Classification
Open Access
- 27 March 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 175-178
Abstract
Mobile eye tracking is an important tool in psychology and human-centred interaction design for understanding how people process visual scenes and user interfaces. However, analysing recordings from mobile eye trackers, which typically include an egocentric video of the scene and a gaze signal, is a time-consuming and largely manual process. To address this challenge, we propose a web-based annotation tool that leverages few-shot image classification and interactive machine learning (IML) to accelerate the annotation process. The tool allows users to efficiently map fixations to areas of interest (AOI) in a video-editing-style interface. It includes an IML component that generates suggestions and learns from user feedback using a few-shot image classification model initialised with a small number of images per AOI. Our goal is to improve the efficiency and accuracy of fixation-to-AOI mapping in mobile eye tracking.Keywords
Funding Information
- HORIZON EUROPE Framework Programme (101093079)
- Bundesministerium für Forschung, Technologie und Raumfahrt (01JD1811C)
This publication has 16 references indexed in Scilit:
- Error-aware gaze-based interfaces for robust mobile gaze interaction2018
- Gaze-guided object classification using deep neural networks for attention-based computing2016
- EyeSee3D 2.02016
- Power to the People: The Role of Humans in Interactive Machine LearningAI Magazine, 2014
- Exploring a Model of Gaze for Grounding in Multimodal HRI2014
- Benchmark data for evaluating visualization and analysis techniques for eye tracking for video stimuli2014
- ISeeCube2014
- Gaze guided object recognition using a head-mounted eye tracker2012
- SemantiCode2010
- A New Methodology for Determining Point-of-Gaze in Head-Mounted Eye Tracking SystemsIEEE Transactions on Biomedical Engineering, 2004