Real-time eye tracking using representation learning and regression
Open Access
- 4 January 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 298-306
Abstract
Eye gaze serves as a primary indicator in identifying the human interest and attention for human-computer interaction (HCI) studies. Most of the eye tracking technologies uses either specialized hardware or requires large number of calibration images to provide accurate results. Although real-time eye tracking approaches are proposed in the literature, most of these approaches use eye attributes such as pupil center and eye-lid for gaze estimation. These features are not robust, sensitive to even minor illumination changes and varies from person-to-person as well. In this work, we propose a novel representation-learning based eye tracking framework that works real-time and requires only limited number of calibration images. The person-to-person variations in eye appearance such as eye lid size and foveal offset is taken into consideration via a regression model. To account for varying head pose during eye tracking, compensation mechanisms are integrated to our pipeline. In order to illustrate the efficacy of our framework, point-wise validation and pursuit-based validation are conducted, and the gaze estimates are found to be accurate. The system is also compared with a baseline model such as Webgazer using open-source benchmark dataset- Eye of the typer Dataset (EOTT). To showcase the usability of our framework, the gaze behaviour of users on web pages and products displayed in shelf are analyzed using our system. It is observed that the gaze analysis results obtained are reliable, intuitive and aligned with the human insights.Keywords
This publication has 28 references indexed in Scilit:
- A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer PlatformsIEEE Access, 2017
- Eye Tracking for Everyone2016
- Person-independent eye gaze prediction from eye images using patch-based featuresNeurocomputing, 2016
- Appearance-based gaze estimation under slight head motionMultimedia Tools and Applications, 2016
- Appearance-based gaze estimation in the wild2015
- Adaptive Linear Regression for Appearance-Based Gaze EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Real-time eye gaze tracking for gaming design and consumer electronics systemsIEEE Transactions on Consumer Electronics, 2012
- Inferring human gaze from appearance via adaptive linear regression2011
- In the Eye of the Beholder: A Survey of Models for Eyes and GazeIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Real-time gaze tracking with appearance-based modelsMachine Vision and Applications, 2008