MagicEyes: A Large Scale Eye Gaze Estimation Dataset for Mixed Reality
Preprint
Abstract
With the emergence of Virtual and Mixed Reality (XR) devices, eye tracking has received significant attention in the computer vision community. Eye gaze estimation is a crucial component in XR -- enabling energy efficient rendering, multi-focal displays, and effective interaction with content. In head-mounted XR devices, the eyes are imaged off-axis to avoid blocking the field of view. This leads to increased challenges in inferring eye related quantities and simultaneously provides an opportunity to develop accurate and robust learning based approaches. To this end, we present MagicEyes, the first large scale eye dataset collected using real MR devices with comprehensive ground truth labeling. MagicEyes includes $587$ subjects with $80,000$ images of human-labeled ground truth and over $800,000$ images with gaze target labels. We evaluate several state-of-the-art methods on MagicEyes and also propose a new multi-task EyeNet model designed for detecting the cornea, glints and pupil along with eye segmentation in a single forward pass.
Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Predicting Gaze in Egocentric Video by Learning Task-Dependent Attention Transition2018
- Learning from Simulated and Unsupervised Images through Adversarial Training2017
- Unsupervised Learning of Depth and Ego-Motion from Video2017
- gvnn: Neural Network Library for Geometric Computer Vision2016
- Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue2016
- Deep Residual Learning for Image Recognition2016
- Eye Tracking for Everyone2016
- Learning-by-Synthesis for Appearance-Based 3D Gaze Estimation2014
- Eye tracking in the wildComputer Vision and Image Understanding, 2005
- A novel non-intrusive eye gaze estimation using cross-ratio under large head motionComputer Vision and Image Understanding, 2005