A Human–Computer Interface Using Symmetry Between Eyes to Detect Gaze Direction
Authors:
- James GipsJGJames Gips
- Matthew R. ScottMSMatthew R. Scott
- Benjamin N. WaberBWBenjamin N. Waber
- 5 November 2008
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
- Vol. 38 (6) , 1248-1261
Abstract
In the cases of paralysis so severe that a person's ability to control movement is limited to the muscles around the eyes, eye movements or blinks are the only way for the person to communicate. Interfaces that assist in such communication are often intrusive, require special hardware, or rely on active infrared illumination. A nonintrusive communication interface system called EyeKeys was therefore developed, which runs on a consumer-grade computer with video input from an inexpensive Universal Serial Bus camera and works without special lighting. The system detects and tracks the person's face using multiscale template correlation. The symmetry between left and right eyes is exploited to detect if the person is looking at the camera or to the left or right side. The detected eye direction can then be used to control applications such as spelling programs or games. The game ldquoBlockEscaperdquo was developed to evaluate the performance of EyeKeys and compare it to a mouse substitution interface. Experiments with EyeKeys have shown that it is an easily used computer input and control device for able-bodied people and has the potential to become a practical tool for people with severe paralysis.Keywords
This publication has 54 references indexed in Scilit:
- Computer interface to use head and eyeball movement for handicapped people2002
- Preliminary investigation of real-time monitoring of a driver in city traffic2002
- Robust face tracking using color2002
- Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver VigilanceReal-Time Imaging, 2002
- Face Detection: A SurveyComputer Vision and Image Understanding, 2001
- SignStream: A tool for linguistic and computer vision research on visual-gestural language dataBehavior Research Methods, Instruments, & Computers, 2001
- Fast, reliable head tracking under varying illumination: an approach based on registration of texture-mapped 3D modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Perceptual user interfaces (introduction)Communications of the ACM, 2000
- A Model-Based Gaze Tracking SystemInternational Journal on Artificial Intelligence Tools, 1997
- Tracking and measuring drivers' eyesImage and Vision Computing, 1996