GazMon: Eye Gazing Enabled Driving Behavior Monitoring and Prediction
- 27 December 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 20 (4) , 1420-1433
Abstract
Automobiles have become one of the necessities of modern life, but also introduced numerous traffic accidents that threaten drivers and other road users. Most state-of-the-art safety systems are passively triggered, reacting to dangerous road conditions or driving maneuvers only after they happen and are observed, which greatly limits the last chances for collision avoidances. Timely tracking and predicting the driving maneuvers calls for a more direct interface beyond the traditional steering wheel/brake/gas pedal. In this paper, we argue that a driver's eyes are the interface, as it is the first and the essential window that gathers external information during driving. Our experiments suggest that a driver's gaze patterns appear prior to and correlate with the driving maneuvers for driving maneuver prediction. We accordingly present GazMon, an active driving maneuver monitoring and prediction framework for driving assistance applications. GazMon extracts the gaze information through a front-camera and analyzes the facial features, including facial landmarks, head pose, and iris centers, through a carefully constructed deep learning architecture. Both our on-road experiments and driving simulator based evaluations demonstrate the superiority of our GazMon on predicting driving maneuvers as well as other distracted behaviors. It is readily deployable using RGB cameras and allows reuse of existing smartphones towards more safely driving.Keywords
Funding Information
- NSERC Postdoctoral Fellowship
- NSERC Discovery Grant
- National Natural Science Foundation of China (61602214)
This publication has 25 references indexed in Scilit:
- Invisible Sensing of Vehicle Steering with Smartphones2015
- Eye Gaze Tracking With a Web Camera in a Desktop EnvironmentIEEE Transactions on Human-Machine Systems, 2015
- Driver Gaze Tracking and Eyes Off the Road Detection SystemIEEE Transactions on Intelligent Transportation Systems, 2015
- Adaptive Linear Regression for Appearance-Based Gaze EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Image smoothing viaL0gradient minimizationACM Transactions on Graphics, 2011
- An Incremental Learning Method for Unconstrained Gaze Estimation2008
- Estimating the eye gaze from one eyeComputer Vision and Image Understanding, 2005
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Long Short-Term MemoryNeural Computation, 1997
- Model-based object pose in 25 lines of codeInternational Journal of Computer Vision, 1995