Data-Driven Estimation of Driver Attention Using Calibration-Free Eye Gaze and Scene Features
- 9 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 69 (2) , 1800-1808
Abstract
Driver attention estimation is one of the key technologies for intelligent vehicles. The existing related methods only focus on the scene image or the driver's gaze or head pose. The purpose of this article is to propose a more reasonable and feasible method based on a dual-view scene with calibration-free gaze direction. According to human visual mechanisms, the low-level features, static visual saliency map, and dynamic optical flow information are extracted as input feature maps, which combine the high-level semantic descriptions and a gaze probability map transformed from the gaze direction. A multiresolution neural network is proposed to handle the calibration-free features. The proposed method is verified on a virtual reality experimental platform that collected more than 550 000 samples and obtained a more accurate ground truth. The experiments show that the proposed method is feasible and better than the state-of-the-art methods based on multiple widely used metrics. This study also provides a discussion of the effects of different landscapes, times, and weather conditions on the performance.Keywords
Funding Information
- Agency for Science, Technology and Research (1922500046)
- Nanyang Technological University (M4082268.050)
This publication has 22 references indexed in Scilit:
- Dynamics of Driver's Gaze: Explorations in Behavior Modeling and Maneuver PredictionIEEE Transactions on Intelligent Vehicles, 2018
- MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Scene Parsing through ADE20K Dataset2017
- On generalizing driver gaze zone estimation using convolutional neural networks2017
- Automated Driving from the View of Technical Standards2016
- Driver-Gaze Zone Estimation Using Bayesian Filtering and Gaussian ProcessesIEEE Transactions on Intelligent Transportation Systems, 2016
- Where Does the Driver Look? Top-Down-Based Saliency Detection in a Traffic Driving EnvironmentIEEE Transactions on Intelligent Transportation Systems, 2016
- Where is the driver looking: Analysis of head, eye and iris for robust gaze zone estimation2014
- A Study on Predicting Hazard Factors for Safe DrivingIEEE Transactions on Industrial Electronics, 2007
- Very high accuracy velocity estimation using orientation tensors, parametric motion, and simultaneous segmentation of the motion field2002