EEG-Based Drowsiness Estimation for Driving Safety Using Deep Q-Learning
- 3 June 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 5 (4) , 583-594
Abstract
Fatigue is the most vital factor of road fatalities, and one manifestation of fatigue during driving is drowsiness. In this paper, we propose using deep Q-learning to study the correlation between drowsiness and driving performance. This study is carried out by analyzing an electroencephalogram (EEG) dataset captured during a simulated endurance driving test. Driving safety research using EEG data represents an important brain-computer interface (BCI) paradigm from an application perspective. To formulate the drowsiness estimation problem as an optimization of a Q-learning task, we adapt the terminologies in the driving test to fit the reinforcement learning framework. Based on that, a deep Q-network (DQN) is tailored by referring to the latest DQN technologies. The designed network merits the characteristics of the EEG data and can generate actions to indirectly estimate drowsiness. The results show that the trained model can trace the variations of mind state in a satisfactory way against the testing EEG data, which confirms the feasibility and practicability of this new computation paradigm. By comparison, it also reveals that our method outperforms the supervised learning counterpart and is superior for real applications. To the best of our knowledge, we are the first to introduce the deep reinforcement learning method to this BCI scenario, and our method can potentially be generalized to other BCI cases.Keywords
All Related Versions
Funding Information
- Australian Research Council (DP180100670, DP180100656)
- Australia Defence Innovation Hub (P18-650825)
- Office of Naval Research Global (ONRG - NICOP - N62909-19-1-2058)
- NSW Defence Innovation Network
- NSW State Government of Australia (DINPP2019 S1-03/09)
This publication has 33 references indexed in Scilit:
- Traffic accidents involving fatigue driving and their extent of casualtiesAccident Analysis & Prevention, 2016
- Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural NetworkIEEE Transactions on Neural Networks and Learning Systems, 2015
- Analysis of EEG Signals and Facial Expressions to Detect Drowsiness and Fatigue using Gabor Filters and SVM Linear ClassifierInternational Journal of Computer Applications, 2015
- Study of Steering Wheel Movement under Fatigue Driving and Drunk Driving Based on Sample EntropyApplied Mechanics and Materials, 2015
- Human-level control through deep reinforcement learningNature, 2015
- A method of detecting driver drowsiness state based on multi-features of face2012
- Neuron-type-specific signals for reward and punishment in the ventral tegmental areaNature, 2012
- Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesisProceedings of the National Academy of Sciences, 2011
- Can SVM be used for automatic EEG detection of drowsiness during car driving?Safety Science, 2009
- Lapse in alertness: coherence of fluctuations in performance and EEG spectrumElectroencephalography and Clinical Neurophysiology, 1993