Real-Time EEG-Based Driver Drowsiness Detection Based on Convolutional Neural Network With Gumbel-Softmax Trick
Authors:
- 12 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (1) , 1860-1871
Abstract
Nowadays, severe traffic accidents attributed to driver drowsiness have become increasingly frequent, prompting a widespread concern among researchers in electroencephalogram (EEG)-based driver drowsiness detection. However, due to the significant differences in EEG signals between participants, the prevalence of redundant information in multi-channel EEG data, and the computational burden in combining channel selection with neural networks, achieving an accurate and efficient real-time driver drowsiness recognition remains challenging. To overcome these limitations, this paper proposes a novel deep learning framework that utilizes a separable CNN to mine the intricate spatiotemporal information in EEG signals, combined with the channel selection layer to jointly optimize EEG channels and network parameters. This layer employs an efficient embedded Gumbel-Softmax technique for discrete sampling and differentiable approximation. To prevent the introduction of duplicate channels, we impose penalties on the row sums of the selection matrix to encourage the selection neurons to learn distinct channels, enabling the neural network to train in an end-to-end manner. The proposed model achieves an average accuracy of 80.84% and an F1 score of 79.65% in cross-subject drowsiness identification for 11 subjects on the publicly available sustained-attention driving task dataset. Compared to the results of recent relevant works, our model exhibits superior performance, surpassing state-of-the-art (SOTA) deep learning methods by 1.47%. Furthermore, building upon the model’s advantages, we have further actualized a real-time driver drowsiness detection graphical user interface (GUI), providing a practical reference for real-world applications.Keywords
Funding Information
- National Natural Science Foundation of China (61936004, 62236005, U1913602)
This publication has 51 references indexed in Scilit:
- TFormer: A time–frequency Transformer with batch normalization for driver fatigue recognitionAdvanced Engineering Informatics, 2024
- Multi-template global re-detection based on Gumbel-Softmax in long-term visual trackingApplied Intelligence, 2023
- An enhanced ensemble deep random vector functional link network for driver fatigue recognitionEngineering Applications of Artificial Intelligence, 2023
- Multi-source signal alignment and efficient multi-dimensional feature classification in the application of EEG-based subject-independent drowsiness detectionBiomedical Signal Processing and Control, 2021
- F*: an interpretable transformation of the F-measureMachine Learning, 2021
- Automated detection of driver fatigue from electroencephalography through wavelet-based connectivityBiocybernetics and Biomedical Engineering, 2021
- MYOLOv3-Tiny: A new convolutional neural network architecture for real-time detection of track fastenersComputers in Industry, 2020
- Inter-subject transfer learning for EEG-based mental fatigue recognitionAdvanced Engineering Informatics, 2020
- Automatic detection of alertness/drowsiness from physiological signals using wavelet-based nonlinear features and machine learningExpert Systems with Applications, 2015
- Mental fatigue and temporal preparation in simple reaction-time performanceActa Psychologica, 2010