Study on Driver Cross-Subject Emotion Recognition Based on Raw Multi-Channels EEG Data
Open Access
- 23 May 2023
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 12 (11) , 2359
Abstract
In our life, emotions often have a profound impact on human behavior, especially for drivers, as negative emotions can increase the risk of traffic accidents. As such, it is imperative to accurately discern the emotional states of drivers in order to preemptively address and mitigate any negative emotions that may otherwise manifest and compromise driving behavior. In contrast to many current studies that rely on complex and deep neural network models to achieve high accuracy, this research aims to explore the potential of achieving high recognition accuracy using shallow neural networks through restructuring the structure and dimensions of the data. In this study, we propose an end-to-end convolutional neural network (CNN) model called simply ameliorated CNN (SACNN) to address the issue of low accuracy in cross-subject emotion recognition. We extracted features and converted dimensions of EEG signals from the SEED dataset from the BCMI Laboratory to construct 62-dimensional data, and obtained the optimal model configuration through ablation experiments. To further improve recognition accuracy, we selected the top 10 channels with the highest accuracy by separately training the EEG data of each of the 62 channels. The results showed that the SACNN model achieved an accuracy of 88.16% based on raw cross-subject data, and an accuracy of 91.85% based on EEG channel data from the top 10 channels. In addition, we explored the impact of the position of the BN and dropout layers on the model through experiments, and found that a targeted shallow CNN model performed better than deeper and larger perceptual field CNN models. Furthermore, we discuss herein the future issues and challenges of driver emotion recognition in promising smart city applications.Keywords
Funding Information
- Shanghai Science and Technology Innovation Action Planning grant (20dz1203800)
This publication has 27 references indexed in Scilit:
- Improving EEG-Based Emotion Classification Using Conditional Transfer LearningFrontiers in Human Neuroscience, 2017
- Identifying Stable Patterns over Time for Emotion Recognition from EEGIEEE Transactions on Affective Computing, 2017
- EEG-Based Emotion Recognition Using Hierarchical Network With Subnetwork NodesIEEE Transactions on Cognitive and Developmental Systems, 2017
- Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network2016
- Driver Behavior Analysis for Safe Driving: A SurveyIEEE Transactions on Intelligent Transportation Systems, 2015
- Novel Vehicle Motion Model considering Driver Behavior for Trajectory Prediction and Driving Risk DetectionTransportation Research Record: Journal of the Transportation Research Board, 2014
- Applying ICA in EEG: Choice of the Window Length and of the Decorrelation Method2013
- Vision-based method for detecting driver drowsiness and distraction in driver monitoring systemOptical Engineering, 2011
- Development of advanced driver assistance systems with vehicle hardware-in-the-loop simulationsVehicle System Dynamics, 2006
- Voluntary Smiling Changes Regional Brain ActivityPsychological Science, 1993