EEG-Based Emotion Recognition Using Spatial-Temporal-Connective Features via Multi-Scale CNN
Open Access
- 25 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 41859-41867
Abstract
Electroencephalography (EEG) is often used for emotion recognition in brain computer interaction (BCI) research. EEG signals from each channel mainly reflect activities of the brain region close to the channel position, and the activities cooperated by various brain regions are response to the emotion-induced stimuli. In this paper, temporal, spatial and connective features are extracted from EEG signals gotten around the head, and used for emotion recognition via a proposed model, spatial-temporal-connective convolutional neural network (STC-CNN). The channel-to-channel connectivity is gotten to describe brain region-to-region cooperation under emotion stimuli. The STC-CNN achieved an average accuracy of 96.79 percent and 96.89 percent after classifying in two emotion dimensions of arousal and valence. Utilization of the method we proposed not only helped to achieve a higher accuracy of emotion recognition, but also explored a new selection of feature for EEG research.Keywords
Funding Information
- National Key Research and Development Program of China (2020YFB1313604)
This publication has 30 references indexed in Scilit:
- Spatial–Temporal Recurrent Neural Network for Emotion RecognitionIEEE Transactions on Cybernetics, 2018
- Review and Classification of Emotion Recognition Based on EEG Brain-Computer Interface System Research: A Systematic ReviewApplied Sciences, 2017
- Identifying Stable Patterns over Time for Emotion Recognition from EEGIEEE Transactions on Affective Computing, 2017
- Emotion Recognition based on EEG using LSTM Recurrent Neural NetworkInternational Journal of Advanced Computer Science and Applications, 2017
- Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation AnalysisIEEE Transactions on Cognitive and Developmental Systems, 2016
- Deep Residual Learning for Image Recognition2016
- Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural NetworksIEEE Transactions on Autonomous Mental Development, 2015
- Classifying Different Emotional States by Means of EEG-Based Functional Connectivity PatternsPLOS ONE, 2014
- An improved method to calculate phase locking value based on Hilbert–Huang transform and its applicationNeural Computing and Applications, 2013
- Phase lag index: Assessment of functional connectivity from multi channel EEG and MEG with diminished bias from common sourcesHuman Brain Mapping, 2007