Emotion Recognition Using Three-Dimensional Feature and Convolutional Neural Network from Multichannel EEG Signals
- 1 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (2) , 2024-2034
Abstract
Using electroencephalogram (EEG) signal to recognize emotional states has become a research hotspot of affective computing. Previous emotion recognition methods almost ignored the correlation and interaction among multichannel EEG signals, which may provide salient information related to emotional states. This paper proposes a novel approach based on rearranged EEG features and deep learning algorithm. In particular, each channel EEG signal is first processed in time domain to get time-domain features. Then, features of all channels are treated as a three-dimensional (3D) feature matrix, according to positions of electrode sensors. This makes the features closer to the real response of the cerebral cortex. Subsequently, an advanced convolutional neural network (CNN) designed with univariate convolution layer and multivariate convolution layer is employed to deal with the 3D feature matrix for emotion recognition. A benchmark dataset for emotion analysis using physiological signal is employed to evaluate this method. The experimental results proved that the 3D feature matrix can effectively represent the emotion-related features in multichannel EEG signals and the proposed CNN can efficaciously mine the unique features of each channel and the correlation among channels for emotion recognition.Keywords
Funding Information
- National Natural Science Foundation of China (61502150)
- Fundamental Research Funds for the Universities of Henan Province (NSFRF1616)
- Foundation for scientific and technological project of Henan Province (172102210279)
- Key scientific research projects of universities in Henan (19A520004)
This publication has 36 references indexed in Scilit:
- EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift AdaptationThe Scientific World Journal, 2014
- Feature Extraction and Selection for Emotion Recognition from EEGIEEE Transactions on Affective Computing, 2014
- Emotional state classification from EEG data using machine learning approachNeurocomputing, 2014
- Evaluating Classifiers for Emotion Recognition Using EEG2013
- Real-Time Fractal-Based Valence Level Recognition from EEG2013
- Survey on speech emotion recognition: Features, classification schemes, and databasesPattern Recognition, 2011
- EEG Correlates of Different Emotional States Elicited during Watching Music Videos2011
- Phase lag index: Assessment of functional connectivity from multi channel EEG and MEG with diminished bias from common sourcesHuman Brain Mapping, 2007
- Neuropsychological mechanisms of individual differences in emotion, personality, and arousal.Neuropsychology, 1993
- EEG analysis based on time domain propertiesElectroencephalography and Clinical Neurophysiology, 1970