Improved EEG-based emotion recognition through information enhancement in connectivity feature map
Authors:
Open Access
- 23 August 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-17
Abstract
Electroencephalography (EEG), despite its inherited complexity, is a preferable brain signal for automatic human emotion recognition (ER), which is a challenging machine learning task with emerging applications. In any automatic ER, machine learning (ML) models classify emotions using the extracted features from the EEG signals, and therefore, such feature extraction is a crucial part of ER process. Recently, EEG channel connectivity features have been widely used in ER, where Pearson correlation coefficient (PCC), mutual information (MI), phase-locking value (PLV), and transfer entropy (TE) are well-known methods for connectivity feature map (CFM) construction. CFMs are typically formed in a two-dimensional configuration using the signals from two EEG channels, and such two-dimensional CFMs are usually symmetric and hold redundant information. This study proposes the construction of a more informative CFM that can lead to better ER. Specifically, the proposed innovative technique intelligently combines CFMs’ measures of two different individual methods, and its outcomes are more informative as a fused CFM. Such CFM fusion does not incur additional computational costs in training the ML model. In this study, fused CFMs are constructed by combining every pair of methods from PCC, PLV, MI, and TE; and the resulting fused CFMs PCC + PLV, PCC + MI, PCC + TE, PLV + MI, PLV + TE, and MI + TE are used to classify emotion by convolutional neural network. Rigorous experiments on the DEAP benchmark EEG dataset show that the proposed CFMs deliver better ER performances than CFM with a single connectivity method (e.g., PCC). At a glance, PLV + MI-based ER is shown to be the most promising one as it outperforms the other methods.Keywords
Funding Information
- Japan Society for the Promotion of Science (21K03930)
This publication has 62 references indexed in Scilit:
- Study on an effective cross-stimulus emotion recognition model using EEGs based on feature selection and support vector machineInternational Journal of Machine Learning and Cybernetics, 2016
- Identifying valence and arousal levels via connectivity between EEG channels2015
- Investigation of window size in classification of EEG-emotion signal with wavelet entropy and support vector machine2015
- HERMES: Towards an Integrated Toolbox to Characterize Functional and Effective Brain ConnectivityNeuroinformatics, 2013
- DEAP: A Database for Emotion Analysis ;Using Physiological SignalsIEEE Transactions on Affective Computing, 2011
- A Novel Emotion Elicitation Index Using Frontal Brain Asymmetry for Enhanced EEG-Based Emotion RecognitionIEEE Transactions on Information Technology in Biomedicine, 2011
- Wavelet-Chaos Methodology for Analysis of EEGs and EEG Sub-Bands2010
- Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysisJournal on Multimodal User Interfaces, 2009
- EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysisJournal of Neuroscience Methods, 2004
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948