A Fine-Grained Approach for EEG-Based Emotion Recognition Using Clustering and Hybrid Deep Neural Networks
Open Access
- 21 November 2023
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 12 (23) , 4717
Abstract
Emotion recognition, as an important part of human-computer interaction, is of great research significance and has already played a role in the fields of artificial intelligence, healthcare, and distance education. In recent times, there has been a growing trend in using deep learning techniques for EEG emotion recognition. These methods have shown higher accuracy in recognizing emotions when compared with traditional machine learning methods. However, most of the current EEG emotion recognition performs multi-category single-label prediction, and is a binary classification problem based on the dimensional model. This simplifies the fact that human emotions are mixed and complex. In order to adapt to real-world applications, fine-grained emotion recognition is necessary. We propose a new method for building emotion classification labels using linguistic resource and density-based spatial clustering of applications with noise (DBSCAN). Additionally, we integrate the frequency domain and spatial features of emotional EEG signals and feed these features into a serial network that combines a convolutional neural network (CNN) and a long short-term memory (LSTM) recurrent neural network (RNN) for EEG emotion feature learning and classification. We conduct emotion classification experiments on the DEAP dataset, and the results show that our method has an average emotion classification accuracy of 92.98% per subject, validating the effectiveness of the improvements we have made to our emotion classification method. Our method for emotion classification holds potential for future use in the domain of affective computing, such as mental health care, education, social media, and so on. By constructing an automatic emotion analysis system using our method to enable the machine to understand the emotional implications conveyed by the subjects’ EEG signals, it can provide healthcare professionals with valuable information for effective treatment outcomes.Keywords
Funding Information
- National Natural Science Founds of China (62072368, U20B2050, 2021ZDLGY05-09, 2022CGKC-09, NCST2021YB-04, 2023-JC-QN-0742)
- Key Research and Development Program of Shaanxi Province (62072368, U20B2050, 2021ZDLGY05-09, 2022CGKC-09, NCST2021YB-04, 2023-JC-QN-0742)
- Open Project Funds of Shaanxi Key Laboratory for Network Computing and Security Technology (62072368, U20B2050, 2021ZDLGY05-09, 2022CGKC-09, NCST2021YB-04, 2023-JC-QN-0742)
- Natural Science Basic Research Program of Shaanxi Province (62072368, U20B2050, 2021ZDLGY05-09, 2022CGKC-09, NCST2021YB-04, 2023-JC-QN-0742)
This publication has 29 references indexed in Scilit:
- Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiersExpert Systems with Applications, 2016
- Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural NetworksIEEE Transactions on Autonomous Mental Development, 2015
- EEG-based emotion estimation using Bayesian weighted-log-posterior function and perceptron convergence algorithmComputers in Biology and Medicine, 2013
- Norms of valence, arousal, and dominance for 13,915 English lemmasBehavior Research Methods, 2013
- DEAP: A Database for Emotion Analysis ;Using Physiological SignalsIEEE Transactions on Affective Computing, 2011
- Music and emotion: Electrophysiological correlates of the processing of pleasant and unpleasant musicPsychophysiology, 2007
- Neurophysiological Correlates of Induced Discrete Emotions in Humans: An Individually Oriented AnalysisNeuroscience and Behavioral Physiology, 2006
- Long Short-Term MemoryNeural Computation, 1997
- Affective space is bipolar.Journal of Personality and Social Psychology, 1979
- Pan-Cultural Elements in Facial Displays of EmotionScience, 1969