An Interpretable Residual Spatio-Temporal Graph Attention Network for Multiclass Emotion Recognition from EEG
Open Access
Abstract
Automatic emotion recognition based on EEG has been a key research frontier in recent years, involving the direct extraction of emotional states from brain dynamics. However, existing deep learning approaches often treat EEG either as a sequence or as a static spatial map, thereby failing to jointly capture the temporal evolution and spatial dependencies underlying emotional responses. To address this limitation, we propose an Interpretable Residual Spatio-Temporal Graph Attention Network (IRSTGANet) that integrates temporal convolutional encoding with residual graph-attention blocks. The temporal module enhances short-term EEG dynamics, while the graph-attention layers learn adaptive node connectivity relationships and preserve contextual information through residual links. Evaluated on the DEAP and SEED datasets, the proposed model achieved exceptional performance on valence and arousal, as well as four-class and nine-class classification on the DEAP dataset and on the three-class SEED dataset, exceeding state-of-the-art methods. These results demonstrate that combining temporal enhancement with residual graph attention yields both improved recognition performance and interpretable insights into emotion-related neural connectivity.Keywords
This publication has 58 references indexed in Scilit:
- SS-EMERGE - self-supervised enhancement for multidimension emotion recognition using GNNs for EEGScientific Reports, 2025
- Structural investigations of multi-reservoir Echo State Networks for EEG-based emotion classificationNeurocomputing, 2025
- Multi-level hierarchical dynamic graph convolutional networks for motor imagery EEG analysisNeurocomputing, 2025
- Emotions in multi-brain dynamics: A promising research frontierNeuroscience & Biobehavioral Reviews, 2024
- Development of a novel machine learning-based approach for brain function assessment and integrated software solutionAdvanced Engineering Informatics, 2024
- An interpretable model based on graph learning for diagnosis of Parkinson’s disease with voice-related EEGnpj Digital Medicine, 2024
- EEG emotion recognition based on Ordinary Differential Equation Graph Convolutional Networks and Dynamic Time WrappingApplied Soft Computing, 2024
- Multi-view domain-adaptive representation learning for EEG-based emotion recognitionInformation Fusion, 2023
- GLFANet: A global to local feature aggregation network for EEG emotion recognitionBiomedical Signal Processing and Control, 2023
- Deep learning with convolutional neural networks for EEG decoding and visualizationHuman Brain Mapping, 2017