Contrastive Twin Latent Informer Based on Autoencoder for EEG Emotion Recognition
- 22 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 56 (4) , 2660-2672
Abstract
Electroencephalography (EEG) is widely used in emotion recognition due to its reliability and noninvasiveness. However, challenges as signal noise and individual variability in EEG data present significant limitations for real-world applications. Inspired by recent neuroscience advances, we propose a contrastive twin latent informer (CTLIN) model for EEG-based emotion recognition and signal generation. The architecture employs a symmetric autoencoder (AE) that synergistically integrates PropSparse self-attention mechanisms with EEG feature extraction, incorporating a novel twin latent permutation (LP) design. By disentangling EEG features into subject and emotion latent representations through contrastive learning, the model demonstrates enhanced capability in capturing generalizable biomarkers. Experimental results show CTLIN’s state-of-the-art performance in zero-shot classification tasks. It significantly surpasses existing models in both subject identification and emotion classification across three benchmark datasets [SEED, SEED-IV, and a self-collected (SC) dataset], achieving subject classification accuracies of 98.63%, 99.13%, and 98.70%, respectively, with corresponding emotion classification accuracies of 77.92%, 53.79%, and 64.41%. Furthermore, a novel paradigm for EEG signal generation and data augmentation is established through the proposed LP approach, providing practical solutions to enhance emotion recognition.Keywords
Funding Information
- National Natural Science Foundation of China (62073282)
- National Natural Science Foundation of China (12332002)
- Natural Science Foundation of Hebei Province (F2022203092)
- Science and Technology (S&T) Program of Qinhuangdao City (202302B015)
- State Key Laboratory of Novel Software Technology (KFKT2025B88)
This publication has 54 references indexed in Scilit:
- Set-pMAE: spatial-spEctral-temporal based parallel masked autoEncoder for EEG emotion recognitionCognitive Neurodynamics, 2024
- Exploring non-Euclidean relationships in EEG emotion recognition: A dynamic graph attention networkBiomedical Signal Processing and Control, 2024
- Self-supervised group meiosis contrastive learning for EEG-based emotion recognitionApplied Intelligence, 2023
- MTLFuseNet: A novel emotion recognition model based on deep latent feature fusion of EEG signals and multi-task learningKnowledge-Based Systems, 2023
- Multisource Wasserstein Adaptation Coding Network for EEG emotion recognitionBiomedical Signal Processing and Control, 2022
- Deep learning in mental health outcome research: a scoping reviewTranslational Psychiatry, 2020
- Unsupervised EEG feature extraction based on echo state networkInformation Sciences, 2019
- Respiration-based emotion recognition with deep learningComputers in Industry, 2017
- Decoding the Nature of Emotion in the BrainTrends in Cognitive Sciences, 2016
- Mapping discrete and dimensional emotions onto the brain: controversies and consensusTrends in Cognitive Sciences, 2012