Hierarchical Attention-Based Temporal Convolutional Networks for Eeg-Based Emotion Recognition
Authors:
- 6 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1240-1244
Abstract
EEG-based emotion recognition is an effective way to infer the inner emotional state of human beings. Recently, deep learning methods, particularly long short-term memory recurrent neural networks (LSTM-RNNs), have made encouraging progress for in the field of emotion recognition. However, the LSTM-RNNs are time-consuming and have difficulty avoiding the problem of exploding/vanishing gradients when during training. In addition, EEG-based emotion recognition often suffers due to the existence of silent and emotional irrelevant frames from intra-channel. Not all channels carry the same emotional discriminative information. In order to tackle these problems, a hierarchical attention-based temporal convolutional networks (HATCN) for efficient EEG-based emotion recognition is proposed. Firstly, a spectrogram representation is generated from raw EEG signals in each channel to capture their time and frequency information. Secondly, temporal convolutional networks (TCNs) are utilised to automatically learn more robust/intrinsic long-term dynamic characters in emotion response. Next, a hierarchical attention mechanism is investigated that aggregates the emotional information at both the frame and channel level. The experimental results on the DEAP dataset show that our method achieves an average recognition accuracy of 0.716 and an F1-score of 0.642 over four emotional dimensions and outperforms other state-of-the-art methods in a user-independent scenario.Keywords
Funding Information
- National Natural Science Foundation of China
- National Science Fund for Distinguished Young Scholars
- National Natural Science Foundation of China
This publication has 14 references indexed in Scilit:
- Emotion Recognition from Multiband EEG Signals Using CapsNetSensors, 2019
- Emotion Recognition from Multi-Channel EEG through Parallel Convolutional Recurrent Neural Network2018
- Hierarchical Convolutional Neural Networks for EEG-Based Emotion RecognitionCognitive Computation, 2017
- Emotions Recognition Using EEG Signals: A SurveyIEEE Transactions on Affective Computing, 2017
- Toolbox for Emotional feAture extraction from Physiological signals (TEAP)Frontiers in ICT, 2017
- Emotion Recognition from EEG Signals Using Multidimensional Information in EMD DomainBioMed Research International, 2017
- Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network2016
- Deep Residual Learning for Image Recognition2016
- Multi-task and multi-view learning of user stateNeurocomputing, 2014
- DEAP: A Database for Emotion Analysis ;Using Physiological SignalsIEEE Transactions on Affective Computing, 2011