Depression Assessment Method: An EEG Emotion Recognition Framework Based on Spatiotemporal Neural Network
Authors:
Open Access
- 15 March 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Psychiatry
- Vol. 12, 837149
Abstract
The main characteristic of depression is emotional dysfunction, manifested by increased levels of negative emotions and decreased levels of positive emotions. Therefore, accurate emotion recognition is an effective way to assess depression. Among the various signals used for emotion recognition, electroencephalogram (EEG) signal has attracted widespread attention due to its multiple advantages, such as rich spatiotemporal information in multi-channel EEG signals. First, we use filtering and Euclidean alignment for data preprocessing. In the feature extraction, we use short-time Fourier transform and Hilbert–Huang transform to extract time-frequency features, and convolutional neural networks to extract spatial features. Finally, bi-directional long short-term memory explored the timing relationship. Before performing the convolution operation, according to the unique topology of the EEG channel, the EEG features are converted into 3D tensors. This study has achieved good results on two emotion databases: SEED and Emotional BCI of 2020 WORLD ROBOT COMPETITION. We applied this method to the recognition of depression based on EEG and achieved a recognition rate of more than 70% under the five-fold cross-validation. In addition, the subject-independent protocol on SEED data has achieved a state-of-the-art recognition rate, which exceeds the existing research methods. We propose a novel EEG emotion recognition framework for depression detection, which provides a robust algorithm for real-time clinical depression detection based on EEG.Keywords
Funding Information
- National Natural Science Foundation of China
This publication has 59 references indexed in Scilit:
- Fusion of facial expressions and EEG for implicit affective taggingImage and Vision Computing, 2013
- Human brain EEG indices of emotions: Delineating responses to affective vocalizations by measuring frontal theta event-related synchronizationNeuroscience & Biobehavioral Reviews, 2011
- Emotion recognition method using entropy analysis of EEG signalsInternational Journal of Image, Graphics and Signal Processing, 2011
- Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues.International Journal of Psychophysiology, 2009
- A review on Hilbert‐Huang transform: Method and its applications to geophysical studiesReviews of Geophysics, 2008
- A mechanism for impaired fear recognition after amygdala damageNature, 2005
- Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant AnalysisNeural Computation, 2002
- Orthogonal Series Density Estimation and the Kernel Eigenvalue ProblemNeural Computation, 2002
- Emotion regulation and mental health.Clinical Psychology: Science and Practice, 1995
- Continuous EEG and Evoked Potential Monitoring in the Neuroscience Intensive Care UnitJournal Of Clinical Neurophysiology, 1993