A Saliency based Feature Fusion Model for EEG Emotion Estimation
Open Access
- 11 July 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Annual International Conference of the IEEE Engineering in Medicine and Biology Society
- Vol. 2022, 3170-3174
Abstract
Among the different modalities to assess emotion, electroencephalogram (EEG), representing the electrical brain activity, achieved motivating results over the last decade. Emotion estimation from EEG could help in the diagnosis or rehabilitation of certain diseases. In this paper, we propose a dual model considering two different representations of EEG feature maps: 1) a sequential based representation of EEG band power, 2) an image-based representation of the feature vectors. We also propose an innovative method to combine the information based on a saliency analysis of the image-based model to promote joint learning of both model parts. The model has been evaluated on four publicly available datasets: SEED-IV, SEED, DEAP and MPED. The achieved results outperform results from state-of-the-art approaches for three of the proposed datasets with a lower standard deviation that reflects higher stability. For sake of reproducibility, the codes and models proposed in this paper are available at https://github.com/VDelv/Emotion-EEG.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Domain Adaptation Techniques for EEG-Based Emotion Recognition: A Comparative Study on Two Public DatasetsIEEE Transactions on Cognitive and Developmental Systems, 2018
- The first MICCAI challenge on PET tumor segmentationMedical Image Analysis, 2018
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- A deep learning approach for human behavior prediction with explanations in health social networks: social restricted Boltzmann machine (SRBM+)Social Network Analysis and Mining, 2016
- Deep Artificial Neural Networks and Neuromorphic Chips for Big Data Analysis: Pharmaceutical and Bioinformatics ApplicationsInternational Journal of Molecular Sciences, 2016
- Hierarchical recurrent neural network for skeleton based action recognition2015
- Latent Space Sparse Subspace Clustering2013
- Differential entropy feature for EEG-based emotion classification2013
- High-frequency brain activity and muscle artifacts in MEG/EEG: a review and recommendationsFrontiers in Human Neuroscience, 2013
- Differential lateralization for positive and negative emotion in the human brain: EEG spectral analysisNeuropsychologia, 1985