Comparative analysis of physiological signals and electroencephalogram (EEG) for multimodal emotion recognition using generative models
Authors:
- 1 September 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 23296232,p. 1-5
Abstract
Multimodal Emotion recognition (MER) is an application of machine learning were different biological signals are used in order to automatically classify a determined affective state. MER systems has been developed for different type of applications from psychological evaluation, anxiety assessment, human-machine interfaces and marketing. There are several spaces of classification proposed in the state of art for the emotion recognition task, the most known are discrete and dimensional spaces were the emotions are described in terms of some basic emotions and latent dimensions respectively. The use of dimensional spaces of classification allows a higher range of emotional states to be analyzed. The most common dimensional space used for this purpose is the Arousal/Valence space were emotions are described in terms of the intensity of the emotion that goes from inactive to active in the arousal dimension, and from unpleasant to pleasant in the valence dimension. The use of physiological signals and the EEG is well suited for emotion recognition due to the fact that an emotional states generates responses from different biological systems of the human body. Since the expression of an emotion is a dynamic process, we propose the use of generative models as Hidden Markov Models (HMM) to capture de dynamics of the signals for further classification of emotional states in terms of arousal and valence. For the development of this work an international database for emotion classification known as Dataset for Emotion Analysis using Physiological signals (DEAP) is used. The objective of this work is to determine which of the physiological and EEG signals brings more relevant information in the emotion recognition task, several experiments using HMMs from different signals and combinations of them are performed, and the results shows that some of those signals brings more discrimination between arousal and valence levels as the EEG and the Galvanic Skin Response (GSR) and the Heart rate (HR).Keywords
This publication has 16 references indexed in Scilit:
- Visual emotion recognition based on dynamic models2013
- Feature selection for multimodal emotion recognition in the arousal-valence space2013
- Two-Level Hierarchical Alignment for Semi-Coupled HMM-Based Audiovisual Emotion Recognition With Temporal CourseIEEE Transactions on Multimedia, 2013
- Computational emotion recognition using multimodal physiological signals: Elicited using Japanese kanji words2012
- Multimodal Emotion Recognition in Response to VideosIEEE Transactions on Affective Computing, 2011
- Continuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence-Arousal SpaceIEEE Transactions on Affective Computing, 2011
- Physiological signals based human emotion Recognition: a review2011
- Determining optimal signal features and parameters for HMM-based emotion classification2010
- Emotion Recognition System in Images Based On Fuzzy Neural Network and HMM2006
- Speech emotion recognition based on HMM and SVM2005