Gaussian process dynamical models for multimodal affect recognition
Authors:
- 18 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2016, 850-853
Abstract
Affective computing systems has a great potential in applications for biofeedback systems and cognitive conductual therapies. Here, by analyzing the physiological behavior of a given subject, we can infer the affective state of an emotional process. Since, emotions can be modeled as dynamic manifestations of these signals, a continuous analysis in the valence/arousal space, brings more information of the affective state related to an emotional process. In this paper we propose a method for dynamic affect recognition from multimodal physiological signals. Our model is based on learning a latent space using Gaussian process latent variable models (GP-LVM), which maps high dimensional data (multimodal physiological signals) in a low dimensional latent space. We incorporate the dynamics to the model by learning the latent representation, with associated dynamics. Finally, a support vector classifier is implemented to evaluate the relevance of the latent space features in the affective recognition process. The results show that the proposed method can efficiently model a physiological time-series and recognize with high accuracy an affective process.Keywords
This publication has 14 references indexed in Scilit:
- Investigation of window size in classification of EEG-emotion signal with wavelet entropy and support vector machine2015
- Recognizing emotions from EEG subbands using wavelet analysis2015
- DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological ResponsesIEEE Transactions on Affective Computing, 2015
- Clustering Affective Qualities of Classical Music: Beyond the Valence-Arousal PlaneIEEE Transactions on Affective Computing, 2014
- Two-Level Hierarchical Alignment for Semi-Coupled HMM-Based Audiovisual Emotion Recognition With Temporal CourseIEEE Transactions on Multimedia, 2013
- Fully Automatic Recognition of the Temporal Phases of Facial ActionsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2011
- DEAP: A Database for Emotion Analysis ;Using Physiological SignalsIEEE Transactions on Affective Computing, 2011
- Action unit detection using sparse appearance descriptors in space-time video volumes2011
- Gaussian Process Dynamical Models for Human MotionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Local distance preservation in the GP-LVM through back constraints2006