Analysis and Compensation of the Reaction Lag of Evaluators in Continuous Emotional Annotations
Authors:
- Soroosh MariooryadSMSoroosh Mariooryad
- Carlos BussoCBCarlos Busso
- 1 September 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21568103,p. 85-90
Abstract
Defining useful emotional descriptors to characterize expressive behaviors is an important research area in affective computing. Recent studies have shown the benefits of using continuous emotional evaluations to annotate spontaneous corpora. Instead of assigning global labels per segments, this approach captures the temporal dynamic evolution of the emotions. A challenge of continuous assessments is the inherent reaction lag of the evaluators. During the annotation process, an observer needs to sense the stimulus, perceive the emotional message, and define his/her judgment, all this in real time. As a result, we expect a reaction lag between the annotation and the underlying emotional content. This paper uses mutual information to quantify and compensate for this reaction lag. Classification experiments on the SEMAINE database demonstrate that the performance of emotion recognition systems improve when the evaluator reaction lag is considered. We explore annotator-dependent and annotator-independent compensation schemes.Keywords
This publication has 22 references indexed in Scilit:
- Toward Effective Automatic Recognition Systems of Emotion in Speech2013
- Dynamic Probabilistic CCA for Analysis of Affective Behaviour2012
- Tracing EmotionInternational Journal of Synthetic Emotions, 2012
- Naturalistic Affective Expression Classification by a Multi-stage Approach Based on Hidden Markov Models2011
- Investigating the Use of Formant Based Features for Detection of Affective Dimensions in Speech2011
- Speech Emotion Recognition System Based on L1 Regularized Linear Regression and Decision Fusion2011
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- Automatic Recognition of Facial Actions in Spontaneous ExpressionsJournal of Multimedia, 2006
- Vocal communication of emotion: A review of research paradigmsSpeech Communication, 2003
- Describing the emotional states that are expressed in speechSpeech Communication, 2003