Interpreting ambiguous emotional expressions
Authors:
- 1 September 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21568103,p. 1-8
Abstract
Emotion expression is a complex process involving dependencies based on time, speaker, context, mood, personality, and culture. Emotion classification algorithms designed for real-world application must be able to interpret the emotional content of an utterance or dialog given the modulations resulting from these and other dependencies. Algorithmic development often rests on the assumption that the input emotions are uniformly recognized by a pool of evaluators. However, this style of consistent prototypical emotion expression often does not exist outside of a laboratory environment. This paper presents methods for interpreting the emotional content of non-prototypical utterances. These methods include modeling across multiple time-scales and modeling interaction dynamics between interlocutors. This paper recommends classifying emotions based on emotional profiles, or soft-labels, of emotion expression rather than relying on just raw acoustic features or categorical hard labels. Emotion expression is both interactive and dynamic. Consequently, to accurately recognize emotional content, these aspects must be incorporated during algorithmic design to improve classification performance.Keywords
This publication has 23 references indexed in Scilit:
- IEMOCAP: interactive emotional dyadic motion capture databaseLanguage Resources and Evaluation, 2008
- Primitives-based evaluation and estimation of emotions in speechSpeech Communication, 2007
- "Of All Things the Measure Is Man" : Automatic Classification of Emotions and Inter-Labeler Consistency2006
- Challenges in real-life emotion annotation and machine learning based detectionNeural Networks, 2005
- Vocal communication of emotion: A review of research paradigmsSpeech Communication, 2003
- Describing the emotional states that are expressed in speechSpeech Communication, 2003
- Facial emotion recognition using multi-modal information2002
- Emotion recognition in human-computer interactionIEEE Signal Processing Magazine, 2001
- Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant.Journal of Personality and Social Psychology, 1999
- Vocal affect expression: A review and a model for future research.Psychological Bulletin, 1986