Emotion Recognition Based on Joint Visual and Audio Cues
Authors:
- 1 January 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (10514651) , 1136-1139
Abstract
Recent technological advances have enabled human users to interact with computers in ways previously unimaginable. Beyond the confines of the keyboard and mouse, new modalities for human-computer interaction such as voice, gesture, and force-feedback are emerging. However, one necessary ingredient for natural interaction is still missing - emotions. This paper describes the problem of bimodal emotion recognition and advocates the use of probabilistic graphical models when fusing the different modalities. We test our audio-visual emotion recognition approach on 38 subjects with 11 HCI-related affect states. The experimental results show that the average person-dependent emotion recognition accuracy is greatly improved when both visual and audio information are used in classificationKeywords
This publication has 5 references indexed in Scilit:
- MULTIMODAL EMOTION RECOGNITION2005
- Toward an affect-sensitive multimodal human-computer interactionProceedings of the IEEE, 2003
- Boosted learning in dynamic bayesian networks for multimodal speaker detectionProceedings of the IEEE, 2003
- Facial expression recognition from video sequences: temporal and static modelingComputer Vision and Image Understanding, 2003
- Modeling Multimodal Expression of User’s Affective Subjective ExperienceUser Modeling and User-Adapted Interaction, 2002