Using body movement and posture for emotion detection in non-acted scenarios
Authors:
Open Access
- 1 June 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10987584,p. 1-8
Abstract
In this paper, we explored the use of features that represent body posture and movement for automatically detecting people's emotions in non-acted standing scenarios. We focused on four emotions that are often observed when people are playing video games: triumph, frustration, defeat, and concentration. The dataset consists of recordings of the rotation angles of the player's joints while playing Wii sports games. We applied various machine learning techniques and bagged them for prediction. When body pose and movement features are used we can reach an overall accuracy of 66.5% for differentiating between these four emotions. In contrast, when using the raw joint rotations, limb rotation movement, or posture features alone, we were only able to achieve accuracy rates of 59%, 61%, and 62% respectively. Our results suggest that features representing changes in body posture can yield improved classification rates over using static postures or joint information alone.Keywords
This publication has 39 references indexed in Scilit:
- Toward a Minimal Representation of Affective GesturesIEEE Transactions on Affective Computing, 2011
- Static vs. dynamic modeling of human nonverbal behavior from multiple cues and modalities2009
- Towards an EEG-based emotion recognizer for humanoid robots2009
- Recognising Human Emotions from Body Movement and Gesture Dynamics2007
- Automatic prediction of frustrationInternational Journal of Human-Computer Studies, 2007
- Detecting Stress During Real-World Driving Tasks Using Physiological SensorsIEEE Transactions on Intelligent Transportation Systems, 2005
- Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint DependenceJournal of Nonverbal Behavior, 2004
- The Use of Body Movements and Gestures as Cues to Emotions in Younger and Older AdultsJournal of Nonverbal Behavior, 1999
- Cues and channels in emotion recognition.Journal of Personality and Social Psychology, 1986
- HEAD AND BODY CUES IN THE JUDGMENT OF EMOTION: A REFORMULATIONPerceptual and Motor Skills, 1967