The more the merrier: Analysing the affect of a group of people in images
- 1 May 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 1-8
Abstract
The recent advancement of social media has given users a platform to socially engage and interact with a global population. With millions of images being uploaded onto social media platforms, there is an increasing interest in inferring the emotion and mood display of a group of people in images. Automatic affect analysis research has come a long way but has traditionally focussed on a single subject in a scene. In this paper, we study the problem of inferring the emotion of a group of people in an image. This group affect has wide applications in retrieval, advertisement, content recommendation and security. The contributions of the paper are: 1) a novel emotion labelled database of groups of people in images; 2) a Multiple Kernel Learning based hybrid affect inference model; 3) a scene context based affect inference model; 4) a user survey to better understand the attributes that affect the perception of affect of a group of people in an image. The detailed experimentation validation provides a rich baseline for the proposed database.Keywords
This publication has 32 references indexed in Scilit:
- Multiple kernel learning for emotion recognition in the wild2013
- Affective Body Expression Perception and Recognition: A SurveyIEEE Transactions on Affective Computing, 2012
- In the Pursuit of Effective Affective Computing: The Relationship Between Features and RegistrationIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2012
- Real-time indoor scene understanding using Bayesian filtering with motion cues2011
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Emotion recognition using PHOG and LPQ features2011
- CENTRIST: A Visual Descriptor for Scene CategorizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- What do we perceive in a glance of a real-world scene?Journal of Vision, 2007
- Visual objects in contextNature Reviews Neuroscience, 2004
- Modeling the Shape of the Scene: A Holistic Representation of the Spatial EnvelopeInternational Journal of Computer Vision, 2001