Happiness level prediction with sequential inputs via multiple regressions
Authors:
Open Access
- 31 October 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 487-493
Abstract
This paper presents our solution submitted to the Emotion Recognition in the Wild (EmotiW 2016) group-level happiness intensity prediction sub-challenge. The objective of this sub-challenge is to predict the overall happiness level given an image of a group of people in a natural setting. We note that both the global setting and the faces of the individuals in the image influence the group-level happiness intensity of the image. Hence the challenge lies in building a solution that incorporates both these factors and also considers their right combination. Our proposed solution incorporates both these factors as a combination of global and local information. We use a convolutional neural network to extract discriminative face features, and a recurrent neural network to selectively memorize the important features to perform the group-level happiness prediction task. Experimental evaluations show promising performance improvements, resulting in Root Mean Square Error (RMSE) reduction of about 0.5 units on the test set compared to the baseline algorithm that uses only global information.Keywords
This publication has 8 references indexed in Scilit:
- EmotiW 2016: video and group-level emotion recognition challenges2016
- Ordinal Regression with Multiple Output CNN for Age Estimation2016
- Facial Landmark Detection via Progressive Initialization2015
- A convolutional neural network cascade for face detection2015
- Automatic Group Happiness Intensity AnalysisIEEE Transactions on Affective Computing, 2015
- Riesz-based Volume Local Binary Pattern and A Novel Group Expression Model for Group Happiness Intensity Analysis2015
- Challenges in Representation Learning: A Report on Three Machine Learning Contests2013
- CENTRIST: A Visual Descriptor for Scene CategorizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010