Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning
Authors:
Top Cited Papers
Open Access
- 9 November 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 443-449
Abstract
This paper presents the techniques employed in our team's submissions to the 2015 Emotion Recognition in the Wild contest, for the sub-challenge of Static Facial Expression Recognition in the Wild. The objective of this sub-challenge is to classify the emotions expressed by the primary human subject in static images extracted from movies. We follow a transfer learning approach for deep Convolutional Neural Network (CNN) architectures. Starting from a network pre-trained on the generic ImageNet dataset, we perform supervised fine-tuning on the network in a two-stage process, first on datasets relevant to facial expressions, followed by the contest's dataset. Experimental results show that this cascading fine-tuning approach achieves better results, compared to a single stage fine-tuning with the combined datasets. Our best submission exhibited an overall accuracy of 48.5% in the validation set and 55.6% in the test set, which compares favorably to the respective 35.96% and 39.13% of the challenge baseline.Keywords
Funding Information
- Agency for Science Technology and Research
This publication has 23 references indexed in Scilit:
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Challenges in representation learning: A report on three machine learning contestsNeural Networks, 2015
- Representation of facial expression categories in continuous arousal–valence space: Feature and correlationImage and Vision Computing, 2014
- Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Context-Sensitive Dynamic Ordinal Regression for Intensity Estimation of Facial Action UnitsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Keeping it real: Recognizing expressions in real compared to schematic facesVisual Cognition, 2014
- Learning realistic facial expressions from web imagesPattern Recognition, 2013
- Recognition of facial emotion in low vision: A flexible usage of facial featuresVisual Neuroscience, 2008
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004
- Recognizing action units for facial expression analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001