Robust smile detection using convolutional neural networks
- 1 November 2016
- journal article
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 25 (6) , 063002
Abstract
We present a fully automated approach for smile detection. Faces are detected using a multiview face detector and aligned and scaled using automatically detected eye locations. Then, we use a convolutional neural network (CNN) to determine whether it is a smiling face or not. To this end, we investigate different shallow CNN architectures that can be trained even when the amount of learning data is limited. We evaluate our complete processing pipeline on the largest publicly available image database for smile detection in an uncontrolled scenario. We investigate the robustness of the method to different kinds of geometric transformations (rotation, translation, and scaling) due to imprecise face localization, and to several kinds of distortions (compression, noise, and blur). To the best of our knowledge, this is the first time that this type of investigation has been performed for smile detection. Experimental results show that our proposal outperforms state-of-the-art methods on both high- and low-quality images.Keywords
This publication has 17 references indexed in Scilit:
- A new descriptor of gradients Self-Similarity for smile detection in unconstrained scenariosNeurocomputing, 2016
- Efficient smile detection by Extreme Learning MachineNeurocomputing, 2015
- A Novel Approach to Detect Smile Expression2012
- Face recognition using Histograms of Oriented GradientsPattern Recognition Letters, 2011
- Smile detection by boosting pixel differencesIEEE Transactions on Image Processing, 2011
- An efficient approach to smile detection2011
- A novel feature extraction method using Pyramid Histogram of Orientation Gradients for smile recognition2009
- Toward Practical Smile DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Facial expression recognition using fisher weight maps2004
- Smiles when lying.Journal of Personality and Social Psychology, 1988