Hybrid face recognition under adverse conditions using appearance‐based and dynamic features of smile expression
Authors:
Open Access
- 19 December 2020
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Biometrics
- Vol. 10 (1) , 99-115
Abstract
Although recent deep‐learning‐based face recognition methods give remarkable accuracies on large databases, their performance has been shown to degrade under adverse conditions (e.g. severe illumination and contrast variations; blur and noise). Under such conditions, soft‐biometric features such as facial dynamics are expected to increase the performance if they are used together with appearance‐based features. We propose a novel hybrid face recognition, which uses appearance‐based features extracted using deep convolutional networks and statistical facial dynamics features extracted from facial landmark positions during smile expression. We evaluated the performances of three different state‐of‐the‐art pre‐trained deep convolutional neural networks (DCNNs) under a variety of severe image distortions with different parameters. The experimental results show that, although the face recognition performance using only DCNN‐based features drops significantly under adverse conditions, the utilization of facial dynamics features together with DCNN‐based features can compensate for the performance loss and increase the accuracy significantly. We believe the proposed system can be useful when face recognition is performed using videos obtained from systems, which may contain blurry and noisy images with a wide range of illumination variations.Keywords
This publication has 61 references indexed in Scilit:
- Gaussian mixture model based estimation of the neutral face shape for emotion recognitionDigital Signal Processing, 2014
- On the facilitative effects of face motion on face recognition and its developmentFrontiers in Psychology, 2014
- BAUM-2: a multilingual audio-visual affective face databaseMultimedia Tools and Applications, 2014
- FACE RECOGNITION FROM VIDEO: A REVIEWInternational Journal of Pattern Recognition and Artificial Intelligence, 2012
- Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles2012
- On the use of dynamic features in face biometrics: recent advances and challengesSignal, Image and Video Processing, 2011
- Extremely randomized treesMachine Learning, 2006
- A search advantage for faces learned in motionExperimental Brain Research, 2005
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004
- Face recognition using independent component analysis and support vector machinesPattern Recognition Letters, 2003