Improved RGB‐D‐T based face recognition
Open Access
- 2 June 2016
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Biometrics
- Vol. 5 (4) , 297-303
Abstract
Reliable facial recognition systems are of crucial importance in various applications from entertainment to security. Thanks to the deep‐learning concepts introduced in the field, a significant improvement in the performance of the unimodal facial recognition systems has been observed in the recent years. At the same time a multimodal facial recognition is a promising approach. This study combines the latest successes in both directions by applying deep learning convolutional neural networks (CNN) to the multimodal RGB, depth, and thermal (RGB‐D‐T) based facial recognition problem outperforming previously published results. Furthermore, a late fusion of the CNN‐based recognition block with various hand‐crafted features (local binary patterns, histograms of oriented gradients, Haar‐like rectangular features, histograms of Gabor ordinal measures) is introduced, demonstrating even better recognition performance on a benchmark RGB‐D‐T database. The obtained results in this study show that the classical engineered features and CNN‐based features can complement each other for recognition purposes.Keywords
This publication has 19 references indexed in Scilit:
- Local Deep Neural Networks for gender recognitionPattern Recognition Letters, 2016
- RGB-D-Based Face Reconstruction and RecognitionIEEE Transactions on Information Forensics and Security, 2014
- DeepFace: Closing the Gap to Human-Level Performance in Face Verification2014
- Haar-like features for robust real-time face recognition2013
- Using Kinect for face recognition under varying poses, expressions, illumination and disguise2013
- Are Haar-Like Rectangular Features for Biometric Recognition Reducible?2013
- Real-Time Plane Segmentation Using RGB-D Cameras2012
- Face recognition by fusing thermal infrared and visible imageryImage and Vision Computing, 2006
- Diagonal principal component analysis for face recognitionPattern Recognition, 2006
- The FERET evaluation methodology for face-recognition algorithmsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000