Using Kinect for face recognition under varying poses, expressions, illumination and disguise
- 1 January 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15505790,p. 186-192
Abstract
We present an algorithm that uses a low resolution 3D sensor for robust face recognition under challenging conditions. A preprocessing algorithm is proposed which exploits the facial symmetry at the 3D point cloud level to obtain a canonical frontal view, shape and texture, of the faces irrespective of their initial pose. This algorithm also fills holes and smooths the noisy depth data produced by the low resolution sensor. The canonical depth map and texture of a query face are then sparse approximated from separate dictionaries learned from training data. The texture is transformed from the RGB to Discriminant Color Space before sparse coding and the reconstruction errors from the two sparse coding steps are added for individual identities in the dictionary. The query face is assigned the identity with the smallest reconstruction error. Experiments are performed using a publicly available database containing over 5000 facial images (RGB-D) with varying poses, expressions, illumination and disguise, acquired using the Kinect sensor. Recognition rates are 96.7% for the RGB-D data and 88.7% for the noisy depth data alone. Our results justify the feasibility of low resolution 3D sensors for robust face recognition.Keywords
This publication has 21 references indexed in Scilit:
- Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch2011
- Illumination invariant recognition and 3D reconstruction of faces using desktop optics.Optics Express, 2011
- Using Facial Symmetry to Handle Pose Variations in Real-World 3D Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Tensor Discriminant Color Space for Face RecognitionIEEE Transactions on Image Processing, 2011
- Bidirectional relighting for 3D-aided 2D face recognition2010
- Color space normalization: Enhancing the discriminating power of color spaces for face recognitionPattern Recognition, 2010
- Robust Face Recognition via Sparse RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Overview of the Face Recognition Grand Challenge2005
- Role of color in face recognitionJournal of Vision, 2002