Identifying Noncooperative Subjects at a Distance Using Face Images and Inferred Three-Dimensional Face Models
Authors:
- 16 December 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
- Vol. 39 (1) , 12-24
Abstract
We present an approach to identify noncooperative individuals at a distance from a sequence of images, using 3-D face models. Most biometric features (such as fingerprints, hand shape, iris, or retinal scans) require cooperative subjects in close proximity to the biometric system. We process images acquired with an ultrahigh-resolution video camera, infer the location of the subjects' head, use this information to crop the region of interest, build a 3-D face model, and use this 3-D model to perform biometric identification. To build the 3-D model, we use an image sequence, as natural head and body motion provides enough viewpoint variation to perform stereomotion for 3-D face reconstruction. We have conducted experiments on a 2-D and 3-D databases collected in our laboratory. First, we found that metric 3-D face models can be used for recognition by using simple scaling method even though there is no exact scale in the 3-D reconstruction. Second, experiments using a commercial 3-D matching engine suggest the feasibility of the proposed approach for recognition against 3-D galleries at a distance (3, 6, and 9 m). Moreover, we show initial 3-D face modeling results on various factors including head motion, outdoor lighting conditions, and glasses. The evaluation results suggest that video data alone, at a distance of 3 to 9 meters, can provide a 3-D face shape that supports successful face recognition. The performance of 3-D-3-D recognition with the currently generated models does not quite match that of 2-D-2-D. We attribute this to the quality of the inferred models, and this suggests a clear path for future research.Keywords
This publication has 27 references indexed in Scilit:
- Non-Cooperative Persons Identification at a Distance with 3D Face Modeling2007
- 3D shape-based face representation and feature extraction for face recognitionImage and Vision Computing, 2006
- A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognitionComputer Vision and Image Understanding, 2006
- Region-based Matching for Robust 3D Face Recognition2005
- Stable real-time 3D tracking using online and offline informationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Mean shift: a robust approach toward feature space analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions2002
- PCA, Neural Networks and Estimation for Face Detection1998
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- A Combined Corner and Edge Detector1988