Multi-biometrics using facial appearance, shape and temperature
Authors:
- 10 June 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 43-48
Abstract
We present results of the first study to examine individual and multi-modal face recognition using 2D, 3D and infrared images of the same set of subjects. Each sensor captures different aspects of human facial features; appearance in intensity representing surface reflectance from a light source, shape data representing depth values from the camera, and the pattern of heat emitted, respectively. We employ a database containing a gallery set of 127 images and an accumulated time-lapse probe set of 297 images. Using a PCA-based approach tuned separately for 2 D, 3D and IR, we find rank-one recognition rates of 90.6% for 2D, 91.9% for 3D and 71.0% for IR. Combining each pair of modalities, we find a multi-modal rank-one recognition rate of 98.7% for 2D-3D, 96.6% for 2D-IR and 98.0% for 3D-IR. When all three modalities are combined, we obtain 100% recognition. The results shown in this study appear to support the conclusion that the path to higher accuracy and robustness in biometrics involves use of multiple biometrics rather than the best possible sensor and algorithm for a single biometric.Keywords
This publication has 16 references indexed in Scilit:
- PCA-based face recognition in infrared imagery: baseline and comparative studies2004
- On probabilistic combination of face and gait cues for identification2003
- Thermal imaging for anxiety detection2002
- Information Fusion in Biometrics2001
- The FERET evaluation methodology for face-recognition algorithmsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- BiolD: a multimodal biometric identification systemComputer, 2000
- On combining classifiersIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Combining evidence in personal identity verification systemsPattern Recognition Letters, 1997
- Combination of face classifiers for person identification1996
- Eigenfaces for RecognitionJournal of Cognitive Neuroscience, 1991