Integrated face and gait recognition from multiple views
Authors:
- 25 August 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (10636919)
Abstract
We develop a view-normalization approach to multi-view face and gait recognition. An image-based visual hull (IBVH) is computed from a set of monocular views and used to render virtual views for tracking and recognition. We determine canonical viewpoints by examining the 3D structure, appearance (texture), and motion of the moving person. For optimal face recognition, we place virtual cameras to capture frontal face appearance; for gait recognition we place virtual cameras to capture a side-view of the person. Multiple cameras can be rendered simultaneously, and camera position is dynamically updated as the person moves through the workspace. Image sequences from each canonical view are passed to an unmodified face or gait recognition algorithm. We show that our approach provides greater recognition accuracy than is obtained using the unnormalized input sequences, and that integrated face and gait recognition provides improved performance over either modality alone. Canonical view estimation, rendering, and recognition have been efficiently implemented and can run at near real-time speeds.Keywords
This publication has 16 references indexed in Scilit:
- Low level recognition of human motion (or how to get your man without finding his body parts)2002
- Photorealistic scene reconstruction by voxel coloring2002
- Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion2002
- Image-based visual hulls2000
- A theory of shape by space carving1999
- Face recognition by elastic bunch graph matchingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- The visual hull concept for silhouette-based image understandingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
- View-based and modular eigenspaces for face recognition1994
- Analyzing and recognizing walking figures in XYT1994
- Deformable Templates for Face RecognitionJournal of Cognitive Neuroscience, 1991