Multimodal Low Resolution Face and Frontal Gait Recognition from Surveillance Video
Open Access
- 24 April 2021
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 10 (9) , 1013
Abstract
Biometric identification using surveillance video has attracted the attention of many researchers as it can be applicable not only for robust identification but also personalized activity monitoring. In this paper, we present a novel multimodal recognition system that extracts frontal gait and low-resolution face images from frontal walking surveillance video clips to perform efficient biometric recognition. The proposed study addresses two important issues in surveillance video that did not receive appropriate attention in the past. First, it consolidates the model-free and model-based gait feature extraction approaches to perform robust gait recognition only using the frontal view. Second, it uses a low-resolution face recognition approach which can be trained and tested using low-resolution face information. This eliminates the need for obtaining high-resolution face images to create the gallery, which is required in the majority of low-resolution face recognition techniques. Moreover, the classification accuracy on high-resolution face images is considerably higher. Previous studies on frontal gait recognition incorporate assumptions to approximate the average gait cycle. However, we quantify the gait cycle precisely for each subject using only the frontal gait information. The approaches available in the literature use the high resolution images obtained in a controlled environment to train the recognition system. However, in our proposed system we train the recognition algorithm using the low-resolution face images captured in the unconstrained environment. The proposed system has two components, one is responsible for performing frontal gait recognition and one is responsible for low-resolution face recognition. Later, score level fusion is performed to fuse the results of the frontal gait recognition and the low-resolution face recognition. Experiments conducted on the Face and Ocular Challenge Series (FOCS) dataset resulted in a 93.5% Rank-1 for frontal gait recognition and 82.92% Rank-1 for low-resolution face recognition, respectively. The score level multimodal fusion resulted in 95.9% Rank-1 recognition, which demonstrates the superiority and robustness of the proposed approach.Keywords
This publication has 47 references indexed in Scilit:
- Context-aware fusion: A case study on fusion of gait and face for human identification in videoPattern Recognition, 2010
- The effect of arm movements on the lower limb during gait after a strokeGait & Posture, 2010
- "GrabCut"ACM Transactions on Graphics, 2004
- Automatic gait recognition based on statistical shape analysisIEEE Transactions on Image Processing, 2003
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Gabor feature based classification using the enhanced fisher linear discriminant model for face recognitionIEEE Transactions on Image Processing, 2002
- The FERET evaluation methodology for face-recognition algorithmsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Pattern recognition by affine moment invariantsPattern Recognition, 1993
- Eigenfaces for RecognitionJournal of Cognitive Neuroscience, 1991
- Visual pattern recognition by moment invariantsIRE Transactions on Information Theory, 1962