Attentive Spatial–Temporal Summary Networks for Feature Learning in Irregular Gait Recognition
- 18 February 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 21 (9) , 2361-2375
Abstract
Gait recognition is an attractive human recognition technology. However, existing gait recognition methods mainly focus on the regular gait cycles, which ignore the irregular situation. In real-world surveillance, human gait is almost irregular, which contains arbitrary dynamic characteristics (e.g., duration, speed, and phase) and varied viewpoints. In this paper, we propose the attentive spatial-temporal summary networks to learn salient spatial-temporal and view-independence features for irregular gait recognition. First of all, we design the gate mechanism with attentive spatial-temporal summary to extract the discriminative sequence-level features for representing the periodic motion cues from irregular gait sequences. The designed general attention and residual attention can concentrate on the discriminative identity-related semantic regions from the spatial feature maps. The proposed Attentive Temporal Summary unit can automatically assign adaptive attentions to enhance the discriminative gait timesteps and suppress the redundant ones. Furthermore, to improve the accuracy of cross-view gait recognition, we combine the Siamese structure and Null Foley-Sammon Transform to obtain the view-invariant gait features from irregular gait sequences. Finally, we quantitatively evaluate the impact of the irregular gait and viewpoint-interval between matching pairs on gait recognition accuracy. Experimental results show that our method achieves the state-of-the-art performance in irregular gait recognition on the OULP and CASIA-B datasets.Keywords
Funding Information
- International Cooperation and Exchange Programme
- National Natural Science Foundation of China (61720106007)
- National Natural Science Foundation of China (61602049)
- NSFC–Guangdong Joint Fund (U1501254)
- 111 Project (B18008)
This publication has 44 references indexed in Scilit:
- A Grassmannian Approach to Address View Change Problem in Gait RecognitionIEEE Transactions on Cybernetics, 2016
- A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Complete canonical correlation analysis with application to multi-view gait recognitionPattern Recognition, 2016
- An aperiodic feature representation for gait recognition in cross-view scenarios for unconstrained biometricsPattern Analysis and Applications, 2015
- Gait-Based Person Recognition Using Arbitrary View Transformation ModelIEEE Transactions on Image Processing, 2014
- Gait recognition by fluctuationsComputer Vision and Image Understanding, 2014
- Two-Point Gait: Decoupling Gait from Body Shape2013
- Histogram of Weighted Local Directions for Gait Recognition2013
- Gait flow image: A silhouette-based gait representation for human identificationPattern Recognition, 2011
- Learning a Similarity Metric Discriminatively, with Application to Face Verification2005