Abstract
Gait recognition is an attractive human recognition technology. However, existing gait recognition methods mainly focus on the regular gait cycles, which ignore the irregular situation. In real-world surveillance, human gait is almost irregular, which contains arbitrary dynamic characteristics (e.g., duration, speed, and phase) and varied viewpoints. In this paper, we propose the attentive spatial-temporal summary networks to learn salient spatial-temporal and view-independence features for irregular gait recognition. First of all, we design the gate mechanism with attentive spatial-temporal summary to extract the discriminative sequence-level features for representing the periodic motion cues from irregular gait sequences. The designed general attention and residual attention can concentrate on the discriminative identity-related semantic regions from the spatial feature maps. The proposed Attentive Temporal Summary unit can automatically assign adaptive attentions to enhance the discriminative gait timesteps and suppress the redundant ones. Furthermore, to improve the accuracy of cross-view gait recognition, we combine the Siamese structure and Null Foley-Sammon Transform to obtain the view-invariant gait features from irregular gait sequences. Finally, we quantitatively evaluate the impact of the irregular gait and viewpoint-interval between matching pairs on gait recognition accuracy. Experimental results show that our method achieves the state-of-the-art performance in irregular gait recognition on the OULP and CASIA-B datasets.
Funding Information
  • International Cooperation and Exchange Programme
  • National Natural Science Foundation of China (61720106007)
  • National Natural Science Foundation of China (61602049)
  • NSFC–Guangdong Joint Fund (U1501254)
  • 111 Project (B18008)

This publication has 44 references indexed in Scilit: