GaitParsing: Human Semantic Parsing for Gait Recognition
- 19 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 4736-4748
Abstract
Gait recognition is a soft biotechnology to identify pedestrians observed from different camera views based on specific walking patterns. However, various dressing and wearing conditions bring great challenges to realistic gait recognition. Most existing methods take holistic gait silhouette as input and focus on local areas through horizontal strip division or attention map. We consider that this processing may contain mixed or incomplete information about multiple body parts so that gait information is misused or underutilized. In this paper, we propose a parsing-guided framework for gait recognition, named GaitParsing , which explores human semantic parsing to dissect human body into a set of specific and complete body parts. Correspondingly, a simple yet effective dual-branch feature extraction network is adopted to process holistic gait and distinct body parts. To maximize the use of highly discriminated gait frames, we propose a self-occlusion frame assessment to measure the self-occlusion in a gait sequence. Since there is no human parsing modality in current gait datasets, we further develop a general human parsing pipeline specifically tailored for gait datasets. This single training enables widespread application across various gait datasets. Extensive experiments with ablation analyses demonstrate competitive performance even in the most challenging conditions, e.g., Cloth-Changing (CC+5.9%). Especially, It is gratifying to see that our model can be easily applied to existing methods and significantly outperform the original architecture, even without much modification. Code is available at https://github.com/wzb-bupt/GaitParsingKeywords
Funding Information
- National Natural Science Foundation of China (62276031, 62276025, 62206022)
- Shenzhen Technology Plan (KQTD20170331093217368)
This publication has 54 references indexed in Scilit:
- MetaGait: Learning to Learn an Omni Sample Adaptive Representation for Gait Recognition2022
- A multi-modal dataset for gait recognition under occlusionApplied Intelligence, 2022
- Identity-Guided Human Semantic Parsing for Person Re-identification2020
- Gait Lateral Network: Learning Discriminative and Compact Representations for Gait Recognition2020
- U2-Net: Going deeper with nested U-structure for salient object detectionPattern Recognition, 2020
- Review of gait recognition approaches and their challenges on view changesIET Biometrics, 2020
- A model-based gait recognition method with body pose and human prior knowledgePattern Recognition, 2020
- Robust gait recognition: a comprehensive surveyIET Biometrics, 2018
- A Study on Security and Surveillance System Using Gait Recognition2016
- Gait recognition without subject cooperationPattern Recognition Letters, 2010