Structured Distilled 3D Gait Fields for Clothes-Changing Person Re-Identification in Videos
- 7 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. PP (10518215) , 1
Abstract
3D gait representation, intrinsically tied to identity, is of great importance in tackling the challenge of video-based clothes-changing person re-identification (VCCRe-ID), where individuals’ clothing appearances vary across video clips captured over an extended duration. Most existing methods derive 3D gait features from sequential 3D skeletons or parameters of a predefined 3D human model (e.g. SMPL). However, the sparsity of 3D skeletons and the low-dimensional nature of 3D human model parameters not only limit their expressive power and discriminative ability, but also impede alignment with higher-dimensional appearance features. To address these issues, we propose Structured Distilled 3D Gait Fields (SD-3DGF) to learn better aligned, more expressive, and discriminative 3D gait features for VCCRe-ID. SD-3DGF defines distilled feature fields that evolve over time, allowing the simulation of 3D gait dynamics from temporal 2D descriptors. Specifically, it densely transfers frame-level shape knowledge from structured 3D space (i.e., 3D mesh surface) to the 2D image domain via 3D-2D knowledge distillation, and models local spatiotemporal correlations among the distilled features to extract 3D gait features. This learning paradigm makes 3D gait features more compatible with appearance features, as they are naturally aligned in the spatiotemporal domain. To fully exploit this potential, we develop a novel Modality-Representative Interactive Encoding (MRIE) module, which facilitates efficient gait-appearance interaction and joint encoding via global and local representative tokens. Experiments on both VCCRe-ID and standard video-based Re-ID benchmarks demonstrate the effectiveness of our method. The code is available at https://github.com/yubinwang2021/SD-3DGF.Keywords
Funding Information
- the Research Project of ZJU-League Research and Development Center, Zhejiang Laboratory (2019KD0AB01)
This publication has 59 references indexed in Scilit:
- Dual-Space Video Person Re-identificationInternational Journal of Computer Vision, 2025
- Robust auxiliary modality is beneficial for video-based cloth-changing person re-identificationImage and Vision Computing, 2024
- Cross-Modality Complementary Learning for Video-Based Cloth-Changing Person Re-identification2024
- Face and body-shape integration model for cloth-changing person re-identificationImage and Vision Computing, 2023
- 3D Shape Temporal Aggregation for Video-Based Clothing-Change Person Re-identification2023
- Learning graph normalization for graph neural networksNeurocomputing, 2022
- Temporal Complementary Learning for Video Person Re-identification2020
- Appearance-Preserving 3D Convolution for Video-Based Person Re-identification2020
- MARS: A Video Benchmark for Large-Scale Person Re-Identification2016
- Person Re-identification by Video Ranking2014