Clothes-Changing Person Re-Identification Using Color and Texture Invariant Representation
- 13 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (1) , 323-336
Abstract
This paper tackles the challenge of Clothes-Changing person Re-Identification (CC-ReID) through the dual lenses of model development and dataset creation. Unlike conventional person ReID, which presumes that individuals maintain consistent clothing, CC-ReID acknowledges the frequent changes in attire encountered in real-world scenarios. This task is particularly difficult due to the substantial variations in visual cues such as colors and textures that accompany changes in clothing. We propose a Multi-modal Assisted feature Learning Framework (MAL-F) designed to learn representations that are invariant to color and texture by utilizing RGB, grayscale, and contour images. MAL-F is a versatile framework that can be seamlessly integrated with existing CC-ReID models, significantly enhancing their accuracy. To further reduce the impact of clothing variations, we introduce a novel CC-ReID backbone named ResTNet, which combines ResNet with a Transformer. ResTNet features a Non-Clothing Salient Region (NC-SR) reinforcement transformer module that employs random clothing block drop and spatial activation mapping. These methods direct the model to emphasize key regions unrelated to clothing, enhancing these features with minimal computational overhead. This strategy substantially enhances CC-ReID performance and supports real-time video processing. Furthermore, recognizing the limitations of current small-scale CC-ReID datasets, we have developed two larger datasets: FBCC and Market1501-CC. Extensive experimental results demonstrate that our proposed methodology surpasses existing state-of-the-art methods for CC-ReID in terms of accuracy, robustness, and efficiency.Keywords
Funding Information
- Key Research and Development Program of Zhejiang Province (2024C03172)
- National Key Research and Development Program of China (2018YFC0824406)
This publication has 64 references indexed in Scilit:
- Temporal Complementary Learning for Video Person Re-identification2020
- Exploiting Temporal Coherence for Self-Supervised One-Shot Video Re-identification2020
- Learning Diverse Features with Part-Level Resolution for Person Re-identification2020
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)2018
- Pose-Normalized Image Generation for Person Re-identification2018
- Performance Measures and a Data Set for Multi-target, Multi-camera Tracking2016
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Salient Color Names for Person Re-identification2014
- Person Re-Identification Using Kernel-Based Metric Learning Methods2014
- Re-identification with RGB-D Sensors2012