Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification
Preprint
Abstract
Visible-infrared person re-identification (VI-ReID) is an important task in night-time surveillance applications, since visible cameras are difficult to capture valid appearance information under poor illumination conditions. Compared to traditional person re-identification that handles only the intra-modality discrepancy, VI-ReID suffers from additional cross-modality discrepancy caused by different types of imaging systems. To reduce both intra- and cross-modality discrepancies, we propose a Hierarchical Cross-Modality Disentanglement (Hi-CMD) method, which automatically disentangles ID-discriminative factors and ID-excluded factors from visible-thermal images. We only use ID-discriminative factors for robust cross-modality matching without ID-excluded factors such as pose or illumination. To implement our approach, we introduce an ID-preserving person image generation network and a hierarchical feature learning module. Our generation network learns the disentangled representation by generating a new cross-modality image with different poses and illuminations while preserving a person's identity. At the same time, the feature learning module enables our model to explicitly extract the common ID-discriminative characteristic between visible-infrared images. Extensive experimental results demonstrate that our method outperforms the state-of-the-art methods on two VI-ReID datasets.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Cross-Modality Person Re-Identification Based on Dual-Path Multi-Branch NetworkIEEE Sensors Journal, 2019
- Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-IdentificationIEEE Transactions on Information Forensics and Security, 2019
- Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal CamerasSensors, 2017
- Cross-Domain Visual Matching via Generalized Similarity Measure and Feature LearningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Histograms of Oriented Gradients for Human Detection2005