Dual‐granularity feature fusion in visible‐infrared person re‐identification
Authors:
Open Access
- 7 December 2023
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Image Processing
- Vol. 18 (4) , 972-980
Abstract
Visible‐infrared person re‐identification (VI‐ReID) aims to recognize images of the same person captured in different modalities. Existing methods mainly focus on learning single‐granularity representations, which have limited discriminability and weak robustness. This paper proposes a novel dual‐granularity feature fusion network for VI‐ReID. Specifically, a dual‐branch module that extracts global and local features and then fuses them to enhance the representative ability is adopted. Furthermore, an identity‐aware modal discrepancy loss that promotes modality alignment by reducing the gap between features from visible and infrared modalities is proposed. Finally, considering the influence of non‐discriminative information in the modal‐shared features of RGB‐IR, a greyscale conversion is introduced to extract modality‐irrelevant discriminative features better. Extensive experiments on the SYSU‐MM01 and RegDB datasets demonstrate the effectiveness of the framework and superiority over state‐of‐the‐art methods.Keywords
This publication has 38 references indexed in Scilit:
- Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-IdentificationIEEE Transactions on Information Forensics and Security, 2019
- SCPNet: Spatial-Channel Parallelism Network for Joint Holistic and Partial Person Re-identification2019
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)2018
- Visible Thermal Person Re-Identification via Dual-Constrained Top-Ranking2018
- Fine-Tuning CNN Image Retrieval with No Human AnnotationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Human Semantic Parsing for Person Re-identification2018
- RGB-Infrared Cross-Modality Person Re-identification2017
- Spindle Net: Person Re-identification with Human Body Region Guided Feature Decomposition and Fusion2017
- Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal CamerasSensors, 2017
- Deep Residual Learning for Image Recognition2016