Mixed Modality Generation and Hierarchical Feature Aggregation for Visible‐Infrared Person Re‐Identification
Authors:
Open Access
- 1 January 2025
- journal article
- Published by Institution of Engineering and Technology (IET) in IET Image Processing
- Vol. 19 (1)
Abstract
The main challenge in visible‐infrared person re‐identification (VI‐ReID), which involves matching images of target persons across different modalities, is the significant modality gap between visible and infrared images. Current approaches generally fall into two categories: network architectures that map features from different modalities into a shared feature space, and methods that focus on modality generation and transformation. However, these methods often fail to fully account for contextual relationships, and the generated modalities may lack semantic interpretability. To address these limitations, this paper proposes a mixed modality generator that aligns the visible and infrared modalities as closely as possible within a unified feature space. To effectively leverage multi‐layered information, we introduce a hierarchical feature aggregation module, which establishes connections between features across different layers. Comprehensive experiments on the SYSU‐MM01, RegDB, and LLCM datasets demonstrate that our method significantly outperforms existing state‐of‐the‐art approaches, setting a new benchmark for VI‐ReID performance.Keywords
This publication has 42 references indexed in Scilit:
- Person re-identification using vision transformer and centroid triplet lossMultimedia Tools and Applications, 2024
- A person re‐identification method for sports event scenes incorporating textual information miningIET Image Processing, 2024
- Dual‐granularity feature fusion in visible‐infrared person re‐identificationIET Image Processing, 2023
- Visible-thermal person re-identification via multiple center-based constraintsMultimedia Tools and Applications, 2022
- Cross-Modality Transformer for Visible-Infrared Person Re-Identification2022
- Modality Synergy Complement Learning with Cascaded Aggregation for Visible-Infrared Person Re-Identification2022
- Deep features for person re-identification on metric learningPattern Recognition, 2021
- Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-identification2020
- RGB-IR Person Re-identification by Cross-Modality Similarity PreservationInternational Journal of Computer Vision, 2020
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)2018