Occlusion-aware Cross-modality Completion Network for Occluded Visible-Infrared Person Re-Identification

Authors:
Top Cited Papers
Publisher website
Google Scholar
Abstract
Occlusion is a key challenge in real-world person reidentification (ReID), as partial occlusions often remove critical identity cues. Most existing methods focus on feature extraction for visible regions while ignoring the holistic contextual information of pedestrians, leading to incomplete feature representations. This issue is particularly severe in visible-infrared ReID (VI-ReID), where spatial inconsistencies of occluded regions and modality-specific feature degradation jointly exacerbate feature misalignment, but has received little attention in previous studies. Therefore, we propose an Occlusion-Aware Cross-Modality Completion Network (OCCNet) to explicitly complete missing identity cues, which integrates three complementary components. The Graph-guided Feature Completion Transformer (GFCT) embeds a dynamically constructed semantic graph into self-attention to complete occluded tokens within each modality, while the Semantic-Aware Region Completion Module (SRCM) aggregates tokens into coherent regions and adaptively transfers complementary cues across modalities. To ensure semantic coherence, a Multi-Distribution Consistency Alignment (MCA) loss is employed to regularize token- and region-level completions toward a unified distribution. By integrating these components, OCCNet recovers missing identity information at multiple levels and mitigates modality gaps caused by occlusion. To evaluate its effectiveness under realistic occlusion scenarios, we first construct two realistic occluded benchmarks, Occluded-SYSU-MM01 and Occluded-RegDB, on which extensive experiments demonstrate that our OCCNet outperforms state-of-the-art methods.
Funding Information
  • Xiao-yuan Jing (No. 2023A1515012653)
  • Jian Yu (25KJB130005)
  • Yujian Feng (BK20251080)
  • Yujian Feng (CQ20250058)
  • Yujian Feng (No. 62501256)
  • Yimu Ji (No. 2023YFB2904000)
  • Yimu Ji (No. 2023YFB2904004)
  • Yimu Ji (No. BE2023004-2)