Occlusion-Aware Feature Recover Model for Occluded Person Re-Identification
- 10 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 5284-5295
Abstract
Occluded person re-identification (Re-ID) is a challenging task, as various object-to-person (OTP) and person-to-person (PTP) occlusion scenarios cause diverse occlusion interference and target person feature loss problems in person matching. Most existing methods, which utilize auxiliary models to evaluate the unoccluded person parts for occlusion feature elimination, are inefficient and cannot handle the PTP occlusion scenarios and person feature loss problems. To solve these issues, we propose a novel Occlusion-Aware Feature Recover (OAFR) model. OAFR simulates diverse occlusions to facilitate the model perceiving OTP, PTP occlusions and recovers occluded query features with unoccluded retrieved gallery features. Concretely, the Prior Knowledge-based Occlusion Simulation method is firstly introduced to synthesize OTP, PTP occlusions and corresponding occlusion labels, empowering model target person perception and occlusion-aware capability through self-supervised learning. Afterward, the feature recovery module reconstructs occluded query features with corresponding unoccluded local features of the top- $K$ retrieved images by the visibility weighted average scheme, thus recovering the occluded query features to maintain more comprehensive features for better retrieval. Extensive experiments demonstrate that the proposed OAFR achieves superior performance to the state-of-the-art for both holistic and occluded Re-ID. Especially for Occluded-DukeMTMC dataset, OAFR outperforms the state-of-the-art by 6.0% for Rank-1 accuracy and 2.2% for mAP score. The source codes are available at https://github.com/yuanbianGit/OAFR .Keywords
Funding Information
- National Natural Science Foundation of China (62073126, 62203168)
- Key Research and Development Program of Hunan Province (2022WK2011)
- Hunan Provincial Innovation Foundation for Postgraduate (QL20230098, jxsq2023102178)
This publication has 54 references indexed in Scilit:
- Unstructured Feature Decoupling for Vehicle Re-identification2022
- High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification2020
- Salience-Guided Cascaded Suppression Network for Person Re-Identification2020
- VRSTC: Occlusion-Free Video Person Re-Identification2019
- Partial Person Re-identification with Alignment and HallucinationLecture Notes in Computer Science, 2019
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)2018
- Deep Spatial Feature Reconstruction for Partial Person Re-identification: Alignment-free Approach2018
- Re-ranking Person Re-identification with k-Reciprocal Encoding2017
- Gated Siamese Convolutional Neural Network Architecture for Human Re-identification2016
- Deep Residual Learning for Image Recognition2016