Erasing, Transforming, and Noising Defense Network for Occluded Person Re-Identification
- 4 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (6) , 4458-4472
Abstract
Occlusion perturbation presents a significant challenge in person re-identification (re-ID), and existing methods that rely on external visual cues require additional computational resources and only consider the issue of missing information caused by occlusion. In this paper, we propose a simple yet effective framework, termed Erasing, Transforming, and Noising Defense Network (ETNDNet), which treats occlusion as a noise disturbance and solves occluded person re-ID from the perspective of adversarial defense. In the proposed ETNDNet, we introduce three strategies: Firstly, we randomly erase the feature map to create an adversarial representation with incomplete information, enabling adversarial learning of identity loss to protect the re-ID system from the disturbance of missing information. Secondly, we introduce random transformations to simulate the position misalignment caused by occlusion, training the extractor and classifier adversarially to learn robust representations immune to misaligned information. Thirdly, we perturb the feature map with random values to address noisy information introduced by obstacles and non-target pedestrians, and employ adversarial gaming in the re-ID system to enhance its resistance to occlusion noise. Without bells and whistles, ETNDNet has three key highlights: (i) it does not require any external modules with parameters, (ii) it effectively handles various issues caused by occlusion from obstacles and non-target pedestrians, and (iii) it designs the first GAN-based adversarial defense paradigm for occluded person re-ID. Extensive experiments on six public datasets fully demonstrate the effectiveness, superiority, and practicality of the proposed ETNDNet. The code will be released at https://github.com/nengdong96/ETNDNet.Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2018AAA0102002)
- National Natural Science Foundation of China (61925204, 62172212)
- Natural Science Foundation of Jiangsu Province (BK20230031)
This publication has 72 references indexed in Scilit:
- Semantic consistent feature construction and multi-granularity feature learning for visible-infrared person re-identificationThe Visual Computer, 2023
- Key point-aware occlusion suppression and semantic alignment for occluded person re-identificationInformation Sciences, 2022
- Learning attention-guided pyramidal features for few-shot fine-grained recognitionPattern Recognition, 2022
- Mutual prediction learning and mixed viewpoints for unsupervised-domain adaptation person re-identification on blockchainSimulation Modelling Practice and Theory, 2022
- Identity-Guided Human Semantic Parsing for Person Re-identification2020
- Interpretable and Generalizable Person Re-identification with Query-Adaptive Convolution and Temporal Lifting2020
- Guided Saliency Feature Learning for Person Re-identification in Crowded Scenes2020
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)2018
- Performance Measures and a Data Set for Multi-target, Multi-camera Tracking2016
- ImageNet: A large-scale hierarchical image database2009