Person Re-Identification via Pyramid Multipart Features and Multi-Attention Framework
Open Access
- 9 February 2022
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 6 (1) , 20
Abstract
Video-based person re-identification has become quite attractive due to its importance in many vision surveillance problems. It is a challenging topic due to the inter/intra changes, occlusion, and pose variations involved. In this paper, we propose a pyramid-attentive framework that relies on multi-part features and multiple attention to aggregate features of multi-levels and learns attention-based representations of persons through various aspects. Self-attention is used to strengthen the most discriminative features in the spatial and channel domains and hence capture robust global information. We propose the use of part-relation attention between different multi-granularities of features’ representation to focus on learning appropriate local features. Temporal attention is used to aggregate temporal features. We integrate the most robust features in the global and multi-level views to build an effective convolution neural network (CNN) model. The proposed model outperforms the previous state-of-the art models on three datasets. Notably, using the proposed model enables the achievement of 98.9% (a relative improvement of 2.7% on the GRL) top1 accuracy and 99.3% mAP on the PRID2011, and 92.8% (a relative improvement of 2.4% relative to GRL) top1 accuracy on iLIDS-vid. We also explore the generalization ability of our model on a cross dataset.Keywords
This publication has 41 references indexed in Scilit:
- MARS: A Video Benchmark for Large-Scale Person Re-Identification2016
- An enhanced deep feature representation for person re-identification2016
- Person re-identification by Local Maximal Occurrence representation and metric learning2015
- GMMCP tracker: Globally optimal Generalized Maximum Multi Clique problem for multiple object tracking2015
- Person Re-identification by Video Ranking2014
- Person Re-identification by Descriptive and Discriminative Classification2011
- Object Detection with Discriminatively Trained Part-Based ModelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- A Spatio-Temporal Descriptor Based on 3D-Gradients2008
- Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features2008
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002