Video-Based Person Re-Identification With Accumulative Motion Context
- 14 June 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 28 (10) , 2788-2802
Abstract
Video-based person re-identification plays a central role in realistic security and video surveillance. In this paper, we propose a novel accumulative motion context (AMOC) network for addressing this important problem, which effectively exploits the long-range motion context for robustly identifying the same person under challenging conditions. Given a video sequence of the same or different persons, the proposed AMOC network jointly learns appearance representation and motion context from a collection of adjacent frames using a two-stream convolutional architecture. Then, AMOC accumulates clues from motion context by recurrent aggregation, allowing effective information flow among adjacent frames and capturing dynamic gist of the persons. The architecture of AMOC is end-to-end trainable, and thus, motion context can be adapted to complement appearance clues under unfavorable conditions (e.g., occlusions). Extensive experiments are conduced on three public benchmark data sets, i.e., the iLIDS-VID, PRID-2011, and MARS data sets, to investigate the performance of AMOC. The experimental results demonstrate that the proposed AMOC network outperforms state-of-the-arts for video-based re-identification significantly and confirm the advantage of exploiting long-range motion context for video-based person re-identification, validating our motivation evidently.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61371155, 61174170, 61632007)
- China Scholarship Council (201506690007)
- National University of Singapore (R-263-000-C08-133)
- Ministry of Education of Singapore AcRF Tier One (R-263-000-C21-112)
- NUS IDS (R-263-000-C67-646)
This publication has 38 references indexed in Scilit:
- Deep feature learning with relative distance comparison for person re-identificationPattern Recognition, 2015
- Cross-Scenario Transfer Person ReidentificationIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Kernelized Relaxed Margin Components Analysis for Person Re-identificationIEEE Signal Processing Letters, 2014
- DeepReID: Deep Filter Pairing Neural Network for Person Re-identification2014
- Covariance descriptor based on bio-inspired features for person re-identification and face verificationImage and Vision Computing, 2014
- Identity Inference: Generalizing Person Re-identification Scenarios2012
- Re-identification of Pedestrians in Crowds Using Dynamic Time Warping2012
- Custom Pictorial Structures for Re-identification2011
- A Database and Evaluation Methodology for Optical FlowInternational Journal of Computer Vision, 2010
- A Spatio-Temporal Descriptor Based on 3D-Gradients2008