Correlation Discrepancy Insight Network for Video Re-identification
Open Access
- 30 November 2020
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 16 (4) , 1-21
Abstract
Video-based person re-identification (ReID) aims at re-identifying a specified person sequence from videos that were captured by disjoint cameras. Most existing works on this task ignore the quality discrepancy across frames by using all video frames to develop a ReID method. Additionally, they adopt only the person self-characteristic as the representation, which cannot adapt to cross-camera variation effectively. To that end, we propose a novel correlation discrepancy insight network for video-based person ReID, which consists of an unsupervised correlation insight model (CIM) for video purification and a discrepancy description network (DDN) for person representation. Concretely, CIM is constructed by using kernelized correlation filters to encode person half-parts, which evaluates the frame quality by the cross correlation across frames for selecting discriminative video fragments. Furthermore, DDN exploits the selected video fragments to generate a discrepancy descriptor using a compression network, which aims at employing the discrepancies with other persons’ to facilitate the representation of the target person rather than only using the self-characteristic. Due to the advantage in handling cross-domain variation, the discrepancy descriptor is expected to provide a new pattern for the object representation in cross-camera tasks. Experimental results on three public benchmarks demonstrate that the proposed method outperforms several state-of-the-art methods.Keywords
Funding Information
- National Key R&D Program of China (2017YFC0803700)
- National Nature Science Foundation of China (U1903214, 61876135)
- Natural Science Fundation of Hubei Province (2019CFB472, 2018AAA062, 2018CFA024)
This publication has 52 references indexed in Scilit:
- Bit-Scalable Deep Hashing With Regularized Similarity Learning for Image Retrieval and Person Re-IdentificationIEEE Transactions on Image Processing, 2015
- Space-time Histograms And Their Application To Person Re-identification In TV Shows2015
- GMMCP tracker: Globally optimal Generalized Maximum Multi Clique problem for multiple object tracking2015
- High-Speed Tracking with Kernelized Correlation FiltersIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Person Re-identification by Video Ranking2014
- Person Re-identification by Descriptive and Discriminative Classification2011
- Evaluation of local spatio-temporal features for action recognition2009
- A Spatio-Temporal Descriptor Based on 3D-Gradients2008
- A 3-dimensional sift descriptor and its application to action recognition2007
- Person Reidentification Using Spatiotemporal Appearance2006