Temporal Knowledge Propagation for Image-to-Video Person Re-identification
Preprint
Abstract
In many scenarios of Person Re-identification (Re-ID), the gallery set consists of lots of surveillance videos and the query is just an image, thus Re-ID has to be conducted between image and videos. Compared with videos, still person images lack temporal information. Besides, the information asymmetry between image and video features increases the difficulty in matching images and videos. To solve this problem, we propose a novel Temporal Knowledge Propagation (TKP) method which propagates the temporal knowledge learned by the video representation network to the image representation network. Specifically, given the input videos, we enforce the image representation network to fit the outputs of video representation network in a shared feature space. With back propagation, temporal knowledge can be transferred to enhance the image features and the information asymmetry problem can be alleviated. With additional classification and integrated triplet losses, our model can learn expressive and discriminative image and video features for image-to-video re-identification. Extensive experiments demonstrate the effectiveness of our method and the overall results on two widely used datasets surpass the state-of-the-art methods by a large margin. Code is available at: https://github.com/guxinqian/TKPKeywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Hard-Aware Point-to-Set Deep Metric for Person Re-identification2018
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)2018
- Top-Push Video-Based Person Re-identification2016
- Recurrent Convolutional Network for Video-Based Person Re-identification2016
- Person re-identification by Local Maximal Occurrence representation and metric learning2015
- Learning Euclidean-to-Riemannian Metric for Point-to-Set Classification2014
- Person Re-identification by Video Ranking2014
- Large scale metric learning from equivalence constraints2012
- The approximation power of moving least-squaresMathematics of Computation, 1998
- Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric HypothesisPsychometrika, 1964