A Multi-Camera Vehicle Tracking System based on City-Scale Vehicle Re-ID and Spatial-Temporal Information
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4072-4081
Abstract
With the demands of the intelligent city and city-scale traffic management, city-scale multi-camera vehicle tracking (MCVT) has become a vital problem. The MCVT is challenging due to frequent occlusion, similar vehicle models, significant feature variation by different lighting conditions, and viewing perspective in different cameras. This paper proposes an MCVT system composed of single-camera tracking (SCT), vehicle re-identification (Re-ID), and multi-camera tracks matching (MCTM). In the SCT phase, we designed a tracker update strategy and used the Re-ID model in advance. We also adopted a template matching method to re-associate the discontinuous tracklets. As for vehicle Re-ID, we implemented a spatial attention mechanism based on the background model. Then we fully leveraged the labels of synthetic data to train attributes Re-ID models as the attributes features extractor. Finally, we proposed an MCTM method to leverage tracklets representation and spatial-temporal information efficiently. Our system is evaluated both on the City-Scale Multi-Camera Vehicle Re-Identification task (Track 2) and City-Scale Multi-Camera Vehicle Tracking task (Track 3) at the AI City Challenge. Our vehicle Re-ID method has achieved 3rd place of Track 2, with an mAP score of 66.50%, and achieved state-of-the-art results on the VeRi776 dataset. Our MCVT system has achieved 3rd place, yielding 76.51% IDF 1 of Track 3. Experimental results demonstrate that our system has achieved competitive performance for city-scale traffic management.Keywords
Funding Information
- National Natural Science Foundation of China
- Technology Development
This publication has 28 references indexed in Scilit:
- Learning Deep Neural Networks for Vehicle Re-ID with Visual-spatio-Temporal Path Proposals2017
- Mask R-CNN2017
- Orientation Invariant Feature Embedding and Spatial Temporal Regularization for Vehicle Re-identification2017
- PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban SurveillanceIEEE Transactions on Multimedia, 2017
- Simple online and realtime tracking with a deep association metric2017
- Simple online and realtime tracking2016
- Deep Residual Learning for Image Recognition2016
- ImageNet: A large-scale hierarchical image database2009
- “Keyhole” method for accelerating imaging of contrast agent uptakeJournal of Magnetic Resonance Imaging, 1993
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955