Spatial feature embedding for robust visual object tracking
Authors:
Open Access
- 20 December 2023
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 18 (4) , 540-556
Abstract
Recently, the offline‐trained Siamese pipeline has drawn wide attention due to its outstanding tracking performance. However, the existing Siamese trackers utilise offline training to extract ‘universal’ features, which is insufficient to effectively distinguish between the target and fluctuating interference in embedding the information of the two branches, leading to inaccurate classification and localisation. In addition, the Siamese trackers employ a pre‐defined scale for cropping the search candidate region based on the previous frame's result, which might easily introduce redundant background noise (clutter, similar objects etc.), affecting the tracker's robustness. To solve these problems, the authors propose two novel sub‐network spatial employed to spatial feature embedding for robust object tracking. Specifically, the proposed spatial remapping (SRM) network enhances the feature discrepancy between target and distractor categories by online remapping, and improves the discriminant ability of the tracker on the embedding space. The MAML is used to optimise the SRM network to ensure its adaptability to complex tracking scenarios. Moreover, a temporal information proposal‐guided (TPG) network that utilises a GRU model to dynamically predict the search scale based on temporal motion states to reduce potential background interference is introduced. The proposed two network is integrated into two popular trackers, namely SiamFC++ and TransT, which achieve superior performance on six challenging benchmarks, including OTB100, VOT2019, UAV123, GOT10K, TrackingNet and LaSOT, TrackingNet and LaSOT denoting them as SiamSRMC and SiamSRMT, respectively. Moreover, the proposed trackers obtain competitive tracking performance compared with the state‐of‐the‐art trackers in the attribute of background clutter and similar object, validating the effectiveness of our method.Keywords
Funding Information
- National Natural Science Foundation of China (61673318)
This publication has 44 references indexed in Scilit:
- Learning Dynamic Memory Networks for Object Tracking2018
- Learning Dynamic Siamese Network for Visual Object Tracking2017
- ECO: Efficient Convolution Operators for Tracking2017
- Trajectory Predictor by Using Recurrent Neural Networks in Visual TrackingIEEE Transactions on Cybernetics, 2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Fully-Convolutional Siamese Networks for Object Tracking2016
- A Benchmark and Simulator for UAV Tracking2016
- Deep Residual Learning for Image Recognition2016
- Object Tracking BenchmarkIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Microsoft COCO: Common Objects in Context2014