SiamDCFF: Dynamic Cascade Feature Fusion for Vision Tracking
Open Access
Abstract
Establishing an accurate and robust feature fusion mechanism is key to enhancing the tracking performance of single-object trackers based on a Siamese network. However, the output features of the depth-wise cross-correlation feature fusion module in fully convolutional trackers based on Siamese networks cannot establish global dependencies on the feature maps of a search area. This paper proposes a dynamic cascade feature fusion (DCFF) module by introducing a local feature guidance (LFG) module and dynamic attention modules (DAMs) after the depth-wise cross-correlation module to enhance the global dependency modeling capability during the feature fusion process. In this paper, a set of verification experiments is designed to investigate whether establishing global dependencies for the features output by the depth-wise cross-correlation operation can significantly improve the performance of fully convolutional trackers based on a Siamese network, providing experimental support for rational design of the structure of a dynamic cascade feature fusion module. Secondly, we integrate the dynamic cascade feature fusion module into the tracking framework based on a Siamese network, propose SiamDCFF, and evaluate it using public datasets. Compared with the baseline model, SiamDCFF demonstrated significant improvements.Keywords
Funding Information
- National Natural Science Foundation of China (62073279, 22567619H)
- Hebei innovation capability improvement plan project (62073279, 22567619H)
This publication has 30 references indexed in Scilit:
- Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework2022
- Ocean: Object-Aware Anchor-Free Tracking2020
- Distractor-Aware Siamese Networks for Visual Object Tracking2018
- ECO: Efficient Convolution Operators for Tracking2017
- YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video2017
- Fully-Convolutional Siamese Networks for Object Tracking2016
- A Benchmark and Simulator for UAV Tracking2016
- Deep Residual Learning for Image Recognition2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Microsoft COCO: Common Objects in Context2014