FDTrack: A Dual-Head Focus Tracking Network With Frequency Enhancement
- 4 December 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (2) , 3879-3897
Abstract
The RGB-T tracking approach combines the advantages of visible and thermal sensors to achieve accurate target tracking in complex scenarios. However, previous RGB-T trackers based on the self-attention mechanism overlook crucial high-frequency information (such as texture, edges, and colors) that is essential for object prediction. To address these challenges, we propose a frequency-enhanced dual-head focus tracking network (FDTrack) for RGB-T tracking. FDTrack comprises four main components: high-frequency feature enhancement (HFFE), wavelet multi-frequency interaction (WMF), autonomous modality prediction (AMP), and search focus preprocessing (SFP). HFFE refines the features from the ViT backbones within specific modalities by adaptively amplifying high-frequency features. In contrast, WMF facilitates communication between different frequency bands to enhance the interaction of RGB-T features from a frequency perspective. To improve tracking robustness under extreme scenes, AMP incorporates dual prediction heads and determines the final outcome through feature matching. SFP adjusts the convolution kernel size based on pixel-to-target distance and preprocesses the search region with Gaussian blur to reduce background clutter interference and emphasize the target. Extensive experimental results demonstrate that FDTrack achieves competitive performance compared to state-of-the-art algorithms across various datasets including RGBT210, RGBT234, and LasHeR, showcasing its cutting-edge capabilities in this field.Keywords
Funding Information
- National Natural Science Foundation of China (62066047)
- National Natural Science Foundation of China (61966037)
- Practice Innovation Fund of Yunnan University (ZC-23234092)
This publication has 72 references indexed in Scilit:
- Visual Prompt Tuning2022
- Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework2022
- FEAR: Fast, Efficient, Accurate and Robust Visual Tracker2022
- Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learning2022
- Wavelet-Based Dual-Branch Network for Image Demoiréing2020
- Challenge-Aware RGBT Tracking2020
- TIRNet: Object detection in thermal infrared images for autonomous drivingApplied Intelligence, 2020
- Wavelet Transform2019
- Multilayer Perceptron (MLP)2017
- Median Filtering: Statistical Properties2006