A Comprehensive Review of RGBT Tracking
- 31 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-23
Abstract
RGBT tracking seeks to leverage both visible and thermal infrared images to enhance the robustness of target tracking. This method makes up for the limitations of single-sensor tracking. The RGB and thermal infrared images complement each other effectively, enabling the tracker to operate seamlessly in complex environments day and night. However, RGBT tracking still faces challenges such as thermal crossover, occlusion, illumination changes, rapid target movement, and background clutter. These problems hinder the performance improvement of RGBT trackers. Researchers have proposed numerous RGBT tracking methods in response to these challenges over time. This paper aims to comprehensively review and summarize the latest research progress in RGBT tracking. First, we categorize the existing tracing methods according to the RGBT tracing framework. Then, we introduce the datasets/benchmarks used to evaluate RGBT tracking methods. Subsequently, we present the results of representative tracking methods on multiple testing benchmarks, providing a more intuitive presentation of current research advances in the field of RGBT tracking. Finally, research directions are discussed to further advance the development of RGBT tracking.Keywords
Funding Information
- National Natural Science Foundation of China (62202362, 62302073, 62172126)
- Fundamental Research Funds for the Central Universities (ZYTS24165)
- China Postdoctoral Science Foundation (2022TQ0247, 2023M742742)
- Basic and Applied Basic Research Foundation of Guangdong Province (2024A1515011626)
- Science and Technology Projects in Guangzhou (2023A04J0397)
- National Key Research and Development Program of China (2022YFB2902900)
This publication has 149 references indexed in Scilit:
- Information Lossless Multi-modal Image Generation for RGB-T Tracking2022
- Challenge-Aware RGBT Tracking2020
- End-to-End Object Detection with Transformers2020
- Learning Joint Spatial-Temporal Transformations for Video Inpainting2020
- The Eighth Visual Object Tracking VOT2020 Challenge Results2020
- Learning Soft-Consistent Correlation Filters for RGB-T Object Tracking2018
- Real-Time MDNet2018
- Cross-Modal Ranking with Soft Consistency and Noisy Labels for Robust RGB-T Tracking2018
- Distractor-Aware Siamese Networks for Visual Object Tracking2018
- Learning Dynamic Memory Networks for Object Tracking2018