TMDiMP: Temporal Memory Guided Discriminative Tracker for UAV Object Tracking
Open Access
- 15 December 2022
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 14 (24) , 6351
Abstract
Unmanned aerial vehicles (UAVs) have attracted increasing attention in recent years because of their broad range of applications in city security, military reconnaissance, disaster rescue, and so on. As one of the critical algorithms in the field of artificial intelligence, object tracking greatly improves the working efficiency of UAVs. However, unmanned aerial vehicle (UAV) object tracking still faces many challenges. UAV objects provide limited textures and contours for feature extraction due to their small sizes. Moreover, to capture objects continuously, a UAV camera must constantly move with the object. The above two reasons are usual causes of object-tracking failures. To this end, we propose an end-to-end discriminative tracker called TMDiMP. Inspired by the self-attention mechanism in Transformer, a novel memory-aware attention mechanism is embedded into TMDiMP, which can generate discriminative features of small objects and overcome the object-forgetting problem after camera motion. We also build a UAV object-tracking dataset with various object categories and attributes, named VIPUOTB, which consists of many video sequences collected in urban scenes. Our VIPUOTB is different from other existing datasets in terms of object size, camera motion speed, location distribution, etc. TMDiMP achieves competitive results on our VIPUOTB dataset and three public datasets, UAVDT, UAV123, and VisDrone, compared with state-of-the-art methods, thus demonstrating the effectiveness and robustness of our proposed algorithm.Keywords
Funding Information
- National Natural Science Foundation of China (62076190, 41831072, 41874195, 62036007, 2022ZDLGY01-11)
- The Key Industry Innovation Chain of Shaanxi (62076190, 41831072, 41874195, 62036007, 2022ZDLGY01-11)
This publication has 53 references indexed in Scilit:
- Fully-Convolutional Siamese Networks for Object Tracking2016
- A Benchmark and Simulator for UAV Tracking2016
- Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking2016
- Discriminative Scale Space TrackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Staple: Complementary Learners for Real-Time Tracking2016
- Monocular Long-Term Target Following on UAVs2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Object Tracking BenchmarkIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- High-Speed Tracking with Kernelized Correlation FiltersIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- An Improved Object Tracking Method in UAV VideosProcedia Engineering, 2011