LocaLock: Enhancing Multi-Object Tracking in Satellite Videos via Local Feature Matching
Open Access
- 22 January 2025
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 17 (3) , 371
Abstract
Multi-object tracking (MOT) in satellite videos is a challenging task due to the small size and blurry features of objects, which often lead to intermittent detection and tracking instability. Many existing object detection and tracking models often struggle with these issues, as they are not designed to effectively handle the unique characteristics of satellite videos. To address these challenges, we propose LocaLock, a joint detection and tracking framework for MOT that incorporates feature matching concepts from single object tracking (SOT) to enhance tracking stability and reduce intermittent tracking results. Specifically, LocaLock utilizes an anchor-free detection backbone for efficiency and employs a local cost volume (LCV) module to perform precise feature matching in the local area. This provides valuable object priors to the detection head, enabling the model to “lock” onto objects with greater accuracy and mitigate the instability associated with small object detection. Additionally, the local computation within the LCV module ensures low computational complexity and memory usage. Furthermore, LocaLock incorporates a novel motion flow (MoF) module to accumulate and exploit temporal information, further enhancing feature robustness and consistency across frames. Rigorous evaluations on the VISO dataset demonstrate the superior performance of LocaLock, surpassing existing methods in tracking accuracy and precision within the demanding satellite video analysis domain. Notably, LocaLock achieved state-of-the-art performance on the VISO benchmark, achieving a multi-object tracking accuracy (MOTA) of 62.6 while ensuring fast running speed.Keywords
Funding Information
- Key Laboratory of Target Cognition and Application Technology (2023-CXPT-LC-005)
This publication has 46 references indexed in Scilit:
- BoostTrack: boosting the similarity measure and detection confidence for improved multiple object trackingMachine Vision and Applications, 2024
- Pay Attention to Local Contrast Learning Networks for Infrared Small Target DetectionIEEE Geoscience and Remote Sensing Letters, 2022
- Space-time super-resolution for satellite video: A joint framework based on multi-scale spatial-temporal transformerInternational Journal of Applied Earth Observation and Geoinformation, 2022
- DSFNet: Dynamic and Static Fusion Network for Moving Object Detection in Satellite VideosIEEE Geoscience and Remote Sensing Letters, 2021
- FairMOT: On the Fairness of Detection and Re-identification in Multiple Object TrackingInternational Journal of Computer Vision, 2021
- Cross-frame keypoint-based and spatial motion information-guided networks for moving vehicle detection and tracking in satellite videosISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Improving Multiple Object Tracking with Single Object Tracking2021
- Moving vehicle detection, tracking and traffic parameter estimation from a satellite video: a perspective on a smarter cityInternational Journal of Remote Sensing, 2019
- Real-Time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identification2018
- Learning Multi-domain Convolutional Neural Networks for Visual Tracking2016