Motion-Guided Multiobject Tracking Model for High-Speed Aerial Objects in Satellite Videos
- 15 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-15
Abstract
With the continuous improvement of remote sensing satellite technology for earth observation, satellite video object tracking has become a new research field. Tracking aerial objects in satellite video facilitates highly accurate positioning over a wide coverage area which plays a crucial role in remote sensing scenes such as military analysis and disaster prevention. However, for such a data-driven task, most previous satellite video datasets focus on ground object tracking and lack attention to high-speed aerial objects. In this regard, a high-resolution satellite video dataset for detecting and tracking high-speed aerial objects (AIR-HSAO) is built including satellite videos from over 20 regions worldwide, with detailed annotations for approximately 1400 airplane trajectories. Based on the AIR-HSAO, an end-to-end online multi-object tracking method called MGTrack is proposed for high-speed aerial objects. Specifically, the motion prediction module is proposed to implicitly model object motion and associate objects. Guided by the predicted offsets, the feature warping and fusion module aligns and fuses temporal features, fully exploiting the temporal correlations of the video sequence to obtain more accurate feature representations for high-speed objects. Additionally, a trajectory-aware size-enhanced loss is designed to handle the problem of discontinuous trajectories and small-scale objects. Experimental results on AIR-HSAO demonstrate that the proposed MGTrack improves the tracking accuracy by 2.3 MOTA and 1.6 IDF1 compared to the state-of-the-art tracking methods. The code is released at https://github.com/RenLibo-aircas/AIR-HSAT-dataset.Keywords
Funding Information
- National Key Research and Development Program of China (2022ZD0118402)
This publication has 48 references indexed in Scilit:
- A multi-frame sparse self-learning PWC-Net for motion estimation in satellite video scenesScience China Information Sciences, 2023
- MOTR: End-to-End Multiple-Object Tracking with Transformer2022
- ByteTrack: Multi-object Tracking by Associating Every Detection Box2022
- FairMOT: On the Fairness of Detection and Re-identification in Multiple Object TrackingInternational Journal of Computer Vision, 2021
- Tracking Objects as Points2020
- Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking2020
- TAO: A Large-Scale Benchmark for Tracking Any Object2020
- Object detection in optical remote sensing images: A survey and a new benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Wave-derived coastal bathymetry from satellite video imagery: A showcase with Pleiades persistent modeRemote Sensing of Environment, 2019
- Intercomparison of Himawari-8 AHI-FSA with MODIS and VIIRS active fire productsInternational Journal of Digital Earth, 2018