RingMo-Aerial: An Aerial Remote Sensing Foundation Model With Affine Transformation Contrastive Learning
- 25 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 47 (12) , 10900-10913
Abstract
Aerial Remote Sensing (ARS) vision tasks present significant challenges due to the unique viewing angle characteristics. Existing research has primarily focused on algorithms for specific tasks, which have limited applicability in a broad range of ARS vision applications. This paper proposes RingMo-Aerial, aiming to fill the gap in foundation model research in the field of ARS vision. A Frequency-Enhanced Multi-Head Self-Attention (FE-MSA) mechanism is introduced to strengthen the model’s capacity for small-object representation. Complementarily, an affine transformation-based contrastive learning method improves its adaptability to the tilted viewing angles inherent in ARS tasks. Furthermore, the ARS-Adapter, an efficient parameter fine-tuning method, is proposed to improve the model’s adaptability and performance in various ARS vision tasks. Experimental results demonstrate that RingMo-Aerial achieves SOTA performance on multiple downstream tasks. This indicates the practicality and efficacy of RingMo-Aerial in enhancing the performance of ARS vision tasks.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62331027, 62301538)
This publication has 36 references indexed in Scilit:
- Context Autoencoder for Self-supervised Representation LearningInternational Journal of Computer Vision, 2023
- OGMN: Occlusion-guided multi-task network for object detection in UAV imagesISPRS Journal of Photogrammetry and Remote Sensing, 2023
- YOLOv4_Drone: UAV image target detection based on an improved YOLOv4 algorithmComputers and Electrical Engineering, 2021
- Exploring Simple Siamese Representation Learning2021
- YOLO-ACN: Focusing on Small Target and Occluded Object DetectionIEEE Access, 2020
- Small-Object Detection in UAV-Captured Images via Multi-Branch Parallel Feature Pyramid NetworksIEEE Access, 2020
- Momentum Contrast for Unsupervised Visual Representation Learning2020
- Robust Object Detection Under Occlusion With Context-Aware CompositionalNets2020
- Deep Residual Learning for Image Recognition2016
- ImageNet: A large-scale hierarchical image database2009