RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoning
Top Cited Papers
- 1 November 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (11) , 14542-14559
Abstract
Remote sensing (RS) images from multiple modalities and platforms exhibit diverse details due to differences in sensor characteristics and imaging perspectives. Existing visionlanguage research in RS largely relies on relatively homogeneous data sources. Moreover, they still remain limited to conventional visual perception tasks such as classification or captioning. As a result, these methods fail to serve as a unified and standalone framework capable of effectively handling RS imagery from diverse sources in real-world applications. To address these issues, we propose RingMo-Agent, a model designed to handle multimodal and multi-platform data that performs perception and reasoning tasks based on user textual instructions. Compared with existing models, RingMo-Agent 1) is supported by a largescale vision-language dataset named RS-VL3M, comprising over 3 million image-text pairs, spanning optical, SAR, and infrared (IR) modalities collected from both satellite and UAV platforms, covering perception and challenging reasoning tasks; 2) learns modality adaptive representations by incorporating separated embedding layers to construct isolated features for heterogeneous modalities and reduce cross-modal interference; 3) functions as an agent-based framework equipped with external tool-use capabilities, employing a reinforcement learning-optimized trajectory decoding mechanism that integrates visual grounding tools for long-horizon embodied navigation tasks. Extensive experiments on various RS vision-language tasks demonstrate that RingMo- Agent not only proves effective in both visual understanding and sophisticated analytical tasks, but also exhibits strong generalizability across different platforms and sensing modalities.Keywords
All Related Versions
Funding Information
- National Key R&D Program of China (2024YFF1401001)
This publication has 58 references indexed in Scilit:
- RSGPT: A remote sensing vision language model and benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2025
- SkyEyeGPT: Unifying remote sensing vision-language tasks via instruction tuning with large language modelISPRS Journal of Photogrammetry and Remote Sensing, 2025
- LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model2024
- A survey on large language model based autonomous agentsFrontiers of Computer Science, 2024
- HIT-UAV: A high-altitude infrared thermal dataset for Unmanned Aerial Vehicle-based object detectionScientific Data, 2023
- shikra, n.2023
- Two novel benchmark datasets from ArcGIS and bing world imagery for remote sensing image retrievalInternational Journal of Remote Sensing, 2020
- Object detection in optical remote sensing images: A survey and a new benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2020
- PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrievalISPRS Journal of Photogrammetry and Remote Sensing, 2018
- Multi-class geospatial object detection and geographic image classification based on collection of part detectorsISPRS Journal of Photogrammetry and Remote Sensing, 2014