HHHuiyang Hu

Huiyang Hu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Huiyang Hu has a total of 25 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Top Cited Papers

    RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoning

    by Huiyang Hu, Peijin Wang, Yingchao Feng, Kaiwen Wei, Wenxin Yin, Wenhui Diao, Mengyu Wang, Hanbo Bi, Kaiyue Kang, Tong Ling, et al.

    Remote sensing (RS) images from multiple modalities and platforms exhibit diverse details due to differences in sensor characteristics and imaging perspectives. Existing visionlanguage research in RS largely relies on relatively homogeneous data sources. Moreover, they still remain limited to conventional visual perception tasks such as classification or captioning. As a result, these methods fail to serve as a unified and standalone framework capable of effectively handling RS imagery from diverse sources in real-world applications. To address these issues, we propose RingMo-Agent, a model designed to handle multimodal and multi-platform data that performs perception and reasoning tasks based on user textual instructions. Compared with existing models, RingMo-Agent 1) is supported by a largescale vision-language dataset named RS-VL3M, comprising over 3 million image-text pairs, spanning optical, SAR, and infrared (IR) modalities collected from both satellite and UAV platforms, covering perception and challenging reasoning tasks; 2) learns modality adaptive representations by incorporating separated embedding layers to construct isolated features for heterogeneous modalities and reduce cross-modal interference; 3) functions as an agent-based framework equipped with external tool-use capabilities, employing a reinforcement learning-optimized trajectory decoding mechanism that integrates visual grounding tools for long-horizon embodied navigation tasks. Extensive experiments on various RS vision-language tasks demonstrate that RingMo- Agent not only proves effective in both visual understanding and sophisticated analytical tasks, but also exhibits strong generalizability across different platforms and sensing modalities.


  • RingMamba: Remote Sensing Multisensor Pretraining With Visual State Space Model

    by Peijin Wang, Hao Chang, Huiyang Hu, Xin Li, Xiaorui Liu, Yu Liu, Zhaolong Zhang, Chen Chen, Yundu Li, Yingchao Feng, et al.

    Previous studies on remote sensing foundation models have demonstrated the representational ability of convolutional neural networks (CNNs) and vision transformers (ViTs). However, these models either focus on single-sensor data, thereby overlooking complementary information across sensors, or they increase the computational complexity in pursuit of a global receptive field. In this manuscript, we introduce RingMamba, a novel multi-sensor RS foundation model that excels in both performance and efficiency. To achieve unified representation learning for multi-sensor data, we propose a multi-sensor self-supervised pre-training framework that integrates generative and contrastive learning strategies based on texture feature constraints, enabling unsupervised training of massive multi-sensor data. Considering the multi-angle and multi-size distribution of instances, we also propose an Asymmetric Scan and Scan Couple block to achieve multi-directional scanning and recognition. We validate the performance of the model on multimodal semantic segmentation, scene classification, object detection, and change detection tasks using nine public datasets. The experimental results shows leading performance across these tasks. Additionally, we evaluate the computational consumption of the model for classification tasks under different input sizes. The results show that our model maintains leading performance with higher throughput and lower FLOPs, especially under high-resolution inputs, making it more suitable for the remote sensing field.


  • RingMoGPT: A Unified Remote Sensing Foundation Model for Vision, Language, and Grounded Tasks

    by Peijin Wang, Huiyang Hu, Boyuan Tong, Ziqi Zhang, Fanglong Yao, Yingchao Feng, Zining Zhu, Hao Chang, Wenhui Diao, Qixiang Ye, et al.

    Recently, multi-modal large language models (MLLMs) have shown excellent reasoning capabilities in various fields. Most of the existing remote sensing MLLMs solve image-level text generation problems (e.g., image captioning), but ignore the core issues of object-level recognition, location and multi-temporal changes in the field of remote sensing. In this paper, we propose RingMoGPT, a multi-modal foundation model that unifies vision, language, and localization. Based on the idea of domain adaption, RingMoGPT can complete training by fine-tuning only a few parameters. To make the model capable of object detection and change captioning, we further propose a Location- and Instruction-aware Q-Former and a change detection module, respectively. To improve the performance of RingMoGPT, we carefully design the pre-training dataset and the instruction-tuning dataset. The pre-training dataset contains over a half million high-quality image and text pairs, which are generated through a low-cost and efficient data generation paradigm. The instruction-tuning dataset contains more than 1.6 million question-answer pairs, including 6 downstream tasks: scene classification, object detection, visual question answering, image captioning, grounded image captioning, and change captioning. Our experiments show that RingMoGPT performs well on 6 tasks, especially its ability to analyze multi-temporal data changes and identify dense objects. We also verified the model under zero-shot setting, and the results show that the proposed RingMoGPT also has good generalization ability in the face of new data.