Danyang Hong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Danyang Hong has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Anzhu Yu
Information Engineering University, Zhengzhou, China
6 shared publications - Yujun Quan
Information Engineering University, Zhengzhou, China
5 shared publications - Song Ji
School of Geospatial Informatics, Information Engineering University, Zhengzhou, China
3 shared publications - Chunping Qiu
Intelligent Game and Decision Lab (IGDL), Beijing, China
2 shared publications - Wenyue Guo
Information Engineering University, Zhengzhou, China
2 shared publications - Yongqi Sun
Information Engineering University, Zhengzhou, China
2 shared publications
Latest Publications
- Open Access
- 23 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 19 (19391404) , 13877-13894
Instance Prompt Meets Dynamic Adapter: Continual Test-Time Adaptation for Urban Scene Image Segmentation
Recently, to enhance the ability of deployed models to adapt to continually changing environments, the continual test time adaptation (CTTA) for urban scene images (USIs) segmentation has been preliminarily studied. CTTA aims to improve the performance of models while continually adapting to multiple different USIs domains that arrive online in sequence. However, due to the lack of effective solutions for error accumulation and catastrophic forgetting, existing methods fail to achieve satisfactory performance. To this end, this paper proposes a novel CTTA method featuring instance prompts and dynamic adapters. The key innovations include: (1) An instance-wise prompt generator based on the depth anything model is proposed, which can provided more precise prompt information at different levels and effectively alleviate error accumulation. (2) A dynamic adapter module is proposed, where the short-term and long-term adapters learn domain-specific and domain-invariant knowledge respectively, to quickly adapt to new domains while avoiding catastrophic forgetting. (3) An uncertainty estimation strategy with multiple prediction is designed to further optimize the CTTA of USIs. Two typical CTTA scenarios, the continual discrepancies in geographical regions and weather conditions, are established using unmanned aerial vehicle images and street-view images respectively. Extensive experiments indicate that the proposed method outperforms existing methods by a sizeable margin, with an improvement of at least 1.8%∼2.1%.
- 23 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 19 (19391404) , 13877-13894
Open AccessInstance Prompt Meets Dynamic Adapter: Continual Test-Time Adaptation for Urban Scene Image Segmentation
Recently, to enhance the ability of deployed models to adapt to continually changing environments, the continual test time adaptation (CTTA) for urban scene images (USIs) segmentation has been preliminarily studied. CTTA aims to improve the performance of models while continually adapting to multiple different USIs domains that arrive online in sequence. However, due to the lack of effective solutions for error accumulation and catastrophic forgetting, existing methods fail to achieve satisfactory performance. To this end, this paper proposes a novel CTTA method featuring instance prompts and dynamic adapters. The key innovations include: (1) An instance-wise prompt generator based on the depth anything model is proposed, which can provided more precise prompt information at different levels and effectively alleviate error accumulation. (2) A dynamic adapter module is proposed, where the short-term and long-term adapters learn domain-specific and domain-invariant knowledge respectively, to quickly adapt to new domains while avoiding catastrophic forgetting. (3) An uncertainty estimation strategy with multiple prediction is designed to further optimize the CTTA of USIs. Two typical CTTA scenarios, the continual discrepancies in geographical regions and weather conditions, are established using unmanned aerial vehicle images and street-view images respectively. Extensive experiments indicate that the proposed method outperforms existing methods by a sizeable margin, with an improvement of at least 1.8%∼2.1%.
- Open Access
- 9 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 23 (1545598X) , 1-5
Few-View DSM Generation of Stereo Satellite Imagery via NeRF
Digital surface model (DSM) generation from stereo satellite imagery is a crucial technique for acquiring Earth’s surface information. Traditional stereo matching methods struggle to capture fine details in reconstructing complex geometric scenes. While neural radiance fields (NeRFs) and 3-D Gaussian splatting (3DGS) achieve high-quality reconstructions, they rely on the number of views and are primarily designed for RGB imagery. For panchromatic satellite imagery with few views and weak textures, we propose an NeRF method for few-view stereo satellite reconstruction. We introduce high-precision dense point clouds as geometric prior information to enhance geometric constraint capabilities from few-view images. Then, a continuous implicit function is used to jointly model the geometry and appearance of the scene. In addition, we use a multitask joint optimization strategy for enhancing DSM accuracy. To evaluate the performance of our method, we conducted qualitative and quantitative experiments on GF7 and WorldView-3 images under few-view conditions. Experimental results demonstrate that our method achieves the best results. Furthermore, we analyzed the impact of the number of views on DSM accuracy, confirming that our method maintains higher accuracy and completeness as the number of views decreases.
- 9 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 23 (1545598X) , 1-5
Open AccessFew-View DSM Generation of Stereo Satellite Imagery via NeRF
Digital surface model (DSM) generation from stereo satellite imagery is a crucial technique for acquiring Earth’s surface information. Traditional stereo matching methods struggle to capture fine details in reconstructing complex geometric scenes. While neural radiance fields (NeRFs) and 3-D Gaussian splatting (3DGS) achieve high-quality reconstructions, they rely on the number of views and are primarily designed for RGB imagery. For panchromatic satellite imagery with few views and weak textures, we propose an NeRF method for few-view stereo satellite reconstruction. We introduce high-precision dense point clouds as geometric prior information to enhance geometric constraint capabilities from few-view images. Then, a continuous implicit function is used to jointly model the geometry and appearance of the scene. In addition, we use a multitask joint optimization strategy for enhancing DSM accuracy. To evaluate the performance of our method, we conducted qualitative and quantitative experiments on GF7 and WorldView-3 images under few-view conditions. Experimental results demonstrate that our method achieves the best results. Furthermore, we analyzed the impact of the number of views on DSM accuracy, confirming that our method maintains higher accuracy and completeness as the number of views decreases.
- Open Access
- 9 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
Learning-Based Multiview Stereo for Remote Sensed Imagery With Relative Depth
The depth map estimation from a set of remote sensed images has been a challenging task due to the complexity of the real-world scenes, yet it is of great importance for applications such as 3D reconstruction and digital surface model (DSM). Most of the existing learning based multi-view stereo (MVS) approaches reconstruct depth map through supervised models that are trained with large amounts of data without any prior knowledge about the areas of interest. A recent foundational model Depth Anything, provides a robust method to estimate the relative depth map (RDM) based on single optical image. Leveraging its excellent performance in depth estimation and fine generalization capability, we propose a RDM fusion module that can be integrated with most state-of-the-art (SOTA) learning based MVS frameworks to improve their performance in 3D reconstruction. Extensive experiments are conducted to verify the effectiveness of the proposed module and positive results indicate that the integration of the proposed module leads to better accuracy and completeness compared to the benchmark models. The codes are available at https://github.com/2022hong/RDM-MVS/tree/main.
- 9 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 22 (1545598X) , 1-5
Open AccessLearning-Based Multiview Stereo for Remote Sensed Imagery With Relative Depth
The depth map estimation from a set of remote sensed images has been a challenging task due to the complexity of the real-world scenes, yet it is of great importance for applications such as 3D reconstruction and digital surface model (DSM). Most of the existing learning based multi-view stereo (MVS) approaches reconstruct depth map through supervised models that are trained with large amounts of data without any prior knowledge about the areas of interest. A recent foundational model Depth Anything, provides a robust method to estimate the relative depth map (RDM) based on single optical image. Leveraging its excellent performance in depth estimation and fine generalization capability, we propose a RDM fusion module that can be integrated with most state-of-the-art (SOTA) learning based MVS frameworks to improve their performance in 3D reconstruction. Extensive experiments are conducted to verify the effectiveness of the proposed module and positive results indicate that the integration of the proposed module leads to better accuracy and completeness compared to the benchmark models. The codes are available at https://github.com/2022hong/RDM-MVS/tree/main.
- Open Access
Refined Equivalent Pinhole Model for Large-scale 3D Reconstruction from Spaceborne CCD Imagery
In this study, we present a large-scale earth surface reconstruction pipeline for linear-array charge-coupled device (CCD) satellite imagery. While mainstream satellite image-based reconstruction approaches perform exceptionally well, the rational functional model (RFM) is subject to several limitations. For example, the RFM has no rigorous physical interpretation and differs significantly from the pinhole imaging model; hence, it cannot be directly applied to learning-based 3D reconstruction networks and to more novel reconstruction pipelines in computer vision. Hence, in this study, we introduce a method in which the RFM is equivalent to the pinhole camera model (PCM), meaning that the internal and external parameters of the pinhole camera are used instead of the rational polynomial coefficient parameters. We then derive an error formula for this equivalent pinhole model for the first time, demonstrating the influence of the image size on the accuracy of the reconstruction. In addition, we propose a polynomial image refinement model that minimizes equivalent errors via the least squares method. The experiments were conducted using four image datasets: WHU-TLC, DFC2019, ISPRS-ZY3, and GF7. The results demonstrated that the reconstruction accuracy was proportional to the image size. Our polynomial image refinement model significantly enhanced the accuracy and completeness of the reconstruction, and achieved more significant improvements for larger-scale images.
Open AccessRefined Equivalent Pinhole Model for Large-scale 3D Reconstruction from Spaceborne CCD Imagery
In this study, we present a large-scale earth surface reconstruction pipeline for linear-array charge-coupled device (CCD) satellite imagery. While mainstream satellite image-based reconstruction approaches perform exceptionally well, the rational functional model (RFM) is subject to several limitations. For example, the RFM has no rigorous physical interpretation and differs significantly from the pinhole imaging model; hence, it cannot be directly applied to learning-based 3D reconstruction networks and to more novel reconstruction pipelines in computer vision. Hence, in this study, we introduce a method in which the RFM is equivalent to the pinhole camera model (PCM), meaning that the internal and external parameters of the pinhole camera are used instead of the rational polynomial coefficient parameters. We then derive an error formula for this equivalent pinhole model for the first time, demonstrating the influence of the image size on the accuracy of the reconstruction. In addition, we propose a polynomial image refinement model that minimizes equivalent errors via the least squares method. The experiments were conducted using four image datasets: WHU-TLC, DFC2019, ISPRS-ZY3, and GF7. The results demonstrated that the reconstruction accuracy was proportional to the image size. Our polynomial image refinement model significantly enhanced the accuracy and completeness of the reconstruction, and achieved more significant improvements for larger-scale images.
- Open Access
- 16 October 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (20) , 4987
Deep Learning Methods for Semantic Segmentation in Remote Sensing with Small Data: A Survey
The annotations used during the training process are crucial for the inference results of remote sensing images (RSIs) based on a deep learning framework. Unlabeled RSIs can be obtained relatively easily. However, pixel-level annotation is a process that necessitates a high level of expertise and experience. Consequently, the use of small sample training methods has attracted widespread attention as they help alleviate reliance on large amounts of high-quality labeled data and current deep learning methods. Moreover, research on small sample learning is still in its infancy owing to the unique challenges faced when completing semantic segmentation tasks with RSI. To better understand and stimulate future research that utilizes semantic segmentation tasks with small data, we summarized the supervised learning methods and challenges they face. We also reviewed the supervised approaches with data that are currently popular to help elucidate how to efficiently utilize a limited number of samples to address issues with semantic segmentation in RSI. The main methods discussed are self-supervised learning, semi-supervised learning, weakly supervised learning and few-shot methods. The solution of cross-domain challenges has also been discussed. Furthermore, multi-modal methods, prior knowledge constrained methods, and future research required to help optimize deep learning models for various downstream tasks in relation to RSI have been identified.
- 16 October 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (20) , 4987
Open AccessDeep Learning Methods for Semantic Segmentation in Remote Sensing with Small Data: A Survey
The annotations used during the training process are crucial for the inference results of remote sensing images (RSIs) based on a deep learning framework. Unlabeled RSIs can be obtained relatively easily. However, pixel-level annotation is a process that necessitates a high level of expertise and experience. Consequently, the use of small sample training methods has attracted widespread attention as they help alleviate reliance on large amounts of high-quality labeled data and current deep learning methods. Moreover, research on small sample learning is still in its infancy owing to the unique challenges faced when completing semantic segmentation tasks with RSI. To better understand and stimulate future research that utilizes semantic segmentation tasks with small data, we summarized the supervised learning methods and challenges they face. We also reviewed the supervised approaches with data that are currently popular to help elucidate how to efficiently utilize a limited number of samples to address issues with semantic segmentation in RSI. The main methods discussed are self-supervised learning, semi-supervised learning, weakly supervised learning and few-shot methods. The solution of cross-domain challenges has also been discussed. Furthermore, multi-modal methods, prior knowledge constrained methods, and future research required to help optimize deep learning models for various downstream tasks in relation to RSI have been identified.
- Open Access
- 12 January 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (2) , 1037
Multi-Task Learning for Building Extraction and Change Detection from Remote Sensing Images
Building extraction (BE) and change detection (CD) from remote sensing (RS) imagery are significant yet highly challenging tasks with substantial application potential in urban management. Learning representative multi-scale features from RS images is a crucial step toward practical BE and CD solutions, as in other DL-based applications. To better exploit the available labeled training data for representation learning, we propose a multi-task learning (MTL) network for simultaneous BE and CD, comprising the state-of-the-art (SOTA) powerful Swin transformer as a shared backbone network and multiple heads for predicting building labels and changes. Using the popular CD dataset the Wuhan University building change detection dataset (WHU-CD), we benchmarked detailed designs of the MTL network, including backbone and pre-training choices. With a selected optimal setting, the intersection over union (IoU) score was improved from 70 to 81 for the WHU-CD. The experimental results of different settings demonstrated the effectiveness of the proposed MTL method. In particular, we achieved top scores in BE and CD from optical images in the 2021 Gaofen Challenge. Our method also shows transferable performance on an unseen CD dataset, indicating high label efficiency.
- 12 January 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (2) , 1037
Open AccessMulti-Task Learning for Building Extraction and Change Detection from Remote Sensing Images
Building extraction (BE) and change detection (CD) from remote sensing (RS) imagery are significant yet highly challenging tasks with substantial application potential in urban management. Learning representative multi-scale features from RS images is a crucial step toward practical BE and CD solutions, as in other DL-based applications. To better exploit the available labeled training data for representation learning, we propose a multi-task learning (MTL) network for simultaneous BE and CD, comprising the state-of-the-art (SOTA) powerful Swin transformer as a shared backbone network and multiple heads for predicting building labels and changes. Using the popular CD dataset the Wuhan University building change detection dataset (WHU-CD), we benchmarked detailed designs of the MTL network, including backbone and pre-training choices. With a selected optimal setting, the intersection over union (IoU) score was improved from 70 to 81 for the WHU-CD. The experimental results of different settings demonstrated the effectiveness of the proposed MTL method. In particular, we achieved top scores in BE and CD from optical images in the 2021 Gaofen Challenge. Our method also shows transferable performance on an unseen CD dataset, indicating high label efficiency.