Shan Zhao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Shan Zhao has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Xiao Xiang Zhu
Chair of Data Science in Earth Observation, Technical University of Munich, Munich, Germany
6 shared publications - Sudipan Saha
Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, India
3 shared publications Zhitong Xiong
3 shared publications- Zhitong Xiong
Chair of Data Science in Earth Observation, Technical University of Munich (TUM), Munich, Germany
2 shared publications Gustau Camps-Valls
1 shared publicationIlektra Karasante
1 shared publication
Latest Publications
- Open Access
- 16 April 2026
- Published by Elsevier in ISPRS Journal of Photogrammetry and Remote Sensing
- Vol. 236, 654-667
Causal Graph Neural Networks for robust wildfire forecasting across geographic shifts
- 16 April 2026
- Published by Elsevier in ISPRS Journal of Photogrammetry and Remote Sensing
- Vol. 236, 654-667
Open AccessCausal Graph Neural Networks for robust wildfire forecasting across geographic shifts
- Open Access
- 7 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-18
RainScaler: A Physics-Inspired Network for Precipitation Correction and Downscaling
Spatial downscaling of precipitation, in which finegrained regional precipitation patterns are recovered from coarse-resolution images, plays a crucial role in various weather and meteorological analyses. However, the intricate noise information presented in the observation data intertwines with the fine-scale characteristics, which poses challenges for subsequent feature extraction. Regional precipitation suffers from complex spatial patterns. Moreover, the real observatory data contains information inconsistent with the established physical principle, due either to inaccurate or incomplete physical models or limited data quality, thus making the implementation of physicallyinformed deep learning more difficult. For example, strong physical constraints may lead to over-regularization, in which the model becomes too rigid and fails to capture certain complexities in the data. In this work, we propose RainScaler, a physicsinspired deep neural network, to tackle these issues. First, to remove the noise and preserve the vital precipitation patterns effectively, the proposed RainScaler exploits an Inconsistencyaware Denoising Net to explicitly model the spatial variability of noise in the input. In addition, a graph module is designed to learn the geographical-dependent fine-grained patterns in high dimensional feature space at a moderate computation cost. Finally, multi-scale physical constraints are skillfully embedded to incorporate additional insights into the data-driven framework. We test our approach on a public dataset consisting of over 60,000 real low-resolution and high-resolution precipitation map pairs collected by different sensors. Our method produces realisticlooking precipitation maps with better discernment capability and corrects the structural error of precipitation distribution, especially for extreme events. Moreover, we evaluate the potential risks of incorporating physical constraints in real-world data applications. Our method unveils opportunities for multi-source data fusion and provides possible solutions to improve the physical feasibility of data-driven models. The codes are available in https://github.com/zhu-xlab/RainScaler.git.
- 7 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-18
Open AccessRainScaler: A Physics-Inspired Network for Precipitation Correction and Downscaling
Spatial downscaling of precipitation, in which finegrained regional precipitation patterns are recovered from coarse-resolution images, plays a crucial role in various weather and meteorological analyses. However, the intricate noise information presented in the observation data intertwines with the fine-scale characteristics, which poses challenges for subsequent feature extraction. Regional precipitation suffers from complex spatial patterns. Moreover, the real observatory data contains information inconsistent with the established physical principle, due either to inaccurate or incomplete physical models or limited data quality, thus making the implementation of physicallyinformed deep learning more difficult. For example, strong physical constraints may lead to over-regularization, in which the model becomes too rigid and fails to capture certain complexities in the data. In this work, we propose RainScaler, a physicsinspired deep neural network, to tackle these issues. First, to remove the noise and preserve the vital precipitation patterns effectively, the proposed RainScaler exploits an Inconsistencyaware Denoising Net to explicitly model the spatial variability of noise in the input. In addition, a graph module is designed to learn the geographical-dependent fine-grained patterns in high dimensional feature space at a moderate computation cost. Finally, multi-scale physical constraints are skillfully embedded to incorporate additional insights into the data-driven framework. We test our approach on a public dataset consisting of over 60,000 real low-resolution and high-resolution precipitation map pairs collected by different sensors. Our method produces realisticlooking precipitation maps with better discernment capability and corrects the structural error of precipitation distribution, especially for extreme events. Moreover, we evaluate the potential risks of incorporating physical constraints in real-world data applications. Our method unveils opportunities for multi-source data fusion and provides possible solutions to improve the physical feasibility of data-driven models. The codes are available in https://github.com/zhu-xlab/RainScaler.git.
- Open Access
- 20 January 2025
- Published by Copernicus GmbH
Enhanced Foundation Model through Efficient Finetuning for Extended-Range Weather Prediction
Weather forecasting is a vital topic in meteorological analysis, agriculture planning, disaster management, etc. The accuracy of forecasts varies with the prediction horizon, spanning from nowcasting to long-range forecasts. The extended range forecast, which predicts weather conditions beyond two weeks to months ahead, is particularly challenging. This difficulty arises from the inherent variability in weather systems, where minor disturbances in the initial condition can lead to significantly divergent future trajectories.Numerical Weather Prediction (NWP) has been the predominant approach in this field. Recently, deep learning (DL) techniques have emerged as a promising alternative, achieving performance comparable to NWP [1, 2]. However, their lack of embedded physical knowledge often limits their acceptance within the research community. To enhance the trustworthiness of DL-based weather forecasts, we explore a transformer-based framework which considers complex geospatial-temporal (4D) processes and interactions. Specifically, we select the Pangu model [3] with a 24-hour lead time as the initial framework. To extend the prediction horizon to two weeks ahead, we employ a low-rank adaptation for model finetuning, which saves computation resources by reducing the number of parameters to only 1.1% of the original model. Besides, we incorporate multiple oceanic and atmospheric indices to capture a broad spectrum of global teleconnections, aiding in the selection of important features. Our contributions are threefold: first, we provide an operational framework for foundation models, improving their applicability in versatile tasks by enabling training rather than limiting them to inference stages. Second, we demonstrate how to leverage these models with limited resources effectively and contribute to the development of green AI. Last, our method improves performance in extended-range weather forecasting, offering enhanced prediction skills, physical consistency, and finer spatial granularity. Our methodology achieved reduced RMSE on T2M, Z500, and T850 for 0.13, 139.2, and 0.52, respectively, compared to IFS. In the future, we plan to explore other settings, such as predicting precipitation and extreme temperatures.REFERENCES[1] Nguyen, Tung, et al. "ClimaX: A foundation model for weather and climate." arXiv preprint arXiv:2301.10343 (2023).[2] Lam, Remi, et al. "Learning skillful medium-range global weather forecasting." Science (2023): eadi2336.[3] Bi, Kaifeng, et al. "Accurate medium-range global weather forecasting with 3D neural networks." Nature 619.7970 (2023): 533-538.
- 20 January 2025
- Published by Copernicus GmbH
Open AccessEnhanced Foundation Model through Efficient Finetuning for Extended-Range Weather Prediction
Weather forecasting is a vital topic in meteorological analysis, agriculture planning, disaster management, etc. The accuracy of forecasts varies with the prediction horizon, spanning from nowcasting to long-range forecasts. The extended range forecast, which predicts weather conditions beyond two weeks to months ahead, is particularly challenging. This difficulty arises from the inherent variability in weather systems, where minor disturbances in the initial condition can lead to significantly divergent future trajectories.Numerical Weather Prediction (NWP) has been the predominant approach in this field. Recently, deep learning (DL) techniques have emerged as a promising alternative, achieving performance comparable to NWP [1, 2]. However, their lack of embedded physical knowledge often limits their acceptance within the research community. To enhance the trustworthiness of DL-based weather forecasts, we explore a transformer-based framework which considers complex geospatial-temporal (4D) processes and interactions. Specifically, we select the Pangu model [3] with a 24-hour lead time as the initial framework. To extend the prediction horizon to two weeks ahead, we employ a low-rank adaptation for model finetuning, which saves computation resources by reducing the number of parameters to only 1.1% of the original model. Besides, we incorporate multiple oceanic and atmospheric indices to capture a broad spectrum of global teleconnections, aiding in the selection of important features. Our contributions are threefold: first, we provide an operational framework for foundation models, improving their applicability in versatile tasks by enabling training rather than limiting them to inference stages. Second, we demonstrate how to leverage these models with limited resources effectively and contribute to the development of green AI. Last, our method improves performance in extended-range weather forecasting, offering enhanced prediction skills, physical consistency, and finer spatial granularity. Our methodology achieved reduced RMSE on T2M, Z500, and T850 for 0.13, 139.2, and 0.52, respectively, compared to IFS. In the future, we plan to explore other settings, such as predicting precipitation and extreme temperatures.REFERENCES[1] Nguyen, Tung, et al. "ClimaX: A foundation model for weather and climate." arXiv preprint arXiv:2301.10343 (2023).[2] Lam, Remi, et al. "Learning skillful medium-range global weather forecasting." Science (2023): eadi2336.[3] Bi, Kaifeng, et al. "Accurate medium-range global weather forecasting with 3D neural networks." Nature 619.7970 (2023): 533-538.
- 4 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Magazine
- Vol. 13 (1) , 175-208
Beyond Grid Data: Exploring graph neural networks for Earth observation
Earth Observation (EO) data analysis has been significantly revolutionized by deep learning (DL), with applications typically limited to grid-like data structures. Graph Neural Networks (GNNs) emerge as an important innovation, propelling DL into the non-Euclidean domain. Naturally, GNNs can effectively tackle the challenges posed by diverse modalities, multiple sensors, and the heterogeneous nature of EO data. To introduce GNNs in the related domains, our review begins by offering fundamental knowledge on GNNs. Then, we summarize the generic problems in EO, to which GNNs can offer potential solutions. Following this, we explore a broad spectrum of GNNs’ applications to scientific problems in Earth systems, covering areas such as weather and climate analysis, disaster management, air quality monitoring, agriculture, land cover classification, hydrological process modeling, and urban modeling. The rationale behind adopting GNNs in these fields is explained, alongside methodologies for organizing graphs and designing favorable architectures for various tasks. Furthermore, we highlight methodological challenges of implementing GNNs in these domains and possible solutions that could guide future research. While acknowledging that GNNs are not a universal solution, we conclude the paper by comparing them with other popular architectures like transformers and analyzing their potential synergies.
- 4 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Magazine
- Vol. 13 (1) , 175-208
Beyond Grid Data: Exploring graph neural networks for Earth observation
Earth Observation (EO) data analysis has been significantly revolutionized by deep learning (DL), with applications typically limited to grid-like data structures. Graph Neural Networks (GNNs) emerge as an important innovation, propelling DL into the non-Euclidean domain. Naturally, GNNs can effectively tackle the challenges posed by diverse modalities, multiple sensors, and the heterogeneous nature of EO data. To introduce GNNs in the related domains, our review begins by offering fundamental knowledge on GNNs. Then, we summarize the generic problems in EO, to which GNNs can offer potential solutions. Following this, we explore a broad spectrum of GNNs’ applications to scientific problems in Earth systems, covering areas such as weather and climate analysis, disaster management, air quality monitoring, agriculture, land cover classification, hydrological process modeling, and urban modeling. The rationale behind adopting GNNs in these fields is explained, alongside methodologies for organizing graphs and designing favorable architectures for various tasks. Furthermore, we highlight methodological challenges of implementing GNNs in these domains and possible solutions that could guide future research. While acknowledging that GNNs are not a universal solution, we conclude the paper by comparing them with other popular architectures like transformers and analyzing their potential synergies.
- Open Access
- 25 February 2023
- Published by Copernicus GmbH
A Coarse-to-Fine Deep Learning Framework for High-Resolution Future Precipitation Map Generation
Precipitation nowcasting, aiming to predict the rainfall intensity in the near future (usually 0-2h) [1], is crucial for urban planning, flood monitoring, agriculture management, and so on. Numerical weather modeling (NWP) takes a variety of data sources as the input of complex computer models that use mathematical equations to simulate the behavior of the atmosphere. Limited by the time needed for model spin-up, the performance in the short near future is not satisfactory. Deep learning (DL)-based method fills in the gap by treating nowcasting as a video prediction problem. The Convolutional LSTM [2] extracts spatial information when dealing with temporal series. The Generated Adversarial Network (GAN)-based [3] method shows potential in simulating the realisticness of the precipitation field. However, training such a model is very time-consuming and data-demanding [3] [4]. Different from natural images, the precipitation field to be estimated usually has a larger spatial size. Moreover, the convolutional layers tend to oversmooth the output and eliminate the small patterns that are important for the meteorologists to make the decision. Thus, we proposed a two-stage framework: the first one is to train an RNN-based model on the coarse field. The second is to downscale and style transfer from the coarse field to high-resolution precipitation maps based on GAN and Graph Convolutional Network (GCN). The coarse prediction will act as a constraint to the finer scale output and allows re-assignment of the spatial distribution of intensities. Such probabilistic output prevents the overestimation of the intensity. RNN is good at capturing long-range characteristics, and GCN [5] can extract local and neighborhood information, thus these two channels are naturally complementary to improve both local patterns and global accuracy scores. The GAN is used to make final output similar to real precipitation maps such as radar scans. To train the model, we downloaded the 2006-2016 ERA5 total precipitation at 0.25-degree spatial resolution and the DWD radar map [6] at 1km spatial resolution. We expect our model can capture the overall coverage of rainfall events and depict the spatial details. More importantly, this alleviates the data shortage problem, i.e., high-resolution precipitation nowcasting at places without ground-based radar stations can be acquired. [1] Shi, Xingjian, et al. "Deep learning for precipitation nowcasting: A benchmark and a new model." Advances in neural information processing systems 30 (2017). [2]Shi, Xingjian, et al. "Convolutional LSTM network: A machine learning approach for precipitation nowcasting." Advances in neural information processing systems 28 (2015). [3] Ravuri, Suman, et al. "Skilful precipitation nowcasting using deep generative models of radar." Nature 597.7878 (2021): 672-677. [4] Sønderby, Casper Kaae, et al. "Metnet: A neural weather model for precipitation forecasting." arXiv preprint arXiv:2003.12140 (2020). [5] Shi, Yilei, Qingyu Li, and Xiao Xiang Zhu. "Building segmentation through a gated graph convolutional neural network with deep structured feature embedding." ISPRS Journal of Photogrammetry and Remote Sensing 159 (2020): 184-197. [6] Ayzel, Georgy, Tobias Scheffer, and Maik Heistermann. "RainNet v1. 0: a convolutional neural network for radar-based precipitation nowcasting." Geoscientific Model Development 13.6 (2020): 2631-2644.
- 25 February 2023
- Published by Copernicus GmbH
Open AccessA Coarse-to-Fine Deep Learning Framework for High-Resolution Future Precipitation Map Generation
Precipitation nowcasting, aiming to predict the rainfall intensity in the near future (usually 0-2h) [1], is crucial for urban planning, flood monitoring, agriculture management, and so on. Numerical weather modeling (NWP) takes a variety of data sources as the input of complex computer models that use mathematical equations to simulate the behavior of the atmosphere. Limited by the time needed for model spin-up, the performance in the short near future is not satisfactory. Deep learning (DL)-based method fills in the gap by treating nowcasting as a video prediction problem. The Convolutional LSTM [2] extracts spatial information when dealing with temporal series. The Generated Adversarial Network (GAN)-based [3] method shows potential in simulating the realisticness of the precipitation field. However, training such a model is very time-consuming and data-demanding [3] [4]. Different from natural images, the precipitation field to be estimated usually has a larger spatial size. Moreover, the convolutional layers tend to oversmooth the output and eliminate the small patterns that are important for the meteorologists to make the decision. Thus, we proposed a two-stage framework: the first one is to train an RNN-based model on the coarse field. The second is to downscale and style transfer from the coarse field to high-resolution precipitation maps based on GAN and Graph Convolutional Network (GCN). The coarse prediction will act as a constraint to the finer scale output and allows re-assignment of the spatial distribution of intensities. Such probabilistic output prevents the overestimation of the intensity. RNN is good at capturing long-range characteristics, and GCN [5] can extract local and neighborhood information, thus these two channels are naturally complementary to improve both local patterns and global accuracy scores. The GAN is used to make final output similar to real precipitation maps such as radar scans. To train the model, we downloaded the 2006-2016 ERA5 total precipitation at 0.25-degree spatial resolution and the DWD radar map [6] at 1km spatial resolution. We expect our model can capture the overall coverage of rainfall events and depict the spatial details. More importantly, this alleviates the data shortage problem, i.e., high-resolution precipitation nowcasting at places without ground-based radar stations can be acquired. [1] Shi, Xingjian, et al. "Deep learning for precipitation nowcasting: A benchmark and a new model." Advances in neural information processing systems 30 (2017). [2]Shi, Xingjian, et al. "Convolutional LSTM network: A machine learning approach for precipitation nowcasting." Advances in neural information processing systems 28 (2015). [3] Ravuri, Suman, et al. "Skilful precipitation nowcasting using deep generative models of radar." Nature 597.7878 (2021): 672-677. [4] Sønderby, Casper Kaae, et al. "Metnet: A neural weather model for precipitation forecasting." arXiv preprint arXiv:2003.12140 (2020). [5] Shi, Yilei, Qingyu Li, and Xiao Xiang Zhu. "Building segmentation through a gated graph convolutional neural network with deep structured feature embedding." ISPRS Journal of Photogrammetry and Remote Sensing 159 (2020): 184-197. [6] Ayzel, Georgy, Tobias Scheffer, and Maik Heistermann. "RainNet v1. 0: a convolutional neural network for radar-based precipitation nowcasting." Geoscientific Model Development 13.6 (2020): 2631-2644.
- 20 September 2022
- Published by Springer Nature
- p. 68-84
Reiterative Domain Aware Multi-target Adaptation
- 20 September 2022
- Published by Springer Nature
- p. 68-84
Reiterative Domain Aware Multi-target Adaptation
- Open Access
- 7 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 19 (1545598X) , 1-5
Multitarget Domain Adaptation for Remote Sensing Classification Using Graph Neural Network
Remote sensing deals with huge variations in geography, acquisition season, and a plethora of sensors. Considering the difficulty of collecting labeled data uniformly representing all scenarios, data-hungry deep learning models are often trained with labeled data in a source domain that is limited in the above-mentioned aspects. Domain adaptation (DA) methods can adapt such model for applying on target domains with different distributions from the source domain. However, most remote sensing DA methods are designed for single-target, thus requiring a separate target classifier to be trained for each target domain. To mitigate this, we propose multitarget DA in which a single classifier is learned for multiple unlabeled target domains. To build a multitarget classifier, it may be beneficial to effectively aggregate features from the labeled source and different unlabeled target domains. Toward this, we exploit coteaching based on the graph neural network that is capable of leveraging unlabeled data. We use a sequential adaptation strategy that first adapts on the easier target domains assuming that the network finds it easier to adapt to the closest target domain. We validate the proposed method on two different datasets, representing geographical and seasonal variation. Code is available at https://gitlab.lrz.de/ai4eo/da-multitarget-gnn/ .
- 7 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 19 (1545598X) , 1-5
Open AccessMultitarget Domain Adaptation for Remote Sensing Classification Using Graph Neural Network
Remote sensing deals with huge variations in geography, acquisition season, and a plethora of sensors. Considering the difficulty of collecting labeled data uniformly representing all scenarios, data-hungry deep learning models are often trained with labeled data in a source domain that is limited in the above-mentioned aspects. Domain adaptation (DA) methods can adapt such model for applying on target domains with different distributions from the source domain. However, most remote sensing DA methods are designed for single-target, thus requiring a separate target classifier to be trained for each target domain. To mitigate this, we propose multitarget DA in which a single classifier is learned for multiple unlabeled target domains. To build a multitarget classifier, it may be beneficial to effectively aggregate features from the labeled source and different unlabeled target domains. Toward this, we exploit coteaching based on the graph neural network that is capable of leveraging unlabeled data. We use a sequential adaptation strategy that first adapts on the easier target domains assuming that the network finds it easier to adapt to the closest target domain. We validate the proposed method on two different datasets, representing geographical and seasonal variation. Code is available at https://gitlab.lrz.de/ai4eo/da-multitarget-gnn/ .