A Heterogeneous Spatiotemporal Attention Fusion Prediction Network for Precipitation Nowcasting
Open Access
- 30 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 16 (19391404) , 8286-8296
Abstract
Precipitation nowcasting underlying various public services from rainstorm warning to flight safety, is quite important and remains challenging due to the fast change in convective weather. Although some deep learning models have been proposed to make prediction automatically, most of them just deal with a single radar echo data source, making them hard to adapt to heterogeneous and diverse data in practice. In this work, a heterogeneous spatiotemporal attention fusion prediction network (HST-AFP) is proposed for radar echo extrapolatio(deterministic output) and further precipitation nowcasting, which deals with mining and fusing knowledge from multiple heterogeneous spatiotemporal (ST) data sources, including history radar echo observations and numerical weather prediction (NWP) data. With the help of the proposed attention-based ST diffusion module (ASTD), the multi-encoder is designed to extract information from both dense ST tensor and sparse ST tensor. On the other hand, the fusion-decoder achieves very deep trainable residual fusion prediction by integrating scale-wise attention fusion module (SWAF) and deep residual spatial and temporal attention mechanism (DRSTA). It can adaptively blend multi-source ST features and rescale the multi-scale temporal-wise and spatial-wise features for better prediction. Experiments in a real-world dataset of South China show that compared with the ingenious RNN-based methods and newly proposed Unet-based methods, our HST-AFP network can handle complex input with heterogeneity in both space and time domains, and performs better on the precipitation nowcasting metrics, as well as requires remarkable shorter forecast time.Keywords
Funding Information
- National Natural Science Foundation of China (42005120)
- National Key R&D Program of China (2019YFE0110100, 2018YFC1506905)
- Natural Science Foundation of Jiangsu Province of China (BK20202006)
- Key R&D Program of Jiangsu Province (BE2019052)
This publication has 37 references indexed in Scilit:
- LightNet2019
- Adaptive Blending Method of Radar-Based and Numerical Weather Prediction QPFs for Urban Flood ForecastingRemote Sensing, 2019
- Image Super-Resolution Using Very Deep Residual Channel Attention Networks2018
- Analysis of Rainfall Trends and its Spatial Patterns During the Last Century over the Gangetic West Bengal, Eastern IndiaJournal of Geovisualization and Spatial Analysis, 2018
- A Variational U-Net for Conditional Appearance and Shape Generation2018
- Single Layer & Multi-layer Long Short-Term Memory (LSTM) Model with Intermediate Variables for Weather ForecastingProcedia Computer Science, 2018
- How machine learning could help to improve climate forecastsNature, 2017
- Operational Application of Optical Flow Techniques to Radar-Based Rainfall NowcastingAtmosphere, 2017
- Improvement of forecast skill for severe weather by merging radar-based extrapolation and storm-scale NWP corrected forecastAtmospheric Research, 2015
- Use of NWP for Nowcasting Convective Precipitation: Recent Progress and ChallengesBulletin of the American Meteorological Society, 2014