STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting
Preprint
Abstract
Precipitation nowcasting is a critical spatio-temporal prediction task for society to prevent severe damage owing to extreme weather events. Despite the advances in this field, the complex and stochastic nature of this task still poses challenges to existing approaches. Specifically, deterministic models tend to produce blurry predictions while generative models often struggle with poor accuracy. In this paper, we present a simple yet effective model architecture termed STLDM, a diffusion-based model that learns the latent representation from end to end alongside both the Variational Autoencoder and the conditioning network. STLDM decomposes this task into two stages: a deterministic forecasting stage handled by the conditioning network, and an enhancement stage performed by the latent diffusion model. Experimental results on multiple radar datasets demonstrate that STLDM achieves superior performance compared to the state of the art, while also improving inference efficiency. The code is available in https://github.com/sqfoo/stldm_official.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Residual corrective diffusion modeling for km-scale atmospheric downscalingCommunications Earth & Environment, 2025
- Skilful nowcasting of extreme precipitation with NowcastNetNature, 2023
- Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning2023
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- SimVP: Simpler yet Better Video Prediction2022
- STRPM: A Spatiotemporal Residual Predictive Model for High-Resolution Video Prediction2022
- Skilful precipitation nowcasting using deep generative models of radarNature, 2021
- A Deep Learning‐Based Methodology for Precipitation Nowcasting With RadarEarth and Space Science, 2020
- Memory in Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity From Spatiotemporal Dynamics2019
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018