Post-processing using deep learning to create operational, high-resolution, and probabilistic weather forecasts

Authors:

Abstract
We present a machine learning model that post-processes high-resolution, deterministic forecasts to produce short to medium-range probabilistic forecasts for seven core weather variables. We developed and operationally implemented a multi-task neural network with a custom loss function, the Continuous Ranked Probability Score (CRPS), using input data from the High Resolution Rapid Refresh (HRRR) model. This combined high-resolution Numerical Weather Prediction (NWP) modeling with machine learning to generate more accurate deterministic and probabilistic forecasts. The results show deterministic forecast improvements in Root Mean Squared Error (RMSE) from 2.5% to 24.7% and probabilistic improvements in CRPS from 31% to 45% over the HRRR model. The multi-task neural network is cheap to train and fast to run operationally on hourly forecasts.