Evaluating Global Machine Learning Models for Tropical Cyclone Dynamics and Thermodynamics
Open Access
- 30 April 2025
- journal article
- Published by American Geophysical Union (AGU) in Journal of Geophysical Research: Machine Learning and Computation
- Vol. 2 (2)
Abstract
Machine Learning Weather Prediction (MLWP) models have recently demonstrated remarkable potential to rival physics‐based Numerical Weather Prediction (NWP) models, offering global weather forecasts at a fraction of the computational cost. However, thorough evaluations are essential before considering MLWP models as replacements for NWP models. This study presents a comprehensive evaluation of four leading MLWP models—GraphCast, PanguWeather, Aurora, and FourCastNet—against observations and three state‐of‐the‐art NWP models in predicting tropical cyclones (TCs) across all tropical ocean basins. All MLWP models exhibited strong skill in forecasting TC tracks, achieving an average track error of less than 200 km at a 96‐hr forecast lead time. However, they consistently underestimated maximum sustained wind speeds compared to NWP models and observations. The low bias in TC intensity forecasts by MLWP models is linked to similar bias in their training data, along with the double penalization effect. MLWP models realistically captured the absolute vorticity patterns and their advection, demonstrating their ability to represent the dynamics underlying TC translation. They also captured the low‐level convergence and vertical warm core structure of TCs, although the magnitudes were weaker than observed, highlighting the linkage between dynamical and thermodynamical processes. The consistency in magnitude between various physical fields in the MLWP models suggests that they intuitively learn the interrelationships among different physical fields during the evolution of weather systems, demonstrating their ability to capture complex physical interactions. Among the MLWP models, Aurora showed superior performance, surpassing GraphCast, PanguWeather, and FourCastNet.Keywords
Funding Information
- Ministry of Earth Sciences (MOES/16/01/2022‐RDESS/AI‐ML‐1, MOES/16/09/2022‐RDESS)
This publication has 23 references indexed in Scilit:
- A Hybrid Machine Learning/Physics‐Based Modeling Framework for 2‐Week Extended Prediction of Tropical CyclonesJournal of Geophysical Research: Machine Learning and Computation, 2024
- On Some Limitations of Current Machine Learning Weather Prediction ModelsGeophysical Research Letters, 2024
- Improving Tropical Cyclone Precipitation Forecasting With Deep Learning and Satellite Image SequencingJournal of Geophysical Research: Machine Learning and Computation, 2024
- The impact of cyclones on local economic growth: Evidence from local projectionsEconomics Letters, 2022
- Revisiting disaster preparedness in coastal communities since 1970s in Bangladesh with an emphasis on the case of tropical cyclone Amphan in May 2020International Journal of Disaster Risk Reduction, 2021
- Effect of the Initial Vortex Vertical Structure on Early Development of an Axisymmetric Tropical CycloneJournal of Geophysical Research: Atmospheres, 2021
- The 1999 super cyclone in Odisha, India: A systematic review of documented lossesInternational Journal of Disaster Risk Reduction, 2020
- The ERA5 global reanalysisQuarterly Journal of the Royal Meteorological Society, 2020
- A review of tropical cyclone‐generated storm surges: Global data sources, observations, and impactsReviews of Geophysics, 2015
- Tropical cyclone track forecasting techniques ― A reviewAtmospheric Research, 2012