Exploring a high-level programming model for the NWP domain using ECMWF microphysics schemes
Open Access
- 30 January 2025
- journal article
- research article
- Published by Copernicus GmbH in Geoscientific Model Development
- Vol. 18 (2) , 529-546
Abstract
We explore the domain-specific Python library GT4Py (GridTools for Python) for implementing a representative physical parametrization scheme and the related tangent-linear and adjoint algorithms from the Integrated Forecasting System (IFS) of ECMWF. GT4Py encodes stencil operators in an abstract and hardware-agnostic fashion, thus enabling more concise, readable, and maintainable scientific applications. The library achieves high performance by translating the application into targeted low-level coding implementations. Here, the main goal is to study the correctness and performance portability of the Python rewrites with GT4Py against the reference Fortran code and a number of automatically and manually ported variants created by ECMWF. The present work is part of a larger cross-institutional effort to port weather and climate models to Python with GT4Py. The focus of the current work is the IFS prognostic cloud microphysics scheme, a core physical parametrization represented by a comprehensive code that takes a significant share of the total forecast model execution time. In order to verify GT4Py for numerical weather prediction (NWP) systems, we put additional emphasis on the implementation and validation of the tangent-linear and adjoint model versions which are employed in data assimilation. We benchmark all prototype codes on three European supercomputers characterized by diverse graphics processing unit (GPU) and central processing unit (CPU) hardware, node designs, software stacks, and compiler suites. Once the application is ported to Python with GT4Py, we find excellent portability, competitive GPU performance, and robust execution in all tested scenarios including with single precision.Keywords
All Related Versions
This publication has 45 references indexed in Scilit:
- A mixed finite‐element, finite‐volume, semi‐implicit discretisation for atmospheric dynamics: Spherical geometryQuarterly Journal of the Royal Meteorological Society, 2024
- GridTools: A framework for portable weather and climate applicationsSoftwareX, 2021
- GPU acceleration of MPAS microphysics WSM6 using OpenACC directives: Performance and verificationComputers & Geosciences, 2021
- LFRic: Meeting the challenges of scalability and performance portability in Weather and Climate modelsJournal of Parallel and Distributed Computing, 2019
- A mixed finite‐element, finite‐volume, semi‐implicit discretization for atmospheric dynamics: Cartesian geometryQuarterly Journal of the Royal Meteorological Society, 2019
- Using OpenACC to port large legacy climate and weather modeling code to GPUs2017
- A finite-volume module for simulating global all-scale atmospheric flowsJournal of Computational Physics, 2016
- Kokkos: Enabling manycore performance portability through polymorphic memory access patternsJournal of Parallel and Distributed Computing, 2014
- The ICON (ICOsahedral Non‐hydrostatic) modelling framework of DWD and MPI‐M: Description of the non‐hydrostatic dynamical coreQuarterly Journal of the Royal Meteorological Society, 2014
- A strategy for operational implementation of 4D‐Var, using an incremental approachQuarterly Journal of the Royal Meteorological Society, 1994