Big Data Assimilation: Real-time 30-second-refresh Heavy Rain Forecast Using Fugaku During Tokyo Olympics and Paralympics
Authors:
- Takemasa MiyoshiTMTakemasa Miyoshi
- Arata AmemiyaAAArata Amemiya
- Shigenori OtsukaSOShigenori Otsuka
- Yasumitsu MaejimaYMYasumitsu Maejima
- James TaylorJTJames Taylor
- Takumi HondaTHTakumi Honda
- Hirofumi TomitaHTHirofumi Tomita
- Seiya NishizawaSNSeiya Nishizawa
- Kenta SuekiKSKenta Sueki
- Tsuyoshi YamauraTYTsuyoshi Yamaura
- Yutaka IshikawaYIYutaka Ishikawa
- Shinsuke SatohSSShinsuke Satoh
Open Access
- 11 November 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Abstract
Real-time 30-second-refresh numerical weather prediction (NWP) was performed with exclusive use of 11,580 nodes (~7%) of supercomputer Fugaku during Tokyo Olympics and Paralympics in 2021. Total 75,248 forecasts were disseminated in the 1-month period mostly stably with time-to-solution less than 3 minutes for 30-minute forecast. Japan's Big Data Assimilation (BDA) project developed the novel NWP system for precise prediction of hazardous rains toward solving the global climate crisis. Compared with typical 1-hour-refresh systems, the BDA system offered two orders of magnitude increase in problem size and revealed the effectiveness of 30-second refresh for highly nonlinear, rapidly evolving convective rains. To achieve the required time-to-solution for real-time 30-second refresh with high accuracy, the core BDA software incorporated single precision and enhanced parallel I/O with properly selected configurations of 1000 ensemble members and 500-m-mesh weather model. The massively parallel, I/O intensive real-time BDA computation demonstrated a promising future direction.Keywords
Funding Information
- Japan Science and Technology Agency (JPMJCR19U2, JPMJCR1312)
This publication has 34 references indexed in Scilit:
- Review of recent progress in lightning and thunderstorm detection techniques in AsiaAtmospheric Research, 2015
- Operational Implementation of the 1D+3D-Var Assimilation Method of Radar Reflectivity Data in the AROME ModelMonthly Weather Review, 2014
- The ICON (ICOsahedral Non‐hydrostatic) modelling framework of DWD and MPI‐M: Description of the non‐hydrostatic dynamical coreQuarterly Journal of the Royal Meteorological Society, 2014
- The benefits of the Met Office variable resolution NWP model for forecasting convectionMeteorological Applications, 2012
- The AROME-France Convective-Scale Operational ModelMonthly Weather Review, 2011
- A k-distribution-based radiation code and its computational optimization for an atmospheric general circulation modelJournal of Quantitative Spectroscopy and Radiative Transfer, 2008
- New Microphysical Schemes with Five and Six Categories by Diagnostic Generation of Cloud IceJournal of the Meteorological Society of Japan, 2008
- Local Ensemble Transform Kalman Filtering with an AGCM at a T159/L48 ResolutionMonthly Weather Review, 2007
- Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filterPhysica D: Nonlinear Phenomena, 2007
- An Improved Mellor–Yamada Level-3 Model with Condensation Physics: Its Design and VerificationBoundary-Layer Meteorology, 2004