“Big Data Assimilation” Toward Post-Petascale Severe Weather Prediction: An Overview and Progress
Open Access
- 26 September 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 104 (11) , 2155-2179
Abstract
Following the invention of the telegraph, electronic computer, and remote sensing, “big data” is bringing another revolution to weather prediction. As sensor and computer technologies advance, orders of magnitude bigger data are produced by new sensors and high-precision computer simulation or “big simulation.” Data assimilation (DA) is a key to numerical weather prediction (NWP) by integrating the real-world sensor data into simulation. However, the current DA and NWP systems are not designed to handle the “big data” from next-generation sensors and big simulation. Therefore, we propose “big data assimilation” (BDA) innovation to fully utilize the big data. Since October 2013, the Japan's BDA project has been exploring revolutionary NWP at 100-m mesh refreshed every 30 s, orders of magnitude finer and faster than the current typical NWP systems, by taking advantage of the fortunate combination of next-generation technologies: the 10-petaflops K computer, phased array weather radar, and geostationary satellite Himawari-8. So far, a BDA prototype system was developed and tested with real-world retrospective local rainstorm cases. This paper summarizes the activities and progress of the BDA project, and concludes with perspectives toward the post-petascale supercomputing era.Keywords
Funding Information
- CREST, JST
This publication has 38 references indexed in Scilit:
- Ensemble Kalman Filter and 4D-Var Intercomparison with the Japanese Operational Global Analysis and Prediction SystemMonthly Weather Review, 2010
- A Mobile, Phased-Array Doppler Radar For The Study of Severe Convective StormsBulletin of the American Meteorological Society, 2010
- Convective-Scale Warn-on-Forecast SystemBulletin of the American Meteorological Society, 2009
- Cloud-Resolving Hurricane Initialization and Prediction through Assimilation of Doppler Radar Observations with an Ensemble Kalman FilterMonthly Weather Review, 2009
- Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filterPhysica D: Nonlinear Phenomena, 2007
- The Operational JMA Nonhydrostatic Mesoscale ModelMonthly Weather Review, 2006
- Applying a Four-dimensional Local Ensemble Transform Kalman Filter (4D-LETKF) to the JMA Nonhydrostatic Model (NHM)SOLA, 2006
- The Model Coupling Toolkit: A New Fortran90 Toolkit for Building Multiphysics Parallel Coupled ModelsThe International Journal of High Performance Computing Applications, 2005
- The Spectral Irradiance of the MoonThe Astronomical Journal, 2005
- Assimilation of Simulated Doppler Radar Observations with an Ensemble Kalman Filter*Monthly Weather Review, 2003