ParticleDA.jl v.1.0: A real-time data assimilation software platform
Preprint
- 21 March 2023
- preprint
- Published by Copernicus GmbH in EGUsphere
- Vol. 2023, 1-20
Abstract
Digital twins of physical and human systems informed by real-time data, are becoming ubiquitous across weather forecasting, disaster preparedness, and urban planning, but researchers lack the tools to run these models effectively and efficiently, limiting progress. One of the current challenges is to assimilate observations in highly nonlinear dynamical systems, as the practical need is often to detect abrupt changes. We developed a software platform to improve the use of real-time data in highly nonlinear system representations where non-Gaussianity prevents the use of more standard Data Assimilation. Optimal Particle filtering data assimilation (DA) techniques have been implemented within an user-friendly open source software platform in Julia – ParticleDA.jl. To ensure the applicability of the developed platform in realistic scenarios, emphasis has been placed on numerical efficiency, scalability and optimisation for high performance computing frameworks. Furthermore, the platform has been developed to be forward model agnostic, ensuring that it is applicable to a wide range of modelling settings, for instance unstructured and non-uniform meshes in the spatial domain or even state spaces that are not spatially organised. Applications to tsunami and numerical weather prediction demonstrate the computational benefits in terms of lower errors, lower computational costs (due to ensemble size and the algorithm's overheads being minimised) and versatility thanks to flexible I/O in a high level language Julia.Keywords
All Related Versions
- Published version: Geoscientific Model Development, 17 (6), 2427.
Funding Information
- Alan Turing Institute (EP/T001569/1)
- UK Atomic Energy Authority (T/AW085/21)
This publication has 25 references indexed in Scilit:
- Data Learning: Integrating Data Assimilation and Machine LearningJournal of Computational Science, 2022
- A physics perspective on lidar data assimilation for mobile robotsRobotica, 2021
- Data Assimilation for a Quasi-Geostrophic Model with Circulation-Preserving Stochastic Transport NoiseJournal of Statistical Physics, 2020
- Particle filters for high‐dimensional geoscience applications: A reviewQuarterly Journal of the Royal Meteorological Society, 2019
- Data assimilation in the geosciences: An overview of methods, issues, and perspectivesWires Climate Change, 2018
- Tsunami data assimilation of Cascadia seafloor pressure gauge records from the 2012 Haida Gwaii earthquakeGeophysical Research Letters, 2016
- Successive estimation of a tsunami wavefield without earthquake source data: A data assimilation approach toward real‐time tsunami forecastingGeophysical Research Letters, 2015
- The 10,240‐member ensemble Kalman filtering with an intermediate AGCMGeophysical Research Letters, 2014
- Atmospheric simulations using a GCM with simplified physical parametrizations. I: model climatology and variability in multi-decadal experimentsClimate Dynamics, 2003
- On sequential Monte Carlo sampling methods for Bayesian filteringStatistics and Computing, 2000