The ensemble transform Schmidt–Kalman filter: A novel method to compensate for observation uncertainty due to unresolved scales
Open Access
- 5 May 2025
- journal article
- Published by Wiley in Atmospheric Science Letters
- Vol. 26 (5)
Abstract
Data assimilation is a mathematical technique that uses observations to improve model predictions through consideration of their respective uncertainties. Observation error due to unresolved scales occurs when there is a difference in scales observed and modeled. To obtain an optimal estimate through data assimilation, the error due to unresolved scales must be accounted for in the algorithm. In this work, we derive a novel ensemble transform formulation of the Schmidt–Kalman filter (ETSKF) to compensate for observation uncertainty due to unresolved scales in nonlinear dynamical systems. The ETSKF represents the small‐scale variability through an ensemble sampled from the representation error covariance. This small‐scale ensemble is added to the large‐scale forecast ensemble to obtain an ensemble representative of all scales resolved by the observations. We illustrate our new method using a simple nonlinear system of ordinary differential equations with two timescales known as the swinging spring (or elastic pendulum). In this simple system, our novel method performs similarly to another method of compensating for uncertainty due to unresolved scales. Indeed, the use of small‐scale ensemble statistics has potential as a new approach to compensate for uncertainty due to unresolved scales in nonlinear dynamical systems but will need further testing using more complicated systems.Keywords
Funding Information
- University of Reading
- National Centre for Earth Observation
- Engineering and Physical Sciences Research Council (EP/P002331/1)
This publication has 29 references indexed in Scilit:
- Progress, challenges, and future steps in data assimilation for convection‐permitting numerical weather prediction: Report on the virtual meeting held on 10 and 12 November 2021Atmospheric Science Letters, 2022
- Exploring the characteristics of a vehicle‐based temperature dataset for kilometre‐scale data assimilationMeteorological Applications, 2022
- Efficient computation of matrix–vector products with full observation weighting matrices in data assimilationQuarterly Journal of the Royal Meteorological Society, 2021
- Evaluating errors due to unresolved scales in convection‐permitting numerical weather predictionQuarterly Journal of the Royal Meteorological Society, 2021
- A pragmatic strategy for implementing spatially correlated observation errors in an operational system: An application to Doppler radial windsQuarterly Journal of the Royal Meteorological Society, 2019
- State-of-the-art stochastic data assimilation methods for high-dimensional non-Gaussian problemsTellus, 2018
- Survey of data assimilation methods for convective‐scale numerical weather prediction at operational centresQuarterly Journal of the Royal Meteorological Society, 2017
- On the representation error in data assimilationQuarterly Journal of the Royal Meteorological Society, 2017
- Ensemble Kalman filters for dynamical systems with unresolved turbulenceJournal of Computational Physics, 2014
- Representativity error for temperature and humidity using the Met Office high‐resolution model†Quarterly Journal of the Royal Meteorological Society, 2013