New bounds on the condition number of the Hessian of the preconditioned variational data assimilation problem
Preprint
Abstract
Data assimilation algorithms combine prior and observational information, weighted by their respective uncertainties, to obtain the most likely posterior of a dynamical system. In variational data assimilation the posterior is computed by solving a nonlinear least squares problem. Many numerical weather prediction (NWP) centres use full observation error covariance (OEC) weighting matrices, which can slow convergence of the data assimilation procedure. Previous work revealed the importance of the minimum eigenvalue of the OEC matrix for conditioning and convergence of the unpreconditioned data assimilation problem. In this paper we examine the use of correlated OEC matrices in the preconditioned data assimilation problem for the first time. We consider the case where there are more state variables than observations, which is typical for applications with sparse measurements e.g. NWP and remote sensing. We find that similarly to the unpreconditioned problem, the minimum eigenvalue of the OEC matrix appears in new bounds on the condition number of the Hessian of the preconditioned objective function. Numerical experiments reveal that the condition number of the Hessian is minimised when the background and observation lengthscales are equal. This contrasts with the unpreconditioned case, where decreasing the observation error lengthscale always improves conditioning. Conjugate gradient experiments show that in this framework the condition number of the Hessian is a good proxy for convergence. Eigenvalue clustering explains cases where convergence is faster than expected.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- On the representation error in data assimilationQuarterly Journal of the Royal Meteorological Society, 2017
- Understanding the effect of disturbance from selective felling on the carbon dynamics of a managed woodland by combining observations with model predictionsJournal of Geophysical Research: Biogeosciences, 2017
- A review of operational methods of variational and ensemble‐variational data assimilationQuarterly Journal of the Royal Meteorological Society, 2017
- Enhancing the impact of IASI observations through an updated observation‐error covariance matrixQuarterly Journal of the Royal Meteorological Society, 2016
- Theoretical insight into diagnosing observation error correlations using observation‐minus‐background and observation‐minus‐analysis statisticsQuarterly Journal of the Royal Meteorological Society, 2015
- The benefits of correlated observation errors for small scalesQuarterly Journal of the Royal Meteorological Society, 2015
- Accounting for correlated error in the assimilation of high‐resolution sounder dataQuarterly Journal of the Royal Meteorological Society, 2013
- Correlated observation errors in data assimilationInternational Journal for Numerical Methods in Fluids, 2007
- Approximate Gauss–Newton methods for optimal state estimation using reduced‐order modelsInternational Journal for Numerical Methods in Fluids, 2007
- Approximate iterative methods for variational data assimilationInternational Journal for Numerical Methods in Fluids, 2004