Efficient computation of matrix–vector products with full observation weighting matrices in data assimilation
Open Access
- 23 September 2021
- journal article
- research article
- Published by Wiley in Quarterly Journal of the Royal Meteorological Society
- Vol. 147 (741) , 4101-4121
Abstract
Recent studies have demonstrated improved skill in numerical weather prediction via the use of spatially correlated observation error covariance information in data assimilation systems. In this case, the observation weighting matrices (inverse error covariance matrices) used in the assimilation may be full matrices rather than diagonal. Thus, the computation of matrix–vector products in the variational minimization problem may be very time‐consuming, particularly if the parallel computation of the matrix–vector product requires a high degree of communication between processing elements. Hence, we introduce a well‐known numerical approximation method, called the fast multipole method (FMM), to speed up the matrix–vector multiplications in data assimilation. We explore a particular type of FMM that uses a singular value decomposition (SVD‐FMM) and adjust it to suit our new application in data assimilation. By approximating a large part of the computation of the matrix–vector product, the SVD‐FMM technique greatly reduces the computational complexity compared with the standard approach. We develop a novel possible parallelization scheme of the SVD‐FMM for our application, which can reduce the communication costs. We investigate the accuracy of the SVD‐FMM technique in several numerical experiments: we first assess the accuracy using covariance matrices that are created using different correlation functions and lengthscales, then investigate the impact of reconditioning the covariance matrices on the accuracy, and finally examine the feasibility of the technique in the presence of missing observations. We also provide theoretical explanations for some numerical results. Our results show that the SVD‐FMM technique can compute the matrix–vector product with good accuracy in a wide variety of circumstances and, hence, has potential as an efficient technique for assimilation of a large volume of observational data within a short time interval.Keywords
All Related Versions
Funding Information
- Engineering and Physical Sciences Research Council (UK EPSRC DARE project (EP/P002331/1))
This publication has 47 references indexed in Scilit:
- Data assimilation with correlated observation errors: experiments with a 1-D shallow water modelTellus, 2013
- The AROME-France Convective-Scale Operational ModelMonthly Weather Review, 2011
- Correlated observation errors in data assimilationInternational Journal for Numerical Methods in Fluids, 2007
- The Met Office global four‐dimensional variational data assimilation schemeQuarterly Journal of the Royal Meteorological Society, 2007
- Use of discrete Fourier transforms in the 1D-Var retrieval problemQuarterly Journal of the Royal Meteorological Society, 2005
- The potential of high‐density observations for numerical weather prediction: A study with simulated observationsQuarterly Journal of the Royal Meteorological Society, 2003
- A Local Least Squares Framework for Ensemble FilteringMonthly Weather Review, 2003
- Supplement to An Introduction to Meteosat Second Generation (MSG)Bulletin of the American Meteorological Society, 2002
- The Met. Office global three‐dimensional variational data assimilation schemeQuarterly Journal of the Royal Meteorological Society, 2000
- An effective way to represent quadtreesCommunications of the ACM, 1982