Adaptive thinning of atmospheric observations in data assimilation with vector quantization and filtering methods
Authors:
- 1 October 2005
- journal article
- Published by Wiley in Quarterly Journal of the Royal Meteorological Society
- Vol. 131 (613) , 3427-3437
Abstract
In data assimilation for numerical weather prediction, measurements of various observation systems are combined with background data to define initial states for the forecasts. Current and future observation systems, in particular satellite instruments, produce large numbers of measurements with high spatial and temporal density. Such datasets significantly increase the computational costs of the assimilation and, moreover, can violate the assumption of spatially independent observation errors. To ameliorate these problems, we propose two greedy thinning algorithms, which reduce the number of assimilated observations while retaining the essential information content of the data. In the first method, the number of points in the output set is increased iteratively. We use a clustering method with a distance metric that combines spatial distance with difference in observation values. In a second scheme, we iteratively estimate the redundancy of the current observation set and remove the most redundant data points. We evaluate the proposed methods with respect to a geometric error measure and compare them with a uniform sampling scheme. We obtain good representations of the original data with thinnings retaining only a small portion of observations. We also evaluate our thinnings of ATOVS satellite data using the assimilation system of the Deutscher Wetterdienst. Impact of the thinning on the analysed fields and on the subsequent forecasts is discussed. Copyright © 2005 Royal Meteorological SocietyKeywords
This publication has 6 references indexed in Scilit:
- The interaction between model resolution, observation resolution and observation density in data assimilation: A one‐dimensional studyQuarterly Journal of the Royal Meteorological Society, 2002
- The Operational Global Icosahedral–Hexagonal Gridpoint Model GME: Description and High-Resolution TestsMonthly Weather Review, 2002
- A direct way of specifying flow-dependent background error correlations for meteorological analysis systemsTellus, 1998
- A direct way of specifying flow-dependent background error correlations for meteorological analysis systemsTellus, 1998
- Vector Quantization and Signal Compression1992
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982