Verification against perturbed analyses and observations
Open Access
- 24 July 2015
- journal article
- Published by Copernicus GmbH in Nonlinear Processes in Geophysics
- Vol. 22 (4) , 403-411
Abstract
It has long been known that verification of a forecast against the sequence of analyses used to produce those forecasts can under-estimate the magnitude of forecast errors. Here we show that under certain conditions the verification of a short-range forecast against a perturbed analysis coming from an ensemble data assimilation scheme can give the same root-mean-square error as verification against the truth. This means that a perturbed analysis can be used as a reliable proxy for the truth. However, the conditions required for this result to hold are rather restrictive: the analysis must be optimal, the ensemble spread must be equal to the error in the mean, the ensemble size must be large and the forecast being verified must be the background forecast used in the data assimilation. Although these criteria are unlikely to be met exactly it becomes clear that for most cases verification against a perturbed analysis gives better results than verification against an unperturbed analysis. We demonstrate the application of these results in a idealised model framework and a numerical weather prediction context. In deriving this result we recall that an optimal (Kalman) analysis is one for which the analysis increments are uncorrelated with the analysis errors.Keywords
This publication has 16 references indexed in Scilit:
- Operational implementation of a hybrid ensemble/4D‐Var global data assimilation system at the Met OfficeQuarterly Journal of the Royal Meteorological Society, 2012
- The MOGREPS short‐range ensemble prediction systemQuarterly Journal of the Royal Meteorological Society, 2008
- Impact of observational error on the validation of ensemble prediction systemsQuarterly Journal of the Royal Meteorological Society, 2008
- Accounting for the effect of observation errors on verification of MOGREPSMeteorological Applications, 2008
- Explicitly Accounting for Observation Error in Categorical Verification of ForecastsMonthly Weather Review, 2006
- The representation of the analysis effect in three error simulation techniquesTellus, 2006
- A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction SystemsMonthly Weather Review, 2005
- On the estimation of radar rainfall error varianceAdvances in Water Resources, 1999
- Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statisticsJournal of Geophysical Research: Oceans, 1994
- Measuring the strangeness of strange attractorsPhysica D: Nonlinear Phenomena, 1983