Adaptive Conditional Bias-Penalized Kalman Filter for Improved Estimation of Extremes and Its Approximation for Reduced Computation
Open Access
Abstract
Kalman filter (KF) and its variants and extensions are wildly used for hydrologic prediction in environmental science and engineering. In many data assimilation applications of Kalman filter (KF) and its variants and extensions, accurate estimation of extreme states is often of great importance. When the observations used are uncertain, however, KF suffers from conditional bias (CB) which results in consistent under- and overestimation of extremes in the right and left tails, respectively. Recently, CB-penalized KF, or CBPKF, has been developed to address CB. In this paper, we present an alternative formulation based on variance-inflated KF to reduce computation and algorithmic complexity, and describe adaptive implementation to improve unconditional performance. For theoretical basis and context, we also provide a complete self-contained description of CB-penalized Fisher-like estimation and CBPKF. The results from one-dimensional synthetic experiments for a linear system with varying degrees of nonstationarity show that adaptive CBPKF reduces the root-mean-square error at the extreme tail ends by 20 to 30% over KF while performing comparably to KF in the unconditional sense. The alternative formulation is found to approximate the original formulation very closely while reducing computing time to 1.5 to 3.5 times of that for KF depending on the dimensionality of the problem. Hence, adaptive CBPKF offers a significant addition to the dynamic filtering methods for general application in data assimilation when the accurate estimation of extremes is of importance.Keywords
All Related Versions
Funding Information
- National Science Foundation (CyberSEES-1442735)
- National Oceanic and Atmospheric Administration (NA16OAR4590232, NA17OAR4590174, NA17OAR4590184)
This publication has 37 references indexed in Scilit:
- Comparative evaluation of maximum likelihood ensemble filter and ensemble Kalman filter for real-time assimilation of streamflow data into operational hydrologic modelsJournal of Hydrology, 2014
- Towards a comprehensive assessment of model structural adequacyWater Resources Research, 2012
- Variational assimilation of streamflow into operational distributed hydrologic models: effect of spatiotemporal scale of adjustmentHydrology and Earth System Sciences, 2012
- Development of a UAV-LiDAR System with Application to Forest InventoryRemote Sensing, 2012
- Conditional bias-penalized kriging (CBPK)Stochastic Environmental Research and Risk Assessment, 2012
- A Nonparametric Postprocessor for Bias Correction of Hydrometeorological and Hydrologic Ensemble ForecastsJournal of Hydrometeorology, 2010
- An ensemble approach for attribution of hydrologic prediction uncertaintyGeophysical Research Letters, 2008
- Crop model data assimilation with the Ensemble Kalman filter for improving regional crop yield forecastsAgricultural and Forest Meteorology, 2007
- An Adaptive Kalman Filter for Dynamic Harmonic State Estimation and Harmonic Injection TrackingIEEE Transactions on Power Delivery, 2005
- Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the LeftJournal of Economic Perspectives, 2001