Iterative updating of model error for Bayesian inversion
- 18 January 2018
- journal article
- research article
- Published by IOP Publishing in Inverse Problems
- Vol. 34 (2) , 025008
Abstract
In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when optimization algorithms are used to find a single estimate, or to speed up Markov chain Monte Carlo (MCMC) calculations in the Bayesian framework. The use of an approximate model introduces a discrepancy, or modeling error, that may have a detrimental effect on the solution of the ill-posed inverse problem, or it may severely distort the estimate of the posterior distribution. In the Bayesian paradigm, the modeling error can be considered as a random variable, and by using an estimate of the probability distribution of the unknown, one may estimate the probability distribution of the modeling error and incorporate it into the inversion. We introduce an algorithm which iterates this idea to update the distribution of the model error, leading to a sequence of posterior distributions that are demonstrated empirically to capture the underlying truth with increasing accuracy. Since the algorithm is not based on rejections, it requires only limited full model evaluations. We show analytically that, in the linear Gaussian case, the algorithm converges geometrically fast with respect to the number of iterations when the data is finite dimensional. For more general models, we introduce particle approximations of the iteratively generated sequence of distributions; we also prove that each element of the sequence converges in the large particle limit under a simplifying assumption. We show numerically that, as in the linear case, rapid convergence occurs with respect to the number of iterations. Additionally, we show through computed examples that point estimates obtained from this iterative algorithm are superior to those obtained by neglecting the model error.Keywords
All Related Versions
Funding Information
- Engineering and Physical Sciences Research Council (EQUIP, MASDOC Graduate Training Program)
- Air Force Office of Scientific Research (FA9550-17-1-0185)
- Defense Advanced Research Projects Agency (W911NF-15-2-0121)
- Office of Naval Research (N00014-17-1-2079)
- Division of Mathematical Sciences (1312424, 1522334, 1714617)
This publication has 27 references indexed in Scilit:
- MCMC Methods for Functions: Modifying Old Algorithms to Make Them FasterStatistical Science, 2013
- Correlation priorsInverse Problems and Imaging, 2011
- Hypermodels in the Bayesian imaging frameworkInverse Problems, 2008
- Approximation error analysis in nonlinear state estimation with an application to state-space identificationInverse Problems, 2007
- A Framework for Validation of Computer ModelsTechnometrics, 2007
- Statistical inverse problems: Discretization, model reduction and inverse crimesJournal of Computational and Applied Mathematics, 2007
- Approximation errors and model reduction with an application in optical diffusion tomographyInverse Problems, 2006
- Sequential importance sampling for nonparametric Bayes models: The next generationCanadian Journal of Statistics, 1999
- Design and Analysis of Computer ExperimentsStatistical Science, 1989
- Linear inverse problems for generalised random variablesInverse Problems, 1989