Automatic Tempered Posterior Distributions for Bayesian Inversion Problems
Open Access
- 6 April 2021
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 9 (7) , 784
Abstract
We propose a novel adaptive importance sampling scheme for Bayesian inversion problems where the inference of the variables of interest and the power of the data noise are carried out using distinct (but interacting) methods. More specifically, we consider a Bayesian analysis for the variables of interest (i.e., the parameters of the model to invert), whereas we employ a maximum likelihood approach for the estimation of the noise power. The whole technique is implemented by means of an iterative procedure with alternating sampling and optimization steps. Moreover, the noise power is also used as a tempered parameter for the posterior distribution of the the variables of interest. Therefore, a sequence of tempered posterior densities is generated, where the tempered parameter is automatically selected according to the current estimate of the noise power. A complete Bayesian study over the model parameters and the scale parameter can also be performed. Numerical experiments show the benefits of the proposed approach.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Adaptive importance sampling in signal processingDigital Signal Processing, 2015
- Bayesian re-analysis of the Gliese 581 exoplanet systemMonthly Notices of the Royal Astronomical Society, 2011
- Generalized rejection sampling schemes and applications in signal processingSignal Processing, 2010
- Marginal Likelihood Estimation via Power PosteriorsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Sequential Monte Carlo SamplersJournal of the Royal Statistical Society Series B: Statistical Methodology, 2006
- An Introduction to MCMC for Machine LearningMachine Learning, 2003
- Annealed importance samplingStatistics and Computing, 2001
- Markov chain Monte Carlo methods with applications to signal processingSignal Processing, 2001
- Simulated Tempering: A New Monte Carlo SchemeEurophysics Letters, 1992
- Optimization by Simulated AnnealingScience, 1983