Improved Laplace approximation for marginal likelihoods
Authors:
- Erlis RuliERErlis Ruli
- Nicola SartoriNSNicola Sartori
- Laura VenturaLVLaura Ventura
Open Access
- 1 January 2016
- journal article
- research article
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 10 (2) , 3986-4009
Abstract
Statistical applications often involve the calculation of intractable multidimensional integrals. The Laplace formula is widely used to approximate such integrals. However, in high-dimensional or small sample size problems, the shape of the integrand function may be far from that of the Gaussian density, and thus the standard Laplace approximation can be inaccurate. We propose an improved Laplace approximation that reduces the asymptotic error of the standard Laplace formula by one order of magnitude, thus leading to third-order accuracy. We also show, by means of practical examples of various complexity, that the proposed method is extremely accurate, even in high dimensions, improving over the standard Laplace formula. Such examples also demonstrate that the accuracy of the proposed method is comparable with that of other existing methods, which are computationally more demanding. An R implementation of the improved Laplace approximation is also provided through the R package iLaplace available on CRAN.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- AD Model Builder: using automatic differentiation for statistical inference of highly parameterized complex nonlinear modelsOptimization Methods and Software, 2012
- Explaining Variational ApproximationsThe American Statistician, 2010
- On a generalization of the Laplace approximationStatistics & Probability Letters, 2009
- Conditional properties of unconditional parametric bootstrap procedures for inference in exponential familiesBiometrika, 2008
- Marginal Likelihood From the Metropolis–Hastings OutputJournal of the American Statistical Association, 2001
- Computing Bayes Factors by Combining Simulation and Asymptotic ApproximationsJournal of the American Statistical Association, 1997
- Another Look at the Salamander Mating Data: A Modified Laplace Approximation ApproachJournal of the American Statistical Association, 1997
- Marginal Likelihood from the Gibbs OutputJournal of the American Statistical Association, 1995
- Bayes FactorsJournal of the American Statistical Association, 1995
- Accurate Approximations for Posterior Moments and Marginal DensitiesJournal of the American Statistical Association, 1986