A Tutorial on Bridge Sampling
Preprint
Abstract
The marginal likelihood plays an important role in many areas of Bayesian statistics such as parameter estimation, model comparison, and model averaging. In most applications, however, the marginal likelihood is not analytically tractable and must be approximated using numerical methods. Here we provide a tutorial on bridge sampling (Bennett, 1976; Meng & Wong, 1996), a reliable and relatively straightforward sampling method that allows researchers to obtain the marginal likelihood for models of varying complexity. First, we introduce bridge sampling and three related sampling methods using the beta-binomial model as a running example. We then apply bridge sampling to estimate the marginal likelihood for the Expectancy Valence (EV) model---a popular model for reinforcement learning. Our results indicate that bridge sampling provides accurate estimates for both a single participant and a hierarchical version of the EV model. We conclude that bridge sampling is an attractive method for mathematical psychologists who typically aim to approximate the marginal likelihood for a limited set of possibly high-dimensional models.Keywords
All Related Versions
This publication has 70 references indexed in Scilit:
- Bayesian Estimation of Multinomial Processing Tree Models with Heterogeneity in Participants and ItemsPsychometrika, 2013
- An encompassing prior generalization of the Savage–Dickey density ratioComputational Statistics & Data Analysis, 2010
- Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey methodCognitive Psychology, 2010
- Default Bayesian model determination methods for generalised linear mixed modelsComputational Statistics & Data Analysis, 2010
- Bayesian parameter estimation in the Expectancy Valence model of the Iowa gambling taskJournal of Mathematical Psychology, 2010
- Generic reversible jump MCMC using graphical modelsStatistics and Computing, 2008
- Signal Detection Models with Random Participant and Item EffectsPsychometrika, 2007
- Modeling individual differences using Dirichlet processesJournal of Mathematical Psychology, 2006
- Insensitivity to future consequences following damage to human prefrontal cortexCognition, 1994
- Efficient estimation of free energy differences from Monte Carlo dataJournal of Computational Physics, 1976