Estimating Convergence of Markov chains with L-Lag Couplings
Preprint
Abstract
Markov chain Monte Carlo (MCMC) methods generate samples that are asymptotically distributed from a target distribution of interest as the number of iterations goes to infinity. Various theoretical results provide upper bounds on the distance between the target and marginal distribution after a fixed number of iterations. These upper bounds are on a case by case basis and typically involve intractable quantities, which limits their use for practitioners. We introduce L-lag couplings to generate computable, non-asymptotic upper bound estimates for the total variation or the Wasserstein distance of general Markov chains. We apply L-lag couplings to the tasks of (i) determining MCMC burn-in, (ii) comparing different MCMC algorithms with the same target, and (iii) comparing exact and approximate MCMC. Lastly, we (iv) assess the bias of sequential Monte Carlo and self-normalized importance samplers.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Smoothing With Couplings of Conditional Particle FiltersJournal of the American Statistical Association, 2019
- Informed Proposals for Local MCMC in Discrete SpacesJournal of the American Statistical Association, 2019
- Unbiased Hamiltonian Monte Carlo with couplingsBiometrika, 2019
- Variance estimation in the particle filterBiometrika, 2018
- On the Coupling Time of the Heat-Bath Process for the Fortuin–Kasteleyn Random–Cluster ModelJournal of Statistical Physics, 2017
- Bayesian Inference for Logistic Models Using Pólya–Gamma Latent VariablesJournal of the American Statistical Association, 2013
- Perfect sampling from independent Metropolis-Hastings chainsJournal of Statistical Planning and Inference, 2002
- Coupling, Stationarity, and Regeneration2000
- A simulation approach to convergence rates for Markov chain Monte Carlo algorithmsStatistics and Computing, 1998
- Analysis of the Gibbs sampler for a model related to James-Stein estimatorsStatistics and Computing, 1996