Transport map unadjusted Langevin algorithms: Learning and discretizing perturbed samplers
- 1 January 2025
- journal article
- research article
- Published by American Institute of Mathematical Sciences (AIMS) in Foundations of Data Science
- Vol. 7 (3) , 705-736
Abstract
Langevin dynamics are widely used in sampling high-dimensional, non-Gaussian distributions whose densities are known up to a normalizing constant. In particular, there is strong interest in unadjusted Langevin algorithms (ULA), which directly discretize Langevin dynamics to estimate expectations over the target distribution. We study the use of transport maps that approximately normalize a target distribution as a way to precondition and accelerate the convergence of Langevin dynamics. We show that in continuous time, when a transport map is applied to Langevin dynamics, the result is a Riemannian manifold Langevin dynamics (RMLD) with metric defined by the transport map. We also show that applying a transport map to an irreversibly-perturbed ULA results in a geometry-informed irreversible perturbation (GiIrr) of the original dynamics. These connections suggest more systematic ways of learning metrics and perturbations, and also yield alternative discretizations of the RMLD described by the map, which we study. Under appropriate conditions, these discretized processes can be endowed with non-asymptotic bounds describing convergence to the target distribution in 2-Wasserstein distance. Illustrative numerical results complement our theoretical claims.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Optimal scaling of the MALA algorithm with irreversible proposals for Gaussian targetsStochastics and Partial Differential Equations: Analysis and Computations, 2019
- A transport-based multifidelity preconditioner for Markov chain Monte CarloAdvances in Computational Mathematics, 2019
- Improving the Convergence of Reversible SamplersJournal of Statistical Physics, 2016
- Sampling via Measure Transport: An Introduction2016
- Analysis and Geometry of Markov Diffusion Operators2014
- Stochastic Processes and Applications2014
- Optimal Non-reversible Linear Drift for the Convergence to Equilibrium of a DiffusionJournal of Statistical Physics, 2013
- A Family of Nonparametric Density Estimation AlgorithmsCommunications on Pure and Applied Mathematics, 2012
- Stochastic Simulation: Algorithms and Analysis2007
- Numerical Solution of Stochastic Differential Equations1992