ADAlain Durmus

Alain Durmus

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Alain Durmus has a total of 35 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Sticky nonlinear SDEs and convergence of McKean-Vlasov equations without confinement

    by Alain Durmus, Andreas Eberle, Arnaud Guillin, Katharina Schuh

    We develop a new approach to study the long time behaviour of solutions to nonlinear stochastic differential equations in the sense of McKean, as well as propagation of chaos for the corresponding mean-field particle system approximations. Our approach is based on a sticky coupling between two solutions to the equation. We show that the distance process between the two copies is dominated by a solution to a one-dimensional nonlinear stochastic differential equation with a sticky boundary at zero. This new class of equations is then analyzed carefully. In particular, we show that the dominating equation has a phase transition. In the regime where the Dirac measure at zero is the only invariant probability measure, we prove exponential convergence to equilibrium both for the one-dimensional equation, and for the original nonlinear SDE. Similarly, propagation of chaos is shown by a componentwise sticky coupling and comparison with a system of one dimensional nonlinear SDEs with sticky boundaries at zero. The approach applies to equations without confinement potential and to interaction terms that are not of gradient type.

    • 20 January 2022
    • Published by HAL in HAL
    Open Access

    Sticky nonlinear SDEs and convergence of McKean-Vlasov equations without confinement

    by Arnaud Guillin, Alain Durmus, Andreas Eberle, Katharina Schuh

    We develop a new approach to study the long time behaviour of solutions to nonlinear stochastic differential equations in the sense of McKean, as well as propagation of chaos for the corresponding mean-field particle system approximations. Our approach is based on a sticky coupling between two solutions to the equation. We show that the distance process between the two copies is dominated by a solution to a onedimensional nonlinear stochastic differential equation with a sticky boundary at zero. This new class of equations is then analyzed carefully. In particular, we show that the dominating equation has a phase transition. In the regime where the Dirac measure at zero is the only invariant probability measure, we prove exponential convergence to equilibrium both for the one-dimensional equation, and for the original nonlinear SDE. Similarly, propagation of chaos is shown by a componentwise sticky coupling and comparison with a system of one dimensional nonlinear SDEs with sticky boundaries at zero. The approach applies to equations without confinement potential and to interaction terms that are not of gradient type.

  • Open Access

    Hypocoercivity of Piecewise Deterministic Markov Process-Monte Carlo

    by Christophe Andrieu, Alain Durmus, Nikolas Nüsken, Julien Roussel

    In this work, we establish $\mathrm{L}^2$-exponential convergence for a broad class of Piecewise Deterministic Markov Processes recently proposed in the context of Markov Process Monte Carlo methods and covering in particular the Randomized Hamiltonian Monte Carlo, the Zig-Zag process and the Bouncy Particle Sampler. The kernel of the symmetric part of the generator of such processes is non-trivial, and we follow the ideas recently introduced by (Dolbeault et al., 2009, 2015) to develop a rigorous framework for hypocoercivity in a fairly general and unifying set-up, while deriving tractable estimates of the constants involved in terms of the parameters of the dynamics. As a by-product we characterize the scaling properties of these algorithms with respect to the dimension of classes of problems, therefore providing some theoretical evidence to support their practical relevance.

  • Open Access

    Piecewise Deterministic Markov Processes and their invariant measures

    by Alain Durmus, Arnaud Guillin, Pierre Monmarché

    Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which implies quantitative bounds on the total variation between the marginal distributions of the two processes. Finally two results are established regarding the invariant measures of PDMPs. A practical condition to show that a probability measure is invariant for the associated PDMP semi-group is presented. In a second time, a bound on the invariant probability measures in $V$-norm of two PDMPs following the same differential flow is established. This last result is then applied to study the asymptotic bias of some non-exact PDMP MCMC methods.

    • 20 April 2021
    • Published by HAL in HAL
    Open Access

    DISCRETE STICKY COUPLING OF FUNCTIONAL AUTOREGRESSIVE PROCESSES

    by Alain Durmus, Andreas Eberle, Aurélien Enfroy, Arnaud Guillin, Pierre Monmarché, Pierre Monmarché Discrete

    In this paper, we provide bounds in various metrics betweenthe successive iterates of two functional autoregressive processes withisotropic Gaussian noise of the form $Y_{k+1}=T_\gamma(Y_k)+\sqrt{\gamma\sigma^2}Z_{k+1}$and $\tilde Y_{k+1}=\tilde T_\gamma(\tilde Y_k)+\sqrt{\gamma\sigma^2}Z_{k+1}$ in the limit where the param-eter γ → 0. More precisely, we give non-asymptotic bounds on$\rho(L(Y_k),L(\tilde Y_k))$, where ρ is an appropriate weighted Wasserstein dis-tance or a V -distance, uniformly in the parameter γ, and on $\rho(\pi_\gamma , \tilde \pi_\gamma),where $\pi_\gamma$ and $\tilde\pi_\gamma$ are the respective stationary measures of the twoprocesses. Of particular interest, this class of processes encompassesthe Euler-Maruyama discretization of Langevin diffusions and itsvariants. To obtain our results, we rely on the construction of a dis-crete Markov chain $(W^{(\gamma)})_{k\in N}$ for which we are able to bound the kmoments and show quantitative convergence rates uniform on γ. In addition, we show that this process converges in distribution to the continuous sticky process studied in [20, 18]. Finally, we illustrate our result on two numerical applications.

  • Open Access

    Nonreversible MCMC from conditional invertible transforms: a complete recipe with convergence guarantees

    by Achille Thin, Nikita Kotelevskii, Christophe Andrieu, Alain Durmus, Eric Moulines, Maxim Panov

    Markov Chain Monte Carlo (MCMC) is a class of algorithms to sample complex and high-dimensional probability distributions. The Metropolis-Hastings (MH) algorithm, the workhorse of MCMC, provides a simple recipe to construct reversible Markov kernels. Reversibility is a tractable property that implies a less tractable but essential property here, invariance. Reversibility is however not necessarily desirable when considering performance. This has prompted recent interest in designing kernels breaking this property. At the same time, an active stream of research has focused on the design of novel versions of the MH kernel, some nonreversible, relying on the use of complex invertible deterministic transforms. While standard implementations of the MH kernel are well understood, the aforementioned developments have not received the same systematic treatment to ensure their validity. This paper fills the gap by developing general tools to ensure that a class of nonreversible Markov kernels, possibly relying on complex transforms, has the desired invariance property and leads to convergent algorithms. This leads to a set of simple and practically verifiable conditions.

  • Top Cited Papers

    An elementary approach to uniform in time propagation of chaos

    by Alain Durmus, Andreas Eberle, Arnaud Guillin, Raphael Zimmer

    Based on a coupling approach, we prove uniform in time propagation of chaos for weakly interacting mean-field particle systems with possibly non-convex confinement and interaction potentials. The approach is based on a combination of reflection and synchronous couplings applied to the individual particles. It provides explicit quantitative bounds that significantly extend previous results for the convex case.


  • Open Access

    Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation

    by Valentin De Bortoli, Alain Durmus, Marcelo Pereyra, Ana F. Vidal

    Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric empirical Bayesian estimation. Combined with Markov chain Monte Carlo algorithms, these stochastic optimisation methods have been successfully applied to a wide range of problems in science and industry. However, this strategy scales poorly to large problems because of methodological and theoretical difficulties related to using high-dimensional Markov chain Monte Carlo algorithms within a stochastic approximation scheme. This paper proposes to address these difficulties by using unadjusted Langevin algorithms to construct the stochastic approximation. This leads to a highly efficient stochastic optimisation methodology with favourable convergence properties that can be quantified explicitly and easily checked. The proposed methodology is demonstrated with three experiments, including a challenging application to high-dimensional statistical audio analysis and a sparse Bayesian logistic regression with random effects problem.

    • 27 May 2020
    • Published by HAL in HAL
    Open Access

    Convergence Analysis of Riemannian Stochastic Approximation Schemes

    by Alain Durmus, Pablo Jiménez, Eric Moulines, Salem Said, Hoi-To Wai, Éric Moulines

    This paper analyzes the convergence for a large class of Riemannian stochastic approximation (SA) schemes, which aim at tackling stochastic optimization problems. In particular, the recursions we study use either the exponential map of the considered manifold (geodesic schemes) or more general retraction functions (retraction schemes) used as a proxy for the exponential map. Such approximations are of great interest since they are low complexity alternatives to geodesic schemes. Under the assumption that the mean field of the SA is correlated with the gradient of a smooth Lyapunov function (possibly non-convex), we show that the above Riemannian SA schemes find an O(b ∞ + log n/ √ n)-stationary point (in expectation) within O(n) iterations, where b ∞ ≥ 0 is the asymptotic bias. Compared to previous works, the conditions we derive are considerably milder. First, all our analysis are global as we do not assume iterates to be a-priori bounded. Second, we study biased SA schemes. To be more specific, we consider the case where the mean-field function can only be estimated up to a small bias, and/or the case in which the samples are drawn from a controlled Markov chain. Third, the conditions on retractions required to ensure convergence of the related SA schemes are weak and hold for well-known examples. We illustrate our results on three machine learning problems.

  • Open Access

    Convergence of diffusions and their discretizations: from continuous to discrete processes and back

    by Valentin De Bortoli, Alain Durmus

    In this paper, we establish new quantitative convergence bounds for a class of functional autoregressive models in weighted total variation metrics. To derive our results, we show that under mild assumptions, explicit minorization and Foster-Lyapunov drift conditions hold. The main applications and consequences of the bounds we obtain concern the geometric convergence of Euler-Maruyama discretizations of diffusions with identity covariance matrix. Second, as a corollary, we provide a new approach to establish quantitative convergence of these diffusion processes by applying our conclusions in the discrete-time setting to a well-suited sequence of discretizations whose associated stepsizes decrease towards zero.