Freidlin-Wentzell solutions of discrete Hamilton-Jacobi equations
- 1 January 2026
- journal article
- Published by Institute of Mathematical Statistics in Electronic Journal of Probability
- Vol. 31 (none) , 1-23
Abstract
We consider a sequence of finite irreducible Markov chains with exponentially small transition rates: the transition graph is a fixed, finite, strongly connected directed graph; the transition rates decay exponentially on a parameter N with a given rate that varies from edge to edge. The stationary equation uniquely identifies the invariant measure for each N, but at exponential scale in the limit as N goes to infinity reduces to a discrete equation for the large deviation rate functional of the invariant measure, that in general has not an unique solution. In analogy with the continuous case of diffusions, we call such equation a discrete Hamilton-Jacobi equation. Likewise in the continuous case we introduce a notion of viscosity supersolutions and viscosity subsolutions and give a detailed geometric characterization of the solutions in terms of special faces of the polyhedron of one-Lipschitz functions on the transition graph. This parallels the weak KAM theory in a purely discrete setting. We identify also a special vanishing viscosity solution obtained in the limit from the combinatorial representation of the invariant measure given by the matrix tree theorem. The result gives a selection principle on the set of solutions to the discrete Hamilton-Jacobi equation obtained by the Freidlin and Wentzell minimal arborescences construction; this enlightens and parallels what happens in the continuous setting.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- A comparison among various notions of viscosity solution for Hamilton–Jacobi equations on networksJournal of Mathematical Analysis and Applications, 2013
- Random Perturbations of Dynamical Systems2012
- Digraphs2009
- Weak KAM Theory and Partial Differential Equations2008
- Markov chains with exponentially small transition probabilities: First exit problem from a general domain. II. The general caseJournal of Statistical Physics, 1996
- Markov chains with exponentially small transition probabilities: First exit problem from a general domain. I. The reversible caseJournal of Statistical Physics, 1995
- Metastability for Markov Chains: A General Procedure Based on Renormalization Group Ideas1994
- Renormalization group for Markov chains and application to metastabilityJournal of Statistical Physics, 1993
- A proof of the Markov chain tree theoremStatistics & Probability Letters, 1989
- Nondifferentiable potentials for nonequilibrium steady statesPhysica A: Statistical Mechanics and its Applications, 1987