Consistency of a simple multidimensional scheme for Hamilton–Jacobi–Bellman equations
Authors:
- Rémi MunosRMRémi Munos
- Hasnaa ZidaniHZHasnaa Zidani
Open Access
- 17 March 2005
- journal article
- Published by MathDoc/Centre Mersenne in Comptes Rendus Mathematique
- Vol. 340 (7) , 499-502
Abstract
This Note presents an approximation scheme for second-order Hamilton–Jacobi–Bellman equations arising in stochastic optimal control. The scheme is based on a Markov chain approximation method. It is easy to implement in any dimension. The consistency of the scheme is proved, which guarantees its convergence.Keywords
This publication has 6 references indexed in Scilit:
- A fast algorithm for the two dimensional HJB equation of stochastic controlESAIM: Mathematical Modelling and Numerical Analysis, 2004
- Consistency of Generalized Finite Difference Schemes for the Stochastic HJB EquationSIAM Journal on Numerical Analysis, 2003
- Variable Resolution Discretization in Optimal ControlMachine Learning, 2002
- Numerical Methods for Stochastic Control Problems in Continuous Time2001
- An approximation scheme for the optimal control of diffusion processesESAIM: Mathematical Modelling and Numerical Analysis, 1995
- Approximation numérique des équations Hamilton-Jacobi-BellmanRAIRO. Analyse numérique, 1980