A Framework for the Dynamic Programming Principle and Martingale-generated Control Correspondences
Preprint
Abstract
We construct an abstract framework in which the dynamic programming principle (DPP) can be readily proven. It encompasses a broad range of common stochastic control problems in the weak formulation, and deals with problems in the "martingale formulation" with particular ease. We give two illustrations; first, we establish the DPP for general controlled diffusions and show that their value functions are viscosity solutions of the associated Hamilton-Jacobi-Bellman equations under minimal conditions. After that, we show how to treat singular control on the example of the classical monotone-follower problem.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Dynamic Programming for Controlled Markov Families: Abstractly and over Martingale MeasuresSIAM Journal on Control and Optimization, 2014
- Stochastic Perron's Method for Hamilton--Jacobi--Bellman EquationsSIAM Journal on Control and Optimization, 2013
- Stochastic Perron’s method and verification without smoothness using viscosity comparison: The linear caseProceedings of the American Mathematical Society, 2012
- Weak Dynamic Programming for Generalized State ConstraintsSIAM Journal on Control and Optimization, 2012
- Weak Dynamic Programming Principle for Viscosity SolutionsSIAM Journal on Control and Optimization, 2011
- The Obstacle Version of the Geometric Dynamic Programming Principle: Application to the Pricing of American Options Under ConstraintsApplied Mathematics & Optimization, 2009
- Dynamic programming for stochastic target problems and geometric flowsJournal of the European Mathematical Society, 2002
- Stochastic Target Problems, Dynamic Programming, and Viscosity SolutionsSIAM Journal on Control and Optimization, 2002
- Connections between Optimal Stopping and Singular Stochastic Control I. Monotone Follower ProblemsSIAM Journal on Control and Optimization, 1984
- Quasimartingales, martingales locales, semimartingales et filtration naturelleProbability Theory and Related Fields, 1977