Optimal Stochastic Switching and the Dirichlet Problem for the Bellman Equation
Authors:
- Lawrence C. EvansLELawrence C. Evans
- Avner FriedmanAFAvner Friedman
- 1 September 1979
- journal article
- Published by JSTOR in Transactions of the American Mathematical Society
- Vol. 253, 365-389
Abstract
Let ${L^i}$ be a sequence of second order elliptic operators in a bounded n-dimensional domain $\Omega$, and let ${f^i}$ be given functions. Consider the problem of finding a solution u to the Bellman equation ${\sup _i}({L^i}u - {f^i}) = 0$ a.e. in $\Omega$, subject to the Dirichlet boundary condition $u = 0$ on $\partial \Omega$. It is proved that, provided the leading coefficients of the ${L^i}$ are constants, there exists a unique solution u of this problem, belonging to ${W^{1,\infty }}(\Omega ) \cap W_{{\text {loc}}}^{2,\infty }(\Omega )$. The solution is obtained as a limit of solutions of certain weakly coupled systems of nonlinear elliptic equations; each component of the vector solution converges to u. Although the proof is entirely analytic, it is partially motivated by models of stochastic control. We solve also certain systems of variational inequalities corresponding to switching with cost.
Keywords
This publication has 8 references indexed in Scilit:
- A variational inequality approach to the Bellman-Dirichlet equation for two elliptic operatorsArchive for Rational Mechanics and Analysis, 1979
- Nonlinear semigroups and differential equations in Banach spaces1976
- A Semigroup Representation of the Maximum Expected Reward Vector in Continuous Parameter Markov Decision TheorySIAM Journal on Control, 1975
- Remarks on stochastic optimal controlsJapanese Journal of Mathematics, 1975
- Principio di massimo per soluzioni di equazioni ellittiche del secondo ordine di tipo cordesAnnali di Matematica Pura ed Applicata (1923 -), 1974
- Semi-linear second-order elliptic equations in L1Journal of the Mathematical Society of Japan, 1973
- An Inequality in the Theory of Stochastic IntegralsTheory of Probability & Its Applications, 1971
- On the generators of non-negative contraction semi-groups in Banach latticesJournal of the Mathematical Society of Japan, 1968