On the maximum principle for relaxed control problems of nonlinear stochastic systems
Authors:
Open Access
- 20 March 2024
- journal article
- research article
- Published by Springer Nature in Advances in Continuous and Discrete Models
- Vol. 2024 (1) , 1-24
Abstract
We consider optimal control problems for a system governed by a stochastic differential equation driven by a d-dimensional Brownian motion where both the drift and the diffusion coefficient are controlled. It is well known that without additional convexity conditions the strict control problem does not admit an optimal control. To overcome this difficulty, we consider the relaxed model, in which admissible controls are measure-valued processes and the relaxed state process is governed by a stochastic differential equation driven by a continuous orthogonal martingale measure. This relaxed model admits an optimal control that can be approximated by a sequence of strict controls by the so-called chattering lemma. We establish optimality necessary conditions, in terms of two adjoint processes, extending Peng’s maximum principle to relaxed control problems. We show that relaxing the drift and diffusion martingale parts directly as in deterministic control does not lead to a true relaxed model as the obtained controlled dynamics is not continuous in the control variable.Keywords
Funding Information
- King Fahd University of Petroleum and Minerals (SB 201017)
This publication has 33 references indexed in Scilit:
- Compactification in optimal control of McKean‐Vlasov stochastic differential equationsOptimal Control Applications and Methods, 2021
- Necessary and Sufficient Optimality Conditions for Relaxed and Strict Control of Forward-Backward Doubly SDEs with Jumps Under Full and Partial InformationJournal of Systems Science and Complexity, 2020
- Existence and optimality conditions for relaxed mean-field stochastic control problemsSystems & Control Letters, 2017
- An introduction to stochastic partial differential equations2006
- Existence of optimal markovian controls for degenerate diffusions2006
- Representation and approximation of martingale measures2005
- Stochastic Controls1999
- Martingale measures and stochastic calculusProbability Theory and Related Fields, 1990
- General necessary conditions for optimal control of stochastic systems1976
- Existence results for optimal stochastic controlsJournal of Optimization Theory and Applications, 1975