On near optimal control of systems with slow observables
Preprint
Abstract
The paper deals with a problem of control of a system characterized by the fact that the influence of controls on the dynamics of certain functions of state variables (called observables) is relatively weak and the rates of change of these observables are much slower than the rates of change of the state variables themselves. The contributions of the paper are twofold. Firstly, the averaged system whose solutions approximate the trajectories of the slow observables is introduced, and it is shown that the optimal value of the problem of optimal control with time discounting criterion considered on the solutions of the system with slow observables (this problem is referred to as perturbed) converges to the optimal value of the corresponding problem of optimal control of the averaged system. Secondly, a way how an asymptotically optimal control of the perturbed problem can be constructed on the basis of an optimal solution of the averaged problem is indicated, sufficient and necessary optimality conditions for the averaged problem are stated, and a way how a near optimal solution of the latter can be constructed numerically is outlined (the construction being illustrated with an example).Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Averaging and Linear Programming in Some Singularly Perturbed Problems of Optimal ControlApplied Mathematics & Optimization, 2014
- Averaging of Singularly Perturbed Controlled Stochastic Differential EquationsApplied Mathematics & Optimization, 2007
- Two-Scale Stochastic Systems2003
- Order Reduction Is Invalid for Singularly Perturbed Control Problems with a Vector Fast VariableMathematics of Control, Signals, and Systems, 2002
- The Value Function of Singularly Perturbed Control SystemsApplied Mathematics & Optimization, 2000
- Limit Occupational Measures Set for a Control System and Averaging of Singularly Perturbed Control SystemsJournal of Mathematical Analysis and Applications, 1999
- Invariant Measures of Differential Inclusions Applied to Singular PerturbationsJournal of Differential Equations, 1999
- A generalization of the Tikhonov theorem for singularly perturbed differential inclusionsJournal of Dynamical and Control Systems, 1997
- Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations1997
- Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems1990