Abstract
In this paper, a bias-Lyapunov iteration method is proposed to solve the optimal control problem of unknown Markovian jump linear systems. By incorporating a bias parameter into the conventional Lyapunov iteration method, the proposed method eliminates initial admissible control requirements. A model-based theoretical framework is subsequently established, accompanied by a rigorous convergence proof for the modified iteration process. Subsequently, a data-driven version of bias-Lyapunov iteration is developed to learn an optimal control for Markovian jump linear systems with completely unknown dynamics. Simulation examples validate the efficacy and advantage of the proposed bias-Lyapunov iteration method.
Funding Information
  • National Science Fund for Distinguished Young Scholars (62125303)
  • National Natural Science Foundation of China-“Qisun Ye” Science Foundation (U2441243)
  • National Natural Science Foundation of China (62303132)
  • National Natural Science Foundation of China (62573165)
  • National Natural Science Foundation of China (62188101)
  • National Natural Science Foundation of China (62173111)
  • Heilongjiang Post-Doctoral Fund (LBH-Z23148)
  • China Post-Doctoral Science Foundation (2024M754186)
  • Heilongjiang Touyan Team Program

This publication has 43 references indexed in Scilit: