Abstract
In this article, we study the optimal control problem of continuous-time (CT) time-invariant nonlinear systems with stochastic nonlinear disturbances. A new stochastic adaptive dynamic programming (ADP) method is developed to solve the Hamilton–Jacobi–Bellman equation (HJBE). Under the conditional expectation, the value function and the control law are successively approximated simultaneously. The asymptotic stability of the closed-loop stochastic system in probability is analyzed by the stochastic Lyapunov direct method, and the convergence of the developed ADP method is given. Finally, four simulations illustrate the effectiveness of the developed method.
Funding Information
  • National Key Research and Development Program of China (2021YFE0206100)
  • science and technology development fund of the Macao special administrative region (FDCT-22-009-MISE)
  • National Natural Science Foundation of China (62073321, U22A2046, 52172322)
  • State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University (RCS2021K005)

This publication has 44 references indexed in Scilit: