Policy Iterative-Based Adaptive Optimal Control for Unknown Continuous-Time Nonlinear Systems
- 28 January 2025
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 55 (4) , 2859-2869
Abstract
This study addresses the optimal control problem for continuous-time nonlinear systems with unknown dynamics. A policy iterative-based optimization algorithm is proposed to solve this problem by leveraging a novel neural network representation termed multivariable neural network linear differential inclusion (MVNNLDI). MVNNLDI approximates the initial nonlinear model with a linear differential equation formulation that includes bounded disturbances. Based on this linearized representation, the relevant adaptive optimal control and disturbance compensation approach are derived to tackle the nonlinear optimization problem. Capitalizing on model-free control principles, the optimal solutions can be obtained using only measured state and input data, thus simplifying algorithmic complexity and accelerating convergence speed substantially. Finally, we use two simulation experiments to demonstrate the feasibility and effectiveness of the proposed method.Keywords
Funding Information
- National Natural Science Foundation of China (62473003, 62073001)
- University Synergy Innovation Program of Anhui Province (GXXT-2021-010)
- Anhui Provincial Key Research and Development Project (2022i01020013)
This publication has 39 references indexed in Scilit:
- Reinforcement learning-based optimal control for Markov jump systems with completely unknown dynamicsAutomatica, 2024
- Distributed adaptive cooperative optimal output regulation via integral reinforcement learningAutomatica, 2024
- Finite-time prescribed performance adaptive fuzzy control for unknown nonlinear systemsFuzzy Sets and Systems, 2021
- Online policy iterative-based H∞ optimization algorithm for a class of nonlinear systemsInformation Sciences, 2019
- Novel iterative neural dynamic programming for data-based approximate optimal control designAutomatica, 2017
- control of linear discrete-time systems: Off-policy reinforcement learningAutomatica, 2017
- Adaptive robust fuzzy control for dual arm robot with unknown input deadzone nonlinearityNonlinear Dynamics, 2015
- A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systemsAutomatica, 2013
- Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamicsAutomatica, 2012
- Adaptive optimal control for continuous-time linear systems based on policy iterationAutomatica, 2009