Data-Based Inverse Reinforcement Learning for Nonlinear Systems With Control Constraints
- 5 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. PP (21682216) , 1-8
Abstract
This article proposes an online data-based inverse reinforcement learning (IRL) scheme to solve optimal control problem for nonlinear systems with control constraints, in which the unknown reward functions are recovered based on the systems’ demonstrated state and input data. To deal with control constraint, we introduce a saturation function to formulate the original constrained optimal control problem into a new unconstrained optimal control problem. Then a data-based identifier using neural network (NN) approximation technique is designed to estimate the system’s dynamics. Subsequently, we develop a data-based IRL approach to learn the unknown reward function and establish the weight tuning law of the value function and reward function using demonstrated state and input data. The proof of the uniform boundedness of the weight estimation error is presented. A simulation example is provided to verify the effectiveness of the proposed approach.Keywords
Funding Information
- National Natural Science Foundation of China (62203208, 62573238)
- Natural Science Foundation of Jiangsu Province of China (BK20241889)
- Natural Science Foundation of Nanjing University of Posts and Telecommunications (NY223080, NY224174)