Asymptotically Stable Adaptive–Optimal Control Algorithm With Saturating Actuators and Relaxed Persistence of Excitation
Authors:
- 26 October 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 27 (11) , 2386-2398
Abstract
This paper proposes a control algorithm based on adaptive dynamic programming to solve the infinite-horizon optimal control problem for known deterministic nonlinear systems with saturating actuators and nonquadratic cost functionals. The algorithm is based on an actor/critic framework, where a critic neural network (NN) is used to learn the optimal cost, and an actor NN is used to learn the optimal control policy. The adaptive control nature of the algorithm requires a persistence of excitation condition to be a priori validated, but this can be relaxed using previously stored data concurrently with current data in the update of the critic NN. A robustifying control term is added to the controller to eliminate the effect of residual errors, leading to the asymptotically stability of the closed-loop system. Simulation results show the effectiveness of the proposed approach for a controlled Van der Pol oscillator and also for a power system plant.Keywords
Funding Information
- ARO MURI (W911NF0910553)
- ARO (Inst. for Collaborative Biotechnologies) (W911NF-09-D-0001, CAPES No BEX-9586/11-3)
This publication has 52 references indexed in Scilit:
- Finite horizon optimal control of non-linear discrete-time switched systems using adaptive dynamic programming with ε-error boundInternational Journal of Systems Science, 2013
- A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systemsAutomatica, 2013
- Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problemAutomatica, 2010
- Intelligence in the brain: A theory of how it works and how to build itNeural Networks, 2009
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approachAutomatica, 2005
- Adaptive dynamic programmingIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2002
- AN ANALYSIS OF EXPERIENCE REPLAY IN TEMPORAL DIFFERENCE LEARNINGCybernetics and Systems, 1999
- Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networksNeural Networks, 1990
- Consistency of HDP applied to a simple reinforcement learning problemNeural Networks, 1990
- On an iterative technique for Riccati equation computationsIEEE Transactions on Automatic Control, 1968