Optimal Control of Nonlinear Continuous-Time Systems in Strict-Feedback Form
- 23 June 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 26 (10) , 2535-2549
Abstract
This paper proposes a novel optimal tracking control scheme for nonlinear continuous-time systems in strict-feedback form with uncertain dynamics. The optimal tracking problem is transformed into an equivalent optimal regulation problem through a feedforward adaptive control input that is generated by modifying the standard backstepping technique. Subsequently, a neural network-based optimal control scheme is introduced to estimate the cost, or value function, over an infinite horizon for the resulting nonlinear continuous-time systems in affine form when the internal dynamics are unknown. The estimated cost function is then used to obtain the optimal feedback control input; therefore, the overall optimal control input for the nonlinear continuous-time system in strict-feedback form includes the feedforward plus the optimal feedback terms. It is shown that the estimated cost function minimizes the Hamilton-Jacobi-Bellman estimation error in a forward-in-time manner without using any value or policy iterations. Finally, optimal output feedback control is introduced through the design of a suitable observer. Lyapunov theory is utilized to show the overall stability of the proposed schemes without requiring an initial admissible controller. Simulation examples are provided to validate the theoretical results.Keywords
Funding Information
- National Science Foundation (ECCS 0901562)
This publication has 22 references indexed in Scilit:
- A Novel Iterative $\theta $-Adaptive Dynamic Programming for Discrete-Time Nonlinear SystemsIEEE Transactions on Automation Science and Engineering, 2013
- State and output feedback-based adaptive optimal control of nonlinear continuous-time systems in strict feedback form2012
- Online Optimal Control of Affine Nonlinear Discrete-Time Systems With Unknown Internal Dynamics by Using Time-Based Policy UpdateIEEE Transactions on Neural Networks and Learning Systems, 2012
- Robust optimal control of uncertain nonaffine MIMO nonlinear discrete‐time systems with application to HCCI enginesInternational Journal of Adaptive Control and Signal Processing, 2012
- Online optimal control of nonlinear discrete-time systems using approximate dynamic programmingControl Theory and Technology, 2011
- Optimal control of affine nonlinear continuous-time systems2010
- Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problemAutomatica, 2010
- Adaptive optimal control for continuous-time linear systems based on policy iterationAutomatica, 2009
- Neural-Network-Based State Feedback Control of a Nonlinear Discrete-Time System in Nonstrict Feedback FormIEEE Transactions on Neural Networks, 2008
- Robust trajectory tracking for a scale model autonomous helicopterInternational Journal of Robust and Nonlinear Control, 2004