Finite-Horizon Near-Optimal Output Feedback Neural Network Control of Quantized Nonlinear Discrete-Time Systems With Input Constraint
Authors:
Open Access
- 18 March 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 26 (8) , 1776-1788
Abstract
The output feedback-based near-optimal regulation of uncertain and quantized nonlinear discrete-time systems in affine form with control constraint over finite horizon is addressed in this paper. First, the effect of input constraint is handled using a nonquadratic cost functional. Next, a neural network (NN)-based Luenberger observer is proposed to reconstruct both the system states and the control coefficient matrix so that a separate identifier is not needed. Then, approximate dynamic programming-based actor-critic framework is utilized to approximate the time-varying solution of the Hamilton–Jacobi–Bellman using NNs with constant weights and time-dependent activation functions. A new error term is defined and incorporated in the NN update law so that the terminal constraint error is also minimized over time. Finally, a novel dynamic quantizer for the control inputs with adaptive step size is designed to eliminate the quantization error overtime, thus overcoming the drawback of the traditional uniform quantizer. The proposed scheme functions in a forward-in-time manner without offline training phase. Lyapunov analysis is used to investigate the stability. Simulation results are given to show the effectiveness and feasibility of the proposed method.Keywords
Funding Information
- National Science Foundation (ECCS-1128281)
- Intelligent Systems Center
This publication has 21 references indexed in Scilit:
- A novel dual iterative Q-learning method for optimal battery management in smart residential environmentsIEEE Transactions on Industrial Electronics, 2014
- Finite-Approximation-Error-Based Discrete-Time Iterative Adaptive Dynamic ProgrammingIEEE Transactions on Cybernetics, 2014
- Policy Iteration Adaptive Dynamic Programming Algorithm for Discrete-Time Nonlinear SystemsIEEE Transactions on Neural Networks and Learning Systems, 2013
- A Novel Iterative $\theta $-Adaptive Dynamic Programming for Discrete-Time Nonlinear SystemsIEEE Transactions on Automation Science and Engineering, 2013
- Numerical adaptive learning control scheme for discrete‐time non‐linear systemsIET Control Theory & Applications, 2013
- Finite-Approximation-Error-Based Optimal Control Approach for Discrete-Time Nonlinear SystemsIEEE Transactions on Cybernetics, 2013
- Stochastic Optimal Controller Design for Uncertain Nonlinear Networked Control System via Neuro Dynamic ProgrammingIEEE Transactions on Neural Networks and Learning Systems, 2013
- Finite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive CriticsIEEE Transactions on Neural Networks and Learning Systems, 2012
- Fundamentals of Wireless Communication2005
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approachAutomatica, 2005