Excitation for Adaptive Optimal Control of Nonlinear Systems in Differential Games
- 25 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 68 (1) , 596-603
Abstract
This article focuses on the fulfillment of the persistent excitation (PE) condition for signals which result from transformations by means of polynomials. This is essential, e.g., for the convergence of adaptive dynamic programming algorithms due to commonly used polynomial function approximators. As theoretical statements are scarce regarding the nonlinear transformation of PE signals, we propose conditions on the system state such that its transformation by polynomials is PE. To validate our theoretical statements, we develop an exemplary excitation procedure based on our conditions using a feed-forward control approach and demonstrate the effectiveness of our method in a nonzero-sum differential game. In this setting, our approach outperforms commonly used probing noise in terms of convergence time and the degree of PE, shown by a numerical example.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Approximate $N$ -Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear SystemIEEE Transactions on Neural Networks and Learning Systems, 2014
- Adaptive dynamic programming as a theory of sensorimotor controlBiological Cybernetics, 2014
- Online Synchronous Approximate Optimal Learning Algorithm for Multi-Player Non-Zero-Sum Games With Unknown DynamicsIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2014
- Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton–Jacobi equationsAutomatica, 2011
- Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problemAutomatica, 2010
- Flatness and defect of non-linear systems: introductory theory and examplesInternational Journal of Control, 1995
- Frequency domain conditions for parameter convergence in multivariable recursive identificationAutomatica, 1990
- Persistent excitation in adaptive systemsInternational Journal of Control, 1987
- Necessary and sufficient conditions for parameter convergence in adaptive controlAutomatica, 1986
- Persistence of excitation in linear systemsSystems & Control Letters, 1986