Adaptive Optimal Output Regulation Based on Adaptive Dynamic Programming and Output-Feedback Hybrid Iteration: Theory and Applications Across Diverse Time Scales From PMDC Motor Drives to IBR-Based Microgrids
- 1 October 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 73 (10) , 15154-15168
Abstract
This article investigates the adaptive optimal output-feedback control problem for discrete-time multiagent linear systems. An adaptive dynamic programming (ADP) algorithm, hybrid iteration (HI), is proposed to solve the adaptive optimal output-feedback control problem. The primary contribution of this work is the advancement of an approach to addressing adaptive optimal output regulation problems for multiagent systems via output-feedback control. Unlike existing ADP-based strategies, such as policy iteration (PI) and value iteration (VI), the proposed output-feedback HI strategy learns the optimal output-feedback control policy over two phases. In the first phase, a data-driven scheme is deployed to learn an admissible output-feedback control policy based on online data. In the second phase, given the admissible control policy, the optimal output-feedback control policy is learned via PI with an accelerated convergence rate. Illustrative examples demonstrating the effectiveness of the proposed output-feedback HI approach to controlling systems with slow and fast dynamics, including long and short time scales (or time constants), respectively, are provided and studied. In this regard, experimental results from rapid control prototyping of a permanent-magnet DC motor drive utilizing a DC–DC buck converter (as an example of a system with slow dynamics, or equivalently, with long time scales) are presented. Additionally, testing results from power hardware-in-the-loop simulations of a modern microgrid utilizing inverter-based resources (as an example of a system with fast dynamics, or equivalently, with short time scales) reveal the efficacy and practicality of the proposed ADP-based adaptive optimal output regulation employing HI.Keywords
This publication has 53 references indexed in Scilit:
- Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programmingAutomatica, 2024
- Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iterationAutomatica, 2023
- Adaptive optimal output regulation of linear discrete-time systems based on event-triggered output-feedbackAutomatica, 2022
- Adaptive Dynamic Programming with Applications in Optimal Control2017
- Output-feedback adaptive optimal control of interconnected systems based on robust adaptive dynamic programmingAutomatica, 2016
- A robust adaptive dynamic programming principle for sensorimotor control with signal-dependent noiseJournal of Systems Science and Complexity, 2015
- Adaptive Dynamic Programming for Control2013
- Reinforcement Learning and Approximate Dynamic Programming for Feedback Control2012
- Optimal Control2012
- A Lyapunov formulation of the nonlinear small-gain theorem for interconnected ISS systemsAutomatica, 1996