Simultaneous Policy Iteration for Decentralized Control of Multi-Machine Power Systems
- 23 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems II: Express Briefs
- Vol. 71 (6) , 3111-3115
Abstract
This article considers a decentralized control problem of interconnected multi-machine power systems with asymmetric input constraints. Initially, such an input-constrained decentralized control problem is converted into a group of unconstrained optimal control problems via preassigning modified nonquadratic cost functions for nominal subsystems. Then, under the framework of adaptive dynamic programming, a simultaneous policy iteration (PI) algorithm is proposed to solve the Hamilton-Jacobi-Bellman equations related to these optimal control problems. To implement the simultaneous PI algorithm, actor and critic neural networks (NNs) are separately constructed to approximate the control policy and the cost function. After that, the least square method and the Monte Carlo integration technique are combined to simultaneously determine the actor and critic NNs’ weights. Finally, simulations of a two-machine power system are conducted to validate the theoretical claims.Keywords
Funding Information
- National Natural Science Foundation of China (62373267)
This publication has 18 references indexed in Scilit:
- Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iterationAutomatica, 2023
- Event-Triggered Robust Adaptive Dynamic Programming With Output Feedback for Large-Scale SystemsIEEE Transactions on Control of Network Systems, 2022
- Online Value Iteration for Intelligent Discounted Tracking Design of Constrained SystemsIEEE Transactions on Circuits and Systems II: Express Briefs, 2022
- Neurodynamic Programming and Tracking Control for Nonlinear Stochastic Systems by PI AlgorithmIEEE Transactions on Circuits and Systems II: Express Briefs, 2022
- ADP-Based Security Decentralized Sliding Mode Control for Partially Unknown Large-Scale Systems Under Injection AttacksIEEE Transactions on Circuits and Systems I: Regular Papers, 2020
- Approximate Dynamic Programming for Nonlinear-Constrained OptimizationsIEEE Transactions on Cybernetics, 2019
- Data-Driven Cooperative Output Regulation of Multi-Agent Systems via Robust Adaptive Dynamic ProgrammingIEEE Transactions on Circuits and Systems II: Express Briefs, 2018
- Adaptive Dynamic Programming with Applications in Optimal Control2017
- Discrete-Time Nonzero-Sum Games for Multiplayer Using Policy-Iteration-Based Adaptive Dynamic Programming AlgorithmsIEEE Transactions on Cybernetics, 2016
- Off-Policy Reinforcement Learning for $ H_\infty $ Control DesignIEEE Transactions on Cybernetics, 2014