A Predictive Control Method Based on Neural Predictor and Soft Actor–Critic for Power Converters
- 29 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 72 (5) , 4556-4566
Abstract
This article focuses on introducing soft reinforcement learning (RL) techniques into the finite controlset model predictive control (FCS-MPC) framework to enhance robust performance. More precisely, building upon a neural predictor, an intelligent agent trained using the soft actor–critic algorithm is developed to explore the optimal control input embedded within the MPC framework. Meanwhile, during training, a constraint based on a Lyapunov function is introduced, and a corresponding update law for the weights is provided. Furthermore, this proposed method guarantees the stability of the system integrated with the RL intelligent agent. Finally, both simulation and experimental results validate the superiority of this approach compared to the existing FCS-MPC methods.Keywords
Funding Information
- Key R&D Plan Projects at Zhejiang Province (2023C01243)
- Joint Science Foundation of Education Ministry of China (8091B022201)
- State Key Laboratory of High-speed Maglev Transportation Technology (SKLM-SFCF-2023-020)
This publication has 30 references indexed in Scilit:
- ANN-Based Surrogate PI and MPC Controllers for Grid-Connected VSC System: Small-Signal Analysis and Comparative EvaluationIEEE Journal of Emerging and Selected Topics in Power Electronics, 2023
- Virtual Voltage Vector-Based Sequential Model-Free Predictive Control for Multiparalleled NPC InvertersIEEE Journal of Emerging and Selected Topics in Power Electronics, 2023
- Event-Triggered ESO-Based Robust MPC for Power ConvertersIEEE Transactions on Industrial Electronics, 2022
- Predictor-Based Neural Network Finite-Set Predictive Control for Modular Multilevel ConverterIEEE Transactions on Industrial Electronics, 2020
- Machine Learning Based Operating Region Extension of Modular Multilevel Converters Under Unbalanced Grid FaultsIEEE Transactions on Industrial Electronics, 2020
- Model-Free Predictive Current Control of PMSM Drives Based on Extended State Observer Using Ultralocal ModelIEEE Transactions on Industrial Electronics, 2020
- Supervised Imitation Learning of Finite-Set Model Predictive Control Systems for Power ElectronicsIEEE Transactions on Industrial Electronics, 2020
- Weighting Factor Design in Model Predictive Control of Power Electronic Converters: An Artificial Neural Network ApproachIEEE Transactions on Industrial Electronics, 2018
- Improved Model-Free Predictive Current Control for Synchronous Reluctance Motor DrivesIEEE Transactions on Industrial Electronics, 2016
- Model Predictive Current Control of Grid-Connected Neutral-Point-Clamped Converters to Meet Low-Voltage Ride-Through RequirementsIEEE Transactions on Industrial Electronics, 2014