Vector Control of PMSM Using TD3 Reinforcement Learning Algorithm
Open Access
- 24 August 2023
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 16 (9) , 404
Abstract
Permanent magnet synchronous motor (PMSM) drive systems are commonly utilized in mobile electric drive systems due to their high efficiency, high power density, and low maintenance cost. To reduce the tracking error of the permanent magnet synchronous motor, a reinforcement learning (RL) control algorithm based on double delay deterministic gradient algorithm (TD3) is proposed. The physical modeling of PMSM is carried out in Simulink, and the current controller controlling id-axis and iq-axis in the current loop is replaced by a reinforcement learning controller. The optimal control network parameters were obtained through simulation learning, and DDPG, BP, and LQG algorithms were simulated and compared under the same conditions. In the experiment part, the trained RL network was compiled into C code according to the workflow with the help of rapid prototyping control, and then downloaded to the controller for testing. The measured output signal is consistent with the simulation results, which shows that the algorithm can significantly reduce the tracking error under the variable speed of the motor, making the system have a fast response.Keywords
This publication has 25 references indexed in Scilit:
- Advanced Design Optimization Technique for Torque Profile Improvement in Six-Phase PMSM Using Supervised Machine Learning for Direct-Drive EVIEEE Transactions on Energy Conversion, 2019
- Nonlinear adaptive speed control of a permanent magnet synchronous motor: A perturbation estimation approachControl Engineering Practice, 2019
- Soft robot perception using embedded soft sensors and recurrent neural networksScience Robotics, 2019
- Optimized Adaptive Nonlinear Tracking Control Using Actor–Critic Reinforcement Learning StrategyIEEE Transactions on Industrial Informatics, 2019
- A Simple Current-Constrained Controller for Permanent-Magnet Synchronous MotorIEEE Transactions on Industrial Informatics, 2018
- Learning deep neural network policies with continuous memory states2016
- Novel nonsingular fast terminal sliding mode control for a PMSM chaotic system with extended state observer and tracking differentiatorJournal of Vibration and Control, 2015
- DeepMPC: Learning Deep Latent Features for Model Predictive Control2015
- More Electric Aircraft: Review, Challenges, and Opportunities for Commercial Transport AircraftIEEE Transactions on Transportation Electrification, 2015
- Design and Implementation of Model Predictive Control for Electrical Motor DrivesIEEE Transactions on Industrial Electronics, 2008