Optimized Pulse Patterns Design for Electrical Drives: A Reinforcement Learning Approach
Open Access
- 12 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of the Industrial Electronics Society
- Vol. 7, 905-919
Abstract
Optimal modulation techniques such as optimized pulse patterns (OPPs) are essential for minimizing power losses and hence achieving efficient operation of electrical drive systems. Conventional OPPs are designed offline to minimize different steady-state performance criteria and require switching angles-based analytical models suitable for gradient-based optimization. Such models are however not always available and can be complex and difficult to validate. Hence, a data-driven design approach that can utilize any form of models, or even be used for direct OPP learning, e.g., from a real-world drive, without requiring any modeling effort, is of significant interest. In this paper, we present a first proof of concept for a data-driven design of steady-state OPPs using reinforcement learning (RL). We explore the feasibility of training an end-to-end neural network policy that maps desired working points (WPs) to reference OPPs by interacting with an electrical drive environment. We introduce a novel parametrization of switching angles that inherently incorporates their constraints, and we utilize an efficient simulation set-up to simplify the training for this proof-of-concept investigation. Through extensive simulation and real-world experiments, we demonstrate the potential and trade offs of the proposed RL-based approach for designing loss-optimal pulse patterns for a traction permanent magnet synchronous motor drive. The performance is benchmarked against a conventional, indirectly loss optimized, model-based OPP design. Test bench results show a potential for power loss reduction in learned OPPs compared to conventional ones, despite the simulation model bias, and motivate learning OPPs directly from a real-world drive environment.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- A Deep Reinforcement Learning-Based Direct Switching Controller Design for Permanent Magnet Synchronous Motors2025
- Calculation of Optimized Pulse Patterns for Electric Drives with an End-To-End Differentiable Simulation Framework2025
- Neue Generation elektrischer Antriebe mit optimierten PulsmusternMTZ - Motortechnische Zeitschrift, 2024
- Learning of synchronous pulse patterns for electrical drivesIET Conference Proceedings, 2024
- Optimized Pulse Patterns for Anisotropic Synchronous Machines2023
- Synchronous Optimal Pulse Width Modulation for Salient Permanent Magnet Synchronous Machines Considering Spatial Harmonics2022
- Single-step deep reinforcement learning for open-loop control of laminar and turbulent flowsPhysical Review Fluids, 2021
- Direct shape optimization through deep reinforcement learningJournal of Computational Physics, 2021
- Heavy-duty Electric Vehicles and Society2021
- Elektrische Antriebe - Regelung von Antriebssystemen2009