Robust Adaptive Fractional-Order PID Controller Design for High-Power DC-DC Dual Active Bridge Converter Enhanced Using Multi-Agent Deep Deterministic Policy Gradient Algorithm for Electric Vehicles
Open Access
Abstract
The Dual Active Bridge converter (DABC), known for its bidirectional power transfer capability and high efficiency, plays a crucial role in various applications, particularly in electric vehicles (EVs), where it facilitates energy storage, battery charging, and grid integration. The Dual Active Bridge Converter (DABC), when paired with a high-performance CLLC filter, is well-regarded for its ability to transfer power bidirectionally with high efficiency, making it valuable across a range of energy applications. While these features make the DABC highly efficient, they also complicate controller design due to nonlinear behavior, fast switching, and sensitivity to component variations. We have used a Fractional-order PID (FOPID) controller to benefit from the simple structure of classical PID controllers with lower complexity and improved flexibility because of additional filtering gains adopted in this method. However, for a FOPID controller to operate effectively under real-time conditions, its parameters must adapt continuously to changes in the system. To achieve this adaptability, a Multi-Agent Reinforcement Learning (MARL) approach is adopted, where each gain of the controller is tuned individually using the Deep Deterministic Policy Gradient (DDPG) algorithm. This structure enhances the controller’s ability to respond to external disturbances with greater robustness and adaptability. Meanwhile, finding the best initial gains in the RL structure can decrease the overall efficiency and tracking performance of the controller. To overcome this issue, Grey Wolf Optimization (GWO) algorithm is proposed to identify the most suitable initial gains for each agent, providing faster adaptation and consistent performance during the training process. The complete approach is tested using a Hardware-in-the-Loop (HIL) platform, where results confirm accurate voltage control and resilient dynamic behavior under practical conditions. In addition, the controller’s performance was validated under a battery management scenario where the DAB converter interacts with a nonlinear lithium-ion battery. The controller successfully regulated the State of Charge (SOC) through automated charging and discharging transitions, demonstrating its real-time adaptability for BMS-integrated EV systems. Consequently, the proposed MARL-FOPID controller reported better disturbance-rejection performance in different working cases compared to other conventional methods.Keywords
Funding Information
- Edith Cowan University
This publication has 81 references indexed in Scilit:
- Distributed computing in multi-agent systems: a survey of decentralized machine learning approachesComputing, 2024
- Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systemsApplied Energy, 2023
- Machine learning enhancing metaheuristics: a systematic reviewSoft Computing, 2023
- Modified Harris Hawks Optimization-Based Fractional-Order Fuzzy PID Controller for Frequency Regulation of Multi-Micro-GridArabian Journal for Science and Engineering, 2023
- Optimal fractional-order PID controller based on fractional-order actor-critic algorithmNeural Computing and Applications, 2022
- Particle Swarm Optimization Algorithm and Its Applications: A Systematic ReviewArchives of Computational Methods in Engineering, 2022
- Genetic Algorithms in the Fields of Artificial Intelligence and Data SciencesAnnals of Data Science, 2021
- Optimal design of FOPID Controller for the control of CSTR by using a novel hybrid metaheuristic algorithmSādhanā, 2021
- Challenges of real-world reinforcement learning: definitions, benchmarks and analysisMachine Learning, 2021
- Hybrid k-means Grasshopper Optimization Algorithm based FOPID controller with feed forward DC–DC converter for solar-wind generating systemJournal of Ambient Intelligence and Humanized Computing, 2021