Proximal Policy Optimization Algorithm for Integrated Energy System Operation with Adaptive Learning Rate Decay Strategy
Authors:
- 24 November 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 545-549
Abstract
With increasing focus on sustainability and efficiency, Integrated Energy Systems (IES) have gained more attention in the provision of electricity and thermal energy. However, the inherent complexity and uncertainty of IES pose challenges to their optimization and management. This paper proposes a Proximal Policy Optimization (PPO) algorithm for the operation of IES, based on an adaptive learning rate decay strategy, aimed at enhancing the operational efficiency and stability of IES. Initially, a Markov decision process is established to simulate the operation of IES. Subsequently, a PPO algorithm with an adaptive learning rate decay strategy is proposed. Experimental results demonstrate that the proposed algorithm significantly outperforms traditional PPO algorithms in reducing overall operational costs and improving the balance of electricity and thermal energy supply and demand. This research provides an effective optimization method for the efficient and sustainable operation of IES.Keywords
Funding Information
- Research and Development
This publication has 10 references indexed in Scilit:
- Proximal Policy Optimization for Energy Management of Electric Vehicles and PV Storage UnitsEnergies, 2023
- Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy systemApplied Energy, 2022
- A critical survey of integrated energy system: Summaries, methodologies and analysisEnergy Conversion and Management, 2022
- Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learningEnergy, 2021
- Soft actor-critic –based multi-objective optimized energy conversion and management strategy for integrated energy systems with renewable energyEnergy Conversion and Management, 2021
- Heuristic Energy Management Strategy of Hybrid Electric Vehicle Based on Deep Reinforcement Learning With Accelerated Gradient OptimizationIEEE Transactions on Transportation Electrification, 2021
- Multi-Energy Scheduling of an Industrial Integrated Energy System by Reinforcement Learning-Based Differential EvolutionIEEE Transactions on Green Communications and Networking, 2021
- Combined heat and power system intelligent economic dispatch: A deep reinforcement learning approachInternational Journal of Electrical Power & Energy Systems, 2020
- A review of artificial intelligence-based optimization techniques for the sizing of integrated renewable energy systems in smart citiesEnvironmental Technology Reviews, 2020
- An Online Optimal Dispatch Schedule for CCHP Microgrids Based on Model Predictive ControlIEEE Transactions on Smart Grid, 2016