Enhancing University Building Energy Flexibility Performance Using Reinforcement Learning Control
Open Access
- 9 December 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. PP, 1
Abstract
The Building Energy Flexibility (BEF) system has the potential to reduce carbon emissions and energy consumption by integrating flexible loads and renewable energy sources. However, without proper optimization, BEF implementation can lead to demand-supply imbalances (DSI), causing voltage fluctuations and power quality issues. This study focuses on addressing these challenges by implementing a flexible load control (FLC) based on reinforcement learning (RL), particularly aimed to optimizing BEF performance in a university building setting. The case study focuses on the LABTEK XIX building in Bandung City, Indonesia, which comprises various zones, including offices, lobbies, libraries, classrooms, and laboratories. Each zones has distinct schedules and activities which, leading to notable variations in energy demands and occupancy patterns. The BEF system was modeled using OpenStudio and EnergyPlus, providing a training environment for the controller. The controller was developed in Python using the OpenAI Gym framework and leverages the Proximal Policy Optimization (PPO) algorithm to manage Heating, Ventilation, and Air Conditioning (HVAC) systems and local photovoltaic (PV) energy supply. By addressing the dynamic nature of flexible loads and the intermittent supply of PV energy, the controller enhances system resilience against disturbances like weather variations and occupancy changes. The key performance indicators (KPIs) evaluated include increasing building self-consumption, energy flexibility, and energy savings while maintaining thermal zones within acceptable comfort levels for occupants. It was evaluated over four weeks during the equinoxes and solstices. The controller successfully increased average self-consumption by 6.58%, achieved an average energy flexibility of 4.91 kWh, and realized energy savings up to 3 kWh, all while ensuring thermal comfort in the managed zones.Keywords
Funding Information
- Institut Teknologi Bandung
This publication has 86 references indexed in Scilit:
- Reinforcement Learning for proactive operation of residential energy systems by learning stochastic occupant behavior and fluctuating solar energy: Balancing comfort, hygiene and energy useApplied Energy, 2022
- Data-driven model predictive control for power demand management and fast demand response of commercial buildings using support vector regressionBuilding Simulation, 2021
- Experiment study of machine-learning-based approximate model predictive control for energy-efficient building controlApplied Energy, 2021
- Development and Evaluation of a Smart Charging Strategy for an Electric Vehicle Fleet Based on Reinforcement LearningApplied Energy, 2021
- Evaluating the impact of thermostat control strategies on the energy flexibility of residential buildings for space heatingBuilding Simulation, 2021
- Embedding power system’s reliability within a long-term Energy System Optimization Model: Linking high renewable energy integration and future grid stability for France by 2050Applied Energy, 2020
- Cost‐ and comfort‐aware aggregated modified least slack time–based domestic power scheduling for residential communitiesTransactions on Emerging Telecommunications Technologies, 2019
- Model predictive control for thermal energy storage and thermal comfort optimization of building demand response in smart gridsApplied Energy, 2019
- Demand response algorithms for smart-grid ready residential buildings using machine learning modelsApplied Energy, 2019
- A novel dynamic modeling approach for predicting building energy performanceApplied Energy, 2014