ProHome: Recurrent Proximal Policy Optimization-driven Advanced Home Energy Management
Preprint
- 18 April 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Advanced Home Energy Management Systems (HEMS) are essential for integrating Renewable Energy Sources (RES) and Electric Vehicles (EVs) into smart homes; however, many existing solutions overlook the temporal dependencies in energy dynamics and are evaluated under overly simplified or fully known price signals. This work proposes ProHome, a HEMS framework based on Recurrent Proximal Policy Optimization (RPPO), where an LSTM-enabled policy learns memory-dependent control strategies from sequential observations. ProHome coordinates a comprehensive set of household assets (HVAC, electric water heater, deferrable appliances, PV generation, an energy storage system, and an EV with bidirectional power exchange) under time-varying electricity prices without assuming access to future prices. A realistic smart home simulation environment driven by historical data was developed for training and testing. Results on a 1,089-day dataset (train/test split 75/25) show that ProHome achieves the lowest average daily electricity cost among the compared DRL baselines and improves EV readiness at departure. Compared with standard PPO, the proposed recurrent agent reduces the mean daily operating cost by 1% and increases the EV state of energy at departure by 2.1 percentage points toward the user-defined target, while maintaining near-zero comfort violations for HVAC and hot-water temperature.Keywords
This publication has 26 references indexed in Scilit:
- Real-world validation of safe reinforcement learning, model predictive control and decision tree-based home energy management systemsEnergy and AI, 2024
- Scalable energy management approach of residential hybrid energy system using multi-agent deep reinforcement learningApplied Energy, 2024
- Optimal energy system scheduling using a constraint-aware reinforcement learning algorithmInternational Journal of Electrical Power & Energy Systems, 2023
- A reinforcement learning approach to home energy management for modulating heat pumps and photovoltaic systemsApplied Energy, 2022
- A multi‐objective multi‐agent deep reinforcement learning approach to residential appliance schedulingIET Smart Grid, 2022
- Scalable multi-agent reinforcement learning for distributed control of residential energy flexibilityApplied Energy, 2022
- A deep reinforcement learning-based approach for the residential appliances schedulingEnergy Reports, 2022
- The impact of intermittent renewable energy generators on Lesotho national electricity gridElectric Power Systems Research, 2021
- Deep reinforcement learning for home energy management system controlEnergy and AI, 2021
- PySCIPOpt: Mathematical Programming in Python with the SCIP Optimization Suite2016