Abstract
Advanced Home Energy Management Systems (HEMS) are essential for integrating Renewable Energy Sources (RES) and Electric Vehicles (EVs) into smart homes; however, many existing solutions overlook the temporal dependencies in energy dynamics and are evaluated under overly simplified or fully known price signals. This work proposes ProHome, a HEMS framework based on Recurrent Proximal Policy Optimization (RPPO), where an LSTM-enabled policy learns memory-dependent control strategies from sequential observations. ProHome coordinates a comprehensive set of household assets (HVAC, electric water heater, deferrable appliances, PV generation, an energy storage system, and an EV with bidirectional power exchange) under time-varying electricity prices without assuming access to future prices. A realistic smart home simulation environment driven by historical data was developed for training and testing. Results on a 1,089-day dataset (train/test split 75/25) show that ProHome achieves the lowest average daily electricity cost among the compared DRL baselines and improves EV readiness at departure. Compared with standard PPO, the proposed recurrent agent reduces the mean daily operating cost by 1% and increases the EV state of energy at departure by 2.1 percentage points toward the user-defined target, while maintaining near-zero comfort violations for HVAC and hot-water temperature.

This publication has 26 references indexed in Scilit: