Context-aware LLM-based AI Agents for Human-centered Energy Management Systems in Smart Buildings
Authors:
Preprint
Abstract
This study presents a conceptual framework and a prototype assessment for Large Language Model (LLM)-based Building Energy Management System (BEMS) AI agents to facilitate context-aware energy management in smart buildings through natural language interaction. The proposed framework comprises three modules: perception (sensing), central control (brain), and action (actuation and user interaction), forming a closed feedback loop that captures, analyzes, and interprets energy data to respond intelligently to user queries and manage connected appliances. By leveraging the autonomous data analytics capabilities of LLMs, the BEMS AI agent seeks to offer context-aware insights into energy consumption, cost prediction, and device scheduling, thereby addressing limitations in existing energy management systems. The prototype's performance was evaluated using 120 user queries across four distinct real-world residential energy datasets and different evaluation metrics, including latency, functionality, capability, accuracy, and cost-effectiveness. The generalizability of the framework was demonstrated using ANOVA tests. The results revealed promising performance, measured by response accuracy in device control (86%), memory-related tasks (97%), scheduling and automation (74%), and energy analysis (77%), while more complex cost estimation tasks highlighted areas for improvement with an accuracy of 49%. This benchmarking study moves toward formalizing the assessment of LLM-based BEMS AI agents and identifying future research directions, emphasizing the trade-off between response accuracy and computational efficiency.Keywords
All Related Versions
This publication has 47 references indexed in Scilit:
- The rise and potential of large language model based agents: a surveyScience China Information Sciences, 2025
- Large language models for building energy applications: Opportunities and challengesBuilding Simulation, 2025
- A survey on large language model based autonomous agentsFrontiers of Computer Science, 2024
- TidyBot: personalized robot assistance with large language modelsAutonomous Robots, 2023
- Conversational artificial intelligence in the AEC industry: A review of present status, challenges and opportunitiesAdvanced Engineering Informatics, 2023
- Home energy management system (HEMS): concept, architecture, infrastructure, challenges and energy management schemesEnergy Systems, 2019
- Occupant perceptions of building information model-based energy visualizations in eco-feedback systemsApplied Energy, 2018
- Foresee: A user-centric home energy management system for energy efficiency and demand responseApplied Energy, 2017
- An insight into actual energy use and its drivers in high-performance buildingsApplied Energy, 2014
- Energy consumption feedback devices’ impact evaluation on domestic energy useApplied Energy, 2013