Framework for LLM-Enabled Construction Robot Task Planning: Knowledge Base Preparation and Robot-LLM Dialogue for Interior Wall Painting
Preprint
- 17 June 2025
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Task planning for a construction robot requires systematically integrating diverse elements, such as building components, construction processes, user input, and robot software. Conventional robot programming complicates this by requiring precise entity naming, relationship definitions, unstructured language interpretation, and accurate action selection. Existing research has focused on isolated components, such as natural language processing, hardcoded data linkages, or BIM data extraction. We introduce a novel framework using an LLM as the cognitive core for autonomous construction robots, encompassing both data preparation and task planning phases. Leveraging OpenAI’s ChatGPT4, we demonstrate how LLMs can process structured BIM data and unstructured human inputs to generate robot instructions. A prototype tested in a simulated environment with a mobile painting robot adaptively executed tasks through real-time dialogues with ChatGPT4, reducing reliance on hardcoded logic. Results suggest that LLMs can serve as the cognitive core for construction robots, with potential for extension to more complex operations.Keywords
All Related Versions
- Version 1, 2025-06-17, Preprints
- Published version: Robotics, 14 (9), 117.
This publication has 36 references indexed in Scilit:
- Integrating action knowledge and LLMs for task planning and situation handling in open worldsAutonomous Robots, 2023
- A BERT-Based Model for Question Answering on Construction Incident Reports2022
- BIM-based task-level planning for robotic brick assembly through image-based 3D modelingAdvanced Engineering Informatics, 2020
- Autonomous motion planning and task execution in geometrically adaptive robotized construction workAutomation in Construction, 2019
- MoveIt!: An Introduction2016
- Appearance-based material classification for monitoring of operation-level construction progress using 4D BIM and site photologsAutomation in Construction, 2015
- Automatic design and planning of scaffolding systems using building information modelingAdvanced Engineering Informatics, 2014
- Building Information Modeling (BIM) and Safety: Automatic Safety Checking of Construction Models and SchedulesAutomation in Construction, 2013
- BIM Handbook2008
- Construction roboticsAutonomous Robots, 2006