CoMuRoS - An LLM-based generalizable hierarchical task planning and execution framework for heterogeneous robot teams with event-driven re-planning
Authors:
Open Access
- 4 August 2026
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Robotics and AI
- Vol. 13, 1843313
Abstract
Heterogeneous multi-robot teams require systems that can interpret natural-language goals, allocate tasks, and adapt to unexpected events. We developed CoMuRoS (Collaborative Multi-Robot System), a generalizable hierarchical architecture combining a centralized task-manager LLM with decentralized robot-level LLMs for executable Python generation from primitive ROS2 skills. The task manager uses static planning rules and dynamic context, including task history, robot/task status, and detected events, while onboard perception using VLM/image processing classifies events as relevant or irrelevant and triggers replanning. Hardware experiments demonstrated recovery from disruptive events, filtering of irrelevant distractions, and coordinated transport with emergent human-robot cooperation, achieving success rates of 9/10 for collaborative object recovery, 8/8 for coordinated transport, and 5/5 for human-assisted recovery. Simulation studies demonstrated intention-aware replanning. A curated benchmark of 22 scenarios, 54 tasks, and around 20 robots evaluated task allocation, classification, IoU, executability, and correctness across multiple LLMs, with correctness up to 0.91 ± 0.053; a 20-scenario replanning benchmark achieved Correctness = 0.948 ± 0.034 using Grok 3. CoMuRoS enables runtime, event-driven replanning on physical robots and supports flexible multi-robot and human-robot collaboration across diverse scenarios.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Environment-Driven and LLM-Guided Multi-Robot Task Inference and Allocation Under Temporal Logic SpecificationsIEEE Transactions on Automation Science and Engineering, 2026
- COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language Models2025
- RoCo: Dialectic Multi-Robot Collaboration with Large Language Models2024
- Code as Policies: Language Model Programs for Embodied Control2023
- ChoiRbot: A ROS 2 Toolbox for Cooperative RoboticsIEEE Robotics and Automation Letters, 2021
- Book ReviewsSIAM Review, 2021
- Efficient multi-robot coverage of a known environment2017
- Multi-robot formation control and object transport in dynamic environments via constrained optimizationThe International Journal of Robotics Research, 2017
- The influence of shared mental models on team process and performance.Journal of Applied Psychology, 2000
- Strips: A new approach to the application of theorem proving to problem solvingArtificial Intelligence, 1971