Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Specifications
- 13 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (10) , 10482-10489
Abstract
To enable non-experts to specify long-horizon, multi-robot collaborative tasks, language models are increasingly used to translate natural language commands into formal specifications. However, because translation can occur in multiple ways, such translations may lack accuracy or lead to inefficient multi-robot planning. Our key insight is that concise hierarchical specifications can simplify planning while remaining straightforward to derive from human instructions. We propose Nl2Hltl2Plan, a framework that translates natural language commands into hierarchical Linear Temporal Logic (LTL) and solves the corresponding planning problem. The translation involves two steps leveraging Large Language Models (LLMs). First, an LLM transforms instructions into a Hierarchical Task Tree, capturing logical and temporal relations. Next, a fine-tuned LLM converts sub-tasks into standard LTL formulas, which are aggregated into hierarchical specifications, with the lowest level corresponding to ordered robot actions. These specifications are then used with off-the-shelf planners. Our Nl2Hltl2Plan demonstrates the potential of LLMs in hierarchical reasoning for multi-robot task planning. Evaluations in simulation and real-world experiments with human participants show that Nl2Hltl2Plan outperforms existing methods, handling more complex instructions while achieving higher success rates and lower costs in task allocation and planning.Keywords
All Related Versions
Funding Information
- Siemens
This publication has 23 references indexed in Scilit:
- RoCo: Dialectic Multi-Robot Collaboration with Large Language Models2024
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration02024
- Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?2024
- Neuro-Symbolic AI + Agent Systems: A First Reflection on Trends, Opportunities and Challenges2024
- ProgPrompt: program generation for situated robot task planning using large language modelsAutonomous Robots, 2023
- nl2spec: Interactively Translating Unstructured Natural Language to Temporal Logics with Large Language Models2023
- Data-Efficient Learning of Natural Language to Linear Temporal Logic Translators for Robot Task Specification2023
- Code as Policies: Language Model Programs for Embodied Control2023
- ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks2020
- Model Checking of Safety PropertiesFormal Methods in System Design, 2001