Large Language Models as Planning Domain Generators (Student Abstract)
Open Access
- 24 March 2024
- journal article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 38 (21) , 23604-23605
Abstract
The creation of planning models, and in particular domain models, is among the last bastions of tasks that require exten- sive manual labor in AI planning; it is desirable to simplify this process for the sake of making planning more accessi- ble. To this end, we investigate whether large language mod- els (LLMs) can be used to generate planning domain models from textual descriptions. We propose a novel task for this as well as a means of automated evaluation for generated do- mains by comparing the sets of plans for domain instances. Finally, we perform an empirical analysis of 7 large language models, including coding and chat models across 9 different planning domains. Our results show that LLMs, particularly larger ones, exhibit some level of proficiency in generating correct planning domains from natural language descriptionsKeywords
This publication has 2 references indexed in Scilit:
- Generalized Planning in PDDL Domains with Pretrained Large Language ModelsProceedings of the AAAI Conference on Artificial Intelligence, 2024
- PDDL2.1: An Extension to PDDL for Expressing Temporal Planning DomainsJournal of Artificial Intelligence Research, 2003