From Fine‐Tuning to Evaluation: How LLM Enables Automatic Domain Modeling
Open Access
- 1 January 2026
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Software
- Vol. 2026 (1) , 1690605
Abstract
Domain modeling is widely utilized in the design, development, and maintenance processes of manufacturing scenarios. However, due to the specialized nature of domain‐specific business requirements and the structural complexity of domain models, modeling remains predominantly manual or semi‐manual. Artificial intelligence (AI) technologies, particularly those based on natural language processing (NLP), have made automatic modeling feasible. Nevertheless, the lack of domain‐specific knowledge limits the completeness of automatic modeling achieved by such methods. To bridge this gap, we leverage large language models (LLMs) with enhanced capabilities for understanding domain‐specific contexts to achieve automatic modeling for manufacturing scenarios. In this study, an automatic modeling LLM (AMLLM) is developed, enabling efficient automatic construction of complex domain models and incorporating a series of quantitative indicators and evaluation measures to assess the generated domain models’ completeness comprehensively. Supported by model evaluation, AMLLM can achieve continuous self‐optimization to support more complete model generation. Finally, through comprehensive experiments guided by our research questions (RQs), we demonstrate that the proposed approach enables efficient and complete automatic domain modeling. Compared with traditional modeling approaches, our solution innovates by automatic modeling via LLMs while enhancing completeness, delivering significant efficiency and quality advantages.Keywords
Funding Information
- National Key Research and Development Program of China (2023YFC3304904)
This publication has 40 references indexed in Scilit:
- Leveraging LLMs for Domain Modeling: The Impact of Granularity and Strategy on Quality2025
- On the use of large language models in model-driven engineeringSoftware and Systems Modeling, 2025
- Large language models for generative information extraction: a surveyFrontiers of Computer Science, 2024
- LLMs for knowledge graph construction and reasoning: recent capabilities and future opportunitiesWorld Wide Web, 2024
- Advances in automated support for requirements engineering: a systematic literature reviewRequirements Engineering, 2024
- Automated, interactive, and traceable domain modelling empowered by artificial intelligenceSoftware and Systems Modeling, 2022
- A behavior‐driven reliability modeling method for complex smart systemsQuality and Reliability Engineering International, 2021
- Value and benefits of model‐based systems engineering (MBSE): Evidence from the literatureSystems Engineering, 2020
- Opportunities in intelligent modeling assistanceSoftware and Systems Modeling, 2020
- Applying Integrated Domain-Specific Modeling for Multi-concerns Development of Complex Systems2018