Data-efficient Neuroradiology MRI Imaging Protocol Prediction Using Open-weights Large Language Models
Open Access
- 14 July 2026
- journal article
- research article
- Published by Springer Nature in Clinical Neuroradiology
- p. 1-10
Abstract
Purpose: To evaluate the feasibility of a locally deployable large language model (LLM) system for automated MRI protocol selection addressing data privacy, annotation burden, and scalability limitations. Methods: This retrospective study included 598 German-language MRI order entries from three neuroradiology domains (brain, head/neck, spine) between June 2018 and January 2023. A radiologist labeled entries for 27 protocol classes based on institutional standard operating procedures (SOP). An SOP-grounded AI system using MedGemma 27B was developed to predict the MRI protocol from the order entry. The system was optimized using Stochastic Introspective Mini-Batch Ascent (SIMBA), a self-reflective prompt optimization algorithm, and compared with a hierarchical system that first classified the body region and then the MRI protocol. Data efficiency was evaluated using training subsets of 10–119 examples across 3 optimization runs per subset size. Results: The flat zero-shot model achieved 73.07% accuracy in the three-domain setting on the held-out dataset ( n = 479). In the hierarchical model, prompt optimization yielded 73.90% ± 3.24% with 30 labeled examples and a maximum of 74.46% ± 3.82% but did not outperform the flat approach. Prompt optimization benefited the hierarchical system, whereas the flat model already performed strongly without labeled examples for optimization. Performance on brain and head/neck cases remained broadly stable after expansion from 22 to 27 protocol classes, i.e., including spine. Conclusion: A locally deployable SOP-grounded open-weight LLM can support MRI protocol selection while preserving data privacy and needing minimal labeled data. In this dataset, hierarchical routing and prompt optimization did not improve overall performance over the flat baseline, although they altered optimization behavior and error profile. These findings support prospective evaluation in human-in-the-loop clinical workflows.Keywords
Funding Information
- Universitätsklinikum Düsseldorf. Anstalt öffentlichen Rechts
This publication has 23 references indexed in Scilit:
- Automated Protocol Suggestions for Cranial MRI Examinations Using Locally Fine-tuned BERT ModelsClinical Neuroradiology, 2025
- Automated MRI protocoling in neuroradiology in the era of large language modelsLa radiologia medica, 2025
- Machine Learning and Deep Learning Models for Automated Protocoling of Emergency Brain MRI Using Text from Clinical ReferralsRadiology: Artificial Intelligence, 2025
- Efficacy of Fine-Tuned Large Language Model in CT Protocol Assignment as Clinical Decision-Supporting SystemJournal of Imaging Informatics in Medicine, 2025
- Abdominal and Pelvic MRI Protocol Prediction Using Natural Language ProcessingJournal of Imaging Informatics in Medicine, 2025
- Reproducibility and across-site transferability of an improved deep learning approach for aneurysm detection and segmentation in time-of-flight MR-angiogramsScientific Reports, 2024
- GPT-4 for Automated Determination of Radiologic Study and Protocol Based on Radiology Request Forms: A Feasibility StudyRadiology, 2023
- Automated Protocoling for MRI Exams—Challenges and SolutionsJournal of Digital Imaging, 2022
- Optimization of Radiology Workflow with Artificial IntelligenceRadiologic Clinics of North America, 2021
- Identification of Neuroradiology MRI Protocol Errors via a Quality-Driven Categorization ApproachJournal of the American College of Radiology, 2016