External validation of SpineNetv2 deep learning system for automated lumbar spine MRI analysis: A multi-pathology diagnostic agreement study
Open Access
- 8 November 2025
- journal article
- research article
- Published by Springer Nature in European Spine Journal
- Vol. 35 (3) , 1238-1248
Abstract
Background Magnetic resonance imaging (MRI) is the reference standard for evaluating degenerative lumbar spine disorders, but interpretation is time-consuming and subject to inter-observer variability. SpineNetv2, a publicly available deep learning system, enables automated analysis of multiple spinal pathologies. This study conducted an independent external validation of SpineNetv2 against expert reference assessments. Methods A total of 491 patients (2,455 lumbar discs, L1/2–L5/S1) were retrospectively included. Disc-level reference assessments were provided by an expert orthopedic surgeon, with a junior orthopedic surgeon serving as comparator. Six pathologies were assessed: disc degeneration (Pfirrmann grading), central canal stenosis (CCS), spondylolisthesis, herniation, and bilateral foraminal stenosis (FS). Performance metrics included sensitivity, specificity, positive predictive value, negative predictive value, F1-score, Matthews correlation coefficient, exact agreement, weighted kappa, and mean absolute error. McNemar’s test and bootstrap resampling (1,000 iterations) were used for statistical analysis. Results Overall agreement ranged from 83.5% to 97.5% (mean 92.8%). SpineNetv2 significantly outperformed the junior orthopedic surgeon in CCS, spondylolisthesis, and bilateral FS (all p ≤ 0.001), with comparable performance in herniation (p = 0.293). Pfirrmann grading showed lower MAE for SpineNetv2 compared with the junior surgeon (0.213 vs. 0.254, p = 0.001), though agreement declined in older patients and upper lumbar discs. Error analysis revealed a specificity-oriented profile, with false negatives exceeding false positives. Conclusions SpineNetv2 demonstrated high agreement across five binary lumbar pathologies, while Pfirrmann grading remained the main limitation, particularly in elderly upper lumbar discs. Its specificity-oriented profile supports use as a confirmatory second reader, but reliance on negative findings is not recommended. Broader reliability will require multicenter, multi-reader validation and sensitivity-oriented calibration.Keywords
All Related Versions
Funding Information
- Guizhou Provincial Department of Science and Technology (No. QKHRC-KJZY[2025]036)
- Guizhou Provincial Department of Science and Technology (Qiankehe Foundation-ZK [2024] General-347)
- Zunyi Science and Technology bureau (Zunshi Kehe HZ (2024) No. 432 and 442)
This publication has 32 references indexed in Scilit:
- Advances and challenges in AI-assisted MRI for lumbar disc degeneration detection and classificationEuropean Spine Journal, 2025
- Automated Three-Dimensional Imaging and Pfirrmann Classification of Intervertebral Disc Using a Graphical Neural Network in Sagittal Magnetic Resonance Imaging of the Lumbar SpineJournal of Imaging Informatics in Medicine, 2024
- Automated magnetic resonance imaging‐based grading of the lumbar intervertebral disc and facet jointsJOR SPINE, 2024
- Relation of lumbar intervertebral disc height and severity of disc degeneration based on Pfirrmann scoresHeliyon, 2023
- Deep learning-based high-accuracy detection for lumbar and cervical degenerative disease on T2-weighted MR imagesEuropean Spine Journal, 2023
- External validation of the deep learning system “SpineNet” for grading radiological features of degeneration on MRIs of the lumbar spineEuropean Spine Journal, 2022
- Recent advances and clinical applications of deep learning in medical image analysisMedical Image Analysis, 2022
- Degenerative disc disease diagnosis from lumbar MR images using hybrid featuresThe Visual Computer, 2021
- ISSLS PRIZE IN BIOENGINEERING SCIENCE 2017: Automation of reading of radiological features from magnetic resonance images (MRIs) of the lumbar spine without human intervention is comparable with an expert radiologistEuropean Spine Journal, 2017
- High-intensity zone (HIZ) of lumbar intervertebral disc on T2-weighted magnetic resonance images: spatial distribution, and correlation of distribution with low back pain (LBP)European Spine Journal, 2012