Systematic scoping review of external validation studies of AI pathology models for lung cancer diagnosis
Open Access
- 7 June 2025
- journal article
- review article
- Published by Springer Nature in npj Precision Oncology
- Vol. 9 (1) , 1-11
Abstract
Clinical adoption of digital pathology-based artificial intelligence models for diagnosing lung cancer has been limited, partly due to lack of robust external validation. This review provides an overview of such tools, their performance and external validation. We systematically searched for external validation studies in medical, engineering and grey literature databases from 1st January 2010 to 31st October 2024. 22 studies were included. Models performed various tasks, including classification of malignant versus non-malignant tissue, tumour growth pattern classification and subtyping of adeno- versus squamous cell carcinomas. Subtyping models were most common and performed highly, with average AUC values ranging from 0.746 to 0.999. Although most studies used restricted datasets, methodological issues relevant to the applicability of models in real-world settings included small and/or non-representative datasets, retrospective studies and case-control studies without further real-world validation. Ultimately, more rigorous external validation of models is warranted for increased clinical adoption.Keywords
Funding Information
- Barts Charity (G-001522, MGU0461, G-001522, G-001522, MGU0461)
This publication has 49 references indexed in Scilit:
- Making Pathologists Ready for the New Artificial Intelligence Era: Changes in Required CompetenciesLaboratory Investigation, 2024
- SAMPLER: unsupervised representations for rapid analysis of whole slide tissue imagesEBioMedicine, 2023
- Current and Future Perspectives on Computed Tomography Screening for Lung Cancer: A Roadmap From 2023 to 2027 From the International Association for the Study of Lung CancerJournal of Thoracic Oncology, 2023
- E2EFP-MIL: End-to-end and high-generalizability weakly supervised deep convolutional network for lung cancer classification from whole slide imageMedical Image Analysis, 2023
- Artificial intelligence–assisted cancer diagnosis improves the efficiency of pathologists in prostatic biopsiesVirchows Archiv, 2023
- A whole-slide image (WSI)-based immunohistochemical feature prediction system improves the subtyping of lung cancerLung Cancer, 2022
- AI-based carcinoma detection and classification using histopathological images: A systematic reviewComputers in Biology and Medicine, 2022
- External validation of clinical prediction models: simulation-based sample size calculations were more reliable than rules-of-thumbJournal of Clinical Epidemiology, 2021
- ConvPath: A software tool for lung adenocarcinoma digital pathological image analysis aided by a convolutional neural networkEBioMedicine, 2019
- Sample size calculation should be performed for design accuracy in diagnostic test studiesJournal of Clinical Epidemiology, 2005