Diagnosing Solid Lesions in the Pancreas With Multimodal Artificial Intelligence
Authors:
Top Cited Papers
Open Access
- 1 July 2024
- journal article
- research article
- Published by American Medical Association (AMA) in JAMA Network Open
- Vol. 7 (7) , e2422454
Abstract
Importance: Diagnosing solid lesions in the pancreas via endoscopic ultrasonographic (EUS) images is challenging. Artificial intelligence (AI) has the potential to help with such diagnosis, but existing AI models focus solely on a single modality.Objective: To advance the clinical diagnosis of solid lesions in the pancreas through developing a multimodal AI model integrating both clinical information and EUS images.Design, Setting, and Participants: In this randomized crossover trial conducted from January 1 to June 30, 2023, from 4 centers across China, 12 endoscopists of varying levels of expertise were randomly assigned to diagnose solid lesions in the pancreas with or without AI assistance. Endoscopic ultrasonographic images and clinical information of 439 patients from 1 institution who had solid lesions in the pancreas between January 1, 2014, and December 31, 2022, were collected to train and validate the joint-AI model, while 189 patients from 3 external institutions were used to evaluate the robustness and generalizability of the model.Intervention: Conventional or AI-assisted diagnosis of solid lesions in the pancreas.Main Outcomes and Measures: In the retrospective dataset, the performance of the joint-AI model was evaluated internally and externally. In the prospective dataset, diagnostic performance of the endoscopists with or without the AI assistance was compared.Results: The retrospective dataset included 628 patients (400 men [63.7%]; mean [SD] age, 57.7 [27.4] years) who underwent EUS procedures. A total of 130 patients (81 men [62.3%]; mean [SD] age, 58.4 [11.7] years) were prospectively recruited for the crossover trial. The area under the curve of the joint-AI model ranged from 0.996 (95% CI, 0.993-0.998) in the internal test dataset to 0.955 (95% CI, 0.940-0.968), 0.924 (95% CI, 0.888-0.955), and 0.976 (95% CI, 0.942-0.995) in the 3 external test datasets, respectively. The diagnostic accuracy of novice endoscopists was significantly enhanced with AI assistance (0.69 [95% CI, 0.61-0.76] vs 0.90 [95% CI, 0.83-0.94]; P < .001), and the supplementary interpretability information alleviated the skepticism of the experienced endoscopists.Conclusions and Relevance: In this randomized crossover trial of diagnosing solid lesions in the pancreas with or without AI assistance, the joint-AI model demonstrated positive human-AI interaction, which suggested its potential to facilitate a clinical diagnosis. Nevertheless, future randomized clinical trials are warranted.Trial Registration: ClinicalTrials.gov Identifier: NCT05476978Keywords
This publication has 30 references indexed in Scilit:
- Interstitial lung disease diagnosis and prognosis using an AI system integrating longitudinal dataNature Communications, 2023
- Artificial intelligence for multimodal data integration in oncologyCancer Cell, 2022
- Advances in the epidemiology of pancreatic cancer: Trends, risk factors, screening, and prognosisCancer Letters, 2021
- Artificial intelligence for clinical oncologyCancer Cell, 2021
- Pancreatic cancerThe Lancet, 2020
- Repeat EUS-FNA of pancreatic masses after nondiagnostic or inconclusive results: systematic review and meta-analysisGastrointestinal Endoscopy, 2020
- Diagnosis and Management of Chronic PancreatitisJAMA, 2019
- Impact of endoscopic ultrasonography on diagnosis of pancreatic cancerJournal of Gastroenterology, 2018
- EUS-guided FNA for diagnosis of solid pancreatic neoplasms: a meta-analysisGastrointestinal Endoscopy, 2012
- The place of endoscopic ultrasound in bilio-pancreatic pathologyGastroentérologie Clinique Et Biologique, 2010