Computer-aided diagnostic system with automated deep learning method based on the AutoGluon framework improved the diagnostic accuracy of early esophageal cancer
Authors:
Open Access
- 1 April 2024
- journal article
- research article
- Published by AME Publishing Company in Journal of Gastrointestinal Oncology
- Vol. 15 (2) , 535-543
Abstract
Background: There have been studies on the application of computer-aided diagnosis (CAD) in the endoscopic diagnosis of early esophageal cancer (EEC), but there is still a significant gap from clinical application. We developed an endoscopic CAD system for EEC based on the AutoGluon framework, aiming to explore the feasibility of automatic deep learning (DL) in clinical application. Methods: The endoscopic pictures of normal esophagus, esophagitis, and EEC were collected from The First Affiliated Hospital of Soochow University (September 2015 to December 2021) and the Norwegian HyperKvasir database. All images of non-cancerous esophageal lesions and EEC in this study were pathologically examined. There were three tasks: task A was normal vs. lesion classification under non-magnifying endoscopy (n=932 vs. 1,092); task B was non-cancer lesion vs. EEC classification under non-magnifying endoscopy (n=594 vs. 429); and task C was non-cancer lesion vs. EEC classification under magnifying endoscopy (n=505 vs. 824). In all classification tasks, we took 100 pictures as the verification set, and the rest comprised as the training set. The CAD system was established based on the AutoGluon framework. Diagnostic performance of the model was compared with that of endoscopists grouped according to years of experience (senior >15 years; junior Results: In tasks A and B, the accuracies of medium-performance CAD and high-performance CAD were lower than those of junior doctors and senior doctors. In task C, the medium-performance and high-performance CAD accuracies were close to those of junior doctors and senior doctors. The high-performance CAD model outperformed the junior doctors in both task A (0.850 vs. 0.830) and task C (0.840 vs. 0.830) in sensitivity comparison, but there was still a large gap between high-performance CAD models and doctors in sensitivity comparison. In task A, with the aid of CAD pre-interpretation, the accuracy of junior and senior physicians were significantly improved (from 0.880 to 0.915 and from 0.920 to 0.945, respectively); the time spent on film reading was significantly shortened (junior: from 11.3 to 8.7 s; senior: from 6.7 to 5.5 s). In task C, with the aid of CAD pre-interpretation, the accuracy of junior and senior physicians were significantly improved (from 0.850 to 0.865 and from 0.915 to 0.935, respectively); the reading time was significantly shortened (junior: from 9.5 to 7.7 s; senior: from 5.6 to 3.0 s). Conclusions: The CAD system based on the AutoGluon framework can assist doctors to improve the diagnostic accuracy and reading time of EEC under endoscopy. This study reveals that automatic DL methods are promising in clinical application.Keywords
This publication has 32 references indexed in Scilit:
- COVID-19 Mortality Prediction From Deep Learning in a Large Multistate Electronic Health Record and Laboratory Information System Data Set: Algorithm Development and ValidationJournal of Medical Internet Research, 2021
- Forecasting the Walking Assistance Rehabilitation Level of Stroke Patients Using Artificial IntelligenceDiagnostics, 2021
- Esophageal squamous dysplasia and cancer: Is artificial intelligence our best weapon?Best Practice & Research Clinical Gastroenterology, 2021
- Endoscopistsʼ diagnostic accuracy in detecting upper gastrointestinal neoplasia in the framework of artificial intelligence studiesEndoscopy, 2021
- Comparative study on artificial intelligence systems for detecting early esophageal squamous cell carcinoma between narrow-band and white-light imagingWorld Journal of Gastroenterology, 2021
- Automatic classification of esophageal lesions in endoscopic images using a convolutional neural networkAnnals of Translational Medicine, 2020
- Deep-Learning System Detects Neoplasia in Patients With Barrett’s Esophagus With Higher Accuracy Than Endoscopists in a Multistep Training and Validation Study With BenchmarkingGastroenterology, 2020
- Endoscopic detection and differentiation of esophageal lesions using a deep neural networkGastrointestinal Endoscopy, 2020
- Screening for esophageal squamous cell carcinoma: recent advancesGastrointestinal Endoscopy, 2018
- Cancer statistics in China, 2015CA: A Cancer Journal for Clinicians, 2016