Towards a robust and compact deep learning system for primary detection of early Barrett’s neoplasia: Initial image‐based results of training on a multi‐center retrospectively collected data set
Open Access
- 24 April 2023
- journal article
- research article
- Published by Wiley in United European Gastroenterology Journal
- Vol. 11 (4) , 324-336
Abstract
Introduction: Endoscopic detection of early neoplasia in Barrett's esophagus is difficult. Computer Aided Detection (CADe) systems may assist in neoplasia detection. The aim of this study was to report the first steps in the development of a CADe system for Barrett's neoplasia and to evaluate its performance when compared with endoscopists.Methods: This CADe system was developed by a consortium, consisting of the Amsterdam University Medical Center, Eindhoven University of Technology, and 15 international hospitals. After pretraining, the system was trained and validated using 1.713 neoplastic (564 patients) and 2.707 non‐dysplastic Barrett's esophagus (NDBE; 665 patients) images. Neoplastic lesions were delineated by 14 experts. The performance of the CADe system was tested on three independent test sets. Test set 1 (50 neoplastic and 150 NDBE images) contained subtle neoplastic lesions representing challenging cases and was benchmarked by 52 general endoscopists. Test set 2 (50 neoplastic and 50 NDBE images) contained a heterogeneous case‐mix of neoplastic lesions, representing distribution in clinical practice. Test set 3 (50 neoplastic and 150 NDBE images) contained prospectively collected imagery. The main outcome was correct classification of the images in terms of sensitivity.Results: The sensitivity of the CADe system on test set 1 was 84%. For general endoscopists, sensitivity was 63%, corresponding to a neoplasia miss‐rate of one‐third of neoplastic lesions and a potential relative increase in neoplasia detection of 33% for CADe‐assisted detection. The sensitivity of the CADe system on test sets 2 and 3 was 100% and 88%, respectively. The specificity of the CADe system varied for the three test sets between 64% and 66%.Conclusion: This study describes the first steps towards the establishment of an unprecedented data infrastructure for using machine learning to improve the endoscopic detection of Barrett's neoplasia. The CADe system detected neoplasia reliably and outperformed a large group of endoscopists in terms of sensitivity.Keywords
This publication has 13 references indexed in Scilit:
- Blue-light imaging and linked-color imaging improve visualization of Barrett’s neoplasia by nonexpert endoscopistsGastrointestinal Endoscopy, 2020
- Deep-Learning System Detects Neoplasia in Patients With Barrett’s Esophagus With Higher Accuracy Than Endoscopists in a Multistep Training and Validation Study With BenchmarkingGastroenterology, 2020
- An Interactive Web-Based Educational Tool Improves Detection and Delineation of Barrett’s Esophagus–Related NeoplasiaGastroenterology, 2019
- Early esophageal adenocarcinoma detection using deep learning methodsInternational Journal of Computer Assisted Radiology and Surgery, 2019
- Computer-aided diagnosis using deep learning in the evaluation of early oesophageal adenocarcinomaGut, 2018
- MobileNetV2: Inverted Residuals and Linear Bottlenecks2018
- Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning modelGut, 2017
- Endoscopic management of Barrett’s esophagus: European Society of Gastrointestinal Endoscopy (ESGE) Position StatementEndoscopy, 2017
- Detection of lesions in dysplastic Barrett’s esophagus by community and expert endoscopistsEndoscopy, 2016
- American Gastroenterological Association Medical Position Statement on the Management of Barrett's EsophagusGastroenterology, 2011