Depth Information-Based Automatic Annotation of Early Esophageal Cancers in Gastroscopic Images Using Deep Learning Techniques
Open Access
- 22 May 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 97907-97919
Abstract
The early diagnoses of esophageal cancer are of great significance in the clinic because they are critical for reducing mortality. At present, the diagnoses are mainly performed by artificial detection and annotations based on gastroscopic images. However, these procedures are very challenging to clinicians due to the large variability in the appearance of early cancer lesions. To reduce the subjectivity and fatigue in manual annotations and to improve the efficiency of diagnoses, computer-aided annotation methods are highly required. In this work, we proposed a novel method that utilized deep learning (DL) techniques to realize the automatic annotation of early esophageal cancer (EEC) lesions in gastroscopic images. The depth map of gastroscopic images was initially extracted by a DL network. Then, this additional depth information was fused with the original RGB gastroscopic images, which were then sent to another DL network to obtain precise annotations of EEC regions. In total, 4231 gastroscopic images of 732 patients were used to build and validate the proposed method. A total of 3190 of those images were EEC images, and the remaining 1041 were non-EEC images. The experimental results show that the combination of depth information and RGB information improved the annotation performance. The final EEC detection rate and mean Dice Similarity Coefficient (DSC) of our method were 97.54% and 74.43%, respectively. Compared with other state-of-the-art DL-based methods, the proposed method showed better annotation performances and fewer false positive outputs. Therefore, our method offers a good prospect in aiding the clinical diagnoses of EEC.Keywords
Funding Information
- National Natural Science Foundation of China (61872405, 61720106004)
- Key Project of Natural Science Foundation of Guangdong Province (2016A030311040)
- Scientific Platform Improvement Project of UESTC
This publication has 28 references indexed in Scilit:
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Identification of lesion images from gastrointestinal endoscope based on feature extraction of combinational methods with and without learning processMedical Image Analysis, 2016
- Computer-Aided Classification of Gastrointestinal Lesions in Regular ColonoscopyIEEE Transactions on Medical Imaging, 2016
- Software for enhanced video capsule endoscopy: challenges for essential progressNature Reviews Gastroenterology & Hepatology, 2015
- Esophageal Cancer: Priorities for PreventionCurrent Epidemiology Reports, 2014
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- A Review of Machine-Vision-Based Analysis of Wireless Capsule Endoscopy VideoDiagnostic and Therapeutic Endoscopy, 2012
- Curative endoscopic resection of early esophageal adenocarcinomas (Barrett's cancer)Gastrointestinal Endoscopy, 2007
- Measures of the Amount of Ecologic Association Between SpeciesEcology, 1945