NanoNet: Real-Time Polyp Segmentation in Video Capsule Endoscopy and Colonoscopy
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 37-43
Abstract
Deep learning in gastrointestinal endoscopy can assist to improve clinical performance and be helpful to assess lesions more accurately. To this extent, semantic segmentation methods that can perform automated real-time delineation of a region-of-interest, e.g., boundary identification of cancer or pre-cancerous lesions, can benefit both diagnosis and interventions. However, accurate and real-time segmentation of endoscopic images is extremely challenging due to its high operator dependence and high-definition image quality. To utilize automated methods in clinical settings, it is crucial to design lightweight models with low latency such that they can be integrated with low-end endoscope hardware devices. In this work, we propose NanoNet, a novel architecture for the segmentation of video capsule endoscopy and colonoscopy images. Our proposed architecture allows real-time performance and has higher segmentation accuracy compared to other more complex ones. We use video capsule endoscopy and standard colonoscopy datasets with polyps, and a dataset consisting of endoscopy biopsies and surgical instruments, to evaluate the effectiveness of our approach. Our experiments demonstrate the increased performance of our architecture in terms of a trade-off between model complexity, speed, model parameters, and metric performances. Moreover, the resulting models' size is relatively tiny, with only nearly 36,000 parameters compared to traditional deep learning approaches having millions of parameters.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic SegmentationIEEE Transactions on Intelligent Transportation Systems, 2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Polyp Detection and Segmentation from Video Capsule Endoscopy: A ReviewJournal of Imaging, 2016
- Deep Residual Learning for Image Recognition2016
- WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physiciansComputerized Medical Imaging and Graphics, 2015
- Towards automatic polyp detection with a polyp appearance modelPattern Recognition, 2012
- ImageNet: A large-scale hierarchical image database2009
- Texture-Based Polyp Detection in Colonoscopy2009
- Video Capsule Endoscopy in Inflammatory Bowel DiseaseInflammatory Bowel Diseases, 2004
- Computer-aided tumor detection in endoscopic video using color wavelet featuresIEEE Transactions on Information Technology in Biomedicine, 2003