WCE Polyp Detection with Triplet based Embeddings
Authors:
- Pablo LaizPLPablo Laiz
- Jordi VitriàJVJordi Vitrià
- Hagen WenzekHWHagen Wenzek
- Carolina MalageladaCMCarolina Malagelada
- Fernando AzpirozFAFernando Azpiroz
- Santi SeguíSSSanti Seguí
Preprint
Abstract
Wireless capsule endoscopy is a medical procedure used to visualize the entire gastrointestinal tract and to diagnose intestinal conditions, such as polyps or bleeding. Current analyses are performed by manually inspecting nearly each one of the frames of the video, a tedious and error-prone task. Automatic image analysis methods can be used to reduce the time needed for physicians to evaluate a capsule endoscopy video, however these methods are still in a research phase. In this paper we focus on computer-aided polyp detection in capsule endoscopy images. This is a challenging problem because of the diversity of polyp appearance, the imbalanced dataset structure and the scarcity of data. We have developed a new polyp computer-aided decision system that combines a deep convolutional neural network and metric learning. The key point of the method is the use of the triplet loss function with the aim of improving feature extraction from the images when having small dataset. The triplet loss function allows to train robust detectors by forcing images from the same category to be represented by similar embedding vectors while ensuring that images from different categories are represented by dissimilar vectors. Empirical results show a meaningful increase of AUC values compared to baseline methods. A good performance is not the only requirement when considering the adoption of this technology to clinical practice. Trust and explainability of decisions are as important as performance. With this purpose, we also provide a method to generate visual explanations of the outcome of our polyp detector. These explanations can be used to build a physician's trust in the system and also to convey information about the inner working of the method to the designer for debugging purposes.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- CapsoCam SV-1 Versus PillCam SB 3 in the Detection of Obscure Gastrointestinal BleedingJournal of Clinical Gastroenterology, 2019
- Novel computer-assisted diagnosis system for endoscopic disease activity in patients with ulcerative colitisGastrointestinal Endoscopy, 2019
- Fully automated diagnostic system with artificial intelligence using endocytoscopy to identify the presence of histologic inflammation associated with ulcerative colitis (with video)Gastrointestinal Endoscopy, 2019
- Follow-up on: optimizing lesion detection in small bowel capsule endoscopy and beyond: from present problems to future solutionsExpert Review of Gastroenterology & Hepatology, 2018
- RIIS-DenseNet: Rotation-Invariant and Image Similarity Constrained Densely Connected Convolutional Network for Polyp Detection2018
- Data augmentation for improving deep learning in image classification problem2018
- Deep learning for polyp recognition in wireless capsule endoscopy imagesMedical Physics, 2017
- Deep feature learning with relative distance comparison for person re-identificationPattern Recognition, 2015
- Adaptable image cuts for motility inspection using WCEComputerized Medical Imaging and Graphics, 2013
- Automatic polyp detection for wireless capsule endoscopy imagesExpert Systems with Applications, 2012