A Hessian-Based Technique for Specular Reflection Detection and Inpainting in Colonoscopy Images
- 24 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 28 (8) , 4724-4736
Abstract
In the field of Computer-Aided Detection (CADx), the use of AI-based algorithms for disease detection in endoscopy images, especially colonoscopy images, is on the rise. However, these algorithms often encounter performance issues due to obstructions like specular reflection, resulting in false positives. This paper presents a novel algorithm specifically designed to tackle the challenges posed by high specular reflection regions in colonoscopy images. The proposed algorithm identifies these regions and applies precise inpainting for restoration. The process entails converting the input image from RGB to HSV color space and focusing on the Saturation (S) component in convex regions detected using a Hessian-based method. This step creates a binary mask that pinpoints areas of specular reflection. The inpainting function then uses this mask to guide the restoration of these identified regions and their borders. To ensure a seamless blend of the restored regions with the background and adjacent pixels, a feathering process is applied to the repaired regions. This enhances both the accuracy and aesthetic coherence of the inpainted images. The performance of our algorithm was rigorously tested on five unique colonoscopy datasets and various endoscopy images from the HyperKvasir dataset, using an extensive set of evaluation metrics and a comparative analysis with existing methods consistently highlighted the superior performance of our algorithm.Keywords
Funding Information
- Swinburne University of Technology Sarawak Higher Degree
This publication has 40 references indexed in Scilit:
- Towards High-Resolution Specular Highlight DetectionInternational Journal of Computer Vision, 2023
- Enhancing Wireless Capsule Endoscopy images from intense illumination specular reflections using the homomorphic filterBiomedical Signal Processing and Control, 2023
- Effect of interpolation on specular reflections in texture-based automatic colonic polyp detectionInternational Journal of Imaging Systems and Technology, 2021
- An improved image quality algorithm for exemplar-based image inpaintingMultimedia Tools and Applications, 2021
- NeoUNet : Towards Accurate Colon Polyp Segmentation and Neoplasm Detection2021
- Deep learning to find colorectal polyps in colonoscopy: A systematic literature reviewArtificial Intelligence in Medicine, 2020
- Content-aware specular reflection suppression based on adaptive image inpainting and neural network for endoscopic imagesComputer Methods and Programs in Biomedicine, 2020
- Kvasir-SEG: A Segmented Polyp Dataset2019
- Distribution of colorectal polyps: Implications for screeningBest Practice & Research Clinical Gastroenterology, 2017
- Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancerInternational Journal of Computer Assisted Radiology and Surgery, 2013