Fast Single Image Reflection Removal Using Multi-Stage Scale Space Network
Open Access
- 4 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 146901-146914
Abstract
Images captured in front of a glass obstruction often suffer from degradation due to the presence of reflections. These reflections can be classified as either high transmitted or low transmitted depending upon whether the captured image is dominated by either the background or the reflections respectively. Current approaches either aim to handle only high transmitted reflections or propose to train a unified neural network for addressing both kinds of reflections. However, using a single network to address different types of reflections is not very effective. Further, these methods are also computationally expensive and impractical to deploy on devices with limited resources such as smart-phones. To address these challenges, we present a multi-stage pipeline for single image reflection removal within a scale space framework to address low and high transmitted reflections separately. Specifically, we treat the removal of low transmitted reflections that typically obscure the desired background as an inpainting challenge, while we handle high transmitted reflections using conventional techniques. We use specialized networks for these types of reflections within a scale space architecture that is light weight and is capable of removing reflections from very high resolution images. Our method shows superior performance both qualitatively and quantitatively compared to state of the art methods and our smartphone implementation takes about ~ 5 seconds to generate a high resolution 12 MP image.Keywords
This publication has 62 references indexed in Scilit:
- Polarized reflection removal with dual-stream attention guidancePattern Recognition, 2024
- NRGlassNet: Glass surface detection from visible and near-infrared image pairsKnowledge-Based Systems, 2024
- Two-stage single image reflection removal with reflection-aware guidanceApplied Intelligence, 2023
- Reflection Separation via Multi-bounce Polarization State Tracing2020
- Face Image Reflection RemovalInternational Journal of Computer Vision, 2020
- The Contextual Loss for Image Transformation with Non-aligned Data2018
- Seeing Deeply and Bidirectionally: A Deep Learning Approach for Single Image Reflection Removal2018
- ConvNet-Based Depth Estimation, Reflection Separation and Deblurring of Plenoptic Images2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Separation of Transparent Layers using FocusInternational Journal of Computer Vision, 2000