A Closer Look at the Reflection Formulation in Single Image Reflection Removal
- 4 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 33 (10577149) , 625-638
Abstract
How to model the effect of reflection is crucial for single image reflection removal (SIRR) task. Modern SIRR methods usually simplify the reflection formulation with the assumption of linear combination of a transmission layer and a reflection layer. However, the large variations in image content and the real-world picture-taking conditions often result in far more complex reflection. In this paper, we introduce a new screen-blur combination based on two important factors, namely the intensity and the blurriness of reflection, to better characterize the reflection formulation in SIRR. Specifically, we present Screen-blur Reflection Networks (SRNet), which executes the screen-blur formulation in its network design and adapts to the complex reflection on real scenes. Technically, SRNet consists of three components: a blended image generator, a reflection estimator and a reflection removal module. The image generator exploits the screen-blur combination to synthesize the training blended images. The reflection estimator learns the reflection layer and a blur degree that measures the level of blurriness for reflection. The reflection removal module further uses the blended image, blur degree and reflection layer to filter out the transmission layer in a cascaded manner. Superior results on three different SIRR methods are reported when generating the training data on the principle of the screen-blur combination. Moreover, extensive experiments on six datasets quantitatively and qualitatively demonstrate the efficacy of SRNet over the state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (62225207, U19B2038)
This publication has 62 references indexed in Scilit:
- Image Inpainting with Cascaded Modulation GAN and Object-Aware Training2022
- CRRN: Multi-scale Guided Concurrent Reflection Removal Network2018
- Single Image Reflection Suppression2017
- Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Reflection Removal Using Low-Rank Matrix Completion2017
- Robust Separation of Reflection from Multiple Images2014
- Single Image Layer Separation Using Relative Smoothness2014
- Defocus map estimation from a single imagePattern Recognition, 2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009