Toward Blind Flare Removal Using Knowledge-Driven Flare-Level Estimator
- 21 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 33 (10577149) , 6114-6128
Abstract
Lens flare is a common phenomenon when strong light rays arrive at the camera sensor and a clean scene is consequently mixed up with various opaque and semi-transparent artifacts. Existing deep learning methods are always constrained with limited real image pairs for training. Though recent synthesis-based approaches are found effective, synthesized pairs still deviate from the real ones as the mixing mechanism of flare artifacts and scenes in the wild always depends on a line of undetermined factors, such as lens structure, scratches, etc . In this paper, we present a new perspective from the blind nature of the flare removal task in a knowledge-driven manner. Specifically, we present a simple yet effective flare-level estimator to predict the corruption level of a flare-corrupted image. The estimated flare-level can be interpreted as additive information of the gap between corrupted images and their flare-free correspondences to facilitate a network at both training and testing stages adaptively. Besides, we utilize a flare-level modulator to better integrate the estimations into networks. We also devise a flare-aware block for more accurate flare recognition and reconstruction. Additionally, we collect a new real-world flare dataset for benchmarking, namely WiderFlare. Extensive experiments on three benchmark datasets demonstrate that our method outperforms state-of-the-art methods quantitatively and qualitatively.Keywords
This publication has 51 references indexed in Scilit:
- HyRSM++: Hybrid relation guided temporal set matching for few-shot action recognitionPattern Recognition, 2023
- CLIP-guided Prototype Modulating for Few-shot Action RecognitionInternational Journal of Computer Vision, 2023
- Simple Baselines for Image Restoration2022
- Blind Image Decomposition2022
- Unsupervised Night Image Enhancement: When Layer Decomposition Meets Light-Effects Suppression2022
- Nighttime Defogging Using High-Low Frequency Decomposition and Grayscale-Color Networks2020
- Automatic Flare Spot Artifact Detection and Removal in PhotographsJournal of Mathematical Imaging and Vision, 2018
- Single Image Dehazing via Multi-scale Convolutional Neural Networks2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Single Image Layer Separation Using Relative Smoothness2014