Semantic-Guided Zero-Shot Learning for Low-Light Image/Video Enhancement
Authors:
- 1 January 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 581-590
Abstract
Low-light images challenge both human perceptions and computer vision algorithms. It is crucial to make algorithms robust to enlighten low-light images for computational photography and computer vision applications such as real-time detection and segmentation. This paper proposes a semantic-guided zero-shot low-light enhancement network (SGZ) which is trained in the absence of paired images, unpaired datasets, and segmentation annotation. Firstly, we design an enhancement factor extraction network using depthwise separable convolution for an efficient estimate of the pixel-wise light deficiency of an low-light image. Secondly, we propose a recurrent image enhancement network to progressively enhance the low-light image with affordable model size. Finally, we introduce an unsupervised semantic segmentation network for preserving the semantic information during intensive enhancement. Extensive experiments on benchmark datasets and a low-light video demonstrate that our model outperforms the previous state-of-the-art. We further discuss the benefits of the proposed method for low-light detection and segmentation. Code is available at https://github.com/ShenZheng2000/SemanticGuided-Low-Light-Image-Enhancement.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- LLNet: A deep autoencoder approach to natural low-light image enhancementPattern Recognition, 2017
- A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance EstimationIEEE Transactions on Image Processing, 2015
- Perceptual Quality Assessment for Multi-Exposure Image FusionIEEE Transactions on Image Processing, 2015
- Deblurring Low-Light Images with Light Streaks2014
- The Role of Context for Object Detection and Semantic Segmentation in the Wild2014
- Contrast enhancement based on layered difference representation2012
- Automatic Exposure Correction of Consumer Photographs2012
- Adaptive total variation denoising based on difference curvatureImage and Vision Computing, 2010
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- The Retinex Theory of Color VisionScientific American, 1977