Real-Time Attentive Dilated U-Net for Extremely Dark Image Enhancement
Open Access
- 12 June 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 20 (8) , 1-19
Abstract
Images taken under low-light conditions suffer from poor visibility, color distortion, and graininess, all of which degrade the image quality and hamper the performance of downstream vision tasks, such as object detection and instance segmentation in the field of autonomous driving, making low-light enhancement an indispensable basic component of high-level visual tasks. Low-light enhancement aims to mitigate these issues, and has garnered extensive attention and research over several decades. The primary challenge in low-light image enhancement arises from the low signal-to-noise ratio caused by insufficient lighting. This challenge becomes even more pronounced in near-zero lux conditions, where noise overwhelms the available image information. Both traditional image signal processing pipeline and conventional low-light image enhancement methods struggle in such scenarios. Recently, deep neural networks have been used to address this challenge. These networks take unmodified RAW images as input and produce the enhanced sRGB images, forming a deep learning based image signal processing pipeline. However, most of these networks are computationally expensive and thus far from practical use. In this article, we propose a lightweight model called attentive dilated U-Net (ADU-Net) to tackle this issue. Our model incorporates several innovative designs, including an asymmetric U-shape architecture, dilated residual modules for feature extraction, and attentive fusion modules for feature fusion. The dilated residual modules provide strong representative capability, whereas the attentive fusion modules effectively leverage low-level texture information and high-level semantic information within the network. Both modules employ a lightweight design but offer significant performance gains. Extensive experiments demonstrate that our method is highly effective, achieving an excellent balance between image quality and computational complexity—that is, taking less than 4ms for a high-definition 4K image on a single GTX 1080Ti GPU and yet maintaining competitive visual quality. Furthermore, our method exhibits pleasing scalability and generalizability, highlighting its potential for widespread applicability.Keywords
Funding Information
- Intelligent Enhancement Technology for Night Scene Research Fund (21AZ0501)
This publication has 51 references indexed in Scilit:
- RawFormer: An Efficient Vision Transformer for Low-Light RAW Image EnhancementIEEE Signal Processing Letters, 2022
- BrightFormer: A transformer to brighten the imageComputers & Graphics, 2022
- Getting to know low-light images with the Exclusively Dark datasetComputer Vision and Image Understanding, 2019
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Visualizing and Understanding Convolutional Networks2014
- Brightness Preserving Dynamic Histogram Equalization for Image Contrast EnhancementIEEE Transactions on Consumer Electronics, 2007
- A multiscale retinex for bridging the gap between color images and the human observation of scenesIEEE Transactions on Image Processing, 1997
- The JPEG still picture compression standardIEEE Transactions on Consumer Electronics, 1992
- Adaptive histogram equalization and its variationsComputer Vision, Graphics, and Image Processing, 1987
- THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATABiometrika, 1948