A two-stage HDR reconstruction pipeline for extreme dark-light RGGB images
Open Access
- 22 January 2025
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 15 (1) , 1-17
Abstract
RGGB sensor arrays are commonly used in digital cameras and mobile photography. However, images of extreme dark-light conditions often suffer from insufficient exposure because the sensor receives insufficient light. The existing methods mainly employ U-Net variants, multi-stage camera parameter simulation, or image parameter processing to address this issue. However, those methods usually apply color adjustments evenly across the entire image, which may cause extensive blue or green noise artifacts, especially in images with dark backgrounds. This study attacks the problem by proposing a novel multi-step process for image enhancement. The pipeline starts with a self-attention U-Net for initial color restoration and applies a Color Correction Matrix (CCM). Thereafter, High Dynamic Range (HDR) image reconstruction techniques are utilized to improve exposure using various Camera Response Functions (CRFs). After removing under- and over-exposed frames, pseudo-HDR images are created through multi-frame fusion. Also, a comparative analysis is conducted based on a standard dataset, and the results show that the proposed approach performs better in creating well-exposed images and improves the Peak-Signal-to-Noise Ratio (PSNR) by 0.16 dB compared to the benchmark methods.Keywords
This publication has 51 references indexed in Scilit:
- Multi-exposure optimized contrast and brightness balance color image enhancementDigital Signal Processing, 2022
- Learning digital camera pipeline for extreme low-light imagingNeurocomputing, 2021
- Fuzzy dissimilarity contextual intensity transformation with gamma correction for color image enhancementMultimedia Tools and Applications, 2020
- Deep Recursive HDRI: Inverse Tone Mapping Using Generative Adversarial Networks2018
- Deep Burst Denoising2018
- RENOIR – A dataset for real low-light image noise reductionJournal of Visual Communication and Image Representation, 2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- A smoothing stochastic gradient method for composite optimizationOptimization Methods and Software, 2014
- Physiological inverse tone mapping based on retina responseThe Visual Computer, 2013
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992