Wakeup-Darkness: When Multimodal Meets Unsupervised Low-Light Image Enhancement
Open Access
- 19 February 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 21 (3) , 1-25
Abstract
Low-light image enhancement is a crucial visual task, and many unsupervised methods overlook the degradation of visible information in low-light scenes, adversely affecting the fusion of complementary information and hindering the generation of satisfactory results. To address this, we introduce Wakeup-Darkness, a multimodal enhancement framework that innovatively enriches user interaction through voice and textual commands. This approach signifies a technical leap and represents a paradigm shift in user engagement. We introduce a Cross-Modal Feature Fusion (CMFF) that synergizes semantic and depth context with low-light enhancement operations. Moreover, we propose a Gated Residual Block (GRB) and a channel-aware Look-Up Table (LUT) to adjust the intensity distribution of each channel. Crucially, the proposed Wakeup-Darkness scheme demonstrates remarkable generalization in unsupervised scenarios. The source code can be accessed from https://github.com/zhangbaijin/Wakeup-Dakness .Keywords
Funding Information
- National Natural Science Foundation (62273235)
- National Major Scientific Research Instrument Development (62227811)
- Ministry of Education (8091B02210)
This publication has 32 references indexed in Scilit:
- WavEnhancer: Unifying Wavelet and Transformer for Image EnhancementJournal of Computer Science and Technology, 2024
- Segment Anything2023
- URetinex-Net: Retinex-based Deep Unfolding Network for Low-light Image Enhancement2022
- Beyond Brightening Low-light ImagesInternational Journal of Computer Vision, 2021
- Luminance-Aware Pyramid Network for Low-Light Image EnhancementIEEE Transactions on Multimedia, 2020
- Lightening Network for Low-Light Image EnhancementIEEE Transactions on Image Processing, 2020
- Zero-Shot Restoration of Underexposed Images via Robust Retinex Decomposition2020
- Low-Light Image Enhancement via a Deep Hybrid NetworkIEEE Transactions on Image Processing, 2019
- LLNet: A deep autoencoder approach to natural low-light image enhancementPattern Recognition, 2017
- LIME: Low-Light Image Enhancement via Illumination Map EstimationIEEE Transactions on Image Processing, 2016