Display Visibility Improvement Through Content and Ambient Light-Adaptive Image Enhancement
Open Access
- 15 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 87902-87916
Abstract
An image in a display device under strong illuminance can be perceived as darker than the original due to the nature of the human visual system (HVS). In order to alleviate this degradation in terms of software, existing schemes employ global luminance compensation or tone mapping. However, since such approaches focus on restoring luminance only, it has a fundamental drawback that chrominance cannot be sufficiently restored. Also, the previous approaches seldom provide acceptable visibility because it does not consider the content of an input image. Furthermore, because they focus mainly on global image quality, they may show unsatisfactory image quality for certain local areas. This paper introduces VisibilityNet, a neural network model designed to restore both chrominance and luminance. By leveraging VisibilityNet, we generate an optimally enhanced dataset tailored to the ambient light conditions. Furthermore, employing the generated dataset and a convolutional neural network (CNN), we estimate weighted piece-wise linear enhancement curves (WPLECs) that take into account both ambient light and image content. These WPLECs effectively enhance global contrast by addressing both luminance and chrominance aspects. Ultimately, through the utilization of a salient object detection algorithm that emulates the HVS, visibility enhancement is achieved not only for the overall region but also for visually salient areas. We verified the performance of the proposed method by comparing it with five existing approaches in terms of two quantitative metrics for a dataset we built ourselves. Experimental findings substantiate that the proposed method surpasses alternative approaches by significantly improving visibility.Keywords
Funding Information
- Ministry of Science and ICT, South Korea (2022-0-00955, 2022R1A2C2010095, 2022R1A4A1033549, RS-2022-00155915)
This publication has 39 references indexed in Scilit:
- Readability Enhancement of Displayed Images Under Ambient LightIEEE Transactions on Circuits and Systems for Video Technology, 2017
- Surrounding adaptive tone mapping in displayed images under ambient light2017
- Ghosting-free multi-exposure image fusion in gradient domain2016
- Contrast Enhancement Using Stratified Parametric-Oriented Histogram EqualizationIEEE Transactions on Circuits and Systems for Video Technology, 2016
- Making a “Completely Blind” Image Quality AnalyzerIEEE Signal Processing Letters, 2012
- Efficient Contrast Enhancement Using Adaptive Gamma Correction With Weighting DistributionIEEE Transactions on Image Processing, 2012
- Realization of the Contrast Limited Adaptive Histogram Equalization (CLAHE) for Real-Time Image EnhancementJournal of Signal Processing Systems, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Quantization Techniques for Visualization of High Dynamic Range Pictures1995
- Brightness Perception in Complex FieldsJournal of the Optical Society of America, 1967