A Low-Cost and High-Throughput FPGA Implementation of the Retinex Algorithm for Real-Time Video Enhancement
- 11 September 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 28 (1) , 101-114
Abstract
For video applications in a special environment such as medical imaging, space exploration, and underwater exploration, the video captured by an image sensor is often deteriorated because of low lighting conditions. Therefore, it is necessary to enhance the part of the image that is too dark to distinguish details while maintaining the remaining part with the same brightness. The retinex algorithm is widely used to restore naturalness of a video, especially exhibiting outstanding performance in the enhancement of a dark area. However, it demands large computational complexity because of its intricate structure, such as the Gaussian filter and exponentiation operations, and consequently, it is difficult to process in real time. This article presents a low-cost and high-throughput design of the retinex video enhancement algorithm. The hardware (HW) design is implemented using a field-programmable gate array (FPGA), and it supports a throughput of 60 frames/s for a 1920 x 1080 image with negligible latency. The proposed FPGA design minimizes HW resources while maintaining the quality and the performance by using a small line buffer instead of a frame buffer, by applying the concept of approximate computing for the complex Gaussian filter, and by designing a new and nontrivial exponentiation operation. The proposed design makes it possible to significantly reduce HW resources (up to 79.22% of total resources) compared to existing systems and is compatible with commercialized devices through the standard HDMI/DVI video ports.Keywords
Funding Information
- Korea Electrotechnology Research Institute (17-12-N0103-10)
- National Research Foundation of Korea (2019R1F1A1057530)
This publication has 43 references indexed in Scilit:
- Retinex processing for automatic image enhancementJournal of Electronic Imaging, 2004
- High dynamic range imaging for digital still camera: an overviewJournal of Electronic Imaging, 2003
- An advanced contrast enhancement using partially overlapped sub-block histogram equalizationIEEE Transactions on Circuits and Systems for Video Technology, 2001
- Image enhancement based on equal area dualistic sub-image histogram equalization methodIEEE Transactions on Consumer Electronics, 1999
- Bayesian and regularization methods for hyperparameter estimation in image restorationIEEE Transactions on Image Processing, 1999
- Contrast enhancement system using spatially adaptive histogram equalization with temporal filteringIEEE Transactions on Consumer Electronics, 1998
- A multiscale retinex for bridging the gap between color images and the human observation of scenesIEEE Transactions on Image Processing, 1997
- Contrast enhancement using brightness preserving bi-histogram equalizationIEEE Transactions on Consumer Electronics, 1997
- A real-time neural system for color constancyIEEE Transactions on Neural Networks, 1991
- Lightness and Retinex TheoryJournal of the Optical Society of America, 1971