CFPNet: Complementary Feature Perception Network for Underwater Image Enhancement
- 15 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Oceanic Engineering
- Vol. 50 (1) , 150-163
Abstract
Images shot underwater are usually characterized by global nonuniform information loss due to selective light absorption and scattering, resulting in various degradation problems, such as color distortion and low visibility. Recently, deep learning has drawn much attention in the field of underwater image enhancement (UIE) for its powerful performance. However, most deep learning-based UIE models rely on either pure convolutional neural network (CNN) or pure transformer, which makes it challenging to enhance images while maintaining local representations and global features simultaneously. In this article, we propose a novel complementary feature perception network (CFPNet), which embeds the transformer into the classical CNN-based UNet3+. The core idea is to fuse the advantages of CNN and transformer to obtain satisfactory high-quality underwater images that can naturally perceive local and global features. CFPNet employs a novel dual encoder structure of the CNN and transformer in parallel, while the decoder is composed of one trunk decoder and two auxiliary decoders. First, we propose the regionalized two-stage vision transformer that can progressively eliminate the variable levels of degradation in a coarse-to-fine manner. Second, we design the full-scale feature fusion module to explore sufficient information by merging the multiscale features. In addition, we propose an auxiliary feature guided learning strategy that utilizes reflectance and shading maps to guide the generation of the final results. The advantage of this strategy is to avoid repetitive and ineffective learning of the model, and to accomplish color correction and deblurring tasks more efficiently. Experiments demonstrate that our CFPNet can obtain high-quality underwater images and show superior performance compared to the state-of-the-art UIE methods qualitatively and quantitatively.Keywords
Funding Information
- National Key Research and Development Program of China (2022YFE0132600)
- National Natural Science Foundation of China (62176037, 62002043, 61802043)
- Liaoning Applied Basic Research Project (2022JH2/101300264)
- Dalian Science and Technology Innovation Fund (2022JJ12GX016)
- Fundamental Research Funds for the Provincial Universities of Liaoning (LJ212410150024)
- Natural Science Foundation of Liaoning Province (2024-MS-168)
This publication has 42 references indexed in Scilit:
- Uncertainty Inspired Underwater Image Enhancement2022
- Attention-guided dynamic multi-branch neural network for underwater image enhancementKnowledge-Based Systems, 2022
- An efficient learning-based method for underwater image enhancementDisplays, 2022
- Medical Image Segmentation Using Transformer NetworksIEEE Access, 2022
- A novel biologically-inspired method for underwater image enhancementSignal Processing: Image Communication, 2022
- UIEC^2-Net: CNN-based underwater image enhancement using two color spaceSignal Processing: Image Communication, 2021
- Bayesian retinex underwater image enhancementEngineering Applications of Artificial Intelligence, 2021
- Underwater scene prior inspired deep underwater image and video enhancementPattern Recognition, 2020
- Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network2016
- Automatic Red-Channel underwater image restorationJournal of Visual Communication and Image Representation, 2015