Phaseformer: Phase-based Attention Mechanism for Underwater Image Restoration and Beyond
Authors:
Preprint
Abstract
Quality degradation is observed in underwater images due to the effects of light refraction and absorption by water, leading to issues like color cast, haziness, and limited visibility. This degradation negatively affects the performance of autonomous underwater vehicles used in marine applications. To address these challenges, we propose a lightweight phase-based transformer network with 1.77M parameters for underwater image restoration (UIR). Our approach focuses on effectively extracting non-contaminated features using a phase-based self-attention mechanism. We also introduce an optimized phase attention block to restore structural information by propagating prominent attentive features from the input. We evaluate our method on both synthetic (UIEB, UFO-120) and real-world (UIEB, U45, UCCS, SQUID) underwater image datasets. Additionally, we demonstrate its effectiveness for low-light image enhancement using the LOL dataset. Through extensive ablation studies and comparative analysis, it is clear that the proposed approach outperforms existing state-of-the-art (SOTA) methods.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Restormer: Efficient Transformer for High-Resolution Image Restoration2022
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- Vision Transformers for Dense Prediction2021
- Underwater scene prior inspired deep underwater image and video enhancementPattern Recognition, 2020
- Using CNN for facial expression recognition: a study of the effects of kernel size and number of filters on accuracyThe Visual Computer, 2019
- A hybrid method for underwater image correctionPattern Recognition Letters, 2017
- Underwater image quality enhancement through integrated color model with Rayleigh distributionApplied Soft Computing, 2015
- Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow MethodsInternational Journal of Computer Vision, 2005
- A case study on process optimization using the gradient loss functionInternational Journal of Production Research, 1995
- Computer modeling and the design of optimal underwater imaging systemsIEEE Journal of Oceanic Engineering, 1990