Joint Distortion Estimation and Removal Network for Versatile Hybrid-Distorted Image Restoration
- 13 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-14
Abstract
Although image restoration methods have achieved great success on single distortion, their performance declines when faced with hybrid distortion effects in real-world scenarios. Recently, some methods for hybrid distortions have been explored. Suppose the total type of distortion is N, the types of distortion that the image suffers may change from 1 to N in real scenarios. However, existing methods fail to simultaneously address variations in distortions. Toward this end, a general network architecture named joint distortion estimation and removal network (JDERNet) is proposed for versatile hybrid-distorted image restoration. The distortion information of the hybrid-distorted image is mathematically represented as a distortion vector, and a neural network is constructed to estimate it. The distortion vector is utilized as a prior to modulate the image reconstruction process. Specifically, a novel feature modulation convolution block (FMCB) is designed. In the FMCB, the distortion vector is employed to modulate the feature maps generated by the attention branch (AB) and the non-AB (NAB), thereby enhancing the restoration of images affected by various types of distortions. Experimental results indicate that the proposed JDERNet achieves state-of-the-art performance in restoring images with varying types of distortions, ranging from multiple hybrid distortions to single distortions.Keywords
This publication has 55 references indexed in Scilit:
- Exploring the potential of channel interactions for image restorationKnowledge-Based Systems, 2023
- Simple Baselines for Image Restoration2022
- Generalizable Medical Image Segmentation via Random Amplitude Mixup and Domain-Specific Image Restoration2022
- Multi-stage image denoising with the wavelet transformPattern Recognition, 2022
- LIRA: Lifelong Image Restoration from Unknown Blended Distortions2020
- Learning Disentangled Feature Representation for Hybrid-Distorted Image Restoration2020
- Efficient Image Super-Resolution Using Pixel Attention2020
- Image Super-Resolution Using Very Deep Residual Channel Attention Networks2018
- Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning2018
- Scope of validity of PSNR in image/video quality assessmentElectronics Letters, 2008