Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessment
Preprint
Abstract
Many super-resolution (SR) algorithms have been proposed to increase image resolution. However, full-reference (FR) image quality assessment (IQA) metrics for comparing and evaluating different SR algorithms are limited. In this work, we propose the Perception-oriented Bidirectional Attention Network (PBAN) for image SR FR-IQA, which is composed of three modules: an image encoder module, a perception-oriented bidirectional attention (PBA) module, and a quality prediction module. First, we encode the input images for feature representations. Inspired by the characteristics of the human visual system, we then construct the perception-oriented PBA module. Specifically, different from existing attention-based SR IQA methods, we conceive a Bidirectional Attention to bidirectionally construct visual attention to distortion, which is consistent with the generation and evaluation processes of SR images. To further guide the quality assessment towards the perception of distorted information, we propose Grouped Multi-scale Deformable Convolution, enabling the proposed method to adaptively perceive distortion. Moreover, we design Sub-information Excitation Convolution to direct visual perception to both sub-pixel and sub-channel attention. Finally, the quality prediction module is exploited to integrate quality-aware features and regress quality scores. Extensive experiments demonstrate that our proposed PBAN outperforms state-of-the-art quality assessment methods.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- LDConv: Linear deformable convolution for improving convolutional neural networksImage and Vision Computing, 2024
- Human perception of spatial frequency varies with stimulus orientation and location in the visual fieldScientific Reports, 2023
- TADSRNet: A triple-attention dual-scale residual network for super-resolution image quality assessmentApplied Intelligence, 2023
- A sub-pixel convolution-based improved bidirectional feature pyramid network for pansharpeningRemote Sensing Letters, 2023
- C$^{2}$MT: A Credible and Class-Aware Multi-Task Transformer for SR-IQAIEEE Signal Processing Letters, 2022
- Joint channel-spatial attention network for super-resolution image quality assessmentApplied Intelligence, 2022
- Dual-quality map based no reference image quality assessment using deformable convolutionDigital Signal Processing, 2022
- MUSIQ: Multi-scale Image Quality Transformer2021
- Blind quality assessment for image superresolution using deep two-stream convolutional networksInformation Sciences, 2020
- Learning a no-reference quality metric for single-image super-resolutionComputer Vision and Image Understanding, 2017