CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolution
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1796-1807
Abstract
Learning continuous image representations is recently gaining popularity for image super-resolution (SR) because of its ability to reconstruct high-resolution images with arbitrary scales from low-resolution inputs. Existing methods mostly ensemble nearby features to predict the new pixel at any queried coordinate in the SR image. Such a local ensemble suffers from some limitations: i) it has no learnable parameters and it neglects the similarity of the visual features; ii) it has a limited receptive field and cannot ensemble relevant features in a large field which are important in an image. To address these issues, this paper proposes a continuous implicit attention-in-attention network, called CiaoSR. We explicitly design an implicit attention network to learn the ensemble weights for the nearby local features. Furthermore, we embed a scale-aware attention in this implicit attention network to exploit additional non-local information. Extensive experiments on benchmark datasets demonstrate CiaoSR significantly outperforms the existing single image SR methods with the same backbone. In addition, CiaoSR also achieves the state-of-the-art performance on the arbitrary-scale SR task. The effectiveness of the method is also demonstrated on the real-world SR setting. More importantly, CiaoSR can be flexibly integrated into any backbone to improve the SR performance.Keywords
All Related Versions
Funding Information
- ETH Zurich
- Humboldt Foundation
This publication has 58 references indexed in Scilit:
- Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image RestorationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Single image super-resolution from transformed self-exemplars2015
- Blind image quality evaluation using perception based features2015
- Anchored Neighborhood Regression for Fast Example-Based Super-Resolution2013
- Nonparametric Blind Super-resolution2013
- Blind/Referenceless Image Spatial Quality Evaluator2011
- Very Low Resolution Face Recognition ProblemIEEE Transactions on Image Processing, 2011
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Super-Resolution Reconstruction of Compressed Video Using Transform-Domain StatisticsIEEE Transactions on Image Processing, 2004
- A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics2002