Cross Parallax Attention Network for Stereo Image Super-Resolution
- 8 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 24 (15209210) , 202-216
Abstract
Stereo super-resolution (SR) aims to enhance the spatial resolution of one camera view using additional information from the other. Previous deep-learning-based stereo SR methods indeed improved the SR performance effectively by employing additional information, but they are unable to super-resolve stereo images where there are large disparities, or different types of epipolar lines. Moreover, in these methods, one model can only super-solve images of a particular view, and for one specific scale factor. This paper proposes a cross parallax attention stereo super-resolution network (CPASSRnet) which can perform stereo SR of multiple scale factors for both views, with a single model. To overcome the difficulties of large disparity and different types of epipolar lines, a cross parallax attention module (CPAM) is presented, which captures the global correspondence of additional information for each view, relative to the other. CPAM allows the two views to exchange additional information with each other according to the generated attention maps. Quantitative and qualitative results compared with the state of the arts illustrate the superiority of CPASSRnet. Ablation experiments demonstrate that the proposed components are effective and noise tests verify the robustness of CPASSRnet.Keywords
Funding Information
- National Natural Science Foundation of China (61972163, U1801262, 61702192, U1636218, 61802131)
- Science and Technology Project of Zhongshan (2019AG024)
- Research and Development Project in Key Areas of Guangdong Province (2018B010109004)
This publication has 57 references indexed in Scilit:
- Object scene flow for autonomous vehicles2015
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Fast Single Image Super-Resolution via Self-Example Learning and Sparse RepresentationIEEE Transactions on Multimedia, 2014
- High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth2014
- Image and video upscaling from local self-examplesACM Transactions on Graphics, 2011
- Image Super-Resolution Via Sparse RepresentationIEEE Transactions on Image Processing, 2010
- Super-resolution through neighbor embedding2004
- High-accuracy stereo depth maps using structured light2003
- Example-based super-resolutionIEEE Computer Graphics and Applications, 2002
- Cubic convolution interpolation for digital image processingIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981