Learning Parallax Attention for Stereo Image Super-Resolution
Authors:
Top Cited Papers
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 12242-12251
Abstract
Stereo image pairs can be used to improve the performance of super-resolution (SR) since additional information is provided from a second viewpoint. However, it is challenging to incorporate this information for SR since disparities between stereo images vary significantly. In this paper, we propose a parallax-attention stereo superresolution network (PASSRnet) to integrate the information from a stereo image pair for SR. Specifically, we introduce a parallax-attention mechanism with a global receptive field along the epipolar line to handle different stereo images with large disparity variations. We also propose a new and the largest dataset for stereo image SR (namely, Flickr1024). Extensive experiments demonstrate that the parallax-attention mechanism can capture correspondence between stereo images to improve SR performance with a small computational and memory cost. Comparative results show that our PASSRnet achieves the state-of-the-art performance on the Middlebury, KITTI 2012 and KITTI 2015 datasets.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network2016
- Video Super-Resolution via Deep Draft-Ensemble Learning2015
- Learning a Deep Convolutional Network for Light-Field Image Super-Resolution2015
- Object scene flow for autonomous vehicles2015
- Resolution Enhancement in Multi-Image StereoIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Super-Resolution Without Explicit Subpixel Motion EstimationIEEE Transactions on Image Processing, 2009
- Generalizing the Nonlocal-Means to Super-Resolution ReconstructionIEEE Transactions on Image Processing, 2008
- Super-resolution image reconstruction: a technical overviewIEEE Signal Processing Magazine, 2003
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- Computational StereoACM Computing Surveys, 1982