Stereoscopic Image Super-Resolution Method with View Incorporation and Convolutional Neural Networks
Open Access
- 26 May 2017
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 7 (6) , 526
Abstract
Super-resolution (SR) plays an important role in the processing and display of mixed-resolution (MR) stereoscopic images. Therefore, a stereoscopic image SR method based on view incorporation and convolutional neural networks (CNN) is proposed. For a given MR stereoscopic image, the left view of which is observed in full resolution, while the right view is viewed in low resolution, the SR method is implemented in two stages. In the first stage, a view difference image is defined to represent the correlation between views. It is estimated by using the full-resolution left view and the interpolated right view as input to the modified CNN. Accordingly, a high-precision view difference image is obtained. In the second stage, to incorporate the estimated right view in the first stage, a global reconstruction constraint is presented to make the estimated right view consistent with the low-resolution right view in terms of the MR stereoscopic image observation model. Experimental results demonstrated that, compared with the SR convolutional neural network (SRCNN) method and depth map based SR method, the proposed method improved the reconstructed right view quality by 0.54 dB and 1.14 dB, respectively, in the Peak Signal to Noise Ratio (PSNR), and subjective evaluation also implied that the proposed method produced better reconstructed stereoscopic images.Keywords
This publication has 25 references indexed in Scilit:
- Reorganized DCT-based image representation for reduced reference stereoscopic image quality assessmentNeurocomputing, 2016
- Efficient multiple-example based super-resolution for symmetric mixed resolution stereoscopic video codingJournal of Visual Communication and Image Representation, 2016
- Small-world brain functional network altered by watching 2D/3DTVJournal of Visual Communication and Image Representation, 2016
- Robust Single Image Super-Resolution via Deep Networks With Sparse PriorIEEE Transactions on Image Processing, 2016
- Improving children's cognitive modifiability by dynamic assessment in 3D Immersive Virtual Reality environmentsComputers & Education, 2016
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Deep learning in neural networks: An overviewNeural Networks, 2015
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Improving resolution by image registrationCVGIP: Graphical Models and Image Processing, 1991