Utilisation of edge adaptive upsampling in compression of depth map videos for enhanced free-viewpoint rendering
Authors:
- 1 November 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15224880,p. 733-736
Abstract
In this paper we propose a novel video object edge adaptive upsampling scheme for application in video-plus-depth and Multi-View plus Depth (MVD) video coding chains with reduced resolution. Proposed scheme is for improving the rate-distortion performance of reduced-resolution depth map coders taking into account the rendering distortion induced in free-viewpoint videos. The inherent loss in fine details due to downsampling, particularly at video object boundaries causes significant visual artefacts in rendered free-viewpoint images. The proposed edge adaptive upsampling filter allows the conservation and better reconstruction of such critical object boundaries. Furthermore, the proposed scheme does not require the edge information to be communicated to the decoder, as the edge information used in the adaptive upsampling is derived from the reconstructed colour video. Test results show that as much as 1.2 dB gain in free-viewpoint video quality can be achieved with the utilization of the proposed method compared to the scheme that uses the linear MPEG re-sampling filter. The proposed approach is suitable for video-plus-depth as well as MVD applications, in which it is critical to satisfy bandwidth constraints while maintaining high free-viewpoint image quality.Keywords
This publication has 9 references indexed in Scilit:
- Prediction of stereoscopic video quality using objective quality models of 2-D videoElectronics Letters, 2008
- Bit-Rate Adaptive Downsampling for the Coding of Multi-View Video with Depth Information2008
- View Scalable Multiview Video Coding Using 3-D Warping With Depth MapIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Locally adaptive wavelet-based image interpolationIEEE Transactions on Image Processing, 2006
- Motion driven adaptive transform based on wavelet transform for enhanced video coding2006
- High-quality video view interpolation using a layered representation2004
- Mesh-based depth map compression and transmission for real-time view-based rendering2003
- New edge-directed interpolationIEEE Transactions on Image Processing, 2001
- Unstructured lumigraph rendering2001