Multiview Plus Depth Video Coding With Temporal Prediction View Synthesis
Authors:
- 9 January 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 26 (2) , 360-374
Abstract
Multiview video (MVV) plus depths formats use view synthesis to build intermediate views from existing adjacent views at the receiver side. Traditional view synthesis exploits the disparity information to interpolate an intermediate view by considered inter-view correlations. However, temporal correlation between different frames of the intermediate view can be used to improve the synthesis. We propose a new coding scheme for 3-D High Efficiency Video Coding (HEVC) that allows us to take full advantage of temporal correlations in the intermediate view and improve the existing synthesis from adjacent views. We use optical flow techniques to derive dense motion vector fields (MVF) from the adjacent views and then warp them at the level of the intermediate view. This allows us to construct multiple temporal predictions of the synthesized frame. A second contribution is an adaptive fusion method that judiciously selects between temporal and inter-view prediction to eliminate artifacts associated with each prediction type. The proposed system is compared against the state-of-the-art view synthesis reference software 1-D Fast technique used in 3-D HEVC standardization. Three intermediary views are synthesized. Gains of up to 1.21-dB Bjontegaard Delta peak SNR are shown when evaluated on several standard MVV test sequences.Keywords
This publication has 33 references indexed in Scilit:
- Depth image based rendering with inverse mapping2013
- Multiple description coding of free viewpoint video for multi-path network streaming2012
- Coding Distortion Elimination of Virtual View Synthesis for 3D Video System: Theoretical Analyses and ImplementationIEEE Transactions on Broadcasting, 2012
- Virtual view synthesis without preprocessing depth image for depth image based rendering2011
- Frame Rate Up-Conversion Using Trilateral FilteringIEEE Transactions on Circuits and Systems for Video Technology, 2010
- Adaptive edge-oriented depth image smoothing approach for depth image based rendering2010
- View synthesis prediction for multiview video codingSignal Processing: Image Communication, 2009
- Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion CompensationIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Multiview Depth-Image Compression Using an Extended H.264 Encoder2007
- TCP-friendly Internet video streaming employing variable frame-rate encoding and interpolationIEEE Transactions on Circuits and Systems for Video Technology, 2000