Asymmetric bidirectional view synthesis for free viewpoint and three-dimensional video
Authors:
- 1 November 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 55 (4) , 2349-2355
Abstract
Virtual view synthesis is a key technology for future free viewpoint video and three-dimensional video applications. A novel asymmetric bidirectional view synthesis method is proposed for multi-view video plus depth based systems. An intermediate virtual view is synthesized based on two adjacent reference views, which are termed as the main view and the auxiliary view. The main view contains two-dimensional color images plus per-pixel depth information. The auxiliary view only contains two-dimensional color images without depth information. The basic depth-image-based rendering technique is firstly optimized with a distance- and- depth weighted algorithm to solve the visibility and resampling problems and then applied in the following four-step view synthesis process. First, extract the occluded color data from the auxiliary view. Second, generate the corresponding occluded depth data. Then, generate two candidate virtual view images based on the main view information and the occluded information. Last, asymmetrically synthesize the two candidate virtual view images to generate the final virtual view image. Theoretical analysis and experimental results show that the proposed method can generate intermediate virtual views with high image quality.Keywords
This publication has 14 references indexed in Scilit:
- Distance Dependent Depth Filtering in 3D Warping for 3DTV2007
- Review and Preview: Disocclusion by Inpainting for Image-Based RenderingIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2007
- Arbitrary view generation based on DIBR2007
- Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation2005
- Stereoscopic Image Generation Based on Depth Images for 3D TVIEEE Transactions on Broadcasting, 2005
- High-quality video view interpolation using a layered representationACM Transactions on Graphics, 2004
- Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV2004
- Layered depth images1998
- Post-rendering 3D warping1997
- Hierarchical Z-buffer visibility1993