Virtual view synthesis method and self‐evaluation metrics for free viewpoint television and 3D video
Authors:
- 18 November 2010
- journal article
- research article
- Published by Wiley in International Journal of Imaging Systems and Technology
- Vol. 20 (4) , 378-390
Abstract
Virtual view synthesis is one of the most important techniques to realize free viewpoint television and three‐dimensional (3D) video. In this article, we propose a view synthesis method to generate high‐quality intermediate views in such applications and new evaluation metrics named as spatial peak signal‐to‐noise ratio and temporal peak signal‐to‐noise ratio to measure spatial and temporal consistency, respectively. The proposed view synthesis method consists of five major steps: depth preprocessing, depth‐based 3D warping, depth‐based histogram matching, base plus assistant view blending, and depth‐based hole‐filling. The efficiency of the proposed view synthesis method has been verified by evaluating the quality of synthesized images with various metrics such as peak signal‐to‐noise ratio, structural similarity, discrete cosine transform (DCT)‐based video quality metric, and the newly proposed metrics. We have also confirmed that the synthesized images are objectively and subjectively natural. © 2010 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 20, 378–390, 2010Keywords
This publication has 18 references indexed in Scilit:
- Image-Based Rendering and SynthesisIEEE Signal Processing Magazine, 2007
- Overview of free viewpoint televisionSignal Processing: Image Communication, 2006
- Development of MPEG standards for 3D and free viewpoint video2005
- Interactive 3-D Video Representation and Coding TechnologiesProceedings of the IEEE, 2005
- High-quality video view interpolation using a layered representationACM Transactions on Graphics, 2004
- Pop-up light fieldACM Transactions on Graphics, 2004
- 3DAV Exploration of Video-Based Rendering Technology in MPEGIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Three-dimensional image processing in the future of immersive mediaIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Layered depth images1998
- Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping1998