A Point-Cloud-Based Multiview Stereo Algorithm for Free-Viewpoint Video
Authors:
- 31 July 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 16 (3) , 407-418
Abstract
This paper presents a robust multiview stereo (MVS) algorithm for free-viewpoint video. Our MVS scheme is totally point-cloud-based and consists of three stages: point cloud extraction, merging, and meshing. To guarantee reconstruction accuracy, point clouds are first extracted according to a stereo matching metric which is robust to noise, occlusion, and lack of texture. Visual hull information, frontier points, and implicit points are then detected and fused with point fidelity information in the merging and meshing steps. All aspects of our method are designed to counteract potential challenges in MVS data sets for accurate and complete model reconstruction. Experimental results demonstrate that our technique produces the most competitive performance among current algorithms under sparse viewpoint setups according to both static and motion MVS data sets.Keywords
This publication has 44 references indexed in Scilit:
- Multi-View Stereo Revisited2006
- Combined Depth and Outlier Estimation in Multi-View Stereo2006
- Virtual view synthesis of people from multiple view video sequencesGraphical Models, 2005
- Robust filtering of noisy scattered point dataProceedings Eurographics/IEEE VGTC Symposium Point-Based Graphics, 2005., 2005
- Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D videoComputer Vision and Image Understanding, 2004
- Space-time isosurface evolution for temporally coherent 3D reconstruction2004
- Algorithm for dynamic 3D object generation from multi-viewpoint images2004
- Methods for Volumetric Reconstruction of Visual ScenesInternational Journal of Computer Vision, 2004
- Point set surfaces2001
- A Theory of Shape by Space CarvingInternational Journal of Computer Vision, 2000