Multi-view image and ToF sensor fusion for dense 3D reconstruction
Open Access
- 1 September 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1542-1549
Abstract
Multi-view stereo methods frequently fail to properly reconstruct 3D scene geometry if visible texture is sparse or the scene exhibits difficult self-occlusions. Time-of-Flight (ToF) depth sensors can provide 3D information regardless of texture but with only limited resolution and accuracy. To find an optimal reconstruction, we propose an integrated multi-view sensor fusion approach that combines information from multiple color cameras and multiple ToF depth sensors. First, multi-view ToF sensor measurements are combined to obtain a coarse but complete model. Then, the initial model is refined by means of a probabilistic multi-view fusion framework, optimizing over an energy function that aggregates ToF depth sensor information with multi-view stereo and silhouette constraints. We obtain high quality dense and detailed 3D models of scenes challenging for stereo alone, while simultaneously reducing complex noise of ToF sensors.Keywords
This publication has 11 references indexed in Scilit:
- A Combined Approach for Estimating Patchlets from PMD Depth Images and Stereo Intensity Images2007
- Joint bilateral upsamplingACM Transactions on Graphics, 2007
- Spatial-Depth Super Resolution for Range Images2007
- Probabilistic visibility for multi-view stereo2007
- Efficient Multi-View Reconstruction of Large-Scale Scenes using Interest Points, Delaunay Triangulation and Graph Cuts2007
- Bayesian Point Cloud ReconstructionComputer Graphics Forum, 2006
- A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms2006
- A Bayesian method for probable surface reconstruction and decimationACM Transactions on Graphics, 2006
- An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (SwissRanger)2004
- Updating Quasi-Newton Matrices with Limited StorageMathematics of Computation, 1980