The Multiple-Camera 3-D Production Studio
Authors:
- Jonathan StarckJSJonathan Starck
- Atsuto MakiAMAtsuto Maki
- Shohei NobuharaSNShohei Nobuhara
- Adrian HiltonAHAdrian Hilton
- Takashi MatsuyamaTMTakashi Matsuyama
- 16 March 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 19 (6) , 856-869
Abstract
Multiple-camera systems are currently widely used in research and development as a means of capturing and synthesizing realistic 3-D video content. Studio systems for 3-D production of human performance are reviewed from the literature, and the practical experience gained in developing prototype studios is reported across two research laboratories. System design should consider the studio backdrop for foreground matting, lighting for ambient illumination, camera acquisition hardware, the camera configuration for scene capture, and accurate geometric and photometric camera calibration. A ground-truth evaluation is performed to quantify the effect of different constraints on the multiple-camera system in terms of geometric accuracy and the requirement for high-quality view synthesis. As changing camera height has only a limited influence on surface visibility, multiple-camera sets or an active vision system may be required for wide area capture, and accurate reconstruction requires a camera baseline of 25deg, and the achievable accuracy is 5-10-mm at current camera resolutions. Accuracy is inherently limited, and view-dependent rendering is required for view synthesis with sub-pixel accuracy where display resolutions match camera resolutions. The two prototype studios are contrasted and state-of-the-art techniques for 3-D content production demonstrated.Keywords
This publication has 32 references indexed in Scilit:
- Surface Capture for Performance-Based AnimationIEEE Computer Graphics and Applications, 2007
- Visual Shapes of Silhouette Sets2006
- Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion TrackingInternational Journal of Computer Vision, 2005
- Image-based spatio-temporal modeling and view interpolation of dynamic eventsACM Transactions on Graphics, 2005
- Real-time cooperative multi-target tracking by communicating active vision agentsComputer Vision and Image Understanding, 2005
- Algorithm for dynamic 3D object generation from multi-viewpoint images2004
- A self-reconfigurable camera array2004
- Computing geodesics and minimal surfaces via graph cuts2003
- Virtualized reality: constructing virtual worlds from real scenesIEEE MultiMedia, 1997
- A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lensesIEEE Journal on Robotics and Automation, 1987