FTV for 3-D Spatial Communication
- 24 February 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 100 (4) , 905-917
Abstract
Free-viewpoint TV (FTV) is cutting the frontier of audiovisual communications. FTV is an innovative media that enables us to view 3-D space by freely changing our viewpoints. It also allows us to listen at any listening point in the 3-D space. Since FTV transmits all audiovisual information of the 3-D space, it can reconstruct an audiovisual replica of the 3-D space anywhere and anytime over distance and time. For video, FTV captures a part of rays in 3-D space by using many cameras, and the other rays that are not captured are obtained by interpolating the captured rays. We constructed real-time FTV systems including the complete chain of operation from image capture to display. We also carried out FTV on a laptop computer and a mobile player. For audio, two kinds of free listening-point systems are demonstrated. MPEG regarded FTV as the most challenging 3-D media and has been conducting its international standardization activities. The first phase of FTV was multiview video coding (MVC) and the second phase of FTV is 3-D video (3DV). MVC enables the efficient coding of multiple camera views and was completed in 2009. MVC has been adopted by Blu-ray 3-D. 3DV is a standard that targets serving a variety of 3-D displays and its call for proposals was issued in March 2011.Keywords
This publication has 43 references indexed in Scilit:
- A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based PriorsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion HandlingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Multiview Video Coding Using View Interpolation and Color CorrectionIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Free viewpoint image generation using multi-pass dynamic programming2007
- Efficient Dense Stereo with Occlusions for New View-Synthesis by Four-State Dynamic ProgrammingInternational Journal of Computer Vision, 2006
- An experimental comparison of min-cut/max- flow algorithms for energy minimization in visionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- What energy functions can be minimized via graph cuts?IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Computing visual correspondence with occlusions using graph cuts2002
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- Fast approximate energy minimization via graph cutsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001