Example-Based Video Stereolization With Foreground Segmentation and Depth Propagation
Authors:
- 22 July 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 16 (7) , 1905-1914
Abstract
With advances in 3DTV technology, video stereolization has attracted much attention in recent years. Although video stereolization can enrich stereoscopic 3D contents, it is hard to create good depth maps from monocular 2D videos. In this paper, we propose an automatic example-based video stereolization method with foreground segmentation and depth propagation, called EBVS. To consider both performance and computational complexity, we separately estimate depth maps according to the key and non-key frames. In the key frames, we first estimate an initial depth map based on examples from the RGB-D training data set, then refine it to preserve boundaries of foreground objects. In the non-key frames, we propagate the depth map of the key frame using motion compensation, and generate depth maps. Finally, we employ depth-image-based-rendering (DIBR) to generate stereoscopic views from 2D videos and their depth maps. Extensive experiments verify that the proposed EBVS produces visually pleasing and realistic stereoscopic 3D views from 2D videos.Keywords
Funding Information
- National Natural Science Foundation of China (61271298)
- International SandT Cooperation Program of China (2014DFG12780)
This publication has 30 references indexed in Scilit:
- Automatic 2D-to-3D image conversion using 3D examples from the internet2012
- 2D to 3D video conversion with key-frame depth propagation and trilateral filteringElectronics Letters, 2011
- A Fast Approximation of the Bilateral Filter Using a Signal Processing ApproachInternational Journal of Computer Vision, 2007
- Block-based Vanishing Line and Vanishing Point Detection for 3D Scene Reconstruction2006
- Digital photography with flash and no-flash image pairs2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Depth from defocus: A spatial domain approachInternational Journal of Computer Vision, 1994
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992
- Determining optical flowArtificial Intelligence, 1981
- The effects of a visual fidelity criterion of the encoding of imagesIEEE Transactions on Information Theory, 1974