The SPS algorithm: patching figural continuity and transparency by split-patch search
- 13 November 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (10636919) , 342-349
Abstract
This paper describes a novel algorithm for the efficient synthesis of high-quality virtual views from only two input images. The emphasis is on the recovery of continuity of objects boundaries (figural continuity) with faithful synthesis of transparency effects. The contribution of this paper is two-fold: (i) the split-patch search (SPS) technique is introduced for dense stereo which handles transparency effects by assigning multiple disparities to mixed pixels; (ii) an efficient extension of exemplar-based image synthesis to the case of two-camera stereo is proposed. Furthermore, this paper presents an approximate but effective solution to the challenging problem of layer estimation and compositing in the case of small image patches. The effectiveness of the proposed technique is demonstrated on a number of stereo image pairs taken from two camera video-conferencing setups, where the quality of the synthesized talking heads is of paramount importance. Moreover the improvement in the quality of image synthesis is quantified by comparing the output of the SPS algorithm with thirteen ground-truth images.Keywords
This publication has 14 references indexed in Scilit:
- Gaze manipulation for one-to-one teleconferencing2003
- Missing data correction in still images and image sequences2002
- Stereo matching with transparency and matting2002
- 3-D surface reconstruction from stereoscopic image sequences2002
- Improvements in real-time correlation-based stereo vision2002
- Computing visual correspondence with occlusions using graph cuts2002
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- Image analogies2001
- A theory of shape by space carving1999
- A pixel dissimilarity measure that is insensitive to image samplingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998