Improving depth perception with motion parallax and its application in teleconferencing
Authors:
- 1 October 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Depth perception, or 3D perception, can add a lot to the feeling of immersiveness in many applications such as 3D TV, 3D teleconferencing, etc. Stereopsis and motion parallax are two of the most important cues for depth perception. Most of the 3D displays today rely on stereopsis to create 3D perception. In this paper, we propose to improve user's depth perception by tracking their motions and creating motion parallax for the rendered image, which can be done even with legacy displays. Two enabling technologies, face tracking and foreground/background segmentation, are discussed in detail. In particular, we propose an efficient and robust feature based face tracking algorithm that is capable of estimating the face's location and scale accurately. We also propose a novel foreground/background segmentation and matting algorithm with time-of-flight camera, which is robust to moving background, lighting variations, moving camera, etc. We demonstrate the application of the above technologies in teleconferencing on legacy displays to create pseudo-3D effects.Keywords
This publication has 15 references indexed in Scilit:
- Optimized Color Sampling for Robust Matting2007
- Discriminant Embedding for Local Image Descriptors2007
- Real-Time Bayesian 3-D Pose TrackingIEEE Transactions on Circuits and Systems for Video Technology, 2006
- Graph Cuts and Efficient N-D Image SegmentationInternational Journal of Computer Vision, 2006
- Bilayer Segmentation of Live Video2006
- Discriminative Random FieldsInternational Journal of Computer Vision, 2006
- Kernel-based object trackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Optical Flow Constraints on Deformable Models with Applications to Face TrackingInternational Journal of Computer Vision, 2000
- Object recognition from local scale-invariant features1999
- CONDENSATION—Conditional Density Propagation for Visual TrackingInternational Journal of Computer Vision, 1998