Temporal consistency enhancement on depth sequences
Authors:
- 1 December 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 5291, 342-345
Abstract
Currently, depth sequences generated by automatic depth estimation suffer from the temporal inconsistency problem. Estimated depth values of some objects vary in adjacent frames, whereas the objects actually remain on the same depth planes. These temporal depth errors significantly impair the visual quality of the synthesized virtual view as well as the coding efficiency of the depth sequences. Since depth sequences correspond to texture sequences, some erroneous temporal depth variations can be detected by analyzing temporal variations of the texture sequences. Utilizing this property, we propose a novel solution to enhance the temporal consistency of depth sequences by applying adaptive temporal filtering on them. Experiments demonstrate that the proposed depth filtering algorithm can effectively suppress transient depth errors and generate more stable depth sequences, resulting in notable temporal quality improvement of the synthesized views and higher coding efficiency on the depth sequences.Keywords
This publication has 7 references indexed in Scilit:
- View generation with 3D warping using depth information for FTVSignal Processing: Image Communication, 2009
- 3-D Displays and Signal ProcessingIEEE Signal Processing Magazine, 2007
- Overview of free viewpoint televisionSignal Processing: Image Communication, 2006
- Stereoscopic Image Generation Based on Depth Images for 3D TVIEEE Transactions on Broadcasting, 2005
- An experimental comparison of min-cut/max- flow algorithms for energy minimization in visionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004