Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering
- 1 December 2009
- journal article
- Published by Zhejiang University Press in Journal of Zhejiang University-SCIENCE A
- Vol. 10 (12) , 1738-1749
Abstract
A new algorithm is proposed for restoring disocclusion regions in depth-image-based rendering (DIBR) warped images. Current solutions include layered depth image (LDI), pre-filtering methods, and post-processing methods. The LDI is complicated, and pre-filtering of depth images causes noticeable geometrical distortions in cases of large baseline warping. This paper presents a depth-aided inpainting method which inherits merits from Criminisi’s inpainting algorithm. The proposed method features incorporation of a depth cue into texture estimation. The algorithm efficiently handles depth ambiguity by penalizing larger Lagrange multipliers of filling points closer to the warping position compared with the surrounding existing points. We perform morphological operations on depth images to accelerate the algorithm convergence, and adopt a luma-first strategy to adapt to various color sampling formats. Experiments on test multi-view sequence showed that our method has superiority in depth differentiation and geometrical loyalty in the restoration of warped images. Also, peak signal-to-noise ratio (PSNR) statistics on non-hole regions and whole image comparisons both compare favorably to those obtained by state of the art techniques.Keywords
This publication has 22 references indexed in Scilit:
- Transport Methods in 3DTV—A SurveyIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Efficient Prediction Structures for Multiview Video CodingIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Motion and Disparity Compensated Coding for Multiview VideoIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Distance Dependent Depth Filtering in 3D Warping for 3DTV2007
- Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalabilitySignal Processing: Image Communication, 2007
- Interactive 3-DTV-Concepts and Key TechnologiesProceedings of the IEEE, 2006
- Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation2005
- Region Filling and Object Removal by Exemplar-Based Image InpaintingIEEE Transactions on Image Processing, 2004
- 3D analysis and image-based rendering for immersive TV applicationsSignal Processing: Image Communication, 2002
- Layered depth images1998