Depth-aided exemplar-based hole filling for DIBR view synthesis
- 1 May 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 02714302,p. 2840-2843
Abstract
Quality of synthesized view by Depth-Image-Based Rendering (DIBR) highly depends on hole filling, especially for synthesized view with large disocclusion. Many hole filling methods are proposed to improve the synthesized view quality and inpainting is the most popular approach to recover the disocclusions. However, the conventional inpainting either makes the hole regions blurred via diffusion or propagates the foreground information to the disoclusion regions. Annoying artifacts are created in the synthesized virtual views. This paper proposes a depth-aided exemplar-based inpainting method for recovering large disoclusion. It consists of two processes, warped depth map filling and warped color image filling. Since depth map can be considered as a grey-scale image without texture, it is much easier to be filled. Disoccluded regions of color image are predicted based on its associated filled depth map information. Regions with texture lying around the background have higher priority to be filled than other regions and disoccluded regions are filled by propagating the background texture through the exemplar-based inpainting. Thus artifacts created by diffusion or using foreground information for prediction can be eliminated. Experimental results show texture can be recovered in large disocclusions and the proposed method has better visual quality compared to existing methods.Keywords
This publication has 10 references indexed in Scilit:
- A foreground biased depth map refinement method for DIBR view synthesis2012
- A new multidirectional extrapolation hole-filling method for Depth-Image-Based Rendering2011
- 3-D Video Representation Using Depth MapsProceedings of the IEEE, 2010
- Depth-aided image inpainting for novel view synthesis2010
- Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based renderingJournal of Zhejiang University-SCIENCE A, 2009
- Learning Conditional Random Fields for Stereo2007
- Stereoscopic imaging: filling disoccluded areas in depth image-based rendering2006
- Stereoscopic Image Generation Based on Depth Images for 3D TVIEEE Transactions on Broadcasting, 2005
- Region Filling and Object Removal by Exemplar-Based Image InpaintingIEEE Transactions on Image Processing, 2004
- Free viewpoint TV system based on ray-space representation2002