Superpixels of RGB-D Images for Indoor Scenes Based on Weighted Geodesic Driven Metric
Authors:
- 26 October 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 23 (10) , 2342-2356
Abstract
Serving as a key step for applications of image processing, superpixel generation has been attracting increasing attention. RGB-D images are used pervasively in scenes reconstruction and representation, benefiting from their contained depth data. In this paper, we present a novel framework for generating superpixels focus on RGB-D images of indoor scenes, based on a weighted geodesic driven metric that combines both color and geometric information. In particular, taking into account the unique structures of indoor scenarios, we first denoise the given RGB-D image, and construct the corresponding triangular mesh. A new weighted geodesic driven metric is defined by introducing a weight function constrained with normal vectors and colors. Under this metric, an energy function is defined to measure our over-segmentation of the triangular mesh, by optimizing which, we can acquire an optimal oversegmentation of the triangular mesh with object boundaries respected, such that vertices in each sub-region have similar geometric structures and color intensities. Re-mapping the over-segmentation of the triangular mesh to the RGB-D image results in desired superpixels. We perform extensive experiments on a large-scale database of RGB-D images to verify the efficacy of our algorithm. The results show that our algorithm has considerable advantages over the existing state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (NSFC) (61332015, 61572288, 61373078, 61572292)
- Shandong University (2015JC009)
This publication has 28 references indexed in Scilit:
- Intrinsic computation of centroidal Voronoi tessellation (CVT) on meshesComputer-Aided Design, 2015
- Fast and Scalable Mesh SuperfacetsComputer Graphics Forum, 2014
- A model-free approach for the segmentation of unknown objects2014
- Object Partitioning Using Local Convexity2014
- Learning depth-sensitive conditional random fields for semantic segmentation of RGB-D images2014
- Voxel Cloud Connectivity Segmentation - Supervoxels for Point Clouds2013
- Recovering Occlusion Boundaries from a Single Image2007
- Boundary Extraction in Natural Images Using Ultrametric Contour Maps2006
- Fast Marching MethodsSIAM Review, 1999
- Computing geodesic paths on manifoldsProceedings of the National Academy of Sciences, 1998