Multi-task low-rank affinity pursuit for image segmentation
Authors:
- 1 November 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15505499,p. 2439-2446
Abstract
This paper investigates how to boost region-based image segmentation by pursuing a new solution to fuse multiple types of image features. A collaborative image segmentation framework, called multi-task low-rank affinity pursuit, is presented for such a purpose. Given an image described with multiple types of features, we aim at inferring a unified affinity matrix that implicitly encodes the segmentation of the image. This is achieved by seeking the sparsity-consistent low-rank affinities from the joint decompositions of multiple feature matrices into pairs of sparse and low-rank matrices, the latter of which is expressed as the production of the image feature matrix and its corresponding image affinity matrix. The inference process is formulated as a constrained nuclear norm and ℓ 2;1 -norm minimization problem, which is convex and can be solved efficiently with the Augmented Lagrange Multiplier method. Compared to previous methods, which are usually based on a single type of features, the proposed method seamlessly integrates multiple types of features to jointly produce the affinity matrix within a single inference step, and produces more accurate and reliable segmentation results. Experiments on the MSRC dataset and Berkeley segmentation dataset well validate the superiority of using multiple features over single feature and also the superiority of our method over conventional methods for feature fusion. Moreover, our method is shown to be very competitive while comparing to other state-of-the-art methods.Keywords
This publication has 20 references indexed in Scilit:
- Curvature regularity for region-based image segmentation and inpainting: A linear programming relaxation2009
- Estimation of Subspace Arrangements with Applications in Modeling and Segmenting Mixed DataSIAM Review, 2008
- Segmentation of Multivariate Mixed Data via Lossy Data Coding and CompressionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Spectral clustering and transductive learning with multiple views2007
- Improving Spatial Support for Objects via Multiple Segmentations2007
- Comparing clusterings2005
- Object recognition from local scale-invariant features1999
- Textons, contours and regions: cue integration in image segmentation1999
- Objective Criteria for the Evaluation of Clustering MethodsJournal of the American Statistical Association, 1971
- Laws of organization in perceptual forms.1938