Multi-Label Learning With Fused Multimodal Bi-Relational Graph
Authors:
- 9 January 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 16 (2) , 403-412
Abstract
The problem of multi-label image classification using multiple feature modalities is considered in this work. Given a collection of images with partial labels, we first model the association between different feature modalities and the images labels. These associations are then propagated with a graph diffusion kernel to classify the unlabeled images. Towards this objective, a novel Fused Multimodal Bi-relational Graph representation is proposed, with multiple graphs corresponding to different feature modalities, and one graph corresponding to the image labels. Such a representation allows for effective exploitation of both feature complementariness and label correlation. This contrasts with previous work where these two factors are considered in isolation. Furthermore, we provide a solution to learn the weight for each image graph by estimating the discriminative power of the corresponding feature modality. Experimental results with our proposed method on two standard multi-label image datasets are very promising.Keywords
This publication has 38 references indexed in Scilit:
- Transductive multi-label ensemble classification for protein function prediction2012
- Labeling Images by Integrating Sparse Multiple Distance Learning and Semantic Context Modeling2012
- Multi-modal constraint propagation for heterogeneous image clustering2011
- Graph-based semi-supervised learning with multiple labelsJournal of Visual Communication and Image Representation, 2009
- Semi-supervised Multi-label Learning by Solving a Sylvester Equation2008
- Correlative multi-label video annotation2007
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Learning multi-label scene classificationPattern Recognition, 2004
- Semi-Supervised Learning on Riemannian ManifoldsMachine Learning, 2004
- Discriminative Methods for Multi-labeled Classification2004