Exploring Weighted Dual Graph Regularized Non-Negative Matrix Tri-Factorization Based Collaborative Filtering Framework for Multi-Label Annotation of Remote Sensing Images
Open Access
- 16 April 2019
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 11 (8) , 922
Abstract
Manually annotating remote sensing images is laborious work, especially on large-scale datasets. To improve the efficiency of this work, we propose an automatic annotation method for remote sensing images. The proposed method formulates the multi-label annotation task as a recommended problem, based on non-negative matrix tri-factorization (NMTF). The labels of remote sensing images can be recommended directly by recovering the image–label matrix. To learn more efficient latent feature matrices, two graph regularization terms are added to NMTF that explore the affiliated relationships on the image graph and label graph simultaneously. In order to reduce the gap between semantic concepts and visual content, both low-level visual features and high-level semantic features are exploited to construct the image graph. Meanwhile, label co-occurrence information is used to build the label graph, which discovers the semantic meaning to enhance the label prediction for unlabeled images. By employing the information from images and labels, the proposed method can efficiently deal with the sparsity and cold-start problem brought by limited image–label pairs. Experimental results on the UCMerced and Corel5k datasets show that our model outperforms most baseline algorithms for multi-label annotation of remote sensing images and performs efficiently on large-scale unlabeled datasets.Keywords
Funding Information
- China Youth Science Foundation (61702413)
- Technology Innovation Funds for the Ninth Academy of China Aerospace (2016JY06)
This publication has 56 references indexed in Scilit:
- Neighborhood rough sets based multi-label classification for automatic image annotationInternational Journal of Approximate Reasoning, 2013
- Identification and Control of Shape Memory AlloysMeasurement and Control, 2013
- Instance Annotation for Multi-Instance Multi-Label LearningACM Transactions on Knowledge Discovery From Data, 2013
- Graph dual regularization non-negative matrix factorization for co-clusteringPattern Recognition, 2012
- Classifier chains for multi-label classificationMachine Learning, 2011
- Orthogonal Nonnegative Matrix Tri-factorization for Semi-supervised Document Co-clustering2010
- Collaborative filtering using orthogonal nonnegative matrix tri-factorizationInformation Processing & Management, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Content-based image retrieval at the end of the early yearsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Laplacian matrices of graphs: a surveyLinear Algebra and its Applications, 1994