Visual Coding in a Semantic Hierarchy
Authors:
Open Access
- 13 October 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 59-68
Abstract
In recent years, tremendous research endeavours have been dedicated to seeking effective visual representations for facilitating various multimedia applications, such as visual annotation and retrieval. Nonetheless, existing approaches can hardly achieve satisfactory performance due to the scarcity of fully exploring semantic properties of visual codes. In this paper, we present a novel visual coding approach, termed as hierarchical semantic visual coding (HSVC), to effectively encode visual objects (e.g., image and video) in a semantic hierarchy. Specifically, we first construct a semantic-enriched dictionary hierarchy, which is comprised of dictionaries corresponding to all concepts in a semantic hierarchy as well as their hierarchical semantic correlation. Moreover, we devise an on-line semantic coding model, which simultaneously 1) exploits the rich hierarchical semantic prior knowledge in the learned dictionary, 2) reflects semantic sparse property of visual codes, and 3) explores semantic relationships among concepts in the semantic hierarchy. To this end, we propose to integrate concept-level group sparsity constraint and semantic correlation matrix into a unified regularization term. We design an effective algorithm to optimize the proposed model, and a rigorous mathematical analysis has been provided to guarantee that the algorithm converges to a global optima. Extensive experiments on various multimedia datasets have been conducted to illustrate the superiority of our proposed approach as compared to state-of-the-art methods.Keywords
This publication has 27 references indexed in Scilit:
- Efficient dictionary learning for visual categorizationComputer Vision and Image Understanding, 2014
- Exploiting Web Images for Semantic Video Indexing Via Robust Sample-Specific LossIEEE Transactions on Multimedia, 2014
- Attribute-augmented semantic hierarchy2013
- Effective transfer tagging from image to videoACM Transactions on Multimedia Computing, Communications, and Applications, 2013
- On Taxonomies for Multi-class Image CategorizationInternational Journal of Computer Vision, 2011
- WordNet2010
- What Does Classifying More Than 10,000 Image Categories Tell Us?2010
- Efficient Object Category Recognition Using Classemes2010
- The Group Lasso for Logistic RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005