A study of query by semantic example
- 1 June 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
In recent years, query-by-semantic-example (QBSE) has become a popular approach to do content based image retrieval. QBSE extends the well established query-by-example retrieval paradigm to the semantic domain. While various authors have pointed out the benefits of QBSE, there are still various open questions with respect to this paradigm. These include a lack of precise understanding of how the overall performance depends on various different parameters of the system. In this work, we present a systematic experimental study of the QBSE framework. This can be broadly divided into three categories. First, we examine the space of low-level visual features for its effects on the retrieval performance. Second, we study the space of learned semantic concepts, herein denoted as the ldquosemantic spacerdquo, and show that not all semantic concepts are equally informative for retrieval. Finally, we present a study of the intrinsic structure of the semantic space, by analyzing the contextual relationships between semantic concepts and show that this intrinsic structure is crucial for the performance improvements.Keywords
This publication has 23 references indexed in Scilit:
- Information-theoretic semantic multimedia indexing2007
- Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Semantic representation2004
- Joint semantics and feature based image retrieval using relevance feedbackIEEE Transactions on Multimedia, 2003
- Image retrieval using color and shapePattern Recognition, 1996
- Photobook: Content-based manipulation of image databasesInternational Journal of Computer Vision, 1996
- A metadatabase system for semantic image search by a mathematical model of meaningACM SIGMOD Record, 1994
- QBIC project: querying images by content, using color, texture, and shape1993
- Nonmetric Multidimensional Scaling: A Numerical MethodPsychometrika, 1964