Social-Sensed Image Search
Authors:
Open Access
- 1 April 2014
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 32 (2) , 1-23
Abstract
Although Web search techniques have greatly facilitate users’ information seeking, there are still quite a lot of search sessions that cannot provide satisfactory results, which are more serious in Web image search scenarios. How to understand user intent from observed data is a fundamental issue and of paramount significance in improving image search performance. Previous research efforts mostly focus on discovering user intent either from clickthrough behavior in user search logs (e.g., Google), or from social data to facilitate vertical image search in a few limited social media platforms (e.g., Flickr). This article aims to combine the virtues of these two information sources to complement each other, that is, sensing and understanding users’ interests from social media platforms and transferring this knowledge to rerank the image search results in general image search engines. Toward this goal, we first propose a novel social-sensed image search framework, where both social media and search engine are jointly considered. To effectively and efficiently leverage these two kinds of platforms, we propose an example-based user interest representation and modeling method, where we construct a hybrid graph from social media and propose a hybrid random-walk algorithm to derive the user-image interest graph. Moreover, we propose a social-sensed image reranking method to integrate the user-image interest graph from social media and search results from general image search engines to rerank the images by fusing their social relevance and visual relevance. We conducted extensive experiments on real-world data from Flickr and Google image search, and the results demonstrated that the proposed methods can significantly improve the social relevance of image search results while maintaining visual relevance well.Keywords
Funding Information
- Ministry of Science and Technology of the People's Republic of China (2013DFG12870, 2011CB302206)
- National Natural Science Foundation of China (61370022, 61303075, 61210008)
- Media Development Authority - Singapore (WBS:R-252-300-001-490)
This publication has 55 references indexed in Scilit:
- Social-oriented visual image searchComputer Vision and Image Understanding, 2013
- Sparse hashing for fast multimedia searchACM Transactions on Information Systems, 2013
- Social contextual recommendation2012
- Who should share what?2011
- Improving graph-walk-based similarity with rerankingACM Transactions on Information Systems, 2010
- Designing Novel Image Search Interfaces by Understanding Unique Characteristics and Usage2009
- Image retrievalACM Computing Surveys, 2008
- Unifying user-based and item-based collaborative filtering approaches by similarity fusion2006
- Searching for images: The analysis of users' queries for image retrieval in American historyJournal of the American Society for Information Science and Technology, 2003
- Models for metasearch2001