Intent-Aware Video Search Result Optimization
- 4 April 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 16 (5) , 1421-1433
Abstract
Video search engines are relatively successful at returning search results that users find to be on topic. These results do not, however, completely satisfy the user's information need unless they also fulfill the user's intent, i.e., the immediate goal a user seeks to accomplish with video search. Satisfying a user's information need to its full extent poses a particular challenge to video search engines because user intent is often not explicitly reflected in the query. In this paper, we propose a multimodal approach that addresses this challenge by refining the results lists returned by a mainstream video search engine in order to optimally capture user intent. Our approach is based on the insight that the results lists returned by video search engines do contain videos that satisfy user's intent, but that videos with the highest potential for satisfaction are often buried within or scattered over the results list. The proposed approach consists of three steps. In the first step, it analyzes the initial results list to determine the intent distribution pattern. On the basis of this pattern, in the second step, it refines the video search results list such that the top of the list better reveals intent. The third step further improves this refinement by visual reranking, exploiting intent-sensitive lightweight visual features extracted from thumbnails. Extensive evaluation of the approach includes a user study carried out on a crowdsourcing platform and a system-oriented evaluation. Evaluation results demonstrate that our approach leads to a substantial improvement of the information need satisfaction at users.Keywords
This publication has 37 references indexed in Scilit:
- Blip100002013
- Exploiting User Comments for Audio-Visual Content Indexing and Retrieval2013
- Query difficulty estimation for image retrievalNeurocomputing, 2012
- Repeatable and reliable search system evaluation using crowdsourcing2011
- To Seek, Perchance to Fail: Expressions of User Needs in Internet Video SearchLecture Notes in Computer Science, 2011
- Crowdsourcing for relevance evaluationACM SIGIR Forum, 2008
- Modeling and Mining of Users' Capture Intention for Home VideosIEEE Transactions on Multimedia, 2006
- Video search reranking via information bottleneck principle2006
- Evaluating implicit measures to improve web searchACM Transactions on Information Systems, 2005
- Video Google: a text retrieval approach to object matching in videos2003