Evaluating the retrieval effectiveness of search engines using Persian navigational queries
Authors:
- 1 September 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 26, 563-568
Abstract
In this paper, we evaluate search engines' performance by considering how they behave for Persian users' navigational queries. About 2000 queries were posed to three search services supporting Persian language (Google and Bing as well-known services and Parsijoo as a local search service). All queries were of navigational type and in Persian language. These queries were created in a way to have web pages from Iranian web sites as their targets. After sending these queries to search engines the position of the target web pages in the result list of search engines were recorded. Then mean reciprocal rank and Success N measures were used for evaluation of the search services' effectiveness. At the end, we find out that although some search services have better performance for such kind of queries, but from a statistical point of view their efficiency is near to each other. For example for the MRR measure Parsijoo score is 0.58 and Google score is 0.54 and Bing Score is 0.52.Keywords
This publication has 14 references indexed in Scilit:
- A Framework for Evaluating the Retrieval Effectiveness of Search Engines2012
- Current research issues and trends in non-English Web searchingInformation Retrieval Journal, 2009
- Web retrieval systems and the Greek language: do they have an understanding?Journal of Information Science, 2007
- Automatic search engine performance evaluation with click-through data analysis2007
- Understanding user goals in web search2004
- Information Retrieval Effectiveness of Turkish Search EnginesLecture Notes in Computer Science, 2002
- A taxonomy of web searchACM SIGIR Forum, 2002
- Measuring Search Engine QualityInformation Retrieval Journal, 2001
- Finding information on the World Wide Web: the retrieval effectiveness of search enginesInformation Processing & Management, 1999
- First 20 precision among World Wide Web search services (search engines)Journal of the American Society for Information Science, 1999