Automated Query Learning with Wikipedia and Genetic Programming
Preprint
Abstract
Most of the existing information retrieval systems are based on bag of words model and are not equipped with common world knowledge. Work has been done towards improving the efficiency of such systems by using intelligent algorithms to generate search queries, however, not much research has been done in the direction of incorporating human-and-society level knowledge in the queries. This paper is one of the first attempts where such information is incorporated into the search queries using Wikipedia semantics. The paper presents an essential shift from conventional token based queries to concept based queries, leading to an enhanced efficiency of information retrieval systems. To efficiently handle the automated query learning problem, we propose Wikipedia-based Evolutionary Semantics (Wiki-ES) framework where concept based queries are learnt using a co-evolving evolutionary procedure. Learning concept based queries using an intelligent evolutionary procedure yields significant improvement in performance which is shown through an extensive study using Reuters newswire documents. Comparison of the proposed framework is performed with other information retrieval systems. Concept based approach has also been implemented on other information retrieval systems to justify the effectiveness of a transition from token based queries to concept based queries.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Mining meaning from WikipediaInternational Journal of Human-Computer Studies, 2009
- Applying multi-objective evolutionary algorithms to the automatic learning of extended Boolean queries in fuzzy ordinal linguistic information retrieval systemsFuzzy Sets and Systems, 2009
- A study of the use of multi‐objective evolutionary algorithms to learn Boolean queries: A comparative studyJournal of the American Society for Information Science and Technology, 2009
- Using genetic algorithms to evolve a population of topical queriesInformation Processing & Management, 2008
- YAGO: A Large Ontology from Wikipedia and WordNetJournal of Web Semantics, 2008
- Improving the learning of Boolean queries by means of a multiobjective IQBE evolutionary algorithmInformation Processing & Management, 2006
- A review on the application of evolutionary computation to information retrievalInternational Journal of Approximate Reasoning, 2003
- Multiple query evaluation based on an enhanced genetic algorithmInformation Processing & Management, 2003
- On using genetic algorithms for multimodal relevance optimization in information retrievalJournal of the American Society for Information Science and Technology, 2002
- Applying genetic algorithms to query optimization in document retrievalInformation Processing & Management, 2000