Lexical Co-Occurrence and Contextual Window-Based Approach with Semantic Similarity for Query Expansion
Authors:
- 1 July 2017
- journal article
- research article
- Published by IGI Global Scientific Publishing in International Journal of Intelligent Information Technologies
- Vol. 13 (3) , 57-78
Abstract
Query expansion (QE) is an efficient method for enhancing the efficiency of information retrieval system. In this work, we try to capture the limitations of pseudo-feedback based QE approach and propose a hybrid approach for enhancing the efficiency of feedback based QE by combining corpus-based, contextual based information of query terms, and semantic based knowledge of query terms. First of all, this paper explores the use of different corpus-based lexical co-occurrence approaches to select an optimal combination of query terms from a pool of terms obtained using pseudo-feedback based QE. Next, we explore semantic similarity approach based on word2vec for ranking the QE terms obtained from top pseudo-feedback documents. Further, we combine co-occurrence statistics, contextual window statistics, and semantic similarity based approaches together to select the best expansion terms for query reformulation. The experiments were performed on FIRE ad-hoc and TREC-3 benchmark datasets. The statistics of our proposed experimental results show significant improvement over baseline method.Keywords
This publication has 22 references indexed in Scilit:
- Co-occurrence and Semantic Similarity Based Hybrid Approach for Improving Automatic Query Expansion in Information Retrieval2015
- A query transformation framework for automated structured query construction in structured retrieval environmentJournal of Information Science, 2014
- A Survey of Automatic Query Expansion in Information RetrievalACM Computing Surveys, 2012
- Finding a good query‐related topic for boosting pseudo‐relevance feedbackJournal of the American Society for Information Science and Technology, 2011
- Improving the effectiveness of information retrieval with local context analysisACM Transactions on Information Systems, 2000
- WordNetCommunications of the ACM, 1995
- The limitations of term co-occurrence data for query expansion in document retrieval systemsJournal of the American Society for Information Science, 1991
- Features of similarity.Psychological Review, 1977
- A THEORETICAL BASIS FOR THE USE OF CO‐OCCURRENCE DATA IN INFORMATION RETRIEVALJournal of Documentation, 1977
- Word‐word associations in document retrieval systemsAmerican Documentation, 1969