Neural Vector Spaces for Unsupervised Information Retrieval
Open Access
- 26 June 2018
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 36 (4) , 1-25
Abstract
We propose the Neural Vector Space Model (NVSM), a method that learns representations of documents in an unsupervised manner for news article retrieval. In the NVSM paradigm, we learn low-dimensional representations of words and documents from scratch using gradient descent and rank documents according to their similarity with query representations that are composed from word representations. We show that NVSM performs better at document ranking than existing latent semantic vector space methods. The addition of NVSM to a mixture of lexical language models and a state-of-the-art baseline vector space model yields a statistically significant increase in retrieval effectiveness. Consequently, NVSM adds a complementary relevance signal. Next to semantic matching, we find that NVSM performs well in cases where lexical matching is needed. NVSM learns a notion of term specificity directly from the document collection without feature engineering. We also show that NVSM learns regularities related to Luhn significance. Finally, we give advice on how to deploy NVSM in situations where model selection (e.g., cross-validation) is infeasible. We find that an unsupervised ensemble of multiple models trained with different hyperparameter values performs better than a single cross-validated model. Therefore, NVSM can safely be used for ranking documents without supervised relevance judgments.Keywords
All Related Versions
Funding Information
- Ahold Delhaize, Amsterdam Data Science, the Bloomberg Research Grant program
- Criteo Faculty Research Award program, Elsevier
- Google Faculty Research Award scheme, the Microsoft Research Ph.D. program, the Netherlands Institute for Sound and Vision, the Netherlands Organisation for Scientific Research (612.001.116, CI-14-25, 652.002.001, 612.001.551, and 652.001.003)
- Yandex
- European Community's Seventh Framework Programme (312827 (VOX-Pol))
This publication has 52 references indexed in Scilit:
- Scalable Nearest Neighbor Algorithms for High Dimensional DataIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Semantic hashingInternational Journal of Approximate Reasoning, 2009
- Bias and the limits of pooling for large collectionsInformation Retrieval Journal, 2007
- The TREC robust retrieval trackACM SIGIR Forum, 2005
- Understanding inverse document frequency: on theoretical arguments for IDFJournal of Documentation, 2004
- A study of smoothing methods for language models applied to information retrievalACM Transactions on Information Systems, 2004
- A taxonomy of web searchACM SIGIR Forum, 2002
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- The DARPA TIPSTER projectACM SIGIR Forum, 1992
- A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVALJournal of Documentation, 1972