A New Adaptive Indexing for Real-Time Web Search
Open Access
- 1 January 2022
- journal article
- research article
- Published by IGI Global Scientific Publishing in International Journal of Intelligent Information Technologies
- Vol. 18 (1) , 1-19
Abstract
Adaptive indexing is an alternative to the self-tuning methods. It is especially useful in the scenario of unpredictable workload, and there is no idle time to invest in index creation. The authors present their ongoing work on a new realistic adaptive indexing that transforms the previous data crawling offline approach to a data-driven online approach. The proposed approach consists of three tasks: topic prediction, resource selection, and results combination and ranking. They work simultaneously to retrieve highly relevant results to the user's query in real time. To make the index highly refreshed and up-to-date, they collected data from highly prominent resources (e.g., Facebook, Twitter, Wikipedia, etc.). The empirical results showed that the proposed model is better than the traditional models that work offline and spend hours or days for building the index in different periods. In addition, the experiments showed that the training results are highly relevant for adhoc and diversity tasks. Request access from your librarian to read this article's full text.Keywords
This publication has 12 references indexed in Scilit:
- LS-AMS: An Adaptive Indexing Structure for Realtime Search on MicroblogsIEEE Transactions on Big Data, 2015
- Aggregated searchACM Computing Surveys, 2014
- Blink and it's doneProceedings of the VLDB Endowment, 2012
- Sources of evidence for vertical selection2009
- User modeling for full-text federated search in peer-to-peer networks2006
- A probabilistic model of information retrieval: development and comparative experimentsInformation Processing & Management, 2000
- Flexible and scalable cost-based query planning in mediators: A transformational approachArtificial Intelligence, 2000
- The anatomy of a large-scale hypertextual Web search engineComputer Networks and ISDN Systems, 1998
- Adaptive search for solving hard project scheduling problemsNaval Research Logistics (NRL), 1996
- Large-scale concurrent computing in artificial intelligence research1988