Cross validation of neural network applications for automatic new topic identification
- 1 January 2005
- journal article
- new developments-in-information-retrieval
- Published by Wiley in Proceedings of the American Society for Information Science and Technology
- Vol. 42 (1)
Abstract
There are recent studies in the literature on automatic topic‐shift identification in Web search engine user sessions; however most of this work applied their topic‐shift identification algorithms on data logs from a single search engine. The purpose of this study is to provide the cross‐validation of an artificial neural network application to automatically identify topic changes in a web search engine user session by using data logs of different search engines for training and testing the neural network. Sample data logs from the Norwegian search engine FAST (currently owned by Overture) and Excite are used in this study. Findings of this study suggest that it could be possible to identify topic shifts and continuations successfully on a particular search engine user session using neural networks that are trained on a different search engine data log.Keywords
This publication has 17 references indexed in Scilit:
- Hourly analysis of a very large topically categorized web query log2004
- A day in the life of Web searching: an exploratory studyInformation Processing & Management, 2004
- Topic modeling for mediated access to very large document collectionsJournal of the American Society for Information Science and Technology, 2004
- Neural network applications for automatic new topic identification on excite web search engine data logsProceedings of the American Society for Information Science and Technology, 2004
- Multitasking Web searching and implications for designProceedings of the American Society for Information Science and Technology, 2003
- Combining evidence for automatic Web session identificationInformation Processing & Management, 2002
- Analysis of large data logs: an application of Poisson sampling on excite web queriesInformation Processing & Management, 2002
- Subject categorization of query terms for exploring Web users' search interestsJournal of the American Society for Information Science and Technology, 2002
- Agglomerative clustering of a search engine query log2000
- Real life, real users, and real needs: a study and analysis of user queries on the webInformation Processing & Management, 2000