Investigating the performance of automatic new topic identification across multiple datasets
Open Access
- 1 January 2006
- journal article
- research article
- Published by Wiley in Proceedings of the American Society for Information Science and Technology
- Vol. 43 (1) , 1-27
Abstract
Recent studies on automatic new topic identification in Web search engine user sessions demonstrated that neural networks are successful in automatic new topic identification. However most of this work applied their new topic identification algorithms on data logs from a single search engine. In this study, we investigate whether the application of neural networks for automatic new topic identification are more successful on some search engines than others. Sample data logs from the Norwegian search engine FAST (currently owned by Overture) and Excite are used in this study. Findings of this study suggest that query logs with more topic shifts tend to provide more successful results on shift‐based performance measures, whereas logs with more topic continuations tend to provide better results on continuation‐based performance measures.Keywords
This publication has 25 references indexed in Scilit:
- Neural network applications for automatic new topic identificationOnline Information Review, 2005
- Topic modeling for mediated access to very large document collectionsJournal of the American Society for Information Science and Technology, 2004
- Neural network applications for automatic new topic identification on excite web search engine data logsProceedings of the American Society for Information Science and Technology, 2004
- Are people asking questions of general Web search engines?Online Information Review, 2003
- Multitasking Web searching and implications for designProceedings of the American Society for Information Science and Technology, 2003
- Multimedia Web searching trendsProceedings of the American Society for Information Science and Technology, 2002
- From e-sex to e-commerce: Web search changesComputer, 2002
- Query clustering using user logsACM Transactions on Information Systems, 2002
- Use of query reformulation and relevance feedback by Excite usersInternet Research, 2000
- Analysis of a very large web search engine query logACM SIGIR Forum, 1999