Web robot detection in scholarly Open Access institutional repositories
- 19 September 2016
- journal article
- research article
- Published by Emerald Publishing in Library Hi Tech
- Vol. 34 (3) , 500-520
Abstract
Purpose: The purpose of this paper is to investigate the impact and techniques for mitigating the effects of web robots on usage statistics collected by Open Access (OA) institutional repositories (IRs). Design/methodology/approach: A close review of the literature provides a comprehensive list of web robot detection techniques. Reviews of system documentation and open source code are carried out along with personal interviews to provide a comparison of the robot detection techniques used in the major IR platforms. An empirical test based on a simple random sample of downloads with 96.20 per cent certainty is undertaken to measure the accuracy of an IR’s web robot detection at a large Irish University. Findings: While web robot detection is not ignored in IRs, there are areas where the two main systems could be improved. The technique tested here is found to have successfully detected 94.18 per cent of web robots visiting the site over a two-year period (recall), with a precision of 98.92 per cent. Due to the high level of robot activity in repositories, correctly labelling more robots has an exponential effect on the accuracy of usage statistics. Research limitations/implications: This study is performed on one repository using a single system. Future studies across multiple sites and platforms are needed to determine the accuracy of web robot detection in OA repositories generally. Originality/value: This is the only study to date to have investigated web robot detection in IRs. It puts forward the first empirical benchmarking of accuracy in IR usage statistics.Keywords
This publication has 10 references indexed in Scilit:
- The Experience of the RePEc Plagiarism Committee in Economics2015
- The Importance of Identifying and Accommodating E-Resource Usage Data for the Presence of Outliers. The Negative Impacts of Inaccurate E-Journal Usage Data.Information Technology and Libraries, 2014
- IRUS-UK: making scholarly statistics count in UK repositoriesInsights the UKSG journal, 2012
- Web robot detection based on pattern-matching techniqueJournal of Information Science, 2012
- Web robot detection techniques: overview and limitationsData Mining and Knowledge Discovery, 2010
- Web robot detection: A probabilistic reasoning approachComputer Networks, 2009
- Web robot detection in the scholarly information environmentJournal of Information Science, 2008
- Earlier Web usage statistics as predictors of later citation impactJournal of the American Society for Information Science and Technology, 2006
- DSpaceD-Lib Magazine, 2003
- Discovery of Web Robot Sessions Based on their Navigational PatternsData Mining and Knowledge Discovery, 2002