Usage impact factor: The effects of sample characteristics on usage‐based impact metrics
Open Access
- 10 December 2007
- journal article
- research article
- Published by Wiley in Journal of the American Society for Information Science and Technology
- Vol. 59 (1) , 136-149
Abstract
There exist ample demonstrations that indicators of scholarly impact analogous to the citation‐based ISI Impact Factor can be derived from usage data; however, so far, usage can practically be recorded only at the level of distinct information services. This leads to community‐specific assessments of scholarly impact that are difficult to generalize to the global scholarly community. In contrast, the ISI Impact Factor is based on citation data and thereby represents the global community of scholarly authors. The objective of this study is to examine the effects of community characteristics on assessments of scholarly impact from usage. We define a journal Usage Impact Factor that mimics the definition of the Thomson Scientific ISI Impact Factor. Usage Impact Factor rankings are calculated on the basis of a large‐scale usage dataset recorded by the linking servers of the California State University system from 2003 to 2005. The resulting journal rankings are then compared to the Thomson Scientific ISI Impact Factor that is used as a reference indicator of general impact. Our results indicate that the particular scientific and demographic characteristics of a discipline have a strong effect on resulting usage‐based assessments of scholarly impact. In particular, we observed that as the number of graduate students and faculty increases in a particular discipline, Usage Impact Factor rankings will converge more strongly with the ISI Impact Factor.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Measuring Total Reading of Journal ArticlesD-Lib Magazine, 2006
- Earlier Web usage statistics as predictors of later citation impactJournal of the American Society for Information Science and Technology, 2006
- Statistical relationships between downloads and citations at the level of individual documents within a single journalJournal of the American Society for Information Science and Technology, 2005
- Worldwide use and impact of the NASA Astrophysics Data System digital libraryJournal of the American Society for Information Science and Technology, 2004
- Project COUNTERJournal of Information Processing and Management, 2004
- Evaluation of Digital Library Impact and User Communities by Analysis of Usage PatternsD-Lib Magazine, 2002
- Open Linking in the Scholarly Information Environment Using the OpenURL FrameworkD-Lib Magazine, 2001
- Reference Linking in a Hybrid Library EnvironmentD-Lib Magazine, 1999
- Sense and nonsense of science citation analyses: comments on the monopoly position of ISI and citation inaccuracies. Risks of possible misuse and biased citation and impact data.New Journal of Chemistry, 1998
- CITATION ANALYSES AS INDICATORS OF THE USE OF SERIALS: A COMPARISON OF RANKED TITLE LISTS PRODUCED BY CITATION COUNTING AND FROM USE DATAJournal of Documentation, 1976