Assessing and tracing the outcomes and impact of research infrastructures
Open Access
- 3 August 2016
- journal article
- review article
- Published by Wiley in Journal of the Association for Information Science and Technology
- Vol. 68 (6) , 1341-1359
Abstract
Recent policy shifts on the part of funding agencies and journal publishers are causing changes in the acknowledgment and citation behaviors of scholars. A growing emphasis on open science and reproducibility is changing how authors cite and acknowledge “research infrastructures”—entities that are used as inputs to or as underlying foundations for scholarly research, including data sets, software packages, computational models, observational platforms, and computing facilities. At the same time, stakeholder interest in quantitative understanding of impact is spurring increased collection and analysis of metrics related to use of research infrastructures. This article reviews work spanning several decades on tracing and assessing the outcomes and impacts from these kinds of research infrastructures. We discuss how research infrastructures are identified and referenced by scholars in the research literature and how those references are being collected and analyzed for the purposes of evaluating impact. Synthesizing common features of a wide range of studies, we identify notable challenges that impede the analysis of impact metrics for research infrastructures and outline key open research questions that can guide future research and applications related to such metrics.Keywords
Funding Information
- Directorate for Computer and Information Science and Engineering (1448480)
- Alfred P. Sloan Foundation (G‐2014‐13746))
This publication has 105 references indexed in Scilit:
- Database Citation in Full Text Biomedical ArticlesPLOS ONE, 2013
- Do Altmetrics Work? Twitter and Ten Other Social Web ServicesPLOS ONE, 2013
- Indicators for the Data Usage Index (DUI): an incentive for publishing primary biodiversity data through global information infrastructureBMC Bioinformatics, 2011
- Extraction of data deposition statements from the literature: a method for automatically tracking research resultsBioinformatics, 2011
- Who Shares? Who Doesn't? Factors Associated with Openly Archiving Raw Research DataPLOS ONE, 2011
- Annotating genes and genomes with DNA sequences extracted from biomedical articlesBioinformatics, 2011
- Public sharing of research datasets: A pilot study of associationsJournal of Informetrics, 2010
- CiTO, the Citation Typing OntologyJournal of Biomedical Semantics, 2010
- A Principal Component Analysis of 39 Scientific Impact MeasuresPLOS ONE, 2009
- Sharing Detailed Research Data Is Associated with Increased Citation RatePLOS ONE, 2007