Using text-mining to measure the scientific impact and legacy of ELIXIR, a distributed research infrastructure for life science data
Open Access
- 22 April 2025
- journal article
- Published by F1000 Research Ltd in F1000Research
- Vol. 13, 1547
Abstract
Background ELIXIR is a pan-European public-funded research infrastructure dedicated to life science data. As such, it must demonstrate public value to its funders and stakeholders. We present methods to inventory research publications linked to ELIXIR that have received funding and support, as well as related citation metrics, used as performance metrics for these audiences. Methods To overcome challenges inherent in ELIXIR’s distributed structure, and the fact that those publishing ELIXIR-supported work are typically working part-time on ELIXIR matters, a semi-automated approach, consisting of text-mining followed by manual curation, is presented. A country-level case study (ELIXIR Italy) refines and expands the methods, notably by introducing more granularity in the curation process (e.g. considering all national-level grants, examining affiliations to report publication per institute) and by additionally looking at the scientific impact of the resources developed and operated by the Italian Node of ELIXIR. Results Overall, the methods described in this article have shown to: (1) be repeatable with acceptable levels of accuracy and consistency (notably across curators); (2) require reasonable effort in terms of curation of monthly ‘harvests’ of publications (obtained by text-mining); and (3) to be well-adapted to ELIXIR’s distributed nature. Conclusions Concrete examples are provided of downstream uses of the inventoried publications and their citations, both for ELIXIR as a whole and for the Italian case study. Limitations of the methods are discussed, particularly the challenges associated with using an ‘Open literature’ database (Europe PMC) for the text-mining, and the constraints related to curation capacity. The methods, along with the valuable lessons learned during their development, are sufficiently generic and pragmatic enough to be readily adapted by other similar research infrastructures.Keywords
Funding Information
- Italian Ministry for Universities and Research (IR0000010)
- European Union (871075, 777563, 101058728)
- ELIXIR, the research infrastructure for life science data
This publication has 12 references indexed in Scilit:
- Europe PMC in 2023Nucleic Acids Research, 2023
- Measuring outcomes and impact from the BioHackathon EuropeBioHackrXiv, 2021
- Demonstrating public value to funders and other stakeholders—the journey of ELIXIR, a virtual and distributed research infrastructure for life science dataAnnals of Public and Cooperative Economics, 2021
- ELIXIR‐EXCELERATE: establishing Europe's data infrastructure for the life science research of the futureThe EMBO Journal, 2021
- The ELIXIR Core Data Resources: fundamental infrastructure for the life sciencesBioinformatics, 2020
- The bio.tools registry of software tools and data resources for the life sciencesGenome Biology, 2019
- Reference framework for assessing the scientific and socio-economic impact of research infrastructures2019
- Identifying ELIXIR Core Data ResourcesF1000Research, 2017
- PatSearch: a program for the detection of patterns and structural motifs in nucleotide sequencesNucleic Acids Research, 2003
- PatSearch: a pattern matcher software that finds functional elements in nucleotide and protein sequences and assesses their statistical significanceBioinformatics, 2000