CORE: A Global Aggregation Service for Open Access Papers
Open Access
- 7 June 2023
- journal article
- research article
- Published by Springer Nature in Scientific Data
- Vol. 10 (1) , 1-19
Abstract
This paper introduces CORE, a widely used scholarly service, which provides access to the world’s largest collection of open access research publications, acquired from a global network of repositories and journals. CORE was created with the goal of enabling text and data mining of scientific literature and thus supporting scientific discovery, but it is now used in a wide range of use cases within higher education, industry, not-for-profit organisations, as well as by the general public. Through the provided services, CORE powers innovative use cases, such as plagiarism detection, in market-leading third-party organisations. CORE has played a pivotal role in the global move towards universal open access by making scientific knowledge more easily and freely discoverable. In this paper, we describe CORE’s continuously growing dataset and the motivation behind its creation, present the challenges associated with systematically gathering research papers from thousands of data providers worldwide at scale, and introduce the novel solutions that were developed to overcome these challenges. The paper then provides an in-depth discussion of the services and tools built on top of the aggregated data and finally examines several use cases that have leveraged the CORE dataset and services.Keywords
This publication has 15 references indexed in Scilit:
- Building Scalable Digital Library Ingestion Pipelines Using Microservices2017
- Microsoft Academic is one year old: the Phoenix is ready to leave the nestScientometrics, 2017
- Scholarly Data Mining: Making Sense of Scientific Literature2017
- Systematic review automation technologiesSystematic Reviews, 2014
- The Number of Scholarly Documents on the Public WebPLOS ONE, 2014
- ResourceSync2013
- CORE: Three Access Levels to Underpin Open AccessD-Lib Magazine, 2012
- Seventy-Five Trials and Eleven Systematic Reviews a Day: How Will We Ever Keep Up?PLOS Medicine, 2010
- Maps of random walks on complex networks reveal community structureProceedings of the National Academy of Sciences, 2008
- How Quickly Do Systematic Reviews Go Out of Date? A Survival AnalysisAnnals of Internal Medicine, 2007