Migrating 120,000 Legacy Publications from Several Systems into a Current Research Information System Using Advanced Data Wrangling Techniques
Open Access
- 14 November 2023
- journal article
- research article
- Published by MDPI AG in Publications
- Vol. 11 (4) , 49
Abstract
This article describes a complex CRIS (current research information system) implementation project involving the migration of around 120,000 legacy publication records from three different systems. The project, undertaken by Tampere University, encountered several challenges in data diversity, data quality, and resource allocation. To handle the extensive and heterogenous dataset, innovative approaches such as machine learning techniques and various data wrangling tools were used to process data, correct errors, and merge information from different sources. Despite significant delays and unforeseen obstacles, the project was ultimately successful in achieving its goals. The project served as a valuable learning experience, highlighting the importance of data quality and standardized practices, and the need for dedicated resources in handling complex data migration projects in research organizations. This study stands out for its comprehensive documentation of the data wrangling and migration process, which has been less explored in the context of CRIS literature.Keywords
This publication has 35 references indexed in Scilit:
- Usability on the Edge: The Implementation of u:cris at the University of ViennaProcedia Computer Science, 2014
- CERIF – Is the Standard Helping to Improve CRIS?Procedia Computer Science, 2014
- BoRIS and BIA: CRIS and Institutional Repository Integration at the Free University of Bozen-BolzanoProcedia Computer Science, 2014
- OpenAIRE Guidelines for CRIS Managers: Supporting Interoperability of Open Research Information through Established StandardsProcedia Computer Science, 2014
- OpenAIRE Guidelines: Supporting Interoperability for Literature Repositories, Data Archives and CRISProcedia Computer Science, 2014
- Managing research publications: lessons learned from the implementation of a Current Research Information SystemSerials, 2011
- XQuery Full Text Implementation in BaseX2009
- Cross-Validation2009
- Current research information systems, open access repositories and librariesLibrary Review, 2008
- Building Predictive Models inRUsing thecaretPackage2008