Data Sharing and Evaluation: Evaluation's Role in Improving the Quality of Open Science Data Sharing Platforms
- 1 December 2024
- journal article
- Published by Wiley in New Directions for Evaluation
- Vol. 2024 (184) , 65-71
Abstract
Data sharing platforms are vital open science tools that facilitate research collaboration and data dissemination. Evaluating these platforms helps ensure they meet open science standards by assessing their accessibility, utility, and impact. This article shares a case example from a user experience evaluation of an open science data sharing platform, which collected mixed methods data from users, stakeholders, and the platform's website. In describing the case example, the authors aimed to understand the role of evaluation in helping the platform adhere to open science practices and to identify opportunities for evaluators to use similar types of platforms to enhance their evaluation practice. The evaluation team used open science principles to design their evaluation, which aligned with evaluation values of inclusion, transparency, and utility. The evaluation provided useful data for understanding platform users’ perspectives on the platform and perceptions of its impact. The case example suggests that open science data sharing platforms could provide many benefits for the evaluation field, such as offering ways to collaborate with others, strengthening the quality of evaluation studies, and improving the availability of data. However, to increase engagement of evaluators in data sharing platforms, it is important to build partnerships between evaluators and platform developers, design training and outreach for evaluators, and research how existing data sharing platforms can be further developed to serve the evaluation community.Keywords
This publication has 18 references indexed in Scilit:
- Philosophy of Open Science2023
- Integrating user experience evaluation in the development of a web-based Community Engagement ToolkitEvaluation and Program Planning, 2022
- Dynamics of cumulative advantage and threats to equity in open science: a scoping reviewRoyal Society Open Science, 2022
- Accessibility of environmental data for sharing: The role of UX in large cyberinfrastructure projectsEcological Informatics, 2021
- Open Science now: A systematic literature review for an integrated definitionJournal of Business Research, 2018
- Data Authorship as an Incentive to Data SharingNew England Journal of Medicine, 2017
- Implementing a data sharing cultureEpidemiology and Psychiatric Sciences, 2016
- Design Principles for Data Visualization in EvaluationNew Directions for Evaluation, 2013
- Evaluating a collaborative IT based research and development projectEvaluation and Program Planning, 2013
- Framing participatory evaluationNew Directions for Evaluation, 1998