Magdalena Kozula
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Magdalena Kozula has a total of 37 co-authors. Here are the top co-authors by number of shared publications:
- Veerle Van Den Eynden
KU Leuven
11 shared publications - Nicholas J. DeVito
University of Oxford
8 shared publications - Mariska Maria Geertruida Leeflang
Department of Epidemiology and Data Science, Amsterdam Public Health, Amsterdam University Medical Centers University of Amsterdam Amsterdam the Netherlands
7 shared publications - Patrick Onghena
Methodology of Educational Sciences, KU Leuven, Leuven, Belgium
7 shared publications - Eva Kormann
Know Center Research GmbH 4 , Graz, Styria, Austria
5 shared publications - Inge Stegeman
Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Utrecht, Utrecht, The Netherlands
5 shared publications
Latest Publications
- Open Access
- 26 August 2026
- Published by The Royal Society in Royal Society Open Science
- Vol. 13 (8)
Open science interventions to improve reproducibility in science: a narrative review from a behaviour change wheel perspective
Academics, policymakers and other research stakeholders have broadly discussed strategies to improve research reproducibility, with heightened attention given to open science practices. One strand of these discussions adopts a behavioural perspective centred on researchers. This narrative review applied the behaviour change wheel (BCW) framework to analyse 103 interventions evaluated for their effectiveness in improving reproducibility and reproducibility-related practices. We systematically mapped the included interventions across the nine BCW intervention types and seven supporting policy categories, highlighting which mechanisms have been most and least frequently evaluated empirically. We then interpreted these mechanisms using the COM-B behaviour model (capability–opportunity–motivation). The analysis revealed that ‘coercion’ and ‘persuasion’ were the most commonly studied types of intervention, implemented through ‘regulations’ and ‘guidelines’, with active enforcement appearing to be more effective than voluntary adherence. By contrast, ‘incentivisation’, ‘training’ and ‘modelling'—central to many reform agendas—were rarely evaluated empirically, and ‘communication’ and ‘legislation’ seldom appeared as implementation policies. Furthermore, most interventions were journal-led rather than funder- or university-led, indicating the limited involvement of other important stakeholders. Our analysis suggests that the key to supporting reproducible and transparent research lies in a strategic and integrated approach that targets all components of COM-B, with accountability mechanisms, context-sensitive measures and synergistic action involving multiple stakeholders.
- 26 August 2026
- Published by The Royal Society in Royal Society Open Science
- Vol. 13 (8)
Open AccessOpen science interventions to improve reproducibility in science: a narrative review from a behaviour change wheel perspective
Academics, policymakers and other research stakeholders have broadly discussed strategies to improve research reproducibility, with heightened attention given to open science practices. One strand of these discussions adopts a behavioural perspective centred on researchers. This narrative review applied the behaviour change wheel (BCW) framework to analyse 103 interventions evaluated for their effectiveness in improving reproducibility and reproducibility-related practices. We systematically mapped the included interventions across the nine BCW intervention types and seven supporting policy categories, highlighting which mechanisms have been most and least frequently evaluated empirically. We then interpreted these mechanisms using the COM-B behaviour model (capability–opportunity–motivation). The analysis revealed that ‘coercion’ and ‘persuasion’ were the most commonly studied types of intervention, implemented through ‘regulations’ and ‘guidelines’, with active enforcement appearing to be more effective than voluntary adherence. By contrast, ‘incentivisation’, ‘training’ and ‘modelling'—central to many reform agendas—were rarely evaluated empirically, and ‘communication’ and ‘legislation’ seldom appeared as implementation policies. Furthermore, most interventions were journal-led rather than funder- or university-led, indicating the limited involvement of other important stakeholders. Our analysis suggests that the key to supporting reproducible and transparent research lies in a strategic and integrated approach that targets all components of COM-B, with accountability mechanisms, context-sensitive measures and synergistic action involving multiple stakeholders.
- Open Access
- 20 May 2026
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 21 (5) , e0348512
What helps and hinders reproducible research? Researchers’ perspectives from a cross-disciplinary interview study
Debates and policy initiatives addressing research reproducibility have expanded considerably in recent years. Yet, many of these measures remain generic and risk overlooking the lived realities of research practice. This study aims to explore researchers’ perspectives on the barriers, facilitators, and motivators that shape reproducible research across diverse fields and career stages, using qualitative methods. Semi-structured interviews were conducted with 60 researchers affiliated with universities and research institutions across the European Union and the United Kingdom. Participants were sampled to ensure diversity in discipline, career stage, gender, and geography. The interviews explored experiences with barriers and facilitators for reproducible research, and the data were analyzed using framework analysis with a hybrid inductive–deductive approach. Five interrelated themes described barriers and facilitators influencing reproducibility: navigating the research ecosystem (incentives and policies of institutions, journals, and funders); social and cultural dynamics as drivers and barriers (disciplinary norms, generational differences, competition, and collaboration); resourcing reproducibility (skills, infrastructure, guidelines and standards, time, funding, and awareness); inside the research process (field-specific constraints, methodological transparency, research material sharing, and external restrictions); and personal commitment to shared responsibility (reflective motivations, pragmatic drivers, and perceptions of accountability). Researchers described reproducibility as less of an individual choice but as a socially and institutionally mediated activity, dependent on enabling conditions such as supportive policies, adequate infrastructure, and equitable resource distribution. Reproducibility reform cannot rely solely on individual researcher commitment or one-size-fits-all policies. Effective interventions must account for disciplinary and methodological diversity, provide targeted resources and training, and realign incentive structures to reward transparency and rigour. These findings highlight reproducibility as a collective responsibility across the research ecosystem, requiring coordinated action by researchers, institutions, funders, and publishers. Promoting reproducible practices in this systemic, context-sensitive manner is essential for fostering a more credible, equitable, and sustainable scientific enterprise.
- 20 May 2026
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 21 (5) , e0348512
Open AccessWhat helps and hinders reproducible research? Researchers’ perspectives from a cross-disciplinary interview study
Debates and policy initiatives addressing research reproducibility have expanded considerably in recent years. Yet, many of these measures remain generic and risk overlooking the lived realities of research practice. This study aims to explore researchers’ perspectives on the barriers, facilitators, and motivators that shape reproducible research across diverse fields and career stages, using qualitative methods. Semi-structured interviews were conducted with 60 researchers affiliated with universities and research institutions across the European Union and the United Kingdom. Participants were sampled to ensure diversity in discipline, career stage, gender, and geography. The interviews explored experiences with barriers and facilitators for reproducible research, and the data were analyzed using framework analysis with a hybrid inductive–deductive approach. Five interrelated themes described barriers and facilitators influencing reproducibility: navigating the research ecosystem (incentives and policies of institutions, journals, and funders); social and cultural dynamics as drivers and barriers (disciplinary norms, generational differences, competition, and collaboration); resourcing reproducibility (skills, infrastructure, guidelines and standards, time, funding, and awareness); inside the research process (field-specific constraints, methodological transparency, research material sharing, and external restrictions); and personal commitment to shared responsibility (reflective motivations, pragmatic drivers, and perceptions of accountability). Researchers described reproducibility as less of an individual choice but as a socially and institutionally mediated activity, dependent on enabling conditions such as supportive policies, adequate infrastructure, and equitable resource distribution. Reproducibility reform cannot rely solely on individual researcher commitment or one-size-fits-all policies. Effective interventions must account for disciplinary and methodological diversity, provide targeted resources and training, and realign incentive structures to reward transparency and rigour. These findings highlight reproducibility as a collective responsibility across the research ecosystem, requiring coordinated action by researchers, institutions, funders, and publishers. Promoting reproducible practices in this systemic, context-sensitive manner is essential for fostering a more credible, equitable, and sustainable scientific enterprise.
- Open Access
- 3 December 2025
- Published by Springer Nature in Research Integrity and Peer Review
- Vol. 10 (1) , 22
Using reporting guidelines to improve the reproducibility of cooking Christmas tree meringues: the “People tasting trees” cluster-randomised controlled trial
To test whether improving a Christmas tree meringue recipe using reporting guidelines yields more appealing and sweeter meringues. A prospective, superiority, single-blind, cluster-randomised (1:1) controlled trial. A public participatory event in a large cultural facility in France. Budding chefs with basic culinary skills, possessing the utensils necessary for baking Christmas tree meringues, and not having burned pasta in the past month (for safety reasons). Bunding chefs represent the cluster and meringue the unit. Each budding chef was randomised to a standard recipe for making Christmas tree meringues or to the same recipe written in consultation with a professional baker using the TIDieR checklist-a reporting guideline for description of complex interventions-plus a short video tutorial. The primary outcome was reproducibility in terms of visual aspect. Secondary outcomes included colour, size, taste and survival time in the course of a sale organised as part of the public event. The visual aspect, colour and size was rated by an independent jury which compared the cooked Christmas tree meringues with the recipe picture on a scale from 1 to 10. Analyses were performed in intention-to-eat (randomization unit: budding chefs / analysis unit: Christmas trees). 60 budding chefs (30 in each group) baked a total of 845 Christmas tree meringues. There was no significant difference between the groups (mean difference = -0.1; [95%CI -0.99; 0.80]; p-value = 0.84; intra-cluster correlation, ICC = 0.77) on visual aspect. No difference was found for reproducibility in terms of colour (mean difference = -0.31; [95%CI -0.97; 0.35]; p-value = 0.35; ICC = 0.67) or size (mean difference = -0.17; [95%CI -1.07; 0.73]; p-value = 0.71; ICC = 0.74). There was no significant difference in terms of taste between the groups (mean difference = -0.55; [95%CI -1.62; 0.52]; p-value = 0.31). 400 meringues were sold during the public event with no difference in survival time between groups (hazard ratio = 1.26 [95% CI 0.75-2.09], p-value = 0.38, with values > 1 in favour of the control group). e.g. 75% survived for 134 min in intervention group and for 124 min in the control group. Our study failed to demonstrate that an improved recipe using the TIDieR reporting guideline with a video tutorial improved the reproducibility in terms of visual aspect, colour, size, taste and sales for Christmas tree meringues. The best way to succeed in reproducing Christmas tree meringues alike those showcased by the recipe-and thereby to improve reproducibility of experiments-remains a mystery still to be solved by further explorations. https://osf.io/dnhbx .
- 3 December 2025
- Published by Springer Nature in Research Integrity and Peer Review
- Vol. 10 (1) , 22
Open AccessUsing reporting guidelines to improve the reproducibility of cooking Christmas tree meringues: the “People tasting trees” cluster-randomised controlled trial
To test whether improving a Christmas tree meringue recipe using reporting guidelines yields more appealing and sweeter meringues. A prospective, superiority, single-blind, cluster-randomised (1:1) controlled trial. A public participatory event in a large cultural facility in France. Budding chefs with basic culinary skills, possessing the utensils necessary for baking Christmas tree meringues, and not having burned pasta in the past month (for safety reasons). Bunding chefs represent the cluster and meringue the unit. Each budding chef was randomised to a standard recipe for making Christmas tree meringues or to the same recipe written in consultation with a professional baker using the TIDieR checklist-a reporting guideline for description of complex interventions-plus a short video tutorial. The primary outcome was reproducibility in terms of visual aspect. Secondary outcomes included colour, size, taste and survival time in the course of a sale organised as part of the public event. The visual aspect, colour and size was rated by an independent jury which compared the cooked Christmas tree meringues with the recipe picture on a scale from 1 to 10. Analyses were performed in intention-to-eat (randomization unit: budding chefs / analysis unit: Christmas trees). 60 budding chefs (30 in each group) baked a total of 845 Christmas tree meringues. There was no significant difference between the groups (mean difference = -0.1; [95%CI -0.99; 0.80]; p-value = 0.84; intra-cluster correlation, ICC = 0.77) on visual aspect. No difference was found for reproducibility in terms of colour (mean difference = -0.31; [95%CI -0.97; 0.35]; p-value = 0.35; ICC = 0.67) or size (mean difference = -0.17; [95%CI -1.07; 0.73]; p-value = 0.71; ICC = 0.74). There was no significant difference in terms of taste between the groups (mean difference = -0.55; [95%CI -1.62; 0.52]; p-value = 0.31). 400 meringues were sold during the public event with no difference in survival time between groups (hazard ratio = 1.26 [95% CI 0.75-2.09], p-value = 0.38, with values > 1 in favour of the control group). e.g. 75% survived for 134 min in intervention group and for 124 min in the control group. Our study failed to demonstrate that an improved recipe using the TIDieR reporting guideline with a video tutorial improved the reproducibility in terms of visual aspect, colour, size, taste and sales for Christmas tree meringues. The best way to succeed in reproducing Christmas tree meringues alike those showcased by the recipe-and thereby to improve reproducibility of experiments-remains a mystery still to be solved by further explorations. https://osf.io/dnhbx .
- Top Cited PapersOpen Access
- 9 April 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (4) , 242057
Open science interventions to improve reproducibility and replicability of research: a scoping review
Various open science practices have been proposed to improve the reproducibility and replicability of scientific research, but not for all practices, there may be evidence they are indeed effective. Therefore, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline , Embase , Web of Science , PsycINFO , Scopus and Eric , on 18 August 2023. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. We summarized the retrieved evidence narratively and in evidence gap maps. Of the 105 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the remainder addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or pre-registration. Thirty studies were non-comparative and 27 were comparative but cross-sectional observational designs, precluding any causal inference. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.
- 9 April 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (4) , 242057
Top Cited PapersOpen AccessOpen science interventions to improve reproducibility and replicability of research: a scoping review
Various open science practices have been proposed to improve the reproducibility and replicability of scientific research, but not for all practices, there may be evidence they are indeed effective. Therefore, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline , Embase , Web of Science , PsycINFO , Scopus and Eric , on 18 August 2023. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. We summarized the retrieved evidence narratively and in evidence gap maps. Of the 105 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the remainder addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or pre-registration. Thirty studies were non-comparative and 27 were comparative but cross-sectional observational designs, precluding any causal inference. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.
- Open Access
- 13 March 2025
- Published by PubPub
Ten tales of reproducibility
The OSIRIS project identified cases of notable, innovative, and inspiring reproducibility practices which advance research institutions, funders, and publishers towards reproducible research.
- 13 March 2025
- Published by PubPub
Open AccessTen tales of reproducibility
The OSIRIS project identified cases of notable, innovative, and inspiring reproducibility practices which advance research institutions, funders, and publishers towards reproducible research.
- Open Access
- 13 March 2025
- Published by PubPub
Open Science in practice: Insights from the OSIRIS project
Within the Horizon-funded OSIRIS project, we share how preregistration and open data practices help to enhance reproducibility in qualitative research. By featuring practices undertaken by the team, we highlight lessons to aid others in adopting open science.
- 13 March 2025
- Published by PubPub
Open AccessOpen Science in practice: Insights from the OSIRIS project
Within the Horizon-funded OSIRIS project, we share how preregistration and open data practices help to enhance reproducibility in qualitative research. By featuring practices undertaken by the team, we highlight lessons to aid others in adopting open science.
- Open Access
- 8 October 2024
- Published by Center for Open Science in MetaArXiv
Using reporting guidelines to improve the reproducibility of cooking Christmas tree meringues: the “People tasting trees” cluster-randomised controlled trial
Objectives: To test whether improving a Christmas tree meringue recipe using reporting guidelines yields more appealing and sweeter meringues.Design: A prospective, superiority, single-blind, cluster-randomised (1:1) controlled trial Setting: A public participatory event in a large cultural facility in France Participants: Budding chefs with basic culinary skills, possessing the utensils necessary for baking Christmas tree meringues, and not having burned pasta in the past month (for safety reasons).Interventions: Each budding chef was randomised to a standard recipe for making Christmas tree meringues or to the same recipe written in consultation with a professional baker using the TIDieR checklist - a reporting guideline for description of complex interventions - plus a short video tutorial.Main outcome measures: The primary outcome was reproducibility in terms of visual aspect as rated by an independent jury which compared the cooked Christmas tree meringues with the recipe picture on a scale from 1 to 10. Secondary outcomes included colour, size, taste and survival time in the course of a sale organised as part of the public event. Analyses were performed in intention-to-eat (randomization unit: budding chefs / analysis unit: Christmas trees).Results: 60 budding chefs (30 in each group) baked a total of 845 Christmas tree meringues. There was no significant difference between the groups (mean difference=-0.1; [95%CI -0.99; 0.80]; p-value=0.84; intra-cluster correlation, ICC=0.77) on visual aspect. No difference was found for reproducibility in terms of colour (mean difference=-0.31; [95%CI -0.97; 0.35]; p-value=0.35; ICC=0.67) or size (mean difference=-0.17; [95%CI -1.07; 0.73]; p-value=0.71; ICC=0.74). There was no significant difference in terms of taste between the groups (mean difference= -0.55; [95%CI -1.62; 0.52]; p-value=0.31). 400 meringues were sold during the public event with no difference in survival time between groups (hazard ratio= 1.26 [95% CI 0.75–2.09], p-value=0.38) in favor of the control group.Conclusions: Our study failed to demonstrate that an improved recipe using the TIDieR reporting guideline with a video tutorial improved the reproducibility in terms of visual aspect, colour, size, taste and sales for Christmas tree meringues. The best way to succeed in baking Christmas tree meringues - and thereby to improve reproducibility of experiments - remains a mystery still to be solved by further explorations. Trial registration: https://osf.io/dnhbx
- 8 October 2024
- Published by Center for Open Science in MetaArXiv
Open AccessUsing reporting guidelines to improve the reproducibility of cooking Christmas tree meringues: the “People tasting trees” cluster-randomised controlled trial
Objectives: To test whether improving a Christmas tree meringue recipe using reporting guidelines yields more appealing and sweeter meringues.Design: A prospective, superiority, single-blind, cluster-randomised (1:1) controlled trial Setting: A public participatory event in a large cultural facility in France Participants: Budding chefs with basic culinary skills, possessing the utensils necessary for baking Christmas tree meringues, and not having burned pasta in the past month (for safety reasons).Interventions: Each budding chef was randomised to a standard recipe for making Christmas tree meringues or to the same recipe written in consultation with a professional baker using the TIDieR checklist - a reporting guideline for description of complex interventions - plus a short video tutorial.Main outcome measures: The primary outcome was reproducibility in terms of visual aspect as rated by an independent jury which compared the cooked Christmas tree meringues with the recipe picture on a scale from 1 to 10. Secondary outcomes included colour, size, taste and survival time in the course of a sale organised as part of the public event. Analyses were performed in intention-to-eat (randomization unit: budding chefs / analysis unit: Christmas trees).Results: 60 budding chefs (30 in each group) baked a total of 845 Christmas tree meringues. There was no significant difference between the groups (mean difference=-0.1; [95%CI -0.99; 0.80]; p-value=0.84; intra-cluster correlation, ICC=0.77) on visual aspect. No difference was found for reproducibility in terms of colour (mean difference=-0.31; [95%CI -0.97; 0.35]; p-value=0.35; ICC=0.67) or size (mean difference=-0.17; [95%CI -1.07; 0.73]; p-value=0.71; ICC=0.74). There was no significant difference in terms of taste between the groups (mean difference= -0.55; [95%CI -1.62; 0.52]; p-value=0.31). 400 meringues were sold during the public event with no difference in survival time between groups (hazard ratio= 1.26 [95% CI 0.75–2.09], p-value=0.38) in favor of the control group.Conclusions: Our study failed to demonstrate that an improved recipe using the TIDieR reporting guideline with a video tutorial improved the reproducibility in terms of visual aspect, colour, size, taste and sales for Christmas tree meringues. The best way to succeed in baking Christmas tree meringues - and thereby to improve reproducibility of experiments - remains a mystery still to be solved by further explorations. Trial registration: https://osf.io/dnhbx
- Open Access
- 10 July 2024
- Published by CERN in Open Research Europe
- Vol. 3, 179
Scoping review and evidence mapping of interventions aimed at improving reproducible and replicable science: Protocol
Background Many interventions, especially those linked to open science, have been proposed to improve reproducibility in science. To what extent these propositions are based on scientific evidence from empirical evaluations is not clear. Aims The primary objective is to identify Open Science interventions that have been formally investigated regarding their influence on reproducibility and replicability. A secondary objective is to list any facilitators or barriers reported and to identify gaps in the evidence. Methods We will search broadly by using electronic bibliographic databases, broad internet search, and contacting experts in the field of reproducibility, replicability, and open science. Any study investigating interventions for their influence on the reproducibility and replicability of research will be selected, including those studies additionally investigating drivers and barriers to the implementation and effectiveness of interventions. Studies will first be selected by title and abstract (if available) and then by reading the full text by at least two independent reviewers. We will analyze existing scientific evidence using scoping review and evidence gap mapping methodologies. Results The results will be presented in interactive evidence maps, summarized in a narrative synthesis, and serve as input for subsequent research. Review registration This protocol has been pre-registered on OSF under doi https://doi.org/10.17605/OSF.IO/D65YS
- 10 July 2024
- Published by CERN in Open Research Europe
- Vol. 3, 179
Open AccessScoping review and evidence mapping of interventions aimed at improving reproducible and replicable science: Protocol
Background Many interventions, especially those linked to open science, have been proposed to improve reproducibility in science. To what extent these propositions are based on scientific evidence from empirical evaluations is not clear. Aims The primary objective is to identify Open Science interventions that have been formally investigated regarding their influence on reproducibility and replicability. A secondary objective is to list any facilitators or barriers reported and to identify gaps in the evidence. Methods We will search broadly by using electronic bibliographic databases, broad internet search, and contacting experts in the field of reproducibility, replicability, and open science. Any study investigating interventions for their influence on the reproducibility and replicability of research will be selected, including those studies additionally investigating drivers and barriers to the implementation and effectiveness of interventions. Studies will first be selected by title and abstract (if available) and then by reading the full text by at least two independent reviewers. We will analyze existing scientific evidence using scoping review and evidence gap mapping methodologies. Results The results will be presented in interactive evidence maps, summarized in a narrative synthesis, and serve as input for subsequent research. Review registration This protocol has been pre-registered on OSF under doi https://doi.org/10.17605/OSF.IO/D65YS
- Open Access
- 17 June 2024
- Published by Center for Open Science in MetaArXiv
Open Science interventions to improve reproducibility and replicability of research: a scoping review preprint
Various interventions – especially those related to open science – have been proposed to improve the reproducibility and replicability of scientific research. To assess whether and which interventions have been formally tested for their effectiveness in improving reproducibility and replicability, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline, Embase, Web of Science, PsycINFO, Scopus and Eric, on August 18, 2023. Grey literature was requested from experts in the fields of reproducibility and open science. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. An intervention could be any action taken by either individual researchers or scientific institutions (e.g., research institutes, publishers and funders). We summarized the retrieved evidence narratively and in an evidence gap map. Of the 104 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the other research questions addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or preregistration. Thirty research questions within included studies were non-comparative and 27 were comparative but cross-sectional, precluding any causal inference. Possible limitations of our review may be the search and selection strategy, which was done by a large team including researchers from different disciplines and different expertise levels. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence-base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.
- 17 June 2024
- Published by Center for Open Science in MetaArXiv
Open AccessOpen Science interventions to improve reproducibility and replicability of research: a scoping review preprint
Various interventions – especially those related to open science – have been proposed to improve the reproducibility and replicability of scientific research. To assess whether and which interventions have been formally tested for their effectiveness in improving reproducibility and replicability, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline, Embase, Web of Science, PsycINFO, Scopus and Eric, on August 18, 2023. Grey literature was requested from experts in the fields of reproducibility and open science. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. An intervention could be any action taken by either individual researchers or scientific institutions (e.g., research institutes, publishers and funders). We summarized the retrieved evidence narratively and in an evidence gap map. Of the 104 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the other research questions addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or preregistration. Thirty research questions within included studies were non-comparative and 27 were comparative but cross-sectional, precluding any causal inference. Possible limitations of our review may be the search and selection strategy, which was done by a large team including researchers from different disciplines and different expertise levels. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence-base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.
- Open Access
- 6 May 2024
- Published by PubPub
Scoping review of open science interventions for improving reproducible and replicable science
The effectiveness of efforts to improve reproducibility in science remains unclear. This poster presents a scoping review of interventions aimed at improving reproducibility, including open science practices. The study was conducted under Horizon Europe projects OSIRIS and TIER2.
- 6 May 2024
- Published by PubPub
Open AccessScoping review of open science interventions for improving reproducible and replicable science
The effectiveness of efforts to improve reproducibility in science remains unclear. This poster presents a scoping review of interventions aimed at improving reproducibility, including open science practices. The study was conducted under Horizon Europe projects OSIRIS and TIER2.