MKMagdalena Kozula

Magdalena Kozula

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Magdalena Kozula has a total of 37 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Open science interventions to improve reproducibility in science: a narrative review from a behaviour change wheel perspective

    by Magdalena Kozula, Veerle Van Den Eynden, Nicholas J. DeVito, Tony Ross-Hellauer, Eva Kormann, Mariska M. G. Leeflang, Patrick Onghena

    Academics, policymakers and other research stakeholders have broadly discussed strategies to improve research reproducibility, with heightened attention given to open science practices. One strand of these discussions adopts a behavioural perspective centred on researchers. This narrative review applied the behaviour change wheel (BCW) framework to analyse 103 interventions evaluated for their effectiveness in improving reproducibility and reproducibility-related practices. We systematically mapped the included interventions across the nine BCW intervention types and seven supporting policy categories, highlighting which mechanisms have been most and least frequently evaluated empirically. We then interpreted these mechanisms using the COM-B behaviour model (capability–opportunity–motivation). The analysis revealed that ‘coercion’ and ‘persuasion’ were the most commonly studied types of intervention, implemented through ‘regulations’ and ‘guidelines’, with active enforcement appearing to be more effective than voluntary adherence. By contrast, ‘incentivisation’, ‘training’ and ‘modelling'—central to many reform agendas—were rarely evaluated empirically, and ‘communication’ and ‘legislation’ seldom appeared as implementation policies. Furthermore, most interventions were journal-led rather than funder- or university-led, indicating the limited involvement of other important stakeholders. Our analysis suggests that the key to supporting reproducible and transparent research lies in a strategic and integrated approach that targets all components of COM-B, with accountability mechanisms, context-sensitive measures and synergistic action involving multiple stakeholders.

  • Open Access

    What helps and hinders reproducible research? Researchers’ perspectives from a cross-disciplinary interview study

    by Magdalena Kozula, Nicholas J. DeVito, Patrick Onghena, Cinzia Colombo, Leonie A. Dudda, Paula Muñoz Teno, Veerle Van Den Eynden

    Debates and policy initiatives addressing research reproducibility have expanded considerably in recent years. Yet, many of these measures remain generic and risk overlooking the lived realities of research practice. This study aims to explore researchers’ perspectives on the barriers, facilitators, and motivators that shape reproducible research across diverse fields and career stages, using qualitative methods. Semi-structured interviews were conducted with 60 researchers affiliated with universities and research institutions across the European Union and the United Kingdom. Participants were sampled to ensure diversity in discipline, career stage, gender, and geography. The interviews explored experiences with barriers and facilitators for reproducible research, and the data were analyzed using framework analysis with a hybrid inductive–deductive approach. Five interrelated themes described barriers and facilitators influencing reproducibility: navigating the research ecosystem (incentives and policies of institutions, journals, and funders); social and cultural dynamics as drivers and barriers (disciplinary norms, generational differences, competition, and collaboration); resourcing reproducibility (skills, infrastructure, guidelines and standards, time, funding, and awareness); inside the research process (field-specific constraints, methodological transparency, research material sharing, and external restrictions); and personal commitment to shared responsibility (reflective motivations, pragmatic drivers, and perceptions of accountability). Researchers described reproducibility as less of an individual choice but as a socially and institutionally mediated activity, dependent on enabling conditions such as supportive policies, adequate infrastructure, and equitable resource distribution. Reproducibility reform cannot rely solely on individual researcher commitment or one-size-fits-all policies. Effective interventions must account for disciplinary and methodological diversity, provide targeted resources and training, and realign incentive structures to reward transparency and rigour. These findings highlight reproducibility as a collective responsibility across the research ecosystem, requiring coordinated action by researchers, institutions, funders, and publishers. Promoting reproducible practices in this systemic, context-sensitive manner is essential for fostering a more credible, equitable, and sustainable scientific enterprise.

  • Open Access

    Using reporting guidelines to improve the reproducibility of cooking Christmas tree meringues: the “People tasting trees” cluster-randomised controlled trial

    by Constant Vinatier, Emma Fahed, Yoann Chollet, Laura Caquelin, Sylvie Jaillard, Veerle Van Den Eynden, Magdalena Kozula, Florian Naudet

    To test whether improving a Christmas tree meringue recipe using reporting guidelines yields more appealing and sweeter meringues. A prospective, superiority, single-blind, cluster-randomised (1:1) controlled trial. A public participatory event in a large cultural facility in France. Budding chefs with basic culinary skills, possessing the utensils necessary for baking Christmas tree meringues, and not having burned pasta in the past month (for safety reasons). Bunding chefs represent the cluster and meringue the unit. Each budding chef was randomised to a standard recipe for making Christmas tree meringues or to the same recipe written in consultation with a professional baker using the TIDieR checklist-a reporting guideline for description of complex interventions-plus a short video tutorial. The primary outcome was reproducibility in terms of visual aspect. Secondary outcomes included colour, size, taste and survival time in the course of a sale organised as part of the public event. The visual aspect, colour and size was rated by an independent jury which compared the cooked Christmas tree meringues with the recipe picture on a scale from 1 to 10. Analyses were performed in intention-to-eat (randomization unit: budding chefs / analysis unit: Christmas trees). 60 budding chefs (30 in each group) baked a total of 845 Christmas tree meringues. There was no significant difference between the groups (mean difference = -0.1; [95%CI -0.99; 0.80]; p-value = 0.84; intra-cluster correlation, ICC = 0.77) on visual aspect. No difference was found for reproducibility in terms of colour (mean difference = -0.31; [95%CI -0.97; 0.35]; p-value = 0.35; ICC = 0.67) or size (mean difference = -0.17; [95%CI -1.07; 0.73]; p-value = 0.71; ICC = 0.74). There was no significant difference in terms of taste between the groups (mean difference = -0.55; [95%CI -1.62; 0.52]; p-value = 0.31). 400 meringues were sold during the public event with no difference in survival time between groups (hazard ratio = 1.26 [95% CI 0.75-2.09], p-value = 0.38, with values > 1 in favour of the control group). e.g. 75% survived for 134 min in intervention group and for 124 min in the control group. Our study failed to demonstrate that an improved recipe using the TIDieR reporting guideline with a video tutorial improved the reproducibility in terms of visual aspect, colour, size, taste and sales for Christmas tree meringues. The best way to succeed in reproducing Christmas tree meringues alike those showcased by the recipe-and thereby to improve reproducibility of experiments-remains a mystery still to be solved by further explorations. https://osf.io/dnhbx .

  • Top Cited Papers
    Open Access

    Open science interventions to improve reproducibility and replicability of research: a scoping review

    by Leonie Dudda, Eva Kormann, Magdalena Kozula, Nicholas J. DeVito, Thomas Klebel, Ayu P. M. Dewi, René Spijker, Inge Stegeman, Veerle Van Den Eynden, Tony Ross-Hellauer, et al.

    Various open science practices have been proposed to improve the reproducibility and replicability of scientific research, but not for all practices, there may be evidence they are indeed effective. Therefore, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline , Embase , Web of Science , PsycINFO , Scopus and Eric , on 18 August 2023. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. We summarized the retrieved evidence narratively and in evidence gap maps. Of the 105 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the remainder addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or pre-registration. Thirty studies were non-comparative and 27 were comparative but cross-sectional observational designs, precluding any causal inference. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.


  • Open Access

    Ten tales of reproducibility

    by Paula Muñoz Teno, Ayu Putu Madri Dewi, Constant Vinatier, Magdalena Kozula, Stefan Wouters, Nicholas DeVito, Hynek Roubik, Mariska Leeflang, Inge Stegeman, Veerle Van Den Eynden

    The OSIRIS project identified cases of notable, innovative, and inspiring reproducibility practices which advance research institutions, funders, and publishers towards reproducible research.

  • Open Access

    Open Science in practice: Insights from the OSIRIS project

    by Magdalena Kozula, Veerle Van Den Eynden, Patrick Onghena, Nicholas DeVito, Cinzia Colombo

    Within the Horizon-funded OSIRIS project, we share how preregistration and open data practices help to enhance reproducibility in qualitative research. By featuring practices undertaken by the team, we highlight lessons to aid others in adopting open science.

  • Open Access

    Using reporting guidelines to improve the reproducibility of cooking Christmas tree meringues: the “People tasting trees” cluster-randomised controlled trial

    by Constant Vinatier, Emma Fahed, Yoann Chollet, Laura Caquelin, Sylvie Jaillard, Veerle Van Den Eynden, Magdalena Kozula, Naudet Florian

    Objectives: To test whether improving a Christmas tree meringue recipe using reporting guidelines yields more appealing and sweeter meringues.Design: A prospective, superiority, single-blind, cluster-randomised (1:1) controlled trial Setting: A public participatory event in a large cultural facility in France Participants: Budding chefs with basic culinary skills, possessing the utensils necessary for baking Christmas tree meringues, and not having burned pasta in the past month (for safety reasons).Interventions: Each budding chef was randomised to a standard recipe for making Christmas tree meringues or to the same recipe written in consultation with a professional baker using the TIDieR checklist - a reporting guideline for description of complex interventions - plus a short video tutorial.Main outcome measures: The primary outcome was reproducibility in terms of visual aspect as rated by an independent jury which compared the cooked Christmas tree meringues with the recipe picture on a scale from 1 to 10. Secondary outcomes included colour, size, taste and survival time in the course of a sale organised as part of the public event. Analyses were performed in intention-to-eat (randomization unit: budding chefs / analysis unit: Christmas trees).Results: 60 budding chefs (30 in each group) baked a total of 845 Christmas tree meringues. There was no significant difference between the groups (mean difference=-0.1; [95%CI -0.99; 0.80]; p-value=0.84; intra-cluster correlation, ICC=0.77) on visual aspect. No difference was found for reproducibility in terms of colour (mean difference=-0.31; [95%CI -0.97; 0.35]; p-value=0.35; ICC=0.67) or size (mean difference=-0.17; [95%CI -1.07; 0.73]; p-value=0.71; ICC=0.74). There was no significant difference in terms of taste between the groups (mean difference= -0.55; [95%CI -1.62; 0.52]; p-value=0.31). 400 meringues were sold during the public event with no difference in survival time between groups (hazard ratio= 1.26 [95% CI 0.75–2.09], p-value=0.38) in favor of the control group.Conclusions: Our study failed to demonstrate that an improved recipe using the TIDieR reporting guideline with a video tutorial improved the reproducibility in terms of visual aspect, colour, size, taste and sales for Christmas tree meringues. The best way to succeed in baking Christmas tree meringues - and thereby to improve reproducibility of experiments - remains a mystery still to be solved by further explorations. Trial registration: https://osf.io/dnhbx


  • Open Access

    Scoping review and evidence mapping of interventions aimed at improving reproducible and replicable science: Protocol

    by Leonie A. Dudda, Magdalena Kozula, Tony Ross-Hellauer, Eva Kormann, René Spijker, Nicholas DeVito, Gowri Gopalakrishna, Veerle Van Den Eynden, Patrick Onghena, Florian Naudet, et al.

    Background Many interventions, especially those linked to open science, have been proposed to improve reproducibility in science. To what extent these propositions are based on scientific evidence from empirical evaluations is not clear. Aims The primary objective is to identify Open Science interventions that have been formally investigated regarding their influence on reproducibility and replicability. A secondary objective is to list any facilitators or barriers reported and to identify gaps in the evidence. Methods We will search broadly by using electronic bibliographic databases, broad internet search, and contacting experts in the field of reproducibility, replicability, and open science. Any study investigating interventions for their influence on the reproducibility and replicability of research will be selected, including those studies additionally investigating drivers and barriers to the implementation and effectiveness of interventions. Studies will first be selected by title and abstract (if available) and then by reading the full text by at least two independent reviewers. We will analyze existing scientific evidence using scoping review and evidence gap mapping methodologies. Results The results will be presented in interactive evidence maps, summarized in a narrative synthesis, and serve as input for subsequent research. Review registration This protocol has been pre-registered on OSF under doi https://doi.org/10.17605/OSF.IO/D65YS


  • Open Access

    Open Science interventions to improve reproducibility and replicability of research: a scoping review preprint

    by Leonie Dudda, Eva Kormann, Magdalena Kozula, Nicholas J DeVito, Thomas Klebel, Ayu Putu Madri Dewi, René Spijker, Inge Stegeman, Veerle Van Den Eynden, Tony Ross-Hellauer, et al.

    Various interventions – especially those related to open science – have been proposed to improve the reproducibility and replicability of scientific research. To assess whether and which interventions have been formally tested for their effectiveness in improving reproducibility and replicability, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline, Embase, Web of Science, PsycINFO, Scopus and Eric, on August 18, 2023. Grey literature was requested from experts in the fields of reproducibility and open science. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. An intervention could be any action taken by either individual researchers or scientific institutions (e.g., research institutes, publishers and funders). We summarized the retrieved evidence narratively and in an evidence gap map. Of the 104 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the other research questions addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or preregistration. Thirty research questions within included studies were non-comparative and 27 were comparative but cross-sectional, precluding any causal inference. Possible limitations of our review may be the search and selection strategy, which was done by a large team including researchers from different disciplines and different expertise levels. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence-base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.


  • Open Access

    Scoping review of open science interventions for improving reproducible and replicable science

    by Magdalena Kozula, Leonie Dudda, Eva Kormann, Veerle Van Den Eynden, Patrick Onghena, Tony Ross-Hellauer, Mariska M. Leeflang, Integrity Enhancing Trust

    The effectiveness of efforts to improve reproducibility in science remains unclear. This poster presents a scoping review of interventions aimed at improving reproducibility, including open science practices. The study was conducted under Horizon Europe projects OSIRIS and TIER2.