ADAyu Putu Madri Dewi

Ayu Putu Madri Dewi

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Ayu Putu Madri Dewi has a total of 67 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Using an Open Science Checklist in Grant Proposal Reviews to Predict Reproducibility of Funded Publications

    by Ayu Putu Madri Dewi, Anne Floor Holtrop, Nicholas J. DeVito, Melissa L. Rethlefsen, Zulfan Zazuli, Mathieu Repiquet, Ka Hin Tai, Constant Vinatier, Monika Varga, Stefan Wouters, et al.

  • Open Access

    Assessing Commitments of Open Science Practices from Grant Proposals to Publications: Observational Study Preprint

    by Ayu Putu Madri Dewi, Inge Stegeman, Mariska Leeflang

    Objective: To assess whether the open science practices promised in grant proposals are subsequently implemented in the resulting publications. Study Design and Setting: We conducted an observational study cohort design using a dataset including 101 grant proposals, each matched with a subsequent publication. All grant proposals were collected from online sources, published in English, and between 1999 and 2024. We assessed which open science practices were mentioned and promised in the proposals using an open science checklist. We used the same checklist to score the subsequent publication and compared the open science scores in the grant and publication and assessed whether there were any discrepancies.Results: Open science practices are reported more frequently in publications than in grant proposals. The majority of open science practices implemented in publications is open access (81 out of 101), whereas a quarter of grants (26 out of 101) include these practices. Open materials, open data, and data citation are also more prevalent in publications than in grant proposals. Other practices, such as protocol availability, study registration, open code, code availability, software and tools, citation of materials or code, transparent reporting, preprints, and registered reports, are infrequently reported in both grants and publications. Notably, registered reports are absent from all publications. Among grants that planned open science practices, the actual implementation rate in funded publications is low. Of all grant proposals that promised to adhere to a certain open science practice between 1.0% and 21.8% of the subsequent articles committed to this practice.Conclusion: Open science practices are being implemented more frequently in publications than at the grant proposals. These findings suggest an opportunity for funders to strengthen policies of open science practices throughout the research lifecycle, from proposal submission to publication.

  • Open Access

    Using an Open Science Checklist in Grant Proposal Reviews to Predict Reproducibility of Funded Publications

    by Ayu Putu Madri Dewi, Anne Floor Holtrop, Nicholas J DeVito, Melissa L. Rethlefsen, Zulfan Zazuli, Mathieu Repiquet, Ka Hin Tai, Constant Vinatier, Monika Varga, Stefan Wouters, et al.

    ObjectiveTo determine whether an open science checklist can be useful for predicting the reproducibility of publications resulting from these grant proposals when used by grant referees assessing them.Study Design and SettingThis is a comparative accuracy study design using funded grant proposals obtained from online sources (i.e., Open Grants, RIO Journal, NIH, and Grantome). Two independent groups of mock referees assessed open science practices in the proposals and predicted whether the resulting publications would be reproducible, with one group using an Open Science checklist as an intervention, and the other without. Then we attempted to reproduce the primary findings of a resulting publication from the grant proposal. Sensitivity, specificity, predictive values, and overall accuracy were calculated from 2×2 tables, comparing predicted versus actual reproducibility. The primary outcome is the level of reproducibility, measured by the predictive value, the proportion of (non)reproducible study findings that are accurately predicted. This study was conducted between April and September 2025.Results Of seven out of 101 publications (6.9%, 95% CI 2.8–13.8%), the primary results could be reproduced. When using the checklist, only 16.8% of the proposals were expected to be reproducible, while without the checklist 75.2% were expected to be reproducible. When using the checklist, 17 proposals were expected to be reproducible, while only 2 out of these 17 could actually be reproduced (positive predictive value (PPV) 11.8% (95% CI 3.3–34.3%)). Without using the checklist, 76 proposals were thought to be reproducible, while only six out of 76 could actually be reproduced (PPV 7.9% (95% CI 3.7−16.2%)). Sensitivity analysis by research field was not conducted because of small sample sizes in most categories.Conclusion The Open Science checklist has a low positive predictive value, as expected given the low reproducibility prevalence in our sample. Although the differences between the group using the checklist and the group that did not use the checklist may also have been caused by their level of knowledge of reproducibility and open science, neither group could predict which proposals would or would not be reproducible.

  • Open Access

    Using an Open Science Checklist in Grant Proposal Reviews to Predict Reproducibility of Funded Publications

    by Ayu Putu Madri Dewi, Anne Floor Holtrop, Nicholas J DeVito, Melissa L. Rethlefsen, Zulfan Zazuli, Mathieu Repiquet, Ka Hin Tai, Constant Vinatier, Monika Varga, Stefan Wouters, et al.

    ObjectiveTo determine whether an open science checklist can be useful for predicting the reproducibility of publications resulting from these grant proposals when used by grant referees assessing them.Study Design and SettingThis is a comparative accuracy study design using funded grant proposals obtained from online sources (i.e., Open Grants, RIO Journal, NIH, and Grantome). Two independent groups of mock referees assessed open science practices in the proposals and predicted whether the resulting publications would be reproducible, with one group using an Open Science checklist as an intervention, and the other without. Then we attempted to reproduce the primary findings of a resulting publication from the grant proposal. Sensitivity, specificity, predictive values, and overall accuracy were calculated from 2×2 tables, comparing predicted versus actual reproducibility. The primary outcome is the level of reproducibility, measured by the predictive value, the proportion of (non)reproducible study findings that are accurately predicted. This study was conducted between April and September 2025.Results Of seven out of 101 publications (6.9%, 95% CI 2.8–13.8%), the primary results could be reproduced. When using the checklist, only 16.8% of the proposals were expected to be reproducible, while without the checklist 75.2% were expected to be reproducible. When using the checklist, 17 proposals were expected to be reproducible, while only 2 out of these 17 could actually be reproduced (positive predictive value (PPV) 11.8% (95% CI 3.3–34.3%)). Without using the checklist, 76 proposals were thought to be reproducible, while only six out of 76 could actually be reproduced (PPV 7.9% (95% CI 3.7−16.2%)). Sensitivity analysis by research field was not conducted because of small sample sizes in most categories.Conclusion The Open Science checklist has a low positive predictive value, as expected given the low reproducibility prevalence in our sample. Although the differences between the group using the checklist and the group that did not use the checklist may also have been caused by their level of knowledge of reproducibility and open science, neither group could predict which proposals would or would not be reproducible.

  • Open Access

    Monitoring of Open Science practices: a survey of 10 major medical journals

    by Constant Vinatier, Ayu Putu Madri Dewi, Guillaume Freyermuth, Margaux Millour, Maud Scheidecker, François-Joseph Arnault, Mathieu Acher, Vladislav Nachev, Tracey L. Weissgerber, Nicholas J. DeVito, et al.

    Objective: To evaluate open science policies of leading general medical journals and the extent to which open science practices are implemented and detectable using automated tools. Design: Cross-sectional audit of journal policies and retrospective observational study of journal articles, with diagnostic accuracy validation of automated screening tools against manual data extraction. Setting: Annals of Internal Medicine, BMC Medicine, The BMJ, CMAJ, JAMA, JAMA Network Open, The Lancet, Nature Medicine, New England Journal of Medicine, and PLOS Medicine. Participants:Research articles published between 2020 and 2023 and randomised controlled trials (RCTs) published before and after policy changes regarding registration and data-sharing. Main outcome measures: Journal policies were assessed using the TOP2025 framework, which rates journals’ transparency and openness standards using the TOP Factor (maximum score 27). At the article level, thirteen core open science practices were examined, including trial registration, protocol sharing, and intention to share data. Nine validated automated tools were applied to detect these practices and compared with manual extraction of 312 articles performed in duplicate. Changes in transparency practices following policy updates were analyzed. Results: Transparency policies varied considerably. TOP Factor scores ranged from 1 (NEJM) to 13 (PLOS Medicine), with many journals’ policies applying primarily to clinical trials rather than all research articles. Only one journal (BMC Medicine) proposed registered reports. At the article level, adoption of open science practices was highest in RCTs: trial registration (99% [95%–100%] vs 68% [55%–79%] in meta-analyses vs 15% [8%–27%] in other research), protocol sharing (95% [90%–98%] vs 67% [54%–78%] vs 19% [11%–32%]), and intention to share data (78% [67%–87%] vs 64% [49%–76%] vs 69% [55%–80%]). Performance across tools was very variable (F1 scores 0.16–1.00). Among all 15,624 research articles, tools detected registration in 20%, protocol sharing in 42%, and intention to share data in 48%, but these were generally underestimated. Policy changes such as mandatory registration or data-sharing requirements were associated with measurable improvements in the corresponding open science practices. Conclusions: Leading medical journals show only partial alignment with TOP2025, with stronger transparency observed for RCTs than for other study types. Triangulation with manual and automated assessments in articles confirms that key open science practices remain suboptimal especially for non-RCTs, highlighting the need for more robust journal policies. Policy changes are associated with observable improvements. Registration: OSF: https://doi.org/10.17605/OSF.IO/F2VW9


  • Top Cited Papers
    Open Access

    Open science interventions to improve reproducibility and replicability of research: a scoping review

    by Leonie Dudda, Eva Kormann, Magdalena Kozula, Nicholas J. DeVito, Thomas Klebel, Ayu P. M. Dewi, René Spijker, Inge Stegeman, Veerle Van Den Eynden, Tony Ross-Hellauer, et al.

    Various open science practices have been proposed to improve the reproducibility and replicability of scientific research, but not for all practices, there may be evidence they are indeed effective. Therefore, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline , Embase , Web of Science , PsycINFO , Scopus and Eric , on 18 August 2023. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. We summarized the retrieved evidence narratively and in evidence gap maps. Of the 105 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the remainder addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or pre-registration. Thirty studies were non-comparative and 27 were comparative but cross-sectional observational designs, precluding any causal inference. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.


  • Open Access

    Ten tales of reproducibility

    by Paula Muñoz Teno, Ayu Putu Madri Dewi, Constant Vinatier, Magdalena Kozula, Stefan Wouters, Nicholas DeVito, Hynek Roubik, Mariska Leeflang, Inge Stegeman, Veerle Van Den Eynden

    The OSIRIS project identified cases of notable, innovative, and inspiring reproducibility practices which advance research institutions, funders, and publishers towards reproducible research.

  • Open Access

    Open Science interventions to improve reproducibility and replicability of research: a scoping review preprint

    by Leonie Dudda, Eva Kormann, Magdalena Kozula, Nicholas J DeVito, Thomas Klebel, Ayu Putu Madri Dewi, René Spijker, Inge Stegeman, Veerle Van Den Eynden, Tony Ross-Hellauer, et al.

    Various interventions – especially those related to open science – have been proposed to improve the reproducibility and replicability of scientific research. To assess whether and which interventions have been formally tested for their effectiveness in improving reproducibility and replicability, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline, Embase, Web of Science, PsycINFO, Scopus and Eric, on August 18, 2023. Grey literature was requested from experts in the fields of reproducibility and open science. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. An intervention could be any action taken by either individual researchers or scientific institutions (e.g., research institutes, publishers and funders). We summarized the retrieved evidence narratively and in an evidence gap map. Of the 104 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the other research questions addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or preregistration. Thirty research questions within included studies were non-comparative and 27 were comparative but cross-sectional, precluding any causal inference. Possible limitations of our review may be the search and selection strategy, which was done by a large team including researchers from different disciplines and different expertise levels. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence-base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.


  • Effects of Rabies Elimination Program on Rabies Cases in Bali, 2008–2015

    by Ayu Putu Madri Dewi, Pandu Riono, Muhammad Noor Farid

    Effects of Rabies Elimination Program on Rabies Cases in Bali, 2008–2015


  • Open Access

    Designing Programs for Eliminating Canine Rabies from Islands: Bali, Indonesia as a Case Study

    by Sunny E. Townsend, I Putu Sumantra, Pudjiatmoko, Gusti Ngurah Bagus, Eric Brum, Sarah Cleaveland, Sally Crafter, Ayu P. M. Dewi, Dewa Made Ngurah Dharma, Jonathan Dushoff, et al.

    Canine rabies is one of the most important and feared zoonotic diseases in the world. In some regions rabies elimination is being successfully coordinated, whereas in others rabies is endemic and continues to spread to uninfected areas. As epidemics emerge, both accepted and contentious control methods are used, as questions remain over the most effective strategy to eliminate rabies. The Indonesian island of Bali was rabies-free until 2008 when an epidemic in domestic dogs began, resulting in the deaths of over 100 people. Here we analyze data from the epidemic and compare the effectiveness of control methods at eliminating rabies. Using data from Bali, we estimated the basic reproductive number, R0, of rabies in dogs, to be ∼1·2, almost identical to that obtained in ten–fold less dense dog populations and suggesting rabies will not be effectively controlled by reducing dog density. We then developed a model to compare options for mass dog vaccination. Comprehensive high coverage was the single most important factor for achieving elimination, with omission of even small areas (<0.5% of the dog population) jeopardizing success. Parameterizing the model with data from the 2010 and 2011 vaccination campaigns, we show that a comprehensive high coverage campaign in 2012 would likely result in elimination, saving ∼550 human lives and ∼$15 million in prophylaxis costs over the next ten years. The elimination of rabies from Bali will not be achieved through achievable reductions in dog density. To ensure elimination, concerted high coverage, repeated, mass dog vaccination campaigns are necessary and the cooperation of all regions of the island is critical. Momentum is building towards development of a strategy for the global elimination of canine rabies, and this study offers valuable new insights about the dynamics and control of this disease, with immediate practical relevance. Canine rabies continues to cause tens of thousands of horrific deaths worldwide, primarily in Asia and Africa. Momentum is building towards development of a global elimination strategy for canine rabies, but questions remain over how best to eliminate rabies epidemics. This paper uses data generated from the recent high-profile rabies outbreak in Bali, Indonesia to evaluate different control options. We find that, despite high dog densities, the spread of rabies on the island was remarkably similar to canine rabies spread elsewhere, suggesting that the practice of dog culling is an ineffective control strategy. We then simulate rabies transmission and spread across the island and compare the effectiveness of mass dog vaccination strategies in terms of how many lives are saved and how long it will take for elimination to be achieved. We find that the effectiveness of campaigns is not improved by being more reactive or synchronized but depends almost entirely upon reaching sufficient coverage (70%) across the population in successive campaigns. Even small ‘gaps’ in vaccination coverage can significantly impede the prospects of elimination. The outputs of this study provide the kind of evidence needed by rabies program coordinators to help design effective national control programmes, and to build the evidence-base to drive forward the development and implementation of effective global rabies policy.