Garret Christensen

Open science practices such as posting data or code and pre-registering analyses are increasingly prescribed and debated in the applied sciences, but the actual popularity and lifetime usage of these practices remain unknown. This study provides an assessment of attitudes toward, use of, and perceived norms regarding open science practices from a sample of authors published in top-10 (most-cited) journals and PhD students in top-20 ranked North American departments from four major social science disciplines: economics, political science, psychology, and sociology. We observe largely favorable private attitudes toward widespread lifetime usage (meaning that a researcher has used a particular practice at least once) of open science practices. As of 2020, nearly 90% of scholars had ever used at least one such practice. Support for posting data or code online is higher (88% overall support and nearly at the ceiling in some fields) than support for pre-registration (58% overall). With respect to norms, there is evidence that the scholars in our sample appear to underestimate the use of open science practices in their field. We also document that the reported lifetime prevalence of open science practices increased from 49% in 2010 to 87% a decade later.

This study estimates the effect of data sharing on the citations of academic articles, using journal policies as a natural experiment. We begin by examining 17 high-impact journals that have adopted the requirement that data from published articles be publicly posted. We match these 17 journals to 13 journals without policy changes and find that empirical articles published just before their change in editorial policy have citation rates with no statistically significant difference from those published shortly after the shift. We then ask whether this null result stems from poor compliance with data sharing policies, and use the data sharing policy changes as instrumental variables to examine more closely two leading journals in economics and political science with relatively strong enforcement of new data policies. We find that articles that make their data available receive 97 additional citations (estimate standard error of 34). We conclude that: a) authors who share data may be rewarded eventually with additional scholarly citations, and b) data-posting policies alone do not increase the impact of articles published in a journal unless those policies are enforced.

Publication bias leads consumers of research to observe a selected sample of statistical estimates calculated by producers of research. We calculate critical values for statistical significance that could help to adjust after the fact for the distortions created by this selection effect, assuming that the only source of publication bias is file drawer bias. These adjusted critical values are easy to calculate and differ from unadjusted critical values by approximately 50%—rather than rejecting a null hypothesis when the t-ratio exceeds 2, the analysis suggests rejecting a null hypothesis when the t-ratio exceeds 3. Samples of published social science research indicate that on average, across research fields, approximately 30% of published t-statistics fall between the standard and adjusted cutoffs.

Author guidelines for journals could help to promote transparency, openness, and reproducibility

In preparation for a larger trial, the Water, Sanitation, and Hygiene (WASH) Benefits pilot study enrolled 72 villages and 499 subjects in two closely related randomized trials of WASH interventions in rural western Kenya. Intervention households received hardware and promotion for one of the following: water treatment, sanitation and latrine improvements, handwashing with soap, or the combination of all three. Interventions were clustered by village. A follow-up survey was conducted 4 months after intervention delivery to assess uptake. Intervention households were significantly more likely than controls to have chlorinated stored water (36–60 percentage point increases), covers over latrine drop holes (55–75 percentage point increases), less stool visible on latrine floors (16–47 percentage point reductions), and a place for handwashing (71–85 percentage point increases) with soap available (49–66 percentage point increases). The high uptake in all arms shows that combined interventions can achieve high short-term adoption rates if well-designed.

Introduction Enteric infections are common during the first years of life in low-income countries and contribute to growth faltering with long-term impairment of health and development. Water quality, sanitation, handwashing and nutritional interventions can independently reduce enteric infections and growth faltering. There is little evidence that directly compares the effects of these individual and combined interventions on diarrhoea and growth when delivered to infants and young children. The objective of the WASH Benefits study is to help fill this knowledge gap. Methods and analysis WASH Benefits includes two cluster-randomised trials to assess improvements in water quality, sanitation, handwashing and child nutrition—alone and in combination—to rural households with pregnant women in Kenya and Bangladesh. Geographically matched clusters (groups of household compounds in Bangladesh and villages in Kenya) will be randomised to one of six intervention arms or control. Intervention arms include water quality, sanitation, handwashing, nutrition, combined water+sanitation+handwashing (WSH) and WSH+nutrition. The studies will enrol newborn children (N=5760 in Bangladesh and N=8000 in Kenya) and measure outcomes at 12 and 24 months after intervention delivery. Primary outcomes include child length-for-age Z-scores and caregiver-reported diarrhoea. Secondary outcomes include stunting prevalence, markers of environmental enteropathy and child development scores (verbal, motor and personal/social). We will estimate unadjusted and adjusted intention-to-treat effects using semiparametric estimators and permutation tests. Ethics and dissemination Study protocols have been reviewed and approved by human subjects review boards at the University of California, Berkeley, Stanford University, the International Centre for Diarrheal Disease Research, Bangladesh, the Kenya Medical Research Institute, and Innovations for Poverty Action. Independent data safety monitoring boards in each country oversee the trials. This study is funded by a grant from the Bill & Melinda Gates Foundation to the University of California, Berkeley. Registration Trial registration identifiers (http://www.clinicaltrials.gov): NCT01590095 (Bangladesh), NCT01704105 (Kenya).