Evaluation of reproducible and transparent research practices in pulmonology
Open Access
- 29 July 2020
- journal article
- research article
- Published by Taylor & Francis in Pulmonology
- Vol. 27 (2) , 134-143
Abstract
Background: Study reproducibility is valuable for validating or refuting results. Provision of reproducibility indicators, such as materials, protocols, and raw data in a study improve its potential for reproduction. Efforts to reproduce noteworthy studies in the biomedical sciences have resulted in an overwhelming majority of them being found to be unreplicable, causing concern for the integrity of research in other fields, including medical specialties. Here, we analyzed the reproducibility of studies in the field of pulmonology. Methods: 500 pulmonology articles were randomly selected from an initial PubMed search for data extraction. Two authors scoured these articles for reproducibility indicators including materials, protocols, raw data, analysis scripts, inclusion in systematic reviews, and citations by replication studies as well as other factors of research transparency including open accessibility, funding source and competing interest disclosures, and study preregistration. Findings: Few publications included statements regarding materials (10%), protocols (1%), data (15%), and analysis script (0%) availability. Less than 10% indicated preregistration. More than half of the publications analyzed failed to provide a funding statement. Conversely, 63% of the publications were open access and 73% included a conflict of interest statement. Interpretation: Overall, our study indicates pulmonology research is currently lacking in efforts to increase replicability. Future studies should focus on providing sufficient information regarding materials, protocols, raw data, and analysis scripts, among other indicators, for the sake of clinical decisions that depend on replicable or refutable results from the primary literature.Keywords
Funding Information
- Center for Health Sciences, Oklahoma State University
This publication has 29 references indexed in Scilit:
- Power failure: why small sample size undermines the reliability of neuroscienceNature Reviews Neuroscience, 2013
- Scientific UtopiaPerspectives on Psychological Science, 2012
- The secret lives of experiments: Methods reporting in the fMRI literatureNeuroImage, 2012
- Consistency in the Analysis and Reporting of Primary End Points in Oncology Randomized Controlled Trials From Registration to Publication: A Systematic ReviewJournal of Clinical Oncology, 2012
- Believe it or not: how much can we rely on published data on potential drug targets?Nature Reviews Drug Discovery, 2011
- Comparison of Registered and Published Primary Outcomes in Randomized Controlled TrialsJAMA, 2009
- Reliability and replicability of genetic association studiesAddiction, 2009
- STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK… and CONSORT: for whom does the guideline toll?Journal of Clinical Epidemiology, 2009
- Clinical Trial Registration — Looking Back and Moving AheadNew England Journal of Medicine, 2007
- Contradicted and Initially Stronger Effects in Highly Cited Clinical ResearchJAMA, 2005