RETRACTED ARTICLE: High replicability of newly discovered social-behavioural findings is achievable
Open Access
- 9 November 2023
- journal article
- retracted article
- Published by Springer Nature in Nature Human Behaviour
- Vol. 8 (2) , 311-319
Abstract
Failures to replicate evidence of new discoveries have forced scientists to ask whether this unreliability is due to suboptimal implementation of methods or whether presumptively optimal methods are not, in fact, optimal. This paper reports an investigation by four coordinated laboratories of the prospective replicability of 16 novel experimental findings using rigour-enhancing practices: confirmatory tests, large sample sizes, preregistration and methodological transparency. In contrast to past systematic replication efforts that reported replication rates averaging 50%, replication attempts here produced the expected effects with significance testing (P < 0.05) in 86% of attempts, slightly exceeding the maximum expected replicability based on observed effect sizes and sample sizes. When one lab attempted to replicate an effect discovered by another lab, the effect size in the replications was 97% that in the original study. This high replication rate justifies confidence in rigour-enhancing methods to increase the replicability of new discoveries.Keywords
Funding Information
- John E. Fetzer Memorial Trust
This publication has 48 references indexed in Scilit:
- An Agenda for Purely Confirmatory ResearchPerspectives on Psychological Science, 2012
- Raise standards for preclinical cancer researchNature, 2012
- Timing glitches dog neutrino claimNature, 2012
- False-Positive PsychologyPsychological Science, 2011
- Fixed effects and variance components estimation in three-level meta-analysisResearch Synthesis Methods, 2011
- Unpublished results hide the decline effectNature, 2011
- Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social SciencesReview of General Psychology, 2009
- One Hundred Years of Social Psychology Quantitatively DescribedReview of General Psychology, 2003
- The file drawer problem and tolerance for null results.Psychological Bulletin, 1979
- Consequences of prejudice against the null hypothesis.Psychological Bulletin, 1975