Seven steps toward more transparency in statistical practice
Authors:
- Eric-Jan WagenmakersEWEric-Jan Wagenmakers
- Alexandra SarafoglouASAlexandra Sarafoglou
- Sil AartsSASil Aarts
- Casper AlbersCACasper Albers
- Johannes AlgermissenJAJohannes Algermissen
- Štěpán BahníkŠBŠtěpán Bahník
- Rink HoekstraRHRink Hoekstra
- David MoreauDMDavid Moreau
- Don van RavenzwaaijDRDon van Ravenzwaaij
- Franziska StankeFSFranziska Stanke
- 11 November 2021
- journal article
- research article
- Published by Springer Nature in Nature Human Behaviour
- Vol. 5 (11) , 1473-1480
Abstract
We argue that statistical practice in the social and behavioural sciences benefits from transparency, a fair acknowledgement of uncertainty and openness to alternative interpretations. Here, to promote such a practice, we recommend seven concrete statistical procedures: (1) visualizing data; (2) quantifying inferential uncertainty; (3) assessing data preprocessing choices; (4) reporting multiple models; (5) involving multiple analysts; (6) interpreting results modestly; and (7) sharing data and code. We discuss their benefits and limitations, and provide guidelines for adoption. Each of the seven procedures finds inspiration in Merton’s ethos of science as reflected in the norms of communalism, universalism, disinterestedness and organized scepticism. We believe that these ethical considerations—as well as their statistical consequences—establish common ground among data analysts, despite continuing disagreements about the foundations of statistical inference.Keywords
All Related Versions
This publication has 66 references indexed in Scilit:
- The Fluctuating Female VotePsychological Science, 2013
- On the Plurality of (Methodological) Worlds: Estimating the Analytic Flexibility of fMRI ExperimentsFrontiers in Neuroscience, 2012
- Why Tables Are Really Much Better Than GraphsJournal of Computational and Graphical Statistics, 2011
- From Submission to Publication: A Retrospective Review of the Tables and Figures in a Cohort of Randomized Controlled Trials Submitted to the British Medical JournalAnnals of Emergency Medicine, 2006
- Exploratory Data Analysis for Complex ModelsJournal of Computational and Graphical Statistics, 2004
- Let's Practice What We PreachThe American Statistician, 2002
- Inhibiting and facilitating conditions of the human smile: A nonobtrusive test of the facial feedback hypothesis.Journal of Personality and Social Psychology, 1988
- Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical MethodsJournal of the American Statistical Association, 1984
- Pioneer Maps of Health and Disease in EnglandThe Geographical Journal, 1958
- Possible Existence of a NeutronNature, 1932