Potential Reporting Bias in Neuroimaging Studies of Sex Differences
Open Access
- 17 April 2018
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 8 (1) , 1-8
Abstract
Numerous functional magnetic resonance imaging (fMRI) studies have reported sex differences. To empirically evaluate for evidence of excessive significance bias in this literature, we searched for published fMRI studies of human brain to evaluate sex differences, regardless of the topic investigated, in Medline and Scopus over 10 years. We analyzed the prevalence of conclusions in favor of sex differences and the correlation between study sample sizes and number of significant foci identified. In the absence of bias, larger studies (better powered) should identify a larger number of significant foci. Across 179 papers, median sample size was n = 32 (interquartile range 23-47.5). A median of 5 foci related to sex differences were reported (interquartile range, 2-9.5). Few articles (n = 2) had titles focused on no differences or on similarities (n = 3) between sexes. Overall, 158 papers (88%) reached “positive” conclusions in their abstract and presented some foci related to sex differences. There was no statistically significant relationship between sample size and the number of foci (−0.048% increase for every 10 participants, p = 0.63). The extremely high prevalence of “positive” results and the lack of the expected relationship between sample size and the number of discovered foci reflect probable reporting bias and excess significance bias in this literature.Keywords
This publication has 30 references indexed in Scilit:
- Potential Reporting Bias in fMRI Studies of the BrainPLOS ONE, 2013
- Power failure: why small sample size undermines the reliability of neuroscienceNature Reviews Neuroscience, 2013
- Registered Reports: A new publishing initiative at CortexCortex, 2013
- A peculiar prevalence of p values just below .05Quarterly Journal of Experimental Psychology, 2012
- Ten ironic rules for non-statistical reviewersNeuroImage, 2012
- The Trouble with Sex DifferencesNeuron, 2011
- The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and ElaborationPLOS Medicine, 2009
- Why sex matters for neuroscienceNature Reviews Neuroscience, 2006
- Evidence for the existence of a sexually dimorphic nucleus in the preoptic area of the ratJournal of Comparative Neurology, 1980
- Sexual Dimorphism in the Preoptic Area of the RatScience, 1971