Potential Reporting Bias in fMRI Studies of the Brain
Open Access
- 25 July 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 8 (7) , e70104
Abstract
Functional magnetic resonance imaging (fMRI) studies have reported multiple activation foci associated with a variety of conditions, stimuli or tasks. However, most of these studies used fewer than 40 participants. After extracting data (number of subjects, condition studied, number of foci identified and threshold) from 94 brain fMRI meta-analyses (k = 1,788 unique datasets) published through December of 2011, we analyzed the correlation between individual study sample sizes and number of significant foci reported. We also performed an analysis where we evaluated each meta-analysis to test whether there was a correlation between the sample size of the meta-analysis and the number of foci that it had identified. Correlation coefficients were then combined across all meta-analyses to obtain a summary correlation coefficient with a fixed effects model and we combine correlation coefficients, using a Fisher’s z transformation. There was no correlation between sample size and the number of foci reported in single studies (r = 0.0050) but there was a strong correlation between sample size and number of foci in meta-analyses (r = 0.62, p<0.001). Only studies with sample sizes 40) numbers of foci and claimed as many discovered foci as studies with sample sizes ≥45, whereas meta-analyses yielded a limited number of foci relative to the yield that would be anticipated from smaller single studies. These results are consistent with possible reporting biases affecting small fMRI studies and suggest the need to promote standardized large-scale evidence in this field. It may also be that small studies may be analyzed and reported in ways that may generate a larger number of claimed foci or that small fMRI studies with inconclusive, null, or not very promising results may not be published at all.Keywords
This publication has 35 references indexed in Scilit:
- Meta-analytic methods for neuroimaging data explainedBiology of Mood & Anxiety Disorders, 2012
- Activation likelihood estimation meta-analysis revisitedNeuroImage, 2012
- Converging Evidence for the Advantage of Dynamic Facial ExpressionsBrain Topography, 2011
- Multisite reliability of cognitive BOLD dataNeuroImage, 2011
- ALE meta-analysis of action observation and imitation in the human brainNeuroImage, 2010
- The neuronal correlates of intranasal trigeminal function—an ALE meta-analysis of human functional brain imaging dataBrain Research Reviews, 2010
- Functional Magnetic Resonance Imaging (fMRI) reproducibility and variance components across visits and scanning sites with a finger tapping taskNeuroImage, 2010
- Coordinate‐based activation likelihood estimation meta‐analysis of neuroimaging data: A random‐effects approach based on empirical estimates of spatial uncertaintyHuman Brain Mapping, 2009
- Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting BiasPLOS ONE, 2008
- The case of the misleading funnel plotBMJ, 2006