fMRI clustering and false-positive rates
- 18 April 2017
- journal article
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 114 (17) , E3370-E3371
Abstract
Recently, Eklund et al. (1) analyzed clustering methods in standard fMRI packages: AFNI (which we maintain), FSL, and SPM. They claim that (i) false-positive rates (FPRs) in traditional approaches are greatly inflated, questioning the validity of “countless published fMRI studies”; (ii) nonparametric methods produce valid, but slightly conservative, FPRs; (iii) a common flawed assumption is that the spatial autocorrelation function (ACF) of fMRI noise is Gaussian-shaped; and (iv) a 15-y-old bug in AFNI’s 3dClustSim significantly contributed to producing “particularly high” FPRs compared with other software. We repeated simulations from ref. 1 [Beijing_Zang data (2), cf. ref. 3) and comment on each point briefly. Fig. 1 A–D compares results of the “buggy” and “fixed” 3dClustSim. For each simulation, the typical difference was small: ΔFPR≲3−5%ΔFPR≲3−5% at per-voxel P=0.01P=0.01 and ≲1−2%≲1−2% for P=0.001P=0.001. The bug had only a minor impact. FPRs for various software scenarios, with 1,000 two-sample one-sided tt-tests (as in ref. …Keywords
All Related Versions
Funding Information
- HHS | NIH | National Institute of Mental Health (ZICMH002888)
- HHS | NIH | National Institute of Neurological Disorders and Stroke (ZICMH002888)
This publication has 7 references indexed in Scilit:
- FMRI Clustering in AFNI: False-Positive Rates ReduxBrain Connectivity, 2017
- AFNI and Clustering: False Positive Rates ReduxbioRxiv, 2016
- Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive ratesProceedings of the National Academy of Sciences, 2016
- Applications of multivariate modeling to neuroimaging group analysis: A comprehensive alternative to univariate general linear modelNeuroImage, 2014
- Linear mixed-effects modeling approach to FMRI group analysisNeuroImage, 2013
- The secret lives of experiments: Methods reporting in the fMRI literatureNeuroImage, 2012
- Toward discovery science of human brain functionProceedings of the National Academy of Sciences, 2010