fMRI clustering and false-positive rates

Authors:

Abstract
Recently, Eklund et al. (1) analyzed clustering methods in standard fMRI packages: AFNI (which we maintain), FSL, and SPM. They claim that (i) false-positive rates (FPRs) in traditional approaches are greatly inflated, questioning the validity of “countless published fMRI studies”; (ii) nonparametric methods produce valid, but slightly conservative, FPRs; (iii) a common flawed assumption is that the spatial autocorrelation function (ACF) of fMRI noise is Gaussian-shaped; and (iv) a 15-y-old bug in AFNI’s 3dClustSim significantly contributed to producing “particularly high” FPRs compared with other software. We repeated simulations from ref. 1 [Beijing_Zang data (2), cf. ref. 3) and comment on each point briefly. Fig. 1 A–D compares results of the “buggy” and “fixed” 3dClustSim. For each simulation, the typical difference was small: ΔFPR≲3−5%ΔFPR≲3−5% at per-voxel P=0.01P=0.01 and ≲1−2%≲1−2% for P=0.001P=0.001. The bug had only a minor impact. FPRs for various software scenarios, with 1,000 two-sample one-sided tt-tests (as in ref. …
Funding Information
  • HHS | NIH | National Institute of Mental Health (ZICMH002888)
  • HHS | NIH | National Institute of Neurological Disorders and Stroke (ZICMH002888)