Moving beyond processing- and analysis-related variation in resting-state functional brain imaging
- 5 August 2024
- journal article
- research article
- Published by Springer Nature in Nature Human Behaviour
- Vol. 8 (10) , 2003-2017
Abstract
When fields lack consensus standard methods and accessible ground truths, reproducibility can be more of an ideal than a reality. Such has been the case for functional neuroimaging, where there exists a sprawling space of tools and processing pipelines. We provide a critical evaluation of the impact of differences across five independently developed minimal preprocessing pipelines for functional magnetic resonance imaging. We show that, even when handling identical data, interpipeline agreement was only moderate, critically shedding light on a factor that limits cross-study reproducibility. We show that low interpipeline agreement can go unrecognized until the reliability of the underlying data is high, which is increasingly the case as the field progresses. Crucially we show that, when interpipeline agreement is compromised, so too is the consistency of insights from brain-wide association studies. We highlight the importance of comparing analytic configurations, because both widely discussed and commonly overlooked decisions can lead to marked variation.Keywords
All Related Versions
Funding Information
- U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (R01MH120482, R24 MH11480602, RF1MH121867, RF1MH121867, R24 MH11480602, R01MH120482, RF1MH121867, RF1MH130859)
- National Natural Science Foundation of China (82122035, 81671774, 81630031)
This publication has 69 references indexed in Scilit:
- Isolating the sources of pipeline‐variability in group‐level task‐fMRI resultsHuman Brain Mapping, 2021
- Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track2021
- Rapid Precision Functional Mapping of Individuals Using Multi-Echo fMRICell Reports, 2020
- Exploring the impact of analysis software on task fMRI resultsHuman Brain Mapping, 2019
- The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sitesDevelopmental Cognitive Neuroscience, 2018
- Accurate nonlinear mapping between MNI volumetric and FreeSurfer surface coordinate systemsHuman Brain Mapping, 2018
- A Connectome Computation System for discovery science of brainScience Bulletin, 2015
- Kolmogorov–Smirnov Test: Overview2014
- Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain ImagesNeuroImage, 2002
- AFNI: Software for Analysis and Visualization of Functional Magnetic Resonance NeuroimagesComputers and Biomedical Research, 1996