Using predictive validity to compare associations between brain damage and behavior
Open Access
- 7 July 2023
- journal article
- research article
- Published by Wiley in Human Brain Mapping
- Vol. 44 (13) , 4738-4753
Abstract
Lesion‐behavior mapping (LBM) provides a statistical map of the association between voxel‐wise brain damage and individual differences in behavior. To understand whether two behaviors are mediated by damage to distinct regions, researchers often compare LBM weight outputs by either the Overlap method or the Correlation method. However, these methods lack statistical criteria to determine whether two LBM are distinct versus the same and are disconnected from a major goal of LBMs: predicting behavior from brain damage. Without such criteria, researchers may draw conclusions from numeric differences between LBMs that are irrelevant to predicting behavior. We developed and validated a predictive validity comparison method (PVC) that establishes a statistical criterion for comparing two LBMs using predictive accuracy: two LBMs are distinct if and only if they provide unique predictive power for the behaviors being assessed. We applied PVC to two lesion‐behavior stroke data sets, demonstrating its utility for determining when behaviors arise from the same versus different lesion patterns. Using region‐of‐interest‐based simulations derived from proportion damage from a large data set (n = 131), PVC accurately detected when behaviors were mediated by different regions (high sensitivity) versus the same region (high specificity). Both the Overlap method and Correlation method performed poorly on the simulated data. By objectively determining whether two behavioral deficits can be explained by single versus distinct patterns of brain damage, PVC provides a critical advance in establishing the brain bases of behavior. We have developed and released a GUI‐driven web app to encourage widespread adoption.Keywords
All Related Versions
Funding Information
- National Institute on Deafness and Other Communication Disorders (R01DC014976)
This publication has 49 references indexed in Scilit:
- The dorsal stream contribution to phonological retrieval in object namingBrain, 2012
- Damage to left anterior temporal cortex predicts impairment of complex syntactic processing: A lesion-symptom mapping studyHuman Brain Mapping, 2012
- The Neural Basis of Reversible Sentence Comprehension: Evidence from Voxel-based Lesion Symptom Mapping in AphasiaJournal of Cognitive Neuroscience, 2012
- Neuroanatomical dissociation for taxonomic and thematic knowledge in the human brainProceedings of the National Academy of Sciences, 2011
- Case series investigations in cognitive neuropsychologyCognitive Neuropsychology, 2010
- Distributed neural system for general intelligence revealed by lesion mappingProceedings of the National Academy of Sciences, 2010
- Anterior temporal involvement in semantic word retrieval: voxel-based lesion-symptom mapping evidence from aphasiaBrain, 2009
- Lesion Mapping of Cognitive Abilities Linked to IntelligenceNeuron, 2009
- Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brainMedical Image Analysis, 2008
- Bayes FactorsJournal of the American Statistical Association, 1995