Modeling Semantic Encoding in a Common Neural Representational Space
Open Access
- 10 July 2018
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neuroscience
- Vol. 12, 437
Abstract
Encoding models for mapping voxelwise semantic tuning are typically estimated separately for each individual, limiting their generalizability. In the current report, we develop a method for estimating semantic encoding models that generalize across individuals. Functional MRI was used to measure brain responses while participants freely viewed a naturalistic audiovisual movie. Word embeddings capturing agent-, action-, object-, and scene-related semantic content were assigned to each imaging volume based on an annotation of the film. We constructed both conventional within-subject semantic encoding models and between-subject models where the model was trained on a subset of participants and validated on a left-out participant. Between-subject models were trained using cortical surface-based anatomical normalization or surface-based whole-cortex hyperalignment. We used hyperalignment to project group data into an individual’s unique anatomical space via a common representational space, thus leveraging a larger volume of data for out-of-sample prediction while preserving the individual’s fine-grained functional–anatomical idiosyncrasies. Our findings demonstrate that anatomical normalization degrades the spatial specificity of between-subject encoding models relative to within-subject models. Hyperalignment, on the other hand, recovers the spatial specificity of semantic tuning lost during anatomical normalization, and yields model performance exceeding that of within-subject models.Keywords
All Related Versions
Funding Information
- National Institute of Mental Health (F32MH085433-01A1, 5R01MH075706)
- National Science Foundation (NSF1129764, NSF1607845)
This publication has 68 references indexed in Scilit:
- Quantifying the variability of scene‐selective regions: Interindividual, interhemispheric, and sex differencesHuman Brain Mapping, 2017
- Reconstructing Visual Experiences from Brain Activity Evoked by Natural MoviesCurrent Biology, 2011
- PyMVPA: a Python Toolbox for Multivariate Pattern Analysis of fMRI DataNeuroinformatics, 2009
- A component based noise correction method (CompCor) for BOLD and perfusion based fMRINeuroImage, 2007
- PsychoPy—Psychophysics software in PythonJournal of Neuroscience Methods, 2007
- Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain ImagesNeuroImage, 2002
- High-resolution intersubject averaging and a coordinate system for the cortical surfaceHuman Brain Mapping, 1999
- Cortical Surface-Based AnalysisNeuroImage, 1999
- AFNI: Software for Analysis and Visualization of Functional Magnetic Resonance NeuroimagesComputers and Biomedical Research, 1996
- Generalized Procrustes AnalysisPsychometrika, 1975