Distilling Neural Representations of Data Structure Manipulation using fMRI and fNIRS
Authors:
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 396-407
Abstract
Data structures permeate many aspects of software engineering, but their associated human cognitive processes are not thoroughly understood. We leverage medical imaging and insights from the psychological notion of spatial ability to decode the neural representations of several fundamental data structures and their manipulations. In a human study involving 76 participants, we examine list, array, tree, and mental rotation tasks using both functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI). We find a nuanced relationship: data structure and spatial operations use the same focal regions of the brain but to different degrees. They are related but distinct neural tasks. In addition, more difficult computer science problems induce higher cognitive load than do problems of pure spatial reasoning. Finally, while fNIRS is less expensive and more permissive, there are some computing-relevant brain regions that only fMRI can reach.Keywords
This publication has 73 references indexed in Scilit:
- Autoregressive model based algorithm for correcting motion and serially correlated errors in fNIRSBiomedical Optics Express, 2013
- The “Perceptual Wedge Hypothesis” as the basis for bilingual babies’ phonetic processing advantage: New insights from fNIRS brain imagingBrain and Language, 2012
- Functional topography of the cerebellum for motor and cognitive tasks: An fMRI studyNeuroImage, 2012
- Overview of Functional Magnetic Resonance ImagingNeurosurgery Clinics of North America, 2011
- A quantitative comparison of NIRS and fMRI across multiple cognitive tasksNeuroImage, 2011
- Perception of Face Parts and Face Configurations: An fMRI StudyJournal of Cognitive Neuroscience, 2010
- Training induces changes in white-matter architectureNature Neuroscience, 2009
- Correspondence of the brain's functional architecture during activation and restProceedings of the National Academy of Sciences, 2009
- Modeling the hemodynamic response function in fMRI: Efficiency, bias and mis-modelingNeuroImage, 2009
- Detecting and adjusting for artifacts in fMRI time series dataNeuroImage, 2005