Matthew Jordan Boring
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Matthew Jordan Boring has a total of 27 co-authors. Here are the top co-authors by number of shared publications:
- Avniel Singh Ghuman
Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA.
6 shared publications - Robert Mark Richardson
Harvard Medical School, Boston, USA
6 shared publications Avniel Singh Ghuman
Program of Neural Computation, Carnegie Mellon University, Pittsburgh, PA, USA
4 shared publicationsMichael J. Ward
Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania 15213
4 shared publicationsR. Mark Richardson
Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, PA, USA
4 shared publicationsJulie A. Fiez
Center for Neuroscience at the University of Pittsburgh, University of Pittsburgh, A210 Langley Hall, Pittsburgh, PA 15260, USA
2 shared publications
Latest Publications
- Open Access
Interacting cortical gradients of neural timescales and functional connectivity and their relationship to perceptual behavior
Cognitive acts take place over a large range of temporal scales. Numerous corresponding gradients in neurodynamic timescales and long-range cortical interactions are believed to provide organizational constraints to the brain and influence neural populations’ roles in cognition. However, it is unclear if gradients in various types of neural timescales and functional connectivity arise from related or distinct neurophysiological processes and if they influence behavior. Here, intracranial recordings from 4,090 electrode contacts in 35 individuals were used to systematically map gradients of multiple aspects of neurodynamics, neural timescales, and functional connectivity, and assess their interactions along category-selective ventral temporal cortex. Opposing functional connectivity gradients, with decreasing connectivity to visually responsive regions and increasing connectivity to regions that were not visually responsive, were observed along the ventral visual hierarchy. Endogenous neural timescales were correlated with functional connectivity to visually responsive regions after removing the effects of shared anatomical gradients, suggesting that these properties influence one another. Different stimulus evoked and endogenous timescales exhibited gradients with longer dynamics along the ventral visual hierarchy, but none of these timescales were significantly correlated with one another. This suggests that local neural timescales depend on neural and cognitive context and different timescales may arise through distinct neurophysiological processes. Furthermore, activity from neural populations with faster endogenous timescales and stronger functional connectivity to visually responsive regions was more predictive of perceptual behavior during a visual repeat detection task. These results reveal interrelationships and key distinctions among neural timescale and functional connectivity gradients that together can influence behavior.
Open AccessInteracting cortical gradients of neural timescales and functional connectivity and their relationship to perceptual behavior
Cognitive acts take place over a large range of temporal scales. Numerous corresponding gradients in neurodynamic timescales and long-range cortical interactions are believed to provide organizational constraints to the brain and influence neural populations’ roles in cognition. However, it is unclear if gradients in various types of neural timescales and functional connectivity arise from related or distinct neurophysiological processes and if they influence behavior. Here, intracranial recordings from 4,090 electrode contacts in 35 individuals were used to systematically map gradients of multiple aspects of neurodynamics, neural timescales, and functional connectivity, and assess their interactions along category-selective ventral temporal cortex. Opposing functional connectivity gradients, with decreasing connectivity to visually responsive regions and increasing connectivity to regions that were not visually responsive, were observed along the ventral visual hierarchy. Endogenous neural timescales were correlated with functional connectivity to visually responsive regions after removing the effects of shared anatomical gradients, suggesting that these properties influence one another. Different stimulus evoked and endogenous timescales exhibited gradients with longer dynamics along the ventral visual hierarchy, but none of these timescales were significantly correlated with one another. This suggests that local neural timescales depend on neural and cognitive context and different timescales may arise through distinct neurophysiological processes. Furthermore, activity from neural populations with faster endogenous timescales and stronger functional connectivity to visually responsive regions was more predictive of perceptual behavior during a visual repeat detection task. These results reveal interrelationships and key distinctions among neural timescale and functional connectivity gradients that together can influence behavior.
- Open Access
- 8 February 2022
- Published by Oxford University Press (OUP) in Cerebral Cortex
- Vol. 32  (20) , 4480-4491
Deep brain stimulation for parkinson’s disease induces spontaneous cortical hypersynchrony in extended motor and cognitive networks
The mechanism of action of deep brain stimulation (DBS) to the basal ganglia for Parkinson’s disease remains unclear. Studies have shown that DBS decreases pathological beta hypersynchrony between the basal ganglia and motor cortex. However, little is known about DBS’s effects on long range corticocortical synchronization. Here, we use machine learning combined with graph theory to compare resting-state cortical connectivity between the off and on-stimulation states and to healthy controls. We found that turning DBS on increased high beta and gamma band synchrony (26 to 50 Hz) in a cortical circuit spanning the motor, occipitoparietal, middle temporal, and prefrontal cortices. The synchrony in this network was greater in DBS on relative to both DBS off and controls, with no significant difference between DBS off and controls. Turning DBS on also increased network efficiency and strength and subnetwork modularity relative to both DBS off and controls in the beta and gamma band. Thus, unlike DBS’s subcortical normalization of pathological basal ganglia activity, it introduces greater synchrony relative to healthy controls in cortical circuitry that includes both motor and non-motor systems. This increased high beta/gamma synchronization may reflect compensatory mechanisms related to DBS’s clinical benefits, as well as undesirable non-motor side effects.
- 8 February 2022
- Published by Oxford University Press (OUP) in Cerebral Cortex
- Vol. 32  (20) , 4480-4491
Open AccessDeep brain stimulation for parkinson’s disease induces spontaneous cortical hypersynchrony in extended motor and cognitive networks
The mechanism of action of deep brain stimulation (DBS) to the basal ganglia for Parkinson’s disease remains unclear. Studies have shown that DBS decreases pathological beta hypersynchrony between the basal ganglia and motor cortex. However, little is known about DBS’s effects on long range corticocortical synchronization. Here, we use machine learning combined with graph theory to compare resting-state cortical connectivity between the off and on-stimulation states and to healthy controls. We found that turning DBS on increased high beta and gamma band synchrony (26 to 50 Hz) in a cortical circuit spanning the motor, occipitoparietal, middle temporal, and prefrontal cortices. The synchrony in this network was greater in DBS on relative to both DBS off and controls, with no significant difference between DBS off and controls. Turning DBS on also increased network efficiency and strength and subnetwork modularity relative to both DBS off and controls in the beta and gamma band. Thus, unlike DBS’s subcortical normalization of pathological basal ganglia activity, it introduces greater synchrony relative to healthy controls in cortical circuitry that includes both motor and non-motor systems. This increased high beta/gamma synchronization may reflect compensatory mechanisms related to DBS’s clinical benefits, as well as undesirable non-motor side effects.
- Open Access
- 4 January 2022
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 22  (1) , 2
Gaze dynamics are sensitive to target orienting for working memory encoding in virtual reality
Numerous studies have demonstrated that visuospatial attention is a requirement for successful working memory encoding. It is unknown, however, whether this established relationship manifests in consistent gaze dynamics as people orient their visuospatial attention toward an encoding target when searching for information in naturalistic environments. To test this hypothesis, participants' eye movements were recorded while they searched for and encoded objects in a virtual apartment (Experiment 1). We decomposed gaze into 61 features that capture gaze dynamics and a trained sliding window logistic regression model that has potential for use in real-time systems to predict when participants found target objects for working memory encoding. A model trained on group data successfully predicted when people oriented to a target for encoding for the trained task (Experiment 1) and for a novel task (Experiment 2), where a new set of participants found objects and encoded an associated nonword in a cluttered virtual kitchen. Six of these features were predictive of target orienting for encoding, even during the novel task, including decreased distances between subsequent fixation/saccade events, increased fixation probabilities, and slower saccade decelerations before encoding. This suggests that as people orient toward a target to encode new information at the end of search, they decrease task-irrelevant, exploratory sampling behaviors. This behavior was common across the two studies. Together, this research demonstrates how gaze dynamics can be used to capture target orienting for working memory encoding and has implications for real-world use in technology and special populations.
- 4 January 2022
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 22  (1) , 2
Open AccessGaze dynamics are sensitive to target orienting for working memory encoding in virtual reality
Numerous studies have demonstrated that visuospatial attention is a requirement for successful working memory encoding. It is unknown, however, whether this established relationship manifests in consistent gaze dynamics as people orient their visuospatial attention toward an encoding target when searching for information in naturalistic environments. To test this hypothesis, participants' eye movements were recorded while they searched for and encoded objects in a virtual apartment (Experiment 1). We decomposed gaze into 61 features that capture gaze dynamics and a trained sliding window logistic regression model that has potential for use in real-time systems to predict when participants found target objects for working memory encoding. A model trained on group data successfully predicted when people oriented to a target for encoding for the trained task (Experiment 1) and for a novel task (Experiment 2), where a new set of participants found objects and encoded an associated nonword in a cluttered virtual kitchen. Six of these features were predictive of target orienting for encoding, even during the novel task, including decreased distances between subsequent fixation/saccade events, increased fixation probabilities, and slower saccade decelerations before encoding. This suggests that as people orient toward a target to encode new information at the end of search, they decrease task-irrelevant, exploratory sampling behaviors. This behavior was common across the two studies. Together, this research demonstrates how gaze dynamics can be used to capture target orienting for working memory encoding and has implications for real-world use in technology and special populations.
- 7 June 2021
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 41  (29) , 6314-6327
Multiple Adjoining Word- and Face-Selective Regions in Ventral Temporal Cortex Exhibit Distinct Dynamics
The map of category-selectivity in human ventral temporal cortex (VTC) provides organizational constraints to models of object recognition. One important principle is lateral-medial response biases to stimuli that are typically viewed in the center or periphery of the visual field. However, little is known about the relative temporal dynamics and location of regions that respond preferentially to stimulus classes that are centrally viewed, such as the face- and word-processing networks. Here, word- and face-selective regions within VTC were mapped using intracranial recordings from 36 patients. Partially overlapping, but also anatomically dissociable patches of face- and word-selectivity, were found in VTC. In addition to canonical word-selective regions along the left posterior occipitotemporal sulcus, selectivity was also located medial and anterior to face-selective regions on the fusiform gyrus at the group level and within individual male and female subjects. These regions were replicated using 7 Tesla fMRI in healthy subjects. Left hemisphere word-selective regions preceded right hemisphere responses by 125 ms, potentially reflecting the left hemisphere bias for language, with no hemispheric difference in face-selective response latency. Word-selective regions along the posterior fusiform responded first, then spread medially and laterally, then anteriorally. Face-selective responses were first seen in posterior fusiform regions bilaterally, then proceeded anteriorally from there. For both words and faces, the relative delay between regions was longer than would be predicted by purely feedforward models of visual processing. The distinct time courses of responses across these regions, and between hemispheres, suggest that a complex and dynamic functional circuit supports face and word perception. SIGNIFICANCE STATEMENT Representations of visual objects in the human brain have been shown to be organized by several principles, including whether those objects tend to be viewed centrally or peripherally in the visual field. However, it remains unclear how regions that process objects that are viewed centrally, such as words and faces, are organized relative to one another. Here, invasive and noninvasive neuroimaging suggests that there is a mosaic of regions in ventral temporal cortex that respond selectively to either words or faces. These regions display differences in the strength and timing of their responses, both within and between brain hemispheres, suggesting that they play different roles in perception. These results illuminate extended, bilateral, and dynamic brain pathways that support face perception and reading.
- 7 June 2021
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 41  (29) , 6314-6327
Multiple Adjoining Word- and Face-Selective Regions in Ventral Temporal Cortex Exhibit Distinct Dynamics
The map of category-selectivity in human ventral temporal cortex (VTC) provides organizational constraints to models of object recognition. One important principle is lateral-medial response biases to stimuli that are typically viewed in the center or periphery of the visual field. However, little is known about the relative temporal dynamics and location of regions that respond preferentially to stimulus classes that are centrally viewed, such as the face- and word-processing networks. Here, word- and face-selective regions within VTC were mapped using intracranial recordings from 36 patients. Partially overlapping, but also anatomically dissociable patches of face- and word-selectivity, were found in VTC. In addition to canonical word-selective regions along the left posterior occipitotemporal sulcus, selectivity was also located medial and anterior to face-selective regions on the fusiform gyrus at the group level and within individual male and female subjects. These regions were replicated using 7 Tesla fMRI in healthy subjects. Left hemisphere word-selective regions preceded right hemisphere responses by 125 ms, potentially reflecting the left hemisphere bias for language, with no hemispheric difference in face-selective response latency. Word-selective regions along the posterior fusiform responded first, then spread medially and laterally, then anteriorally. Face-selective responses were first seen in posterior fusiform regions bilaterally, then proceeded anteriorally from there. For both words and faces, the relative delay between regions was longer than would be predicted by purely feedforward models of visual processing. The distinct time courses of responses across these regions, and between hemispheres, suggest that a complex and dynamic functional circuit supports face and word perception. SIGNIFICANCE STATEMENT Representations of visual objects in the human brain have been shown to be organized by several principles, including whether those objects tend to be viewed centrally or peripherally in the visual field. However, it remains unclear how regions that process objects that are viewed centrally, such as words and faces, are organized relative to one another. Here, invasive and noninvasive neuroimaging suggests that there is a mosaic of regions in ventral temporal cortex that respond selectively to either words or faces. These regions display differences in the strength and timing of their responses, both within and between brain hemispheres, suggesting that they play different roles in perception. These results illuminate extended, bilateral, and dynamic brain pathways that support face perception and reading.
- Open Access
Deep Brain Stimulation for Parkinson’s Disease Induces Spontaneous Cortical Hypersynchrony In Extended Motor and Cognitive Networks
The mechanism of action of deep brain stimulation (DBS) for Parkinson’s disease remains unclear. Studies have shown that DBS decreases pathological beta hypersynchrony between the basal ganglia and motor cortex. However, little is known about DBS’s effects on long range corticocortical synchronization. Here, we use machine learning combined with spectral graph theory to compare resting-state cortical connectivity between the off and on-stimulation states and compare these differences to healthy controls. We found that turning DBS on increased high beta and gamma band coherence in a cortical circuit spanning the motor, occipitoparietal, middle temporal, and prefrontal cortices. We found no significant difference between DBS-off and controls in this network with multivariate pattern classification showing that the brain connectivity pattern in control subjects is more like those during DBS-off than DBS-on. These results show that therapeutic DBS increases spontaneous high beta-gamma synchrony in a network that couples motor areas to broader cognitive systems.
Open AccessDeep Brain Stimulation for Parkinson’s Disease Induces Spontaneous Cortical Hypersynchrony In Extended Motor and Cognitive Networks
The mechanism of action of deep brain stimulation (DBS) for Parkinson’s disease remains unclear. Studies have shown that DBS decreases pathological beta hypersynchrony between the basal ganglia and motor cortex. However, little is known about DBS’s effects on long range corticocortical synchronization. Here, we use machine learning combined with spectral graph theory to compare resting-state cortical connectivity between the off and on-stimulation states and compare these differences to healthy controls. We found that turning DBS on increased high beta and gamma band coherence in a cortical circuit spanning the motor, occipitoparietal, middle temporal, and prefrontal cortices. We found no significant difference between DBS-off and controls in this network with multivariate pattern classification showing that the brain connectivity pattern in control subjects is more like those during DBS-off than DBS-on. These results show that therapeutic DBS increases spontaneous high beta-gamma synchrony in a network that couples motor areas to broader cognitive systems.
- Open Access
Multiple adjoining word- and face-selective regions in ventral temporal cortex exhibit distinct dynamics
The map of category-selectivity in human ventral temporal cortex (VTC) provides organizational constraints to models of object recognition. One important principle is lateral-medial response biases to stimuli that are typically viewed in the center or periphery of the visual field. However, little is known about the relative temporal dynamics and location of regions that respond preferentially to stimulus classes that are centrally viewed, like the face and word processing networks. Here, word- and face-selective regions within VTC were mapped using intracranial recordings from 36 patients. Partially overlapping, but also anatomically dissociable patches of face and word selectivity were found in ventral temporal cortex. In addition to canonical word-selective regions along the left posterior occipitotemporal sulcus, selectivity was also located medial and anterior to face-selective regions on the fusiform gyrus at the group level and within individual subjects. These regions were replicated using 7-Tesla fMRI in healthy subjects. Left hemisphere word-selective regions preceded right hemisphere responses by 125 ms, potentially reflecting the left hemisphere bias for language; with no hemispheric difference in face-selective response latency. Word-selective regions along the posterior fusiform responded first, then spread medially and laterally, then anteriorally. Face-selective responses were first seen in posterior fusiform regions bilaterally, then proceeded anteriorally from there. For both words and faces, the relative delay between regions was longer than would be predicted by purely feedforward models of visual processing. The distinct time-courses of responses across these regions, and between hemispheres, suggest a complex and dynamic functional circuit supports face and word perception. Significance Statement Representations of visual objects in the human brain have been shown to be organized by several principles, including whether those objects tend to be viewed centrally or in the periphery of the visual field. However, it remains unclear how regions that process objects that are viewed centrally, like words and faces, are organized relative to one another. Here, direct neural recordings and 7T fMRI demonstrate that several intermingled regions in ventral temporal cortex participate in word and face processing. These regions display differences in their temporal dynamics and response characteristics, both within and between brain hemispheres, suggesting they play different roles in perception. These results illuminate extended, bilateral, and dynamic brain pathways that support face perception and reading.
Open AccessMultiple adjoining word- and face-selective regions in ventral temporal cortex exhibit distinct dynamics
The map of category-selectivity in human ventral temporal cortex (VTC) provides organizational constraints to models of object recognition. One important principle is lateral-medial response biases to stimuli that are typically viewed in the center or periphery of the visual field. However, little is known about the relative temporal dynamics and location of regions that respond preferentially to stimulus classes that are centrally viewed, like the face and word processing networks. Here, word- and face-selective regions within VTC were mapped using intracranial recordings from 36 patients. Partially overlapping, but also anatomically dissociable patches of face and word selectivity were found in ventral temporal cortex. In addition to canonical word-selective regions along the left posterior occipitotemporal sulcus, selectivity was also located medial and anterior to face-selective regions on the fusiform gyrus at the group level and within individual subjects. These regions were replicated using 7-Tesla fMRI in healthy subjects. Left hemisphere word-selective regions preceded right hemisphere responses by 125 ms, potentially reflecting the left hemisphere bias for language; with no hemispheric difference in face-selective response latency. Word-selective regions along the posterior fusiform responded first, then spread medially and laterally, then anteriorally. Face-selective responses were first seen in posterior fusiform regions bilaterally, then proceeded anteriorally from there. For both words and faces, the relative delay between regions was longer than would be predicted by purely feedforward models of visual processing. The distinct time-courses of responses across these regions, and between hemispheres, suggest a complex and dynamic functional circuit supports face and word perception. Significance Statement Representations of visual objects in the human brain have been shown to be organized by several principles, including whether those objects tend to be viewed centrally or in the periphery of the visual field. However, it remains unclear how regions that process objects that are viewed centrally, like words and faces, are organized relative to one another. Here, direct neural recordings and 7T fMRI demonstrate that several intermingled regions in ventral temporal cortex participate in word and face processing. These regions display differences in their temporal dynamics and response characteristics, both within and between brain hemispheres, suggesting they play different roles in perception. These results illuminate extended, bilateral, and dynamic brain pathways that support face perception and reading.
- Open Access
Dynamic Domain Specificity In Human Ventral Temporal Cortex
An enduring neuroscientific debate concerns the extent to which neural representation is restricted to neural populations specialized for particular domains of perceptual input, or distributed outside of highly selective populations as well. A critical level for this debate is the neural representation of the identity of individual images, such as individual-level face or written word recognition. Here, intracranial recordings throughout ventral temporal cortex across 17 human subjects were used to assess the spatiotemporal dynamics of individual word and face processing within and outside regions strongly selective for these categories of visual information. Individual faces and words were first discriminable primarily only in strongly selective areas, beginning at about 150 milliseconds after word or face onset, and then discriminable both within and outside strongly selective areas approximately 170 milliseconds later. Regions of ventral temporal cortex that were and were not strongly selective both contributed non-redundant information to the discrimination of individual images. These results can reconcile previous results endorsing disparate poles of the domain specificity debate by highlighting the temporally segregated contributions of different functionally defined cortical areas to individual level representations. This work supports a dynamic model of neural representation characterized by successive domain-specific and distributed processing stages.
Open AccessDynamic Domain Specificity In Human Ventral Temporal Cortex
An enduring neuroscientific debate concerns the extent to which neural representation is restricted to neural populations specialized for particular domains of perceptual input, or distributed outside of highly selective populations as well. A critical level for this debate is the neural representation of the identity of individual images, such as individual-level face or written word recognition. Here, intracranial recordings throughout ventral temporal cortex across 17 human subjects were used to assess the spatiotemporal dynamics of individual word and face processing within and outside regions strongly selective for these categories of visual information. Individual faces and words were first discriminable primarily only in strongly selective areas, beginning at about 150 milliseconds after word or face onset, and then discriminable both within and outside strongly selective areas approximately 170 milliseconds later. Regions of ventral temporal cortex that were and were not strongly selective both contributed non-redundant information to the discrimination of individual images. These results can reconcile previous results endorsing disparate poles of the domain specificity debate by highlighting the temporally segregated contributions of different functionally defined cortical areas to individual level representations. This work supports a dynamic model of neural representation characterized by successive domain-specific and distributed processing stages.
- Open Access
- 20 October 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20  (11) , 576
Ventral temporal neurodynamics captured with electrocorticography during free-viewing of natural scenes
Response properties of regions in ventral temporal cortex (VTC) have often been characterized during highly controlled experimental paradigms where an unpredictable sequence of single, isolated objects are presented for a few hundred milliseconds to passively fixating participants. The visual environment of the real world is relatively stable and predictable, containing contextual information that grounds objects in their environment, which is actively and volitionally sampled during free-viewing. The degree to which these differences between experimental versus naturalistic viewing conditions are reflected in the neurodynamics of VTC regions remains unclear. To compare these responses, we presented natural scenes to one pilot patient with intractable epilepsy during a free-viewing paradigm while collecting electrocorticography (ECoG) from VTC and eye tracking data. The VTC neurodynamics collected during free-viewing of natural scenes was compared to the responses evoked by similar objects presented in a more traditional experimental paradigm. VTC data could be used to reliably predict when the subject was looking at a face or not during free-viewing. Furthermore, above-chance decoding occurred as early as 200 ms prior to saccades landing on a face. This suggests that face-processing occurs in VTC even prior to fixating faces in natural scenes. Classifiers trained to discriminate face from non-face trials in the traditional paradigm could reliably discriminate face from non-face fixations in the free-viewing task. This suggests that neural responses during the traditional experimental paradigm shared some similarity to those evoked during free-viewing paradigm. However, responses evoked by face fixations in the free-viewing task were stronger in the high gamma frequencies (40-200 Hz) and less pronounced in lower frequency ranges compared to those evoked by the traditional paradigm. Future work is necessary to investigate how image characteristics, such as scene context, contribute to pre-saccadic activation of object-selective VTC and whether these results generalize to larger patient populations.
- 20 October 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20  (11) , 576
Open AccessVentral temporal neurodynamics captured with electrocorticography during free-viewing of natural scenes
Response properties of regions in ventral temporal cortex (VTC) have often been characterized during highly controlled experimental paradigms where an unpredictable sequence of single, isolated objects are presented for a few hundred milliseconds to passively fixating participants. The visual environment of the real world is relatively stable and predictable, containing contextual information that grounds objects in their environment, which is actively and volitionally sampled during free-viewing. The degree to which these differences between experimental versus naturalistic viewing conditions are reflected in the neurodynamics of VTC regions remains unclear. To compare these responses, we presented natural scenes to one pilot patient with intractable epilepsy during a free-viewing paradigm while collecting electrocorticography (ECoG) from VTC and eye tracking data. The VTC neurodynamics collected during free-viewing of natural scenes was compared to the responses evoked by similar objects presented in a more traditional experimental paradigm. VTC data could be used to reliably predict when the subject was looking at a face or not during free-viewing. Furthermore, above-chance decoding occurred as early as 200 ms prior to saccades landing on a face. This suggests that face-processing occurs in VTC even prior to fixating faces in natural scenes. Classifiers trained to discriminate face from non-face trials in the traditional paradigm could reliably discriminate face from non-face fixations in the free-viewing task. This suggests that neural responses during the traditional experimental paradigm shared some similarity to those evoked during free-viewing paradigm. However, responses evoked by face fixations in the free-viewing task were stronger in the high gamma frequencies (40-200 Hz) and less pronounced in lower frequency ranges compared to those evoked by the traditional paradigm. Future work is necessary to investigate how image characteristics, such as scene context, contribute to pre-saccadic activation of object-selective VTC and whether these results generalize to larger patient populations.
- Open Access
- 18 September 2020
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 17  (5) , 056016
Continuous decoding of cognitive load from electroencephalography reveals task-general and task-specific correlates
Objective. Algorithms to detect changes in cognitive load using non-invasive biosensors (e.g. electroencephalography (EEG)) have the potential to improve human–computer interactions by adapting systems to an individual’s current information processing capacity, which may enhance performance and mitigate costly errors. However, for algorithms to provide maximal utility, they must be able to detect load across a variety of tasks and contexts. The current study aimed to build models that capture task-general EEG correlates of cognitive load, which would allow for load detection across variable task contexts. Approach. Sliding-window support vector machines (SVM) were trained to predict periods of high versus low cognitive load across three cognitively and perceptually distinct tasks: n-back, mental arithmetic, and multi-object tracking. To determine how well these SVMs could generalize to novel tasks, they were trained on data from two of the three tasks and evaluated on the held-out task. Additionally, to better understand task-general and task-specific correlates of cognitive load, a set of models were trained on subsets of EEG frequency features. Main results. Models achieved reliable performance in classifying periods of high versus low cognitive load both within and across tasks, demonstrating their generalizability. Furthermore, continuous model outputs correlated with subtle differences in self-reported mental effort and they captured predicted changes in load within individual trials of each task. Additionally, alpha or beta frequency features achieved reliable within- and cross-task performance, suggesting that activity in these frequency bands capture task-general signatures of cognitive load. In contrast, delta and theta frequency features performed considerably worse than the full cross-task models, suggesting that delta and theta activity may be reflective of task-specific differences across cognitive load conditions. Significance. EEG data contains task-general signatures of cognitive load. Sliding-window SVMs can capture these signatures and continuously detect load across multiple task contexts.
- 18 September 2020
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 17  (5) , 056016
Open AccessContinuous decoding of cognitive load from electroencephalography reveals task-general and task-specific correlates
Objective. Algorithms to detect changes in cognitive load using non-invasive biosensors (e.g. electroencephalography (EEG)) have the potential to improve human–computer interactions by adapting systems to an individual’s current information processing capacity, which may enhance performance and mitigate costly errors. However, for algorithms to provide maximal utility, they must be able to detect load across a variety of tasks and contexts. The current study aimed to build models that capture task-general EEG correlates of cognitive load, which would allow for load detection across variable task contexts. Approach. Sliding-window support vector machines (SVM) were trained to predict periods of high versus low cognitive load across three cognitively and perceptually distinct tasks: n-back, mental arithmetic, and multi-object tracking. To determine how well these SVMs could generalize to novel tasks, they were trained on data from two of the three tasks and evaluated on the held-out task. Additionally, to better understand task-general and task-specific correlates of cognitive load, a set of models were trained on subsets of EEG frequency features. Main results. Models achieved reliable performance in classifying periods of high versus low cognitive load both within and across tasks, demonstrating their generalizability. Furthermore, continuous model outputs correlated with subtle differences in self-reported mental effort and they captured predicted changes in load within individual trials of each task. Additionally, alpha or beta frequency features achieved reliable within- and cross-task performance, suggesting that activity in these frequency bands capture task-general signatures of cognitive load. In contrast, delta and theta frequency features performed considerably worse than the full cross-task models, suggesting that delta and theta activity may be reflective of task-specific differences across cognitive load conditions. Significance. EEG data contains task-general signatures of cognitive load. Sliding-window SVMs can capture these signatures and continuously detect load across multiple task contexts.