Leanne Hirshfield
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Leanne Hirshfield has a total of 100 co-authors. Here are the top co-authors by number of shared publications:
- Emily Doherty
Institute of Cognitive Science, University of Colorado Boulder, Boulder, Colorado, USA
7 shared publications - Lucca Eloy
University of Colorado Boulder
5 shared publications - G. S. Rajshekar Reddy
Institute of Cognitive Science, University of Colorado Boulder, United States
4 shared publications - James Crum
Institute of Cognitive Science, University of Colorado
4 shared publications - Marta Čeko
Institute of Cognitive Science, University of Colorado, Boulder, CO, USA
4 shared publications - Cara A. Spencer
University of Colorado Boulder, CO, USA
3 shared publications
Latest Publications
- Open Access
- 8 September 2026
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 23 (5) , 056010
ERP-XTTN: interpretable prototype-guided cross-attention for cross-subject ERP classification
Objective. Interpretable brain-computer interface classifiers that generalize across subjects without calibration remain an open challenge. We evaluated whether prototype-based cross-attention can provide competitive, inherently interpretable event-related potential (ERP) classification across diverse paradigms under deployment-compatible conditions. Approach. We propose ERP-XTTN (ERP Cross-Attention), a cross-attention architecture that routes input electroencephalographic peaks to fixed difference-wave prototypes via query-key-only cross-attention with no value projection. Classification is based directly on prototype similarity and a separate measure of component amplitude, so that the prototype content contributes to every decision by construction. Prototypes are derived automatically from prominent extrema in the training-fold grand-average difference wave. We evaluated across three public sources (BNCI Horizon 2020, HRI Cursor, and ERP CORE) encompassing eight ERP components (ERN, LRP, ErrP, N170, P300, N2pc, MMN, N400). Evaluations used leave-one-subject-out (LOSO) cross-validation with causal filtering at a three-channel montage, compared against EEGNet, EEG-Deformer, ERP Prototypical Matching Net, and xDAWN with Riemannian geometry (xDAWN+RG). Main results. At three channels, the mean performance gap between the best baseline and ERP-XTTN was 0.025 area under the receiver operating characteristic curve. Prototype interventions confirmed that decisions depend on the physiological content of the prototypes rather than on the routing attention pattern alone. False positives morphologically resembled true positives more than true negatives did across all datasets, indicating classification errors are neurophysiologically explicable. Significance. ERP-XTTN generalizes across diverse ERP morphologies under causal, calibration-free conditions, while retaining competitive performance and decisions that depend directly on physiological prototype content at a three-channel montage. Unlike post-hoc explanation methods for black-box models, the basis of each decision is directly observable in the trained model itself. To our knowledge, this is the first epoch-level LOSO benchmark on ERP CORE.
- 8 September 2026
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 23 (5) , 056010
Open AccessERP-XTTN: interpretable prototype-guided cross-attention for cross-subject ERP classification
Objective. Interpretable brain-computer interface classifiers that generalize across subjects without calibration remain an open challenge. We evaluated whether prototype-based cross-attention can provide competitive, inherently interpretable event-related potential (ERP) classification across diverse paradigms under deployment-compatible conditions. Approach. We propose ERP-XTTN (ERP Cross-Attention), a cross-attention architecture that routes input electroencephalographic peaks to fixed difference-wave prototypes via query-key-only cross-attention with no value projection. Classification is based directly on prototype similarity and a separate measure of component amplitude, so that the prototype content contributes to every decision by construction. Prototypes are derived automatically from prominent extrema in the training-fold grand-average difference wave. We evaluated across three public sources (BNCI Horizon 2020, HRI Cursor, and ERP CORE) encompassing eight ERP components (ERN, LRP, ErrP, N170, P300, N2pc, MMN, N400). Evaluations used leave-one-subject-out (LOSO) cross-validation with causal filtering at a three-channel montage, compared against EEGNet, EEG-Deformer, ERP Prototypical Matching Net, and xDAWN with Riemannian geometry (xDAWN+RG). Main results. At three channels, the mean performance gap between the best baseline and ERP-XTTN was 0.025 area under the receiver operating characteristic curve. Prototype interventions confirmed that decisions depend on the physiological content of the prototypes rather than on the routing attention pattern alone. False positives morphologically resembled true positives more than true negatives did across all datasets, indicating classification errors are neurophysiologically explicable. Significance. ERP-XTTN generalizes across diverse ERP morphologies under causal, calibration-free conditions, while retaining competitive performance and decisions that depend directly on physiological prototype content at a three-channel montage. Unlike post-hoc explanation methods for black-box models, the basis of each decision is directly observable in the trained model itself. To our knowledge, this is the first epoch-level LOSO benchmark on ERP CORE.
- 27 June 2026
- Published by Springer Nature
- p. 91-106
Bridging fMRI and fNIRS: Challenges in Transfer Learning for Ecologically Valid Cognitive State Decoding
- 27 June 2026
- Published by Springer Nature
- p. 91-106
Bridging fMRI and fNIRS: Challenges in Transfer Learning for Ecologically Valid Cognitive State Decoding
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-28
Mapping the Spectrum of Automatability: A Framework for LLM-Assisted Annotation of Team Communication and Metacognition
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-28
Open AccessMapping the Spectrum of Automatability: A Framework for LLM-Assisted Annotation of Team Communication and Metacognition
- 28 October 2025
- Published by Elsevier in Neuroscience & Biobehavioral Reviews
- Vol. 179, 106448
Understanding the neurocognitive mechanisms of cognitive security
- 28 October 2025
- Published by Elsevier in Neuroscience & Biobehavioral Reviews
- Vol. 179, 106448
Understanding the neurocognitive mechanisms of cognitive security
- 11 August 2025
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 42 (3) , 1394-1426
Enhancing Adaptive Human-Agent Teaming Systems with Functional Near-Infrared Spectroscopy
- 11 August 2025
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 42 (3) , 1394-1426
Enhancing Adaptive Human-Agent Teaming Systems with Functional Near-Infrared Spectroscopy
- Open Access
Block-Wise Domain Adaptation for Workload Prediction from fNIRS Data
Functional near-infrared spectroscopy (fNIRS) is a non-intrusive way to measure cortical hemodynamic activity. Predicting cognitive workload from fNIRS data has taken on a diffuse set of methods. To be applicable in real-world settings, models are needed, which can perform well across different sessions as well as different subjects. However, most existing works assume that training and testing data come from the same subjects and/or cannot generalize well across never-before-seen subjects. Additional challenges imposed by fNIRS data include not only the high variations in inter-subject fNIRS data but also the variations in intra-subject data collected across different blocks of sessions. To address these challenges, we propose an effective method, referred to as the block-wise domain adaptation (BWise-DA), which explicitly minimizes intra-session variance as well by viewing different blocks from the same subject and same session as different domains. We minimize the intra-class domain discrepancy and maximize the inter-class domain discrepancy accordingly. In addition, we propose an MLPMixer-based model for workload prediction. Experimental results demonstrate that the proposed model provides better performance compared to three different baseline models on three publicly-available workload datasets. Two of the datasets are collected from n-back tasks and one of them is from finger-tapping. Moreover, the experimental results show that our proposed contrastive learning method can also be leveraged to improve the performance of the baseline models. We also present a visualization study showing that the models are paying attention to the right regions in the brain, which are known to be involved in the respective tasks.
Open AccessBlock-Wise Domain Adaptation for Workload Prediction from fNIRS Data
Functional near-infrared spectroscopy (fNIRS) is a non-intrusive way to measure cortical hemodynamic activity. Predicting cognitive workload from fNIRS data has taken on a diffuse set of methods. To be applicable in real-world settings, models are needed, which can perform well across different sessions as well as different subjects. However, most existing works assume that training and testing data come from the same subjects and/or cannot generalize well across never-before-seen subjects. Additional challenges imposed by fNIRS data include not only the high variations in inter-subject fNIRS data but also the variations in intra-subject data collected across different blocks of sessions. To address these challenges, we propose an effective method, referred to as the block-wise domain adaptation (BWise-DA), which explicitly minimizes intra-session variance as well by viewing different blocks from the same subject and same session as different domains. We minimize the intra-class domain discrepancy and maximize the inter-class domain discrepancy accordingly. In addition, we propose an MLPMixer-based model for workload prediction. Experimental results demonstrate that the proposed model provides better performance compared to three different baseline models on three publicly-available workload datasets. Two of the datasets are collected from n-back tasks and one of them is from finger-tapping. Moreover, the experimental results show that our proposed contrastive learning method can also be leveraged to improve the performance of the baseline models. We also present a visualization study showing that the models are paying attention to the right regions in the brain, which are known to be involved in the respective tasks.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Piecing Together Teamwork: A Responsible Approach to an LLM-based Educational Jigsaw Agent
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Open AccessPiecing Together Teamwork: A Responsible Approach to an LLM-based Educational Jigsaw Agent
- Open Access
- 4 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 407-417
Putting the “Brain” Back in the Eye-Mind Link: Aligning Eye Movements and Brain Activations During Naturalistic Reading
Eye movements have long been used to reflect ongoing cognitive processing to develop explanatory and predictive models of mental states and processes. This relationship, deemed the eye-mind link, contains underlying assumptions of the mental processes occurring in the brain, which have rarely been explicitly investigated. We propose a multimodal approach to investigate alignment of eye movements and brain activations (eye-brain alignment) and how it might be predicted by unfolding cognitive processes. We applied this method to a dataset of 76 participants who read long, connected texts while their eye movements and the hemodynamic responses in their brains were tracked using functional near-infrared spectroscopy (fNIRS). We found that reliable eye-brain alignment signals varied based on the participants’ cognitive state during reading. Implications for multimodal modeling of cognitive processes are discussed.
- 4 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 407-417
Open AccessPutting the “Brain” Back in the Eye-Mind Link: Aligning Eye Movements and Brain Activations During Naturalistic Reading
Eye movements have long been used to reflect ongoing cognitive processing to develop explanatory and predictive models of mental states and processes. This relationship, deemed the eye-mind link, contains underlying assumptions of the mental processes occurring in the brain, which have rarely been explicitly investigated. We propose a multimodal approach to investigate alignment of eye movements and brain activations (eye-brain alignment) and how it might be predicted by unfolding cognitive processes. We applied this method to a dataset of 76 participants who read long, connected texts while their eye movements and the hemodynamic responses in their brains were tracked using functional near-infrared spectroscopy (fNIRS). We found that reliable eye-brain alignment signals varied based on the participants’ cognitive state during reading. Implications for multimodal modeling of cognitive processes are discussed.
- 7 October 2024
- Published by Springer Nature in Nature Human Behaviour
- Vol. 8 (12) , 2268-2271
Misinformation research needs ecological validity
- 7 October 2024
- Published by Springer Nature in Nature Human Behaviour
- Vol. 8 (12) , 2268-2271
Misinformation research needs ecological validity