Speaker Identity is Robustly Encoded in Spatial Patterns of Intracranial EEG for Attention Decoding
Authors:
- Sukru Samet DindarSDSukru Samet Dindar
- Xilin JiangXJXilin Jiang
- Vishal ChoudhariVCVishal Choudhari
- Stephan BickelSBStephan Bickel
- Ashesh MehtaAMAshesh Mehta
- Catherine SchevonCSCatherine Schevon
- Guy M. McKhannGMGuy M. McKhann
- Daniel FriedmanDFDaniel Friedman
- Adeen FlinkerAFAdeen Flinker
- Nima MesgaraniNMNima Mesgarani
Preprint
Abstract
The human auditory cortex robustly tracks attended speech, yet it remains unclear if speaker identity is encoded in spatial patterns of neural activity independent of temporal dynamics. Here, we demonstrate that the identity of an attended speaker is reliably reflected in distinct, time-invariant spatial activation maps in human intracranial EEG (iEEG). Leveraging these "neural fingerprints", we developed a novel framework for Auditory Attention Decoding (AAD) that shifts from traditional temporal envelope tracking to spatial speaker identification. By decoupling the decoding of "who" is speaking from "when" they are speaking, our modular system achieves state-of-the-art speech extraction, particularly in short time windows (<2 seconds) where temporal models typically fail. Furthermore, we observed a reciprocal shift in neural activity during attentional switches, confirming that these spatial codes dynamically track listener intent. These findings establish that speaker identity is a robust, spatially distributed feature in the auditory cortex, offering a high-speed, complementary mechanism for neuro-steered hearing technologies.Keywords
Funding Information
- Marie-Josee and Henry R. Kravis Foundation
This publication has 14 references indexed in Scilit:
- Decoding the auditory brain with canonical component analysisNeuroImage, 2018
- Distinct Cortical Pathways for Music and Speech Revealed by Hypothesis-Free Voxel DecompositionNeuron, 2015
- Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEGCerebral Cortex, 2014
- Emergence of neural encoding of auditory objects while listening to competing speakersProceedings of the National Academy of Sciences, 2012
- Multiplexed and Robust Representations of Sound Features in Auditory CortexThe Journal of Neuroscience, 2011
- Temporal coherence and attention in auditory scene analysisTrends in Neurosciences, 2011
- "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and SpeechScience, 2008
- Phoneme representation and classification in primary auditory cortexThe Journal of the Acoustical Society of America, 2008
- Spectral-Temporal Receptive Fields of Nonlinear Auditory Neurons Obtained Using Natural SoundsThe Journal of Neuroscience, 2000
- Long Short-Term MemoryNeural Computation, 1997