A Framework for Speech Activity Detection Using Adaptive Auditory Receptive Fields
Open Access
- 23 September 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 23 (12) , 2422-2433
Abstract
One of the hallmarks of sound processing in the brain is the ability of the nervous system to adapt to changing behavioral demands and surrounding soundscapes. It can dynamically shift sensory and cognitive resources to focus on relevant sounds. Neurophysiological studies indicate that this ability is supported by adaptively retuning the shapes of cortical spectro-temporal receptive fields (STRFs) to enhance features of target sounds while suppressing those of task-irrelevant distractors. Because an important component of human communication is the ability of a listener to dynamically track speech in noisy environments, the solution obtained by auditory neurophysiology implies a useful adaptation strategy for speech activity detection (SAD). SAD is an important first step in a number of automated speech processing systems, and performance is often reduced in highly noisy environments. In this paper, we describe how task-driven adaptation is induced in an ensemble of neurophysiological STRFs, and show how speech-adapted STRFs reorient themselves to enhance spectro-temporal modulations of speech while suppressing those associated with a variety of nonspeech sounds. We then show how an adapted ensemble of STRFs can better detect speech in unseen noisy environments compared to an unadapted ensemble and a noise-robust baseline. Finally, we use a stimulus reconstruction task to demonstrate how the adapted STRF ensemble better captures the spectro-temporal modulations of attended speech in clean and noisy conditions. Our results suggest that a biologically plausible adaptation framework can be applied to speech processing systems to dynamically adapt feature representations for improving noise robustness.Keywords
Funding Information
- National Science Foundation (IIS-0846112)
- National Institutes of Health (1R01AG036424)
- Office of Naval Research (N00014-12-1-0740, N000141010278)
This publication has 90 references indexed in Scilit:
- Sustained Firing of Model Central Auditory Neurons Yields a Discriminative Spectro-temporal Representation for Natural SoundsPLOS Computational Biology, 2013
- Emergence of neural encoding of auditory objects while listening to competing speakersProceedings of the National Academy of Sciences, 2012
- Reconstructing Speech from Human Auditory CortexPLOS Biology, 2012
- Influence of Context and Behavior on Stimulus Reconstruction From Neural Activity in Primary Auditory CortexJournal of Neurophysiology, 2009
- The Modulation Transfer Function for Speech IntelligibilityPLOS Computational Biology, 2009
- Functional Groups in the Avian Auditory SystemThe Journal of Neuroscience, 2009
- Attention to Stimulus Features Shifts Spectral Tuning of V4 Neurons during Natural VisionNeuron, 2008
- Object-based auditory and visual attentionTrends in Cognitive Sciences, 2008
- Auditory Cortical Receptive Fields: Stable Entities with Plastic AbilitiesJournal of Neuroscience, 2007
- RASTA processing of speechIEEE Transactions on Speech and Audio Processing, 1994