From Birdsong to Human Speech Recognition: Bayesian Inference on a Hierarchy of Nonlinear Dynamical Systems
Open Access
- 12 September 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 9 (9) , e1003219
Abstract
Our knowledge about the computational mechanisms underlying human learning and recognition of sound sequences, especially speech, is still very limited. One difficulty in deciphering the exact means by which humans recognize speech is that there are scarce experimental findings at a neuronal, microscopic level. Here, we show that our neuronal-computational understanding of speech learning and recognition may be vastly improved by looking at an animal model, i.e., the songbird, which faces the same challenge as humans: to learn and decode complex auditory input, in an online fashion. Motivated by striking similarities between the human and songbird neural recognition systems at the macroscopic level, we assumed that the human brain uses the same computational principles at a microscopic level and translated a birdsong model into a novel human sound learning and recognition model with an emphasis on speech. We show that the resulting Bayesian model with a hierarchy of nonlinear dynamical systems can learn speech samples such as words rapidly and recognize them robustly, even in adverse conditions. In addition, we show that recognition can be performed even when words are spoken by different speakers and with different accents—an everyday situation in which current state-of-the-art speech recognition models often fail. The model can also be used to qualitatively explain behavioral data on human speech learning and derive predictions for future experiments. Neuroscience still lacks a concrete explanation of how humans recognize speech. Even though neuroimaging techniques are helpful in determining the brain areas involved in speech recognition, there are rarely mechanistic explanations at a neuronal level. Here, we assume that songbirds and humans solve a very similar task: extracting information from sound wave modulations produced by a singing bird or a speaking human. Given strong evidence that both humans and songbirds, although genetically very distant, converged to a similar solution, we combined the vast amount of neurobiological findings for songbirds with nonlinear dynamical systems theory to develop a hierarchical, Bayesian model which explains fundamental functions in recognition of sound sequences. We found that the resulting model is good at learning and recognizing human speech. We suggest that this translated model can be used to qualitatively explain or predict experimental data, and the underlying mechanism can be used to construct improved automatic speech recognition algorithms.Keywords
This publication has 103 references indexed in Scilit:
- A dynamical pattern recognition model of gamma activity in auditory cortexNeural Networks, 2012
- Temporal Predictive Codes for Spoken Words in Auditory CortexCurrent Biology, 2012
- Hippocampal “Time Cells” Bridge the Gap in Memory for Discontiguous EventsNeuron, 2011
- A reafferent and feed-forward model of song syntax generation in the Bengalese finchJournal of Computational Neuroscience, 2011
- Support for a synaptic chain model of neuronal sequence generationNature, 2010
- Statistically optimal perception and learning: from behavior to neural representationsTrends in Cognitive Sciences, 2010
- On-line plasticity in spoken sentence comprehension: Adapting to time-compressed speechNeuroImage, 2010
- The cocktail party problemCurrent Biology, 2009
- Perceptual adaptation to non-native speechCognition, 2008
- Are there interactive processes in speech perception?Trends in Cognitive Sciences, 2006