Neural network-assisted analysis of tube vocal tract models
Authors:
- Runhui SongRSRunhui Song
- Johan SjonsJSJohan Sjons
- Axel EkströmAEAxel Ekström
Preprint
Abstract
We present a pipeline for deep neural network assisted modeling and analysis of tube vocal tract models. Such models are composed of a series of cylindrical tube segments, each characterized by length and cross-sectional area. A large synthetic dataset of such tube configurations is generated, and a circuit theory–based algorithm predicts corresponding formant frequencies. To explore the mapping between tube sequence shapes and predicted resonance (formant) values, the pipeline integrates both linear regression and nonlinear machine learning models —including multi-layer perceptrons. Model interpretability is assessed using Shapley Additive Explanations (SHAP), which quantifies the contribution of each segment to predicted formant frequencies. The proposed framework enables detailed exploration of the articulatory-acoustic relationships inherent to an acoustic tube and vocal tract simulacrum. We present and describe the pipeline in the context of modeling effects of perturbations on the first three predicted resonances for a 16- cm tube, divided into 1 cm segments. Our pipeline can be applied to any method that models predictions of behavior of an acoustic tube, where the tube is conceived as a series of segmented units.Keywords
This publication has 17 references indexed in Scilit:
- Explaining Deep Neural Networks and Beyond: A Review of Methods and ApplicationsProceedings of the IEEE, 2021
- Estimation of prediction error by using K-fold cross-validationStatistics and Computing, 2009
- An experimental study of the open end correction coefficient for side branches within an acoustic tubeThe Journal of the Acoustical Society of America, 1998
- Distinctive regions and modes: a new theory of speech productionSpeech Communication, 1988
- Articulatory model for the study of speech productionThe Journal of the Acoustical Society of America, 1973
- Dynamic Articulatory Model of Speech ProductionThe Journal of the Acoustical Society of America, 1966
- Development of a Quantitative Description of Vowel ArticulationThe Journal of the Acoustical Society of America, 1955
- On the Theory and Design of Acoustic ResonatorsThe Journal of the Acoustical Society of America, 1953
- An Electrical Analog of the Vocal TractThe Journal of the Acoustical Society of America, 1953
- The Calculation of Vowel Resonances, and an Electrical Vocal TractThe Journal of the Acoustical Society of America, 1950