Estimation of the Underlying F0 Range of a Speaker from the Spectral Features of a Brief Speech Input
Open Access
- 27 June 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (13) , 6494
Abstract
From a very brief speech, human listeners can estimate the pitch range of the speaker and normalize pitch perception. Spectral features which inherently involve both articulatory and phonatory characteristics were speculated to play roles in this process, but few were reported to directly correlate with speaker’s F0 range. To mimic this human auditory capability and validate the speculation, in a preliminary study we proposed an LSTM-based method to estimate speaker’s F0 range from a 300 ms-long speech input, which turned out to outperform the conventional method. By two more experiments, this study further improved the method and verified its validity in estimating the speaker-specific underlying F0 range. After incorporating a novel measurement of F0 range and a multi-task training approach, Experiment 1 showed that the refined model gave more accurate estimates than the initial model. Based on a Japanese-Chinese bilingual parallel speech corpus, Experiment 2 found that the F0 ranges estimated with the model from the Chinese speech and the model from the Japanese speech produced by the same set of speakers had no significant difference, whereas the conventional method showed significant difference. The results indicate that the proposed spectrum-based method captures the speaker-specific underlying F0 range which is independent of the linguistic content.Keywords
Funding Information
- Beijing Language and Culture University (20YJ04002, KYR17005, 19PT04)
- Advanced Innovation Center for Language Resource and Intelligence (20YJ04002, KYR17005, 19PT04)
- Wutong Innovation Platform of Beijing Language and Culture University (20YJ04002, KYR17005, 19PT04)
This publication has 44 references indexed in Scilit:
- Cross-language differences in fundamental frequency range: A comparison of English and GermanThe Journal of the Acoustical Society of America, 2012
- The aging female voice: Acoustic and respiratory dataClinical Linguistics & Phonetics, 2006
- The effect of speech melody on voice qualitySpeech Communication, 2001
- EFFECTS OF AGING ON SELECTED ACOUSTIC VOICE PARAMETERS: PRELIMINARY NORMATIVE DATA AND EDUCATIONAL IMPLICATIONSEducational Gerontology, 2001
- Speaker normalization in the perception of Mandarin Chinese tonesThe Journal of the Acoustical Society of America, 1997
- Influence of spectral locus and F0 changes on the pitch and timbre of complex tonesThe Journal of the Acoustical Society of America, 1992
- Information for Mandarin Tones in the Amplitude Contour and in Brief SegmentsPhonetica, 1992
- Descriptions of the Speech of Patients with Cancer of the Vocal Folds. Part I: Measures of Fundamental FrequencyThe Journal of the Acoustical Society of America, 1971
- Information Conveyed by VowelsThe Journal of the Acoustical Society of America, 1957
- Control Methods Used in a Study of the VowelsThe Journal of the Acoustical Society of America, 1952