Yubin Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yubin Zhang has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Caicai Zhang
Hong Kong Polytechnic University
1 shared publication - James Kirby
Institute for Phonetics and Speech Processing, Spoken Language Processing Group, LMU Munich 1 , Munich, 80799
1 shared publication - Jihwan Lee
University of Southern California University of Southern California University of Southern California University of Southern California University of Southern California University of Southern California University of Southern California
1 shared publication - Kevin Huang
Signal Analysis and Interpretation Laboratory University of Southern California USA
1 shared publication - Louis Goldstein
Department of Linguistics University of Southern California USA
1 shared publication - Shrikanth Narayanan
Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California 1 , Los Angeles, California 90089
1 shared publication
Latest Publications
- 1 November 2024
- Published by Acoustical Society of America (ASA) in JASA Express Letters
- Vol. 4 (11)
Direct articulatory observation reveals phoneme recognition performance characteristics of a self-supervised speech model
Variability in speech pronunciation is widely observed across different linguistic backgrounds, which impacts modern automatic speech recognition performance. Here, we evaluate the performance of a self-supervised speech model in phoneme recognition using direct articulatory evidence. Findings indicate significant differences in phoneme recognition, especially in front vowels, between American English and Indian English speakers. To gain a deeper understanding of these differences, we conduct real-time MRI-based articulatory analysis, revealing distinct velar region patterns during the production of specific front vowels. This underscores the need to deepen the scientific understanding of self-supervised speech model variances to advance robust and inclusive speech technology.
- 1 November 2024
- Published by Acoustical Society of America (ASA) in JASA Express Letters
- Vol. 4 (11)
Direct articulatory observation reveals phoneme recognition performance characteristics of a self-supervised speech model
Variability in speech pronunciation is widely observed across different linguistic backgrounds, which impacts modern automatic speech recognition performance. Here, we evaluate the performance of a self-supervised speech model in phoneme recognition using direct articulatory evidence. Findings indicate significant differences in phoneme recognition, especially in front vowels, between American English and Indian English speakers. To gain a deeper understanding of these differences, we conduct real-time MRI-based articulatory analysis, revealing distinct velar region patterns during the production of specific front vowels. This underscores the need to deepen the scientific understanding of self-supervised speech model variances to advance robust and inclusive speech technology.
- Open Access
- 1 August 2024
- Published by Cambridge University Press (CUP) in Journal of the International Phonetic Association
- Vol. 54 (2) , 788-810
Central Tibetan (Lhasa)
- 1 August 2024
- Published by Cambridge University Press (CUP) in Journal of the International Phonetic Association
- Vol. 54 (2) , 788-810
Open AccessCentral Tibetan (Lhasa)
- Open Access
- 1 August 2024
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 86 (6) , 2136-2152
Phonetic categorization in phonological lexical neighborhoods: Facilitatory and inhibitory effects
Phonetic processing, whereby the bottom-up speech signal is translated into higher-level phonological representations such as phonemes, has been demonstrated to be influenced by phonological lexical neighborhoods. Previous studies show facilitatory effects of lexicality and phonological neighborhood density on phonetic categorization. However, given the evidence for lexical competition in spoken word recognition, we hypothesize that there are concurrent facilitatory and inhibitory effects of phonological lexical neighborhoods on phonetic processing. In Experiments 1 and 2, participants categorized the onset phoneme in word-nonword and nonword-word acoustic continua. The results show that the target word of the continuum exhibits facilitatory lexical influences whereas rhyme neighbors inhibit phonetic categorization. The results support the hypothesis that sublexical phonetic processing is affected by multiple facilitatory and inhibitory lexical forces in the processing stream.
- 1 August 2024
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 86 (6) , 2136-2152
Open AccessPhonetic categorization in phonological lexical neighborhoods: Facilitatory and inhibitory effects
Phonetic processing, whereby the bottom-up speech signal is translated into higher-level phonological representations such as phonemes, has been demonstrated to be influenced by phonological lexical neighborhoods. Previous studies show facilitatory effects of lexicality and phonological neighborhood density on phonetic categorization. However, given the evidence for lexical competition in spoken word recognition, we hypothesize that there are concurrent facilitatory and inhibitory effects of phonological lexical neighborhoods on phonetic processing. In Experiments 1 and 2, participants categorized the onset phoneme in word-nonword and nonword-word acoustic continua. The results show that the target word of the continuum exhibits facilitatory lexical influences whereas rhyme neighbors inhibit phonetic categorization. The results support the hypothesis that sublexical phonetic processing is affected by multiple facilitatory and inhibitory lexical forces in the processing stream.
- Open Access
- 1 July 2020
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 148 (1) , EL40-EL45
The role of F0 and phonation cues in Cantonese low tone perception
For languages that primarily exploit F0 to signal tonal contrast, the role of phonation cues in tonal perception remains controversial. This study revisits the use of F0 and phonation cues in Cantonese low tone perception (tone 4, 21/tone 6, 22) using synthesized stimuli. In line with previous studies, F0 contour and height were found to be the most salient cues, with F0 height being more important. The effects of non-modal phonation (creaky and breathy voice) were relatively small. Non-modal phonation enhanced low tone perception only in the low F0 range. The results are consistent with the differential integration hypothesis that the perceptual role of phonation is dependent on F0 and that phonation cues integrate with F0 differently depending on F0 height.
- 1 July 2020
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 148 (1) , EL40-EL45
Open AccessThe role of F0 and phonation cues in Cantonese low tone perception
For languages that primarily exploit F0 to signal tonal contrast, the role of phonation cues in tonal perception remains controversial. This study revisits the use of F0 and phonation cues in Cantonese low tone perception (tone 4, 21/tone 6, 22) using synthesized stimuli. In line with previous studies, F0 contour and height were found to be the most salient cues, with F0 height being more important. The effects of non-modal phonation (creaky and breathy voice) were relatively small. Non-modal phonation enhanced low tone perception only in the low F0 range. The results are consistent with the differential integration hypothesis that the perceptual role of phonation is dependent on F0 and that phonation cues integrate with F0 differently depending on F0 height.
- 27 January 2020
- Published by Taylor & Francis in Clinical Linguistics & Phonetics
- Vol. 35 (2) , 101-116
Emotion processing in congenital amusia: the deficits do not generalize to written emotion words
Congenital amusia is a lifelong impairment in musical ability. Individuals with amusia are found to show reduced sensitivity to emotion recognition in speech prosody and silent facial expressions, implying a possible cross-modal emotion-processing deficit. However, it is not clear whether the observed deficits are primarily confined to socio-emotional contexts, where visual cues (facial expression) often co-occur with auditory cues (emotion prosody) to express intended emotions, or extend to linguistic emotion processing. In order to better understand the underlying deficiency mechanism of emotion processing in individuals with amusia, we examined whether reduced sensitivity to emotional processing extends to the recognition of emotion category and valence of written words in individuals with amusia. Twenty Cantonese speakers with amusia and 17 controls were tested in three experiments: (1) emotion prosody rating, in which participants rated how much each spoken sentence was expressed in each of the four emotions on 7-point rating scales; (2) written word emotion recognition, in which participants recognized the emotion of written emotion words; and (3) written word valence judgment, in which participants judged the valence of written words. Results showed that participants with amusia preformed significantly less accurately than controls in emotion prosody recognition; in contrast, the two groups showed no significant difference in accuracy rates in both written word tasks (emotion recognition and valence judgment). The results indicate that the impairment of individuals with amusia in emotion processing may not generalize to linguistic emotion processing in written words, implying that the emotion deficit is likely to be restricted to socio-emotional contexts in individuals with amusia.
- 27 January 2020
- Published by Taylor & Francis in Clinical Linguistics & Phonetics
- Vol. 35 (2) , 101-116
Emotion processing in congenital amusia: the deficits do not generalize to written emotion words
Congenital amusia is a lifelong impairment in musical ability. Individuals with amusia are found to show reduced sensitivity to emotion recognition in speech prosody and silent facial expressions, implying a possible cross-modal emotion-processing deficit. However, it is not clear whether the observed deficits are primarily confined to socio-emotional contexts, where visual cues (facial expression) often co-occur with auditory cues (emotion prosody) to express intended emotions, or extend to linguistic emotion processing. In order to better understand the underlying deficiency mechanism of emotion processing in individuals with amusia, we examined whether reduced sensitivity to emotional processing extends to the recognition of emotion category and valence of written words in individuals with amusia. Twenty Cantonese speakers with amusia and 17 controls were tested in three experiments: (1) emotion prosody rating, in which participants rated how much each spoken sentence was expressed in each of the four emotions on 7-point rating scales; (2) written word emotion recognition, in which participants recognized the emotion of written emotion words; and (3) written word valence judgment, in which participants judged the valence of written words. Results showed that participants with amusia preformed significantly less accurately than controls in emotion prosody recognition; in contrast, the two groups showed no significant difference in accuracy rates in both written word tasks (emotion recognition and valence judgment). The results indicate that the impairment of individuals with amusia in emotion processing may not generalize to linguistic emotion processing in written words, implying that the emotion deficit is likely to be restricted to socio-emotional contexts in individuals with amusia.