Acoustically-Driven Phoneme Removal that Preserves Vocal Affect Cues
Open Access
- 4 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
- Vol. 2023, 1-5
Abstract
In this paper, we propose a method for removing linguistic information from speech for the purpose of isolating paralinguistic indicators of affect. The immediate utility of this method lies in clinical tests of sensitivity to vocal affect that are not confounded by language, which is impaired in a variety of clinical populations. The method is based on simultaneous recordings of speech audio and electroglotto-graphic (EGG) signals. The speech audio signal is used to estimate the average vocal tract filter response and amplitude envelop. The EGG signal supplies a direct correlate of voice source activity that is mostly independent of phonetic articulation. The dynamic energy of the speech audio and the average vocal tract filter are applied to the EGG signal create a third signal designed to capture as much paralinguistic information from the vocal production system as possible— maximizing the retention of bioacoustic cues to affect—while eliminating phonetic cues to verbal meaning. To evaluate the success of this method, we studied the perception of corresponding speech audio and transformed EGG signals in an affect rating experiment with online listeners. The results show a high degree of similarity in the perceived affect of matched signals, indicating that our method is effective.Keywords
All Related Versions
Funding Information
- Health
This publication has 20 references indexed in Scilit:
- Influence on Spectral Energy Distribution of Emotional ExpressionJournal of Voice, 2013
- Auditory processing in autism spectrum disorder: A reviewNeuroscience & Biobehavioral Reviews, 2012
- Neurological Foundations of Voice Production and Perception2011
- Major depression is associated with impaired processing of emotion in music as well as in facial and vocal stimuliJournal of Affective Disorders, 2011
- A resource of validated affective and neutral sentences to assess identification of emotion in spoken language after a brain injuryBrain Injury, 2010
- A dimensional approach to vocal expression of emotionCognition and Emotion, 2005
- Relationships between Electroglottograph, Speech, and Vocal Cord ContactFolia Phoniatrica et Logopaedica, 1984
- Personality inference from voice quality: The loud voice of extroversionEuropean Journal of Social Psychology, 1978
- A course in phonetics . By Peter Ladefoged. New York: Harcourt Brace Jovanovich, 1975. Pp. xvi, 296. $5.95.Language, 1977
- The Electroglottography and its Relation to Glottal ActivityFolia Phoniatrica et Logopaedica, 1975