Relationship between auditory and semantic entrainment using Deep Neural Networks (DNN)
Preprint
Abstract
The tendency of people to engage in similar, matching, or synchronized behaviour when interacting is known as entrainment. Many studies examined linguistic (syntactic and lexical structures) and paralinguistic (pitch, intensity) entrainment, but less attention was given to finding the relationship between them. In this study, we utilized state-of-the-art DNN embeddings such as BERT and TRIpLet Loss network (TRILL) vectors to extract features for measuring semantic and auditory similarities of turns within dialogues in two comparable spoken corpora of two different languages. We found people's tendency to entrain on semantic features more when compared to auditory features. Additionally, we found that entrainment in semantic and auditory linguistic features are positively correlated. The findings of this study might assist in implementing the mechanism of entrainment in human-machine interaction (HMI).Keywords
All Related Versions
- Version 1, 2023-12-27, ArXiv
- Published version: .
This publication has 8 references indexed in Scilit:
- Verbal entrainment in autism spectrum disorder and first-degree relativesScientific Reports, 2022
- SlovakBERT: Slovak Masked Language Model2022
- It’s alignment all the way down, but not all the way up: Speakers align on some features but not others within a dialogueJournal of Phonetics, 2021
- Towards Learning a Universal Non-Semantic Representation of Speech2020
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks2019
- Deep Metric Learning Using Triplet Network2015
- Language Style Matching Predicts Relationship Initiation and StabilityPsychological Science, 2010
- Toward a mechanistic psychology of dialogueBehavioral and Brain Sciences, 2004