Štefan Beňuš
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Štefan Beňuš has a total of 116 co-authors. Here are the top co-authors by number of shared publications:
Agustín Gravano
10 shared publicationsJulia Hirschberg
10 shared publications- Rivka Levitan
Columbia University, New York, USA
6 shared publications Milan Rusko
Ústav Informatiky SAV , Bratislava , Slovakia
5 shared publicationsMarian Trnka
Ústav Informatiky SAV , Bratislava , Slovakia
4 shared publicationsSakhia Darjaa
Ústav Informatiky SAV , Bratislava , Slovakia
4 shared publications
Latest Publications
- 26 December 2025
- Published by Elsevier in Computer Speech & Language
- Vol. 99
Entrainment detection using DNN
- 26 December 2025
- Published by Elsevier in Computer Speech & Language
- Vol. 99
Entrainment detection using DNN
- Open Access
- 23 May 2025
- Published by Elsevier in Computers in Human Behavior Reports
- Vol. 18
Can behavioral features reveal lying in an online personality questionnaire? The impact of mouse dynamics and speech
- 23 May 2025
- Published by Elsevier in Computers in Human Behavior Reports
- Vol. 18
Open AccessCan behavioral features reveal lying in an online personality questionnaire? The impact of mouse dynamics and speech
- 19 April 2025
- Published by Elsevier in Speech Communication
- Vol. 171
Lexical, syntactic, semantic and acoustic entrainment in Slovak, Spanish, English, and Hungarian: A cross-linguistic comparison
- 19 April 2025
- Published by Elsevier in Speech Communication
- Vol. 171
Lexical, syntactic, semantic and acoustic entrainment in Slovak, Spanish, English, and Hungarian: A cross-linguistic comparison
- Open Access
Language Proficiency and F0 Entrainment: A Study of L2 English Imitation in Italian, French, and Slovak Speakers
This study explores F0 entrainment in second language (L2) English speech imitation during an Alternating Reading Task (ART). Participants with Italian, French, and Slovak native languages imitated English utterances, and their F0 entrainment was quantified using the Dynamic Time Warping (DTW) distance between the parameterized F0 contours of the imitated utterances and those of the model utterances. Results indicate a nuanced relationship between L2 English proficiency and entrainment: speakers with higher proficiency generally exhibit less entrainment in pitch variation and declination. However, within dyads, the more proficient speakers demonstrate a greater ability to mimic pitch range, leading to increased entrainment. This suggests that proficiency influences entrainment differently at individual and dyadic levels, highlighting the complex interplay between language skill and prosodic adaptation.
Open AccessLanguage Proficiency and F0 Entrainment: A Study of L2 English Imitation in Italian, French, and Slovak Speakers
This study explores F0 entrainment in second language (L2) English speech imitation during an Alternating Reading Task (ART). Participants with Italian, French, and Slovak native languages imitated English utterances, and their F0 entrainment was quantified using the Dynamic Time Warping (DTW) distance between the parameterized F0 contours of the imitated utterances and those of the model utterances. Results indicate a nuanced relationship between L2 English proficiency and entrainment: speakers with higher proficiency generally exhibit less entrainment in pitch variation and declination. However, within dyads, the more proficient speakers demonstrate a greater ability to mimic pitch range, leading to increased entrainment. This suggests that proficiency influences entrainment differently at individual and dyadic levels, highlighting the complex interplay between language skill and prosodic adaptation.
- Open Access
ART: The Alternating Reading Task Corpus for Speech Entrainment and Imitation
We introduce the Alternating Reading Task (ART) Corpus, a collection of dyadic sentence reading for studying the entrainment and imitation behaviour in speech communication. The ART corpus features three experimental conditions - solo reading, alternating reading, and deliberate imitation - as well as three sub-corpora encompassing French-, Italian-, and Slovak-accented English. This design allows systematic investigation of speech entrainment in a controlled and less-spontaneous setting. Alongside detailed transcriptions, it includes English proficiency scores, demographics, and in-experiment questionnaires for probing linguistic, personal and interpersonal influences on entrainment. Our presentation covers its design, collection, annotation processes, initial analysis, and future research prospects.
Open AccessART: The Alternating Reading Task Corpus for Speech Entrainment and Imitation
We introduce the Alternating Reading Task (ART) Corpus, a collection of dyadic sentence reading for studying the entrainment and imitation behaviour in speech communication. The ART corpus features three experimental conditions - solo reading, alternating reading, and deliberate imitation - as well as three sub-corpora encompassing French-, Italian-, and Slovak-accented English. This design allows systematic investigation of speech entrainment in a controlled and less-spontaneous setting. Alongside detailed transcriptions, it includes English proficiency scores, demographics, and in-experiment questionnaires for probing linguistic, personal and interpersonal influences on entrainment. Our presentation covers its design, collection, annotation processes, initial analysis, and future research prospects.
- 1 April 2024
- Published by Walter de Gruyter GmbH in Human Affairs
- Vol. 34 (2) , 224-243
Towards the Use of Social Robot Furhat and Generative AI in Testing Cognitive Abilities
Spoken communication between social robotic devices, powered by generative AI tools such as ChatGPT, and the senior population offers great potential for researching social interaction and robot identity perceptions as well as exploring the potential opportunities and challenges when implementing this human-machine interactions in real life situations and health care. In this paper we explore people’s perceptions of the social robot Furhat when administering verbal tasks similar to those used in screening for Alzheimer’s disease. We describe the Slovak system mounted on the robot that includes a speech recognizer, the scenarios powered by generative large language model ChatGPT, and a speech synthesizer. We tested the functionality of the proposed approach with two groups of participants: attendees of a large science fair and a scientific conference. The observations from 87 collected questionnaires suggest good potential and applicability of such an approach for the given task and more positive attitudes of older subjects compared to younger ones.
- 1 April 2024
- Published by Walter de Gruyter GmbH in Human Affairs
- Vol. 34 (2) , 224-243
Towards the Use of Social Robot Furhat and Generative AI in Testing Cognitive Abilities
Spoken communication between social robotic devices, powered by generative AI tools such as ChatGPT, and the senior population offers great potential for researching social interaction and robot identity perceptions as well as exploring the potential opportunities and challenges when implementing this human-machine interactions in real life situations and health care. In this paper we explore people’s perceptions of the social robot Furhat when administering verbal tasks similar to those used in screening for Alzheimer’s disease. We describe the Slovak system mounted on the robot that includes a speech recognizer, the scenarios powered by generative large language model ChatGPT, and a speech synthesizer. We tested the functionality of the proposed approach with two groups of participants: attendees of a large science fair and a scientific conference. The observations from 87 collected questionnaires suggest good potential and applicability of such an approach for the given task and more positive attitudes of older subjects compared to younger ones.
- 5 March 2024
- Published by SAGE Publications in Language and Speech
- Vol. 68 (1) , 36-62
Speech Fluency Production and Perception in L1 (Slovak) and L2 (English) Read Speech
Research on fluency in native (L1) and non-native (L2) speech production and perception helps us understand how individual L1 speaking style might affect perceived L2 fluency and how this relationship might be reflected in L1 versus L2 oral assessment. While the relationship between production and perception of fluency in spontaneous speech has been studied, the information provided by reading has been overlooked. We argue that reading provides a direct and controlled way to assess language proficiency that might complement information gained from spontaneous speaking. This work analyzes the relationship between speech fluency production and perception in passages of L1 (Slovak) and L2 (English) read by 57 undergraduate Slovak students of English and rated for fluency by 15 English teachers who are Slovak natives. We compare acoustic production measures between L1 and L2 and analyze how their effect on perceived fluency differs for the two languages. Our main finding is that the articulation rate, the overall number of pauses, and the number of between-clause and mid-clause pauses predict ratings differently in L1 Slovak versus L2 English. The speech rate and durations of pauses predict ratings similarly in both languages. The contribution of our results to understanding fluency aspects of spontaneous and read speech, the relationship between L1 and L2, the relationship between production and perception, and to the teaching of L2 English are discussed.
- 5 March 2024
- Published by SAGE Publications in Language and Speech
- Vol. 68 (1) , 36-62
Speech Fluency Production and Perception in L1 (Slovak) and L2 (English) Read Speech
Research on fluency in native (L1) and non-native (L2) speech production and perception helps us understand how individual L1 speaking style might affect perceived L2 fluency and how this relationship might be reflected in L1 versus L2 oral assessment. While the relationship between production and perception of fluency in spontaneous speech has been studied, the information provided by reading has been overlooked. We argue that reading provides a direct and controlled way to assess language proficiency that might complement information gained from spontaneous speaking. This work analyzes the relationship between speech fluency production and perception in passages of L1 (Slovak) and L2 (English) read by 57 undergraduate Slovak students of English and rated for fluency by 15 English teachers who are Slovak natives. We compare acoustic production measures between L1 and L2 and analyze how their effect on perceived fluency differs for the two languages. Our main finding is that the articulation rate, the overall number of pauses, and the number of between-clause and mid-clause pauses predict ratings differently in L1 Slovak versus L2 English. The speech rate and durations of pauses predict ratings similarly in both languages. The contribution of our results to understanding fluency aspects of spontaneous and read speech, the relationship between L1 and L2, the relationship between production and perception, and to the teaching of L2 English are discussed.
- Open Access
Relationship between auditory and semantic entrainment using Deep Neural Networks (DNN)
The tendency of people to engage in similar, matching, or synchronized behaviour when interacting is known as entrainment. Many studies examined linguistic (syntactic and lexical structures) and paralinguistic (pitch, intensity) entrainment, but less attention was given to finding the relationship between them. In this study, we utilized state-of-the-art DNN embeddings such as BERT and TRIpLet Loss network (TRILL) vectors to extract features for measuring semantic and auditory similarities of turns within dialogues in two comparable spoken corpora of two different languages. We found people's tendency to entrain on semantic features more when compared to auditory features. Additionally, we found that entrainment in semantic and auditory linguistic features are positively correlated. The findings of this study might assist in implementing the mechanism of entrainment in human-machine interaction (HMI).
Open AccessRelationship between auditory and semantic entrainment using Deep Neural Networks (DNN)
The tendency of people to engage in similar, matching, or synchronized behaviour when interacting is known as entrainment. Many studies examined linguistic (syntactic and lexical structures) and paralinguistic (pitch, intensity) entrainment, but less attention was given to finding the relationship between them. In this study, we utilized state-of-the-art DNN embeddings such as BERT and TRIpLet Loss network (TRILL) vectors to extract features for measuring semantic and auditory similarities of turns within dialogues in two comparable spoken corpora of two different languages. We found people's tendency to entrain on semantic features more when compared to auditory features. Additionally, we found that entrainment in semantic and auditory linguistic features are positively correlated. The findings of this study might assist in implementing the mechanism of entrainment in human-machine interaction (HMI).
- Open Access
Unsupervised Auditory and Semantic Entrainment Models with Deep Neural Networks
Speakers tend to engage in adaptive behavior, known as entrainment, when they become similar to their interlocutor in various aspects of speaking. We present an unsupervised deep learning framework that derives meaningful representation from textual features for developing semantic entrainment. We investigate the model's performance by extracting features using different variations of the BERT model (DistilBERT and XLM-RoBERTa) and Google's universal sentence encoder (USE) embeddings on two human-human (HH) corpora (The Fisher Corpus English Part 1, Columbia games corpus) and one human-machine (HM) corpus (Voice Assistant Conversation Corpus (VACC)). In addition to semantic features we also trained DNN-based models utilizing two auditory embeddings (TRIpLet Loss network (TRILL) vectors, Low-level descriptors (LLD) features) and two units of analysis (Inter pausal unit and Turn). The results show that semantic entrainment can be assessed with our model, that models can distinguish between HH and HM interactions and that the two units of analysis for extracting acoustic features provide comparable findings.
Open AccessUnsupervised Auditory and Semantic Entrainment Models with Deep Neural Networks
Speakers tend to engage in adaptive behavior, known as entrainment, when they become similar to their interlocutor in various aspects of speaking. We present an unsupervised deep learning framework that derives meaningful representation from textual features for developing semantic entrainment. We investigate the model's performance by extracting features using different variations of the BERT model (DistilBERT and XLM-RoBERTa) and Google's universal sentence encoder (USE) embeddings on two human-human (HH) corpora (The Fisher Corpus English Part 1, Columbia games corpus) and one human-machine (HM) corpus (Voice Assistant Conversation Corpus (VACC)). In addition to semantic features we also trained DNN-based models utilizing two auditory embeddings (TRIpLet Loss network (TRILL) vectors, Low-level descriptors (LLD) features) and two units of analysis (Inter pausal unit and Turn). The results show that semantic entrainment can be assessed with our model, that models can distinguish between HH and HM interactions and that the two units of analysis for extracting acoustic features provide comparable findings.
- 22 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 90, 000099-000104
Speech Entrainment and Emotion
The tendency of speakers to become more similar to their interlocutors during a conversation is known as entrainment. Earlier studies examined entrainment at different linguistic levels with different social factors; however, the relationship between speech entrainment and emotion has received less attention. In this study, we analyze the relationship between speech entrainment and emotion in the Multi-modal emotion dataset (MELD) collected from the episodes of TV series Friends. We found that the emotional state of dyads affect the type of features on which they entrain. Furthermore, a novel and interesting finding is that directionality of emotional states, i.e. whether a turn expressing a positive emotion follows a turn with a neutral emotion or vice versa, affects how acoustic-prosodic features participate in entrainment. Our results may facilitate implementing the emotional entrainment functionality in human-machine interactions (HMI).
- 22 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 90, 000099-000104
Speech Entrainment and Emotion
The tendency of speakers to become more similar to their interlocutors during a conversation is known as entrainment. Earlier studies examined entrainment at different linguistic levels with different social factors; however, the relationship between speech entrainment and emotion has received less attention. In this study, we analyze the relationship between speech entrainment and emotion in the Multi-modal emotion dataset (MELD) collected from the episodes of TV series Friends. We found that the emotional state of dyads affect the type of features on which they entrain. Furthermore, a novel and interesting finding is that directionality of emotional states, i.e. whether a turn expressing a positive emotion follows a turn with a neutral emotion or vice versa, affects how acoustic-prosodic features participate in entrainment. Our results may facilitate implementing the emotional entrainment functionality in human-machine interactions (HMI).