ŠBŠtefan Beňuš

Štefan Beňuš

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Štefan Beňuš has a total of 116 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Entrainment detection using DNN

    by Jay Kejriwal, Štefan Beňuš, Lina M. Rojas-Barahona


  • Open Access

    Language Proficiency and F0 Entrainment: A Study of L2 English Imitation in Italian, French, and Slovak Speakers

    by Zheng Yuan, Štefan Beňuš, Alessandro D'Ausilio

    This study explores F0 entrainment in second language (L2) English speech imitation during an Alternating Reading Task (ART). Participants with Italian, French, and Slovak native languages imitated English utterances, and their F0 entrainment was quantified using the Dynamic Time Warping (DTW) distance between the parameterized F0 contours of the imitated utterances and those of the model utterances. Results indicate a nuanced relationship between L2 English proficiency and entrainment: speakers with higher proficiency generally exhibit less entrainment in pitch variation and declination. However, within dyads, the more proficient speakers demonstrate a greater ability to mimic pitch range, leading to increased entrainment. This suggests that proficiency influences entrainment differently at individual and dyadic levels, highlighting the complex interplay between language skill and prosodic adaptation.

  • Open Access

    ART: The Alternating Reading Task Corpus for Speech Entrainment and Imitation

    by Zheng Yuan, Dorina de Jong, Štefan Beňuš, Noël Nguyen, Ruitao Feng, Róbert Sabo, Luciano Fadiga, Alessandro D`ausilio

    We introduce the Alternating Reading Task (ART) Corpus, a collection of dyadic sentence reading for studying the entrainment and imitation behaviour in speech communication. The ART corpus features three experimental conditions - solo reading, alternating reading, and deliberate imitation - as well as three sub-corpora encompassing French-, Italian-, and Slovak-accented English. This design allows systematic investigation of speech entrainment in a controlled and less-spontaneous setting. Alongside detailed transcriptions, it includes English proficiency scores, demographics, and in-experiment questionnaires for probing linguistic, personal and interpersonal influences on entrainment. Our presentation covers its design, collection, annotation processes, initial analysis, and future research prospects.

  • Towards the Use of Social Robot Furhat and Generative AI in Testing Cognitive Abilities

    by Róbert Sabo, Štefan Beňuš, Viktória Kevická, Marian Trnka, Milan Rusko, Sakhia Darjaa, Jay Kejriwal

    Spoken communication between social robotic devices, powered by generative AI tools such as ChatGPT, and the senior population offers great potential for researching social interaction and robot identity perceptions as well as exploring the potential opportunities and challenges when implementing this human-machine interactions in real life situations and health care. In this paper we explore people’s perceptions of the social robot Furhat when administering verbal tasks similar to those used in screening for Alzheimer’s disease. We describe the Slovak system mounted on the robot that includes a speech recognizer, the scenarios powered by generative large language model ChatGPT, and a speech synthesizer. We tested the functionality of the proposed approach with two groups of participants: attendees of a large science fair and a scientific conference. The observations from 87 collected questionnaires suggest good potential and applicability of such an approach for the given task and more positive attitudes of older subjects compared to younger ones.


  • Speech Fluency Production and Perception in L1 (Slovak) and L2 (English) Read Speech

    by Lucia Mareková, Štefan Beňuš

    Research on fluency in native (L1) and non-native (L2) speech production and perception helps us understand how individual L1 speaking style might affect perceived L2 fluency and how this relationship might be reflected in L1 versus L2 oral assessment. While the relationship between production and perception of fluency in spontaneous speech has been studied, the information provided by reading has been overlooked. We argue that reading provides a direct and controlled way to assess language proficiency that might complement information gained from spontaneous speaking. This work analyzes the relationship between speech fluency production and perception in passages of L1 (Slovak) and L2 (English) read by 57 undergraduate Slovak students of English and rated for fluency by 15 English teachers who are Slovak natives. We compare acoustic production measures between L1 and L2 and analyze how their effect on perceived fluency differs for the two languages. Our main finding is that the articulation rate, the overall number of pauses, and the number of between-clause and mid-clause pauses predict ratings differently in L1 Slovak versus L2 English. The speech rate and durations of pauses predict ratings similarly in both languages. The contribution of our results to understanding fluency aspects of spontaneous and read speech, the relationship between L1 and L2, the relationship between production and perception, and to the teaching of L2 English are discussed.


  • Open Access

    Relationship between auditory and semantic entrainment using Deep Neural Networks (DNN)

    by Jay Kejriwal, Štefan Beňuš

    The tendency of people to engage in similar, matching, or synchronized behaviour when interacting is known as entrainment. Many studies examined linguistic (syntactic and lexical structures) and paralinguistic (pitch, intensity) entrainment, but less attention was given to finding the relationship between them. In this study, we utilized state-of-the-art DNN embeddings such as BERT and TRIpLet Loss network (TRILL) vectors to extract features for measuring semantic and auditory similarities of turns within dialogues in two comparable spoken corpora of two different languages. We found people's tendency to entrain on semantic features more when compared to auditory features. Additionally, we found that entrainment in semantic and auditory linguistic features are positively correlated. The findings of this study might assist in implementing the mechanism of entrainment in human-machine interaction (HMI).

  • Open Access

    Unsupervised Auditory and Semantic Entrainment Models with Deep Neural Networks

    by Jay Kejriwal, Stefan Benus, Lina M. Rojas-Barahona

    Speakers tend to engage in adaptive behavior, known as entrainment, when they become similar to their interlocutor in various aspects of speaking. We present an unsupervised deep learning framework that derives meaningful representation from textual features for developing semantic entrainment. We investigate the model's performance by extracting features using different variations of the BERT model (DistilBERT and XLM-RoBERTa) and Google's universal sentence encoder (USE) embeddings on two human-human (HH) corpora (The Fisher Corpus English Part 1, Columbia games corpus) and one human-machine (HM) corpus (Voice Assistant Conversation Corpus (VACC)). In addition to semantic features we also trained DNN-based models utilizing two auditory embeddings (TRIpLet Loss network (TRILL) vectors, Low-level descriptors (LLD) features) and two units of analysis (Inter pausal unit and Turn). The results show that semantic entrainment can be assessed with our model, that models can distinguish between HH and HM interactions and that the two units of analysis for extracting acoustic features provide comparable findings.

  • Speech Entrainment and Emotion

    by Jay Kejriwal, Štefan Beňuš

    The tendency of speakers to become more similar to their interlocutors during a conversation is known as entrainment. Earlier studies examined entrainment at different linguistic levels with different social factors; however, the relationship between speech entrainment and emotion has received less attention. In this study, we analyze the relationship between speech entrainment and emotion in the Multi-modal emotion dataset (MELD) collected from the episodes of TV series Friends. We found that the emotional state of dyads affect the type of features on which they entrain. Furthermore, a novel and interesting finding is that directionality of emotional states, i.e. whether a turn expressing a positive emotion follows a turn with a neutral emotion or vice versa, affects how acoustic-prosodic features participate in entrainment. Our results may facilitate implementing the emotional entrainment functionality in human-machine interactions (HMI).