ABAlisa Barkar

Alisa Barkar

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Alisa Barkar has a total of 7 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    How LLMs Assess Public Speaking? Methodology of Explaining LLM Judgments through Linguistic Patterns and Rhetorical Criteria

    by Alisa Barkar, Mathieu Chollet, Matthieu Labeau, Beatrice Biancardi, Chloé Clavel

    This study examines how Large Language Models, specifically GPT-4o-mini, evaluate public speaking performances based on textual transcripts. We collect a new annotation of speeches from the 3MT_French dataset and compare GPT-4o-mini annotations to those of an expert across both concrete rhetorical criteria and abstract subjective dimensions. In contrast to the expert, GPT-4o-mini exhibits limited cross-criterion integration and struggles with subjective judgments such as persuasiveness and creativity. Further, we utilise linguistic features in order to interpret provided annotations and demonstrated that GPT-4o-mini relies heavily on surface-level linguistic features and tends to prioritise structural and stylistic markers, while expert annotations reflect broader discourse-level understanding and persuasive intent. These findings highlight the limitations of using LLMs in high-level rhetorical evaluation and suggest the need for hybrid systems that combine model capabilities with theory-driven evaluation criteria. The annotated dataset and code are released to support future work in this direction: https://github.com/abarkar/ How-LLMs-Assess-Public-Speaking-/tree/main

  • Open Access

    Probing Experts' Perspectives on AI-Assisted Public Speaking Training

    by Nesrine Fourati, Alisa Barkar, Marion Dragée, Liv Danthon-Lefebvre, Mathieu Chollet

    Background: Public speaking is a vital professional skill, yet it remains a source of significant anxiety for many individuals. Traditional training relies heavily on expert coaching, but recent advances in AI has led to novel types of commercial automated public speaking feedback tools. However, most research has focused on prototypes rather than commercial applications, and little is known about how public speaking experts perceive these tools. Objectives: This study aims to evaluate expert opinions on the efficacy and design of commercial AI-based public speaking training tools and to propose guidelines for their improvement. Methods: The research involved 16 semi-structured interviews and 2 focus groups with public speaking experts. Participants discussed their views on current commercial tools, their potential integration into traditional coaching, and suggestions for enhancing these systems. Results and Conclusions: Experts acknowledged the value of AI tools in handling repetitive, technical aspects of training, allowing coaches to focus on higher-level skills. However they found key issues in current tools, emphasising the need for personalised, understandable, carefully selected feedback and clear instructional design. Overall, they supported a hybrid model combining traditional coaching with AI-supported exercises.

  • Open Access

    The Anatomy of Speech Persuasion: Linguistic Shifts in LLM-Modified Speeches

    by Alisa Barkar, Mathieu Chollet, Matthieu Labeau, Beatrice Biancardi, Chloe Clavel

    This study examines how large language models understand the concept of persuasiveness in public speaking by modifying speech transcripts from PhD candidates in the "Ma These en 180 Secondes" competition, using the 3MT French dataset. Our contributions include a novel methodology and an interpretable textual feature set integrating rhetorical devices and discourse markers. We prompt GPT-4o to enhance or diminish persuasiveness and analyze linguistic shifts between original and generated speech in terms of the new features. Results indicate that GPT-4o applies systematic stylistic modifications rather than optimizing persuasiveness in a human-like manner. Notably, it manipulates emotional lexicon and syntactic structures (such as interrogative and exclamatory clauses) to amplify rhetorical impact.