Sorting Pauses in Speech Based Dialog Systems: Effects Of Knowing Whether Pauses in Speech are Mid-Turn or at The End Of the Turn
Open Access
- 11 November 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 587-591
Abstract
Intelligent tutoring systems (ITS) can provide scalable and accessible education at scale. Generally, speech-based tutoring systems interpret the users' long pauses as a signal to take the floor. However, such behavior creates barriers for minority and low-literacy individuals who pause mid-sentence just to finish articulating their thoughts. For them, these systems inappropriately interrupt them, resulting in frustration. In this study, we present a bigram pause detection model that determines whether a pause is occurring in the middle or at the end of a sentence and implemented this model on an ITS (MODIFIED). We also compared the effect of this modification with a baseline ITS that interprets long pauses as the end of a turn (TRADITIONAL). Our results show that participants interacted longer with MODIFIED, and perceive it more human-like than the TRADITIONAL system. We argue that conversational systems need to be designed considering unique needs of their intended interlocutors.Keywords
Funding Information
- National Science Foundation (2219586)
This publication has 15 references indexed in Scilit:
- Audio and ASR-based Filled Pause Detection2022
- Patterns of Adults with Low Literacy Skills Interacting with an Intelligent Tutoring SystemInternational Journal of Artificial Intelligence in Education, 2022
- Evolution and trends in intelligent tutoring systems research: a multidisciplinary and scientometric viewAsia Pacific Education Review, 2021
- Anthropomorphism brings us closer: The mediating role of psychological distance in User–AI assistant interactionsComputers in Human Behavior, 2021
- Study design and protocol for My Guide : An e-health intervention to improve patient-centered outcomes among Hispanic breast cancer survivorsContemporary Clinical Trials, 2018
- Health Literacy Assessment Using Talking Touchscreen Technology (Health LiTT): A New Item Response Theory-Based Measure of Health LiteracyJournal of Health Communication, 2011
- Language and Ideology in CongressBritish Journal of Political Science, 2011
- Oscar: An Intelligent Adaptive Conversational Agent Tutoring System2011
- Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of RobotsInternational Journal of Social Robotics, 2008
- AutoTutor: An Intelligent Tutoring System With Mixed-Initiative DialogueIEEE Transactions on Education, 2005