End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics
Preprint
Abstract
The advances in language-based Artificial Intelligence (AI) technologies applied to build educational applications can present AI for social-good opportunities with a broader positive impact. Across many disciplines, enhancing the quality of mathematics education is crucial in building critical thinking and problem-solving skills at younger ages. Conversational AI systems have started maturing to a point where they could play a significant role in helping students learn fundamental math concepts. This work presents a task-oriented Spoken Dialogue System (SDS) built to support play-based learning of basic math concepts for early childhood education. The system has been evaluated via real-world deployments at school while the students are practicing early math concepts with multimodal interactions. We discuss our efforts to improve the SDS pipeline built for math learning, for which we explore utilizing MathBERT representations for potential enhancement to the Natural Language Understanding (NLU) module. We perform an end-to-end evaluation using real-world deployment outputs from the Automatic Speech Recognition (ASR), Intent Recognition, and Dialogue Manager (DM) components to understand how error propagation affects the overall performance in real-world scenarios.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- Can guidance during play enhance children’s learning and development in educational contexts? A systematic review and meta-analysisChild Development, 2022
- Benchmarking Natural Language Understanding Services for Building Conversational Agents2021
- A Multimodal Human-Computer Interaction System and Its Application in Smart Learning Environments2020
- Sara, the Lecturer: Improving Learning in Online Education with a Scaffolding-Based Conversational Agent2020
- Kid Space2018
- Artificial Intelligence trends in education: a narrative overviewProcedia Computer Science, 2018
- A Survey on Dialogue SystemsACM SIGKDD Explorations Newsletter, 2017
- Using Recurrent Neural Networks for Slot Filling in Spoken Language UnderstandingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- Serious Games Get Smart: Intelligent Game‐Based Learning EnvironmentsAI Magazine, 2013
- AutoTutor and affective autotutorACM Transactions on Interactive Intelligent Systems, 2012