Test Case Generation for Dialogflow Task-Based Chatbots
Authors:
- 31 March 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 93-102
Abstract
Chatbots are software typically embedded in Web and Mobile applications designed to assist the user in a plethora of activities, from chit-chatting to task completion. They enable diverse forms of interactions, like text and voice commands. As any software, even chatbots are susceptible to bugs, and their pervasiveness in our lives, as well as the underlying technological advancements, call for tailored quality assurance techniques. However, test case generation techniques for conversational chatbots are still limited. In this paper, we present Chatbot Test Generator (CTG), an automated testing technique designed for task-based chatbots. We conducted an experiment comparing CTG with state-of-the-art Botium and Charm tools with seven chatbots, observing that the test cases generated by CTG outperformed the competitors, in terms of robustness and effectiveness.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- A Review of Quality Assurance Research of Dialogue Systems2022
- Ontology-based metamorphic testing for chatbotsSoftware Quality Journal, 2021
- Chatbots: History, technology, and applicationsMachine Learning with Applications, 2020
- Testing Chatbots with Charm2020
- Survey on evaluation methods for dialogue systemsArtificial Intelligence Review, 2020
- An Overview of Chatbot Technology2020
- Testing Chatbots Using Metamorphic Relations2019
- Chatbot Testing Using AI Planning2019
- Assessing the Robustness of Conversational Agents using Paraphrases2019
- Conversational agents in healthcare: a systematic reviewJournal of the American Medical Informatics Association, 2018