Dialogue agents 101: a beginner’s guide to critical ingredients for designing effective conversational systems
Authors:
Open Access
- 9 September 2024
- journal article
- research article
- Published by Cambridge University Press (CUP) in Natural Language Processing
- Vol. 31 (3) , 874-912
Abstract
Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of conversational tasks, datasets, and methods. However, with numerous tasks being explored simultaneously, the current landscape of conversational AI has become fragmented. Consequently, initiating a well-thought-out model for a dialogue agent can pose significant challenges for a practitioner. Toward highlighting the critical ingredients needed for a practitioner to design a dialogue agent from scratch, the current study provides a comprehensive overview of the primary characteristics of a dialogue agent, the supporting tasks, their corresponding open-domain datasets, and the methods used to benchmark these datasets. We observe that different methods have been used to tackle distinct dialogue tasks. However, building separate models for each task is costly and does not leverage the correlation among the several tasks of a dialogue agent. As a result, recent trends suggest a shift toward building unified foundation models. To this end, we propose Unit, a Unified dialogue dataset constructed from conversations of varying datasets for different dialogue tasks capturing the nuances for each of them. We then train a Unified dialogue foundation model, GPT-2 $^{\textrm{U}}$ and present a concise comparative performance of GPT-2 $^{\textrm{U}}$ against existing large language models. We also examine the evaluation strategies used to measure the performance of dialogue agents and highlight the scope for future research in the area of conversational AI with a thorough discussion of popular models such as ChatGPT.
Keywords
All Related Versions
This publication has 231 references indexed in Scilit:
- Evaluating a Conversational Agent for Second Language Learning Aligned with the School Curriculum2023
- DuReSE: Rewriting Incomplete Utterances via Neural Sequence EditingNeural Processing Letters, 2023
- Bringing Stories to Life in 1001 Nights: A Co-creative Text Adventure Game Using a Story Generation Model2022
- Robust Intent Classification Using Bayesian LSTM for Clinical Conversational Agents (CAs)2022
- Benchmarking Natural Language Understanding Services for Building Conversational Agents2021
- Recent advances and challenges in task-oriented dialog systemsScience China Technological Sciences, 2020
- Survey on evaluation methods for dialogue systemsArtificial Intelligence Review, 2020
- Zero-Shot Slot Filling via Latent Question Representation and Reading ComprehensionLecture Notes in Computer Science, 2019
- Finite State Machines2017
- Emotion, Affect and Conversation2012