MG-ShopDial: A Multi-Goal Conversational Dataset for e-Commerce
Open Access
- 18 July 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2775-2785
Abstract
Conversational systems can be particularly effective in supporting complex information seeking scenarios with evolving information needs. Finding the right products on an e-commerce platform is one such scenario, where a conversational agent would need to be able to provide search capabilities over the item catalog, understand and make recommendations based on the user's preferences, and answer a range of questions related to items and their usage. Yet, existing conversational datasets do not fully support the idea of mixing different conversational goals (i.e., search, recommendation, and question answering) and instead focus on a single goal. To address this, we introduce MG-ShopDial: a dataset of conversations mixing different goals in the domain of e-commerce. Specifically, we make the following contributions. First, we develop a coached human-human data collection protocol where each dialogue participant is given a set of instructions, instead of a specific script or answers to choose from. Second, we implement a data collection tool to facilitate the collection of multi-goal conversations via a web chat interface, using the above protocol. Third, we create the MG-ShopDial collection, which contains 64 high-quality dialogues with a total of 2,196 utterances for e-commerce scenarios of varying complexity. The dataset is additionally annotated with both intents and goals on the utterance level. Finally, we present an analysis of this dataset and identify multi-goal conversational patterns.Keywords
All Related Versions
Funding Information
- Research Council of Norway (309834)
This publication has 35 references indexed in Scilit:
- User Intent Prediction in Information-seeking Conversations2019
- Research Frontiers in Information RetrievalACM SIGIR Forum, 2018
- Decoupling Strategy and Generation in Negotiation Dialogues2018
- QuAC: Question Answering in Context2018
- Inter-annotator Agreement2017
- Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddings2017
- ParlAI: A Dialog Research Software Platform2017
- Dialogue Act Annotation with the ISO 24617-2 Standard2016
- Part 3. Designing the Future2013
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977