An Evaluation of Chinese Human-Computer Dialogue Technology
Authors:
Open Access
- 2 June 2021
- journal article
- research article
- Published by China Science Publishing & Media Ltd. in Data Intelligence
- Vol. 3 (2) , 274-286
Abstract
There is a growing interest in developing human-computer dialogue systems which is an important branch in the field of artificial intelligence (AI). However, the evaluation of large-scale Chinese human-computer dialogues is still a challenging task. To attract more attention to dialogue evaluation work, we held the fourth Evaluation of Chinese Human-Computer Dialogue Technology (ECDT). It consists of few-shot learning in spoken language understanding (SLU) (Task 1) and knowledge-driven multi-turn dialogue competition (Task 2), the data sets of which are provided by Harbin Institute of Technology and Tsinghua University. In this paper, we will introduce the evaluation tasks and data sets in detail. Meanwhile, we will also analyze the evaluation results and the existing problems in the evaluation.Keywords
This publication has 9 references indexed in Scilit:
- KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversation2020
- Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network2020
- Coupled Context Modeling for Deep Chit-Chat2018
- Neural personalized response generation as domain adaptationWorld Wide Web, 2018
- A Survey on Dialogue SystemsACM SIGKDD Explorations Newsletter, 2017
- Survey of evaluation methods for dialogue systems}{Survey of evaluation methods for dialogue systemsSCIENTIA SINICA Informationis, 2017
- Recent Advances on Human-Computer DialogueCAAI Transactions on Intelligence Technology, 2016
- Using Recurrent Neural Networks for Slot Filling in Spoken Language UnderstandingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- I.—COMPUTING MACHINERY AND INTELLIGENCEMind, 1950