ChID: A Large-scale Chinese IDiom Dataset for Cloze Test
Preprint
Abstract
Cloze-style reading comprehension in Chinese is still limited due to the lack of various corpora. In this paper we propose a large-scale Chinese cloze test dataset ChID, which studies the comprehension of idiom, a unique language phenomenon in Chinese. In this corpus, the idioms in a passage are replaced by blank symbols and the correct answer needs to be chosen from well-designed candidate idioms. We carefully study how the design of candidate idioms and the representation of idioms affect the performance of state-of-the-art models. Results show that the machine accuracy is substantially worse than that of human, indicating a large space for further research.Keywords
All Related Versions
This publication has 4 references indexed in Scilit:
- CoQA: A Conversational Question Answering ChallengeTransactions of the Association for Computational Linguistics, 2019
- Précis of Foundations of Language: Brain, Meaning, Grammar, Evolution,Behavioral and Brain Sciences, 2003
- Formulaic Language and the Lexicon2002
- Cloze item types and second language comprehensionLanguage Testing, 1991