Automatic distractor generation for multiple-choice English vocabulary questions
Open Access
- 1 October 2018
- journal article
- research article
- Published by Springer Nature in Research and Practice in Technology Enhanced Learning
- Vol. 13 (1) , 1-16
Abstract
The use of automated systems in second-language learning could substantially reduce the workload of human teachers and test creators. This study proposes a novel method for automatically generating distractors for multiple-choice English vocabulary questions. The proposed method introduces new sources for collecting distractor candidates and utilises semantic similarity and collocation information when ranking the collected candidates. We evaluated the proposed method by administering the questions to real English learners. We further asked an expert to judge the quality of the distractors generated by the proposed method, a baseline method and humans. The results show that the proposed method produces fewer problematic distractors than the baseline method. Furthermore, the generated distractors have a quality that is comparable with that of human-made distractors.Keywords
This publication has 18 references indexed in Scilit:
- Automatic Generation of English Reference Question by Utilising Nonrestrictive Relative Clause2017
- Selected-Response Item Formats in Test Development2015
- Automatic Generation of English Vocabulary Tests2015
- Automatic Generation of Challenging Distractors Using Context-Sensitive Inference Rules2014
- Relationship between types of distractor and difficulty of multiple-choice vocabulary tests in sentential contextLanguage Testing in Asia, 2013
- Refined Distractor Generation with LSA and Stylometry for Automated Multiple Choice Question Generation2012
- Three Options Are Optimal for Multiple‐Choice Items: A Meta‐Analysis of 80 Years of ResearchEducational Measurement: Issues and Practice, 2005
- Computer-aided generation of multiple-choice tests2003
- WordNet: An electronic lexical database . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.Language, 2000
- Straightforward Statistics for the Behavioral Sciences.Journal of the American Statistical Association, 1996