QUALITY AND FEATURE OF MULTIPLE-CHOICE QUESTIONS IN EDUCATION
Authors:
Open Access
- 5 August 2020
- journal article
- research article
- Published by Scientia Socialis Ltd in Problems of Education in the 21st Century
- Vol. 78 (4) , 576-594
Abstract
The quality of multiple-choice questions (MCQs) as well as the student's solve behavior in MCQs are educational concerns. MCQs cover wide educational content and can be immediately and accurately scored. However, many studies have found some flawed items in this exam type, thereby possibly resulting in misleading insights into students’ performance and affecting important decisions. This research sought to determine the characteristics of MCQs and factors that may affect the quality of MCQs by using item response theory (IRT) to evaluate data. For this, four samples of different sizes from US and China in secondary and higher education were chosen. Item difficulty and discrimination were determined using item response theory statistical item analysis models. Results were as follows. First, only a few guessing behaviors are included in MCQ exams because all data fit the two-parameter logistic model better than the three-parameter logistic model. Second, the quality of MCQs depended more on the degree of training of examiners and less on middle or higher education levels. Lastly, MCQs must be evaluated to ensure that high-quality items can be used as bases of inference in middle and higher education. Keywords: higher education, item evaluation, item response theory, multiple-choice test, secondary educationKeywords
This publication has 37 references indexed in Scilit:
- Cognitive psychology meets psychometric theory: On the relation between process models for decision making and latent variable models for individual differences.Psychological Review, 2011
- Approaches to data analysis of multiple-choice questionsPhysical Review Special Topics - Physics Education Research, 2009
- Designing Multiple-Choice Test Items at Higher Cognitive LevelsNurse Educator, 2009
- A Bootstrap Generalization of Modified Parallel Analysis for IRT Dimensionality AssessmentApplied Measurement in Education, 2008
- IRT Models for Ability-Based GuessingApplied Psychological Measurement, 2006
- Use of flawed multiple-choice items by theNew England Journal of Medicinefor continuing medical educationMedical Teacher, 2006
- The Effects of Violating Standard Item Writing Principles on Tests and Students: The Consequences of Using Flawed Test Items on Achievement Examinations in Medical EducationAdvances in Health Sciences Education, 2005
- Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing TestbanksJournal of Education for Business, 1997
- The Learning Gap: Why Our Schools are Failing and What We Can Learn from Japanese and Chinese Education.Contemporary Sociology: A Journal of Reviews, 1993
- Formula Scoring of Multiple‐Choice Tests (Correction for Guessing)Educational Measurement: Issues and Practice, 1988