Multiple dichotomous-scored items in second language testing: investigating the multiple true-false item type under norm-referenced conditions
Author:
- 1 April 2006
- journal article
- research article
- Published by SAGE Publications in Language Testing
- Vol. 23 (2) , 198-228
Abstract
This study examined the multiple true-false (MTF) test format in second language testing by comparing multiple-choice (MCQ) and multiple true-false (MTF) test formats in two language areas of general English: vocabulary and reading. Two counter-balanced experimental designs - one for each language area - were examined in terms of the number of MCQ and MTF differentially responded to, MTF item dependency, reliability, and concurrent validity. The data were analysed by classical test theory (CTT) and Rasch analysis. The results showed a two- and three-fold increase in vocabulary and reading items answered, respectively. Participants responded to significantly more MTF items than MCQ, and further analysis revealed no item dependency for both language domains. Reliability increases were found in the reading tests. Item conversions did not alter the basic functioning of the MTF items, and common person equating plots demonstrated a steady relationship between MCQ and MTF person ability estimates.Keywords
This publication has 14 references indexed in Scilit:
- Criterion-Referenced Language Testing2001
- The Multiple True‐False Item Format: A Status ReviewEducational Measurement: Issues and Practice, 1992
- An Analysis of Textbook Advice About True-False TestsApplied Measurement in Education, 1991
- Multiple True-False Items: A Study of Interitem Correlations, Scoring Alternatives, and Reliability EstimationJournal of Educational Measurement, 1988
- ESTIMATING THE RELIABILITY OF MULTIPLE TRUE-FALSE TESTSJournal of Educational Measurement, 1986
- Scoring Multiple True/False TestsEvaluation & the Health Professions, 1982
- THE RELATIVE MERITS OF MULTIPLE TRUE‐FALSE ACHIEVEMENT TESTSJournal of Educational Measurement, 1982
- The Assessment of Partial KnowledgeEducational and Psychological Measurement, 1956
- An experimental comparison of the multiple true-false and multiple multiple-choice tests.Journal of Educational Psychology, 1941
- Note on the multiple true-false test exercise.Journal of Educational Psychology, 1939