Measurement Efficiency of Innovative Item Formats in Computer‐Based Testing
- 1 March 2003
- journal article
- Published by Wiley in Journal of Educational Measurement
- Vol. 40 (1) , 1-15
Abstract
The psychometric literature provides little empirical evaluation of examinee test data to assess essential psychometric properties of innovative items. In this study, examinee responses to conventional (e.g., multiple choice) and innovative item formats in a computer‐based testing program were analyzed for IRT information with the three‐parameter and graded response models. The innovative item types considered in this study provided more information across all levels of ability than multiple‐choice items. In addition, accurate timing data captured via computer administration were analyzed to consider the relative efficiency of the multiple choice and innovative item types. As with previous research, multiple‐choice items provide more information per unit time. Implications for balancing policy, psychometric, and pragmatic factors in selecting item formats are also discussed.Keywords
This publication has 6 references indexed in Scilit:
- An introduction to latent semantic analysisDiscourse Processes, 1998
- Models for Speed and Time-Limit Tests1997
- An Empirical Examination of the IRT Information of Polytomously Scored Reading Items Under the Generalized Partial Credit ModelJournal of Educational Measurement, 1994
- Combining Multiple-Choice and Constructed-Response Test Scores: Toward a Marxist Theory of Test ConstructionApplied Measurement in Education, 1993
- Item Response Theory1985
- INFORMATION IN WRONG RESPONSES TO THE RAVEN PROGRESSIVE MATRICESJournal of Educational Measurement, 1976