An Investigation of Exposure Control Methods With Variable-Length CAT Using the Partial Credit Model
- 23 January 2019
- journal article
- research article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 43 (8) , 624-638
Abstract
The purpose of this simulation study was to investigate the effect of several different item exposure control procedures in computerized adaptive testing (CAT) with variable-length stopping rules using the partial credit model. Previous simulation studies on CAT exposure control methods with polytomous items rarely considered variable-length tests. The four exposure control techniques examined were the randomesque with a group of three items, randomesque with a group of six items, progressive-restricted standard error (PR-SE), and no exposure control. The two variable-length stopping rules included were the SE and predicted standard error reduction (PSER), along with three item pools of varied sizes (43, 86, and 172 items). Descriptive statistics on number of nonconvergent cases, measurement precision, testing burden, item overlap, item exposure, and pool utilization were calculated. Results revealed that the PSER stopping rule administered fewer items on average while maintaining measurement precision similar to the SE stopping rule across the different item pool sizes and exposure controls. The PR-SE exposure control procedure surpassed the randomesque methods by further reducing test overlap, maintaining maximum exposure rates at the target rate or lower, and utilizing all items from the pool with a minimal increase in number of items administered and nonconvergent cases.Keywords
This publication has 29 references indexed in Scilit:
- A Comparison of Exposure Control Procedures in CAT Systems Based on Different Measurement Models for TestletsApplied Measurement in Education, 2013
- A New Stopping Rule for Computerized Adaptive TestingEducational and Psychological Measurement, 2010
- Strategies for Controlling Item Exposure in Computerized Adaptive Testing With the Generalized Partial Credit ModelApplied Psychological Measurement, 2004
- Item Exposure Constraints for Testlets in the Verbal Reasoning Section of the MCATApplied Psychological Measurement, 2003
- a-Stratified Multistage Computerized Adaptive Testing with b BlockingApplied Psychological Measurement, 2001
- a-Stratified Multistage Computerized Adaptive TestingApplied Psychological Measurement, 1999
- A Comparison of Maximum Likelihood Estimation and Expected a Posteriori Estimation in CAT Using the Partial Credit ModelEducational and Psychological Measurement, 1998
- Computerized Adaptive Testing With Polytomous ItemsApplied Psychological Measurement, 1995
- The Nominal Response Model in Computerized Adaptive TestingApplied Psychological Measurement, 1992
- The Effect of Item Selection Procedure and Stepsize on Computerized Adaptive Attitude Measurement Using the Rating Scale ModelApplied Psychological Measurement, 1990