Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive tests
Authors:
Open Access
- 1 June 2009
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 37 (3) , 1466-1488
Abstract
Computerized adaptive testing is becoming increasingly popular due to advancement of modern computer technology. It differs from the conventional standardized testing in that the selection of test items is tailored to individual examinee’s ability level. Arising from this selection strategy is a nonlinear sequential design problem. We study, in this paper, the sequential design problem in the context of the logistic item response theory models. We show that the adaptive design obtained by maximizing the item information leads to a consistent and asymptotically normal ability estimator in the case of the Rasch model. Modifications to the maximum information approach are proposed for the two- and three-parameter logistic models. Similar asymptotic properties are established for the modified designs and the resulting estimator. Examples are also given in the case of the two-parameter logistic model to show that without such modifications, the maximum likelihood estimator of the ability parameter may not be consistent.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Two-Phase Item Selection Procedure for Flexible Content Balancing in CATApplied Psychological Measurement, 2007
- a ‐Stratified CAT design with content blockingBritish Journal of Mathematical and Statistical Psychology, 2003
- Implementing Content Constraints in Alpha-Stratified Adaptive Testing Using a Shadow Test ApproachApplied Psychological Measurement, 2003
- a-Stratified Multistage Computerized Adaptive TestingApplied Psychological Measurement, 1999
- Bayesian Item Selection Criteria for Adaptive TestingPsychometrika, 1998
- A Global Information Approach to Computerized Adaptive TestingApplied Psychological Measurement, 1996
- Efficient Sequential Designs With Binary DataJournal of the American Statistical Association, 1985
- A Bayesian Sequential Procedure for Quantal Response in the Context of Adaptive Mental TestingJournal of the American Statistical Association, 1975
- Local Convergence of Martingales and the Law of Large NumbersThe Annals of Mathematical Statistics, 1965
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951