Optimal Calibration Designs for Tests of Polytomously Scored Items Described by Item Response Theory Models
Authors:
- 1 December 2001
- journal article
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 26 (4) , 361-380
Abstract
This article examines calibration designs, which maximize the determinant of Fisher’s information matrix on the item parameters (D-optimal), for sets of polytomously scored items. These items were analyzed using a number of item response theory (IRT) models, which are members of the “divide-by-total” family, including the nominal categories model, the rating scale model, the unidimensional polytomous Rasch model and the partial credit model. We extend the known results for dichotomous items, both singly and in tests to polytomous items. The structure of Fisher’s information matrix is examined in order to gain insights into the structure of D-optimal calibration designs for IRT models. A theorem giving an upper bound for the number of support points for such models is proved. A lower bound is also given. Finally, we examine a set of items, which have been analyzed using a number of different models. The locally D-optimal calibration design for each analysis is calculated using an exact numerical and a sequential procedure. The results are discussed both in general and in relation to each other.Keywords
This publication has 18 references indexed in Scilit:
- Minimax D-Optimal Designs for Item Response Theory ModelsPsychometrika, 2000
- Optimal Sequential Designs for On-line Item EstimationPsychometrika, 1994
- D-Optimal Sequential Sampling Designs for Item Response Theory ModelsJournal of Educational Statistics, 1994
- Sequential Sampling Designs for the Two-Parameter Item Response Theory ModelPsychometrika, 1992
- A Generalized Partial Credit Model: Application of an EM AlgorithmApplied Psychological Measurement, 1992
- On the Efficiency of IRT Models When Applied to Different Sampling DesignsApplied Psychological Measurement, 1991
- Optimal Bayesian design applied to logistic regression experimentsJournal of Statistical Planning and Inference, 1989
- On d-optimal designs for binary dataJournal of Statistical Planning and Inference, 1988
- A Rasch Model for Partial Credit ScoringPsychometrika, 1982
- Estimating Item Parameters and Latent Ability when Responses are Scored in Two or More Nominal CategoriesPsychometrika, 1972