Assessing Goodness of Fit of Item Response Theory Models: A Comparison of Traditional and Alternative Procedures
Authors:
- 1 December 2003
- journal article
- Published by Wiley in Journal of Educational Measurement
- Vol. 40 (4) , 331-352
Abstract
Testing the goodness of fit of item response theory (IRT) models is relevant to validating IRT models, and new procedures have been proposed. These alternatives compare observed and expected response frequencies conditional on observed total scores, and use posterior probabilities for responses across θ levels rather than cross‐classifying examinees using point estimates of θ and score responses. This research compared these alternatives with regard to their methods, properties (Type 1 error rates and empirical power), available research, and practical issues (computational demands, treatment of missing data, effects of sample size and sparse data, and available computer programs). Different advantages and disadvantages related to these characteristics are discussed. A simulation study provided additional information about empirical power and Type 1 error rates.Keywords
This publication has 13 references indexed in Scilit:
- The Effect of Errors in Estimating Ability on Goodness-of-Fit Tests for Irt ModelsEducational and Psychological Measurement, 2000
- Likelihood-Based Item-Fit Indices for Dichotomous Item Response Theory ModelsApplied Psychological Measurement, 2000
- Monte Carlo Based Null Distribution for an Alternative Goodness‐of‐Fit Test Statistic in IRT ModelsJournal of Educational Measurement, 2000
- Item Response Theory for Scores on Tests Including Polytomous Items with Ordered ResponsesApplied Psychological Measurement, 1995
- A Comparison of Item- and Person-Fit Methods of Assessing Model-Data Fit in IRTApplied Psychological Measurement, 1990
- A Comparison of Several Goodness-of-Fit StatisticsApplied Psychological Measurement, 1985
- Comparison of IRT True-Score and Equipercentile Observed-Score "Equatings"Applied Psychological Measurement, 1984
- Using Simulation Results to Choose a Latent Trait ModelApplied Psychological Measurement, 1981
- Algorithm AS 155: The Distribution of a Linear Combination of χ 2 Random VariablesJournal of the Royal Statistical Society Series C: Applied Statistics, 1980
- Estimating Item Parameters and Latent Ability when Responses are Scored in Two or More Nominal CategoriesPsychometrika, 1972