A Comparison of Item-Fit Statistics for the Three-Parameter Logistic Model
- 1 March 2003
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 27 (2) , 87-106
Abstract
In this article, the Type I error rate and the power of a number of existing and new tests of fit to the 3-parameter logistic model (3PLM) are investigated. The first test is a generalization of a test for the evaluation of the fit to the 2-parameter logistic model (2PLM) based on the Lagrange multiplier (LM) test or the equivalent efficient score test. This technique is applied to two model violations: deviation from the 3PLM item characteristic curve and violation of local stochastic independence. The LM test for the first violation is compared with the Q 1 – G² j and S – G² j tests, respectively. The LM test for the second violation is compared with the Q 3 test and a new test, the S 3 test, which can be viewed as a generalization of the approach of the S – G² j test to the evaluation of violation of local independence. The results of simulation studies indicate that all tests, except the Q 1 – G² j test, have a Type I error rate that is acceptably close to the nominal significance level, and good power to detect the model violations they are targeted at. When, however, misfitting items are present in a test, the proportion of items that are flagged incorrectly as misfitting can become undesirably high, especially for short tests.Keywords
This publication has 21 references indexed in Scilit:
- Likelihood-Based Item-Fit Indices for Dichotomous Item Response Theory ModelsApplied Psychological Measurement, 2000
- Scaling Performance Assessments: Strategies for Managing Local Item DependenceJournal of Educational Measurement, 1993
- A Comparison of Several Goodness-of-Fit StatisticsApplied Psychological Measurement, 1985
- Comparison of IRT True-Score and Equipercentile Observed-Score "Equatings"Applied Psychological Measurement, 1984
- Effects of Local Item Dependence on the Fit and Equating Performance of the Three-Parameter Logistic ModelApplied Psychological Measurement, 1984
- Characterizing the Manifest Probabilities of Latent Trait ModelsPsychometrika, 1983
- Adaptive EAP Estimation of Ability in a Microcomputer EnvironmentApplied Psychological Measurement, 1982
- Two New Test Statistics for the Rasch ModelPsychometrika, 1982
- Using Simulation Results to Choose a Latent Trait ModelApplied Psychological Measurement, 1981
- Maximum-Likelihood Estimation of Parameters Subject to RestraintsThe Annals of Mathematical Statistics, 1958