Comparison of item response theory ability and item parameters according to classical and Bayesian estimation methods
Open Access
- 20 June 2024
- journal article
- research article
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 11 (2) , 213-248
Abstract
This research aims to compare the ability and item parameter estimations of Item Response Theory according to Maximum likelihood and Bayesian approaches in different Monte Carlo simulation conditions. For this purpose, depending on the changes in the priori distribution type, sample size, test length, and logistics model, the ability and item parameters estimated according to the maximum likelihood and Bayesian method and the differences in the RMSE of these parameters were examined. The priori distribution (normal, left-skewed, right-skewed, leptokurtic, and platykurtic), test length (10, 20, 40), sample size (100, 500, 1000), logistics model (2PL, 3PL). The simulation conditions were performed with 100 replications. Mixed model ANOVA was performed to determine RMSE differentiations. The prior distribution type, test length, and estimation method in the differentiation of ability parameter and RMSE were estimated in 2PL models; the priori distribution type and test length were significant in the differences in the ability parameter and RMSE estimated in the 3PL model. While prior distribution type, sample size, and estimation method created a significant difference in the RMSE of the item discrimination parameter estimated in the 2PL model, none of the conditions created a significant difference in the RMSE of the item difficulty parameter. The priori distribution type, sample size, and estimation method in the item discrimination RMSE were estimated in the 3PL model; the a priori distribution and estimation method created significant differentiation in the RMSE of the lower asymptote parameter. However, none of the conditions significantly changed the RMSE of item difficulty parameters.Keywords
This publication has 50 references indexed in Scilit:
- Using simulation studies to evaluate statistical methodsStatistics in Medicine, 2019
- ggplot22009
- Limited Information Goodness-of-fit Testing in Multidimensional Contingency TablesPsychometrika, 2006
- The Bias Function of the Maximum Likelihood Estimate of Ability for the Dichotomous Response LevelPsychometrika, 1993
- An Approximation for the Bias Function of the Maximum Likelihood Estimate of a Latent Variable for the General Case where the Item Responses are DiscretePsychometrika, 1993
- Bayesian Estimation in the Three-Parameter Logistic ModelPsychometrika, 1986
- Bayes Modal Estimation in Item Response ModelsPsychometrika, 1986
- Item Response Theory1985
- Unbiased Estimators of Ability Parameters, of their Variance, and of their Parallel-Forms ReliabilityPsychometrika, 1983
- Some Standard Errors in Item Response TheoryPsychometrika, 1982