Effect of Differential Item Functioning on Computer Adaptive Testing Under Different Conditions
- 17 September 2024
- journal article
- research article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 48 (7-8) , 303-322
Abstract
This study provides an overview of the effect of differential item functioning (DIF) on measurement precision, test information function (TIF), and test effectiveness in computer adaptive tests (CATs). Simulated data for the study was produced and analyzed with the Rstudio. During the data generation process, item pool size, DIF type, DIF percentage, item selection method for CAT, and the test termination rules were considered changed conditions. Sample size and ability parameter distribution, Item Response Theory (IRT) model, DIF size, ability estimation method, test starting rule, and item usage frequency method regarding CAT conditions were considered fixed conditions. To examine the effect of DIF, measurement precision, TIF and test effectiveness were calculated. Results show DIF has negative effects on measurement precision, TIF, and test effectiveness. In particular, statistically significant effects of the percentage DIF items and DIF type are observed on measurement precision.Keywords
This publication has 58 references indexed in Scilit:
- On Wald tests for differential item functioning detectionStatistical Methods & Applications, 2018
- Using Credible Intervals to Detect Differential Item Functioning in IRT ModelsSpringer Proceedings in Mathematics & Statistics, 2018
- A Penalty Approach to Differential Item Functioning in Rasch ModelsPsychometrika, 2015
- Assessing Differential Item Functioning in Multiple Grouping Variables with Factorial Logistic Regression2015
- Modeling differential item functioning with group-specific item parameters: A computerized adaptive testing applicationMeasurement, 2013
- The Assessment of Differential Item Functioning in Comput Adaptive Tests2000
- Bayesian Item Selection Criteria for Adaptive TestingPsychometrika, 1998
- A New Procedure for Detection of Crossing DIFPsychometrika, 1996
- Computerized Adaptive Testing: Theory, Applications, and Standards1991
- Item bias and item response theoryInternational Journal of Educational Research, 1989