Detecting Differential Item Functioning in CAT Using IRT Residual DIF Approach
Authors:
- 28 April 2023
- journal article
- research article
- Published by Wiley in Journal of Educational Measurement
- Vol. 60 (4) , 626-650
Abstract
The residual differential item functioning (RDIF) detection framework was developed recently under a linear testing context. To explore the potential application of this framework to computerized adaptive testing (CAT), the present study investigated the utility of the RDIFR statistic both as an index for detecting uniform DIF of pretest items in CAT and as a direct measure of the effect size of uniform DIF. Extensive CAT simulations revealed RDIFR to have well‐controlled Type I error and slightly higher power to detect uniform DIF compared with CATSIB, especially when pretest items were calibrated using fixed‐item parameter calibration. Moreover, RDIFR accurately estimated the amount of uniform DIF irrespective of the presence of impact. Therefore, RDIFR demonstrates its potential as a useful tool for evaluating both the statistical and practical significance of uniform DIF in CAT.Keywords
This publication has 27 references indexed in Scilit:
- Detection of Crossing Differential Item FunctioningEducational and Psychological Measurement, 2007
- Comparing Methods of Assessing Differential Item Functioning in a Computerized Adaptive Testing EnvironmentJournal of Educational Measurement, 2006
- Application of an Empirical Bayes Enhancement of Mantel-Haenszel Differential Item Functioning Analysis to a Computerized Adaptive TestApplied Psychological Measurement, 2002
- A Comparative Study of On‐line Pretest Item—Calibration/Scaling Methods in Computerized Adaptive TestingJournal of Educational Measurement, 2001
- Improved Type I Error Control and Reduced Estimation Bias for DIF Detection Using SIBTESTJournal of Educational and Behavioral Statistics, 1998
- Simulation Studies of the Effects of Small Sample Size and Studied Item Parameters on SIBTEST and Mantel‐Haenszel Type I Error PerformanceJournal of Educational Measurement, 1996
- Applying the Mantel‐Haenszel Procedure to Complex Samples of ItemsJournal of Educational Measurement, 1996
- DIF Assessment for Polytomously Scored Items: A Framework for Classification and EvaluationApplied Psychological Measurement, 1995
- A Simulation Study of Methods for Assessing Differential Item Functioning in Computerized Adaptive TestsApplied Psychological Measurement, 1994
- Procedures for Selecting Items for Computerized Adaptive TestsApplied Measurement in Education, 1989