Evaluating the Performance of a Regularized Differential Item Functioning Method for Testlet-Based Polytomous Items
- 31 May 2025
- journal article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 85 (6) , 1180-1199
Abstract
This study investigated the effect of testlets on regularization-based differential item functioning (DIF) detection in polytomous items, focusing on the generalized partial credit model with lasso penalization (GPCMlasso) DIF method. Five factors were manipulated: sample size, magnitude of testlet effect, magnitude of DIF, number of DIF items, and type of DIF-inducing covariates. Model performance was evaluated using false-positive rate (FPR) and true-positive rate (TPR). Results showed that the simulation had effective control of FPR across conditions, while the TPR was differentially influenced by the manipulated factors. Generally, the small testlet effect did not noticeably affect the GPCMlasso model’s performance regarding FPR and TPR. The findings provide evidence of the effectiveness of the GPCMlasso method for DIF detection in polytomous items when testlets were present. The implications for future research and limitations were also discussed.Keywords
This publication has 52 references indexed in Scilit:
- DIF Analysis with Unknown Groups and Anchor ItemsPsychometrika, 2024
- A comparison of methods to address item non-response when testing for differential item functioning in multidimensional patient-reported outcome measuresQuality of Life Research, 2022
- A Machine Learning Approach to Assess Differential Item Functioning of the KINDL Quality of Life Questionnaire Across Children with and Without ADHDChild Psychiatry & Human Development, 2021
- Improving the assessment of measurement invariance: Using regularization to select anchor items and identify differential item functioning.Psychological Methods, 2020
- Introduction to bifactor polytomous item response theory analysisJournal of School Psychology, 2017
- ROC-ing along: Evaluation and interpretation of receiver operating characteristic curvesSurgery, 2016
- A Penalty Approach to Differential Item Functioning in Rasch ModelsPsychometrika, 2015
- Examining type I error and power for detection of differential item and testlet functioningAsia Pacific Education Review, 2009
- Testlet Response Theory and Its Applications2007
- ACT research report series: The effect of item response dependency on trait or ability dimensionality1987