Improved Wald Statistics for Item-Level Model Comparison in Diagnostic Classification Models
- 14 September 2018
- journal article
- research article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 43 (5) , 402-414
Abstract
Diagnostic classification models (DCMs) have been widely used in education, psychology, and many other disciplines. To select the most appropriate DCM for each item, the Wald test has been recommended. However, prior research has revealed that this test provides inflated Type I error rates. To address this problem, the authors propose to replace the asymptotic covariance matrix from the original version of the Wald statistic with a matrix obtained from improved computation methods. In this study, the Wald test based on the observed information matrix and the Wald test based on the sandwich-type matrix are proposed for item-level model comparisons and a simulation study is conducted to investigate their empirical behavior. Simulation results indicate that when the sample size is reasonably large ( ), the Type I error rates of the Wald test based on the sandwich-type matrix are accurate with adequate or excellent power under most of the simulation conditions.
Keywords
Funding Information
- Social Science foundation of Shandong Province, China (18CJYJ16)
This publication has 21 references indexed in Scilit:
- Evaluating the Wald Test for Item‐Level Comparison of Saturated and Reduced Models in Cognitive DiagnosisJournal of Educational Measurement, 2013
- The Impact of Model Misspecification on Parameter Estimation and Item‐Fit Assessment in Log‐Linear Diagnostic Classification ModelsJournal of Educational Measurement, 2012
- The Generalized DINA Model FrameworkPsychometrika, 2011
- Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent VariablesPsychometrika, 2009
- DINA Model and Parameter Estimation: A DidacticJournal of Educational and Behavioral Statistics, 2009
- Cognitive Diagnostic Assessment for Education2007
- Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response TheoryApplied Psychological Measurement, 2001
- Practical Significance: A Concept Whose Time Has ComeEducational and Psychological Measurement, 1996
- Using Restricted Latent Class Models to Map the Skill Structure of Achievement ItemsJournal of Educational Measurement, 1989
- Robustness?British Journal of Mathematical and Statistical Psychology, 1978