Approximate Invariance Testing in Diagnostic Classification Models in the Presence of Attribute Hierarchies: A Bayesian Network Approach
Open Access
Abstract
This paper demonstrates the process of invariance testing in diagnostic classification models in the presence of attribute hierarchies via an extension of the log-linear cognitive diagnosis model (LCDM). This extension allows researchers to test for measurement (item) invariance as well as attribute (structural) invariance simultaneously in a single analysis. The structural model of the LCDM was parameterized as a Bayesian network, which allows attribute hierarchies to be modeled and tested for attribute invariance via a series of latent regression models. We illustrate the steps for carrying out the invariance analyses through an in-depth case study with an empirical dataset and provide JAGS code for carrying out the analysis within the Bayesian framework. The analysis revealed that a subset of the items exhibit partial invariance, and evidence of full invariance was found at the structural level.Keywords
All Related Versions
This publication has 53 references indexed in Scilit:
- Testing Measurement Invariance: A Comparison of Multiple-Group Categorical CFA and IRTStructural Equation Modeling: A Multidisciplinary Journal, 2011
- A Note on the Invariance of the DINA Model ParametersJournal of Educational Measurement, 2010
- Testing Measurement Invariance Using Item Response Theory in Longitudinal Data: An IntroductionChild Development Perspectives, 2010
- Modeling Diagnostic Assessments with Bayesian NetworksJournal of Educational Measurement, 2007
- Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy.Journal of Applied Psychology, 2006
- Measurement of psychological disorders using cognitive diagnosis models.Psychological Methods, 2006
- Bayesian Measures of Model Complexity and FitJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response TheoryApplied Psychological Measurement, 2001
- Inference from Iterative Simulation Using Multiple SequencesStatistical Science, 1992
- RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORYJournal of Educational Measurement, 1983