The Effects of Q-Matrix Design on Classification Accuracy in the Log-Linear Cognitive Diagnosis Model
Open Access
- 22 June 2014
- journal article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 75 (3) , 491-511
Abstract
Diagnostic classification models are psychometric models that aim to classify examinees according to their mastery or non-mastery of specified latent characteristics. These models are well-suited for providing diagnostic feedback on educational assessments because of their practical efficiency and increased reliability when compared with other multidimensional measurement models. A priori specifications of which latent characteristics or attributes are measured by each item are a core element of the diagnostic assessment design. This item–attribute alignment, expressed in a Q-matrix, precedes and supports any inference resulting from the application of the diagnostic classification model. This study investigates the effects of Q-matrix design on classification accuracy for the log-linear cognitive diagnosis model. Results indicate that classification accuracy, reliability, and convergence rates improve when the Q-matrix contains isolated information from each measured attribute.Keywords
This publication has 18 references indexed in Scilit:
- Combining Item Response Theory and Diagnostic Classification Models: A Psychometric Model for Scaling Ability and Diagnosing MisconceptionsPsychometrika, 2014
- Diagnosing Teachers’ Understandings of Rational Numbers: Building a Multidimensional Test Within the Diagnostic Classification FrameworkEducational Measurement: Issues and Practice, 2013
- Estimating Classification Consistency and Accuracy for Cognitive Diagnostic AssessmentJournal of Educational Measurement, 2012
- On the Analysis of Fraction Subtraction Data: The DINA Model, Classification, Latent Class Sizes, and the Q-MatrixApplied Psychological Measurement, 2010
- Cluster Analysis for Cognitive Diagnosis: Theory and ApplicationsPsychometrika, 2009
- Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent VariablesPsychometrika, 2009
- DINA Model and Parameter Estimation: A DidacticJournal of Educational and Behavioral Statistics, 2009
- Test Validity in Cognitive Assessment2007
- Test Construction for Cognitive DiagnosisApplied Psychological Measurement, 2005
- Using Restricted Latent Class Models to Map the Skill Structure of Achievement ItemsJournal of Educational Measurement, 1989