An Iterative Method for Empirically-Based Q-Matrix Validation
- 19 May 2018
- journal article
- research article
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 5 (2) , 248-262
Abstract
In cognitive diagnosis modeling, the attributes required for each item are specified in the Q-matrix. The traditional way of constructing a Q-matrix based on expert opinion is inherently subjective, consequently resulting in serious validity concerns. The current study proposes a new validation method under the deterministic inputs, noisy “and” gate (DINA) model to empirically validate attribute specifications in the Q-matrix. In particular, an iterative procedure with a modified version of the sequential search algorithm is introduced. Simulation studies are conducted to compare the proposed method with existing parametric and nonparametric methods. Results show that the new method outperforms the other methods across the board. Finally, the method is applied to real data using fraction-subtraction data.Keywords
This publication has 23 references indexed in Scilit:
- Data-Driven Learning of Q-MatrixApplied Psychological Measurement, 2012
- On the Analysis of Fraction Subtraction Data: The DINA Model, Classification, Latent Class Sizes, and the Q-MatrixApplied Psychological Measurement, 2010
- A Cognitive Diagnosis Model for Cognitively Based Multiple-Choice OptionsApplied Psychological Measurement, 2009
- DINA Model and Parameter Estimation: A DidacticJournal of Educational and Behavioral Statistics, 2009
- An Empirically Based Method of Q‐Matrix Validation for the DINA Model: Development and ApplicationsJournal of Educational Measurement, 2008
- The Effects of Q-Matrix Misspecification on Parameter Estimates and Classification Accuracy in the DINA ModelEducational and Psychological Measurement, 2007
- Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response TheoryApplied Psychological Measurement, 2001
- Test Theory ReconceivedJournal of Educational Measurement, 1996
- Using Restricted Latent Class Models to Map the Skill Structure of Achievement ItemsJournal of Educational Measurement, 1989
- RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORYJournal of Educational Measurement, 1983