Cognitive Diagnostic Models for Random Guessing Behaviors
Authors:
Open Access
- 25 September 2020
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 11
Abstract
Many test-takers do not carefully answer every test question; instead they sometimes quickly answer without thoughtful consideration (rapid guessing, RG). Researchers have not modeled RG when assessing student learning with cognitive diagnostic models (CDMs) to personalize feedback on a set of fine-grained skills (or attributes). Therefore, this study proposes to enhance cognitive diagnosis by modeling RG via an advanced CDM with item response and response time. This study tests the parameter recovery of this new CDM with a series of simulations via Markov chain Monte Carlo methods in JAGS. Also, this study tests the degree to which the standard and proposed CDMs fit the student response data for the Programme for International Student Assessment (PISA) 2015 computer-based mathematics test. This new CDM outperformed the simpler CDM that ignored RG; the new CDM showed less bias and greater precision for both item and person estimates, and greater classification accuracy of test results. Meanwhile, the empirical study showed different levels of student RG across test items and confirmed the findings in the simulations.Keywords
This publication has 30 references indexed in Scilit:
- The linear transformation model with frailties for the analysis of item response timesBritish Journal of Mathematical and Statistical Psychology, 2012
- A Mixture Rasch Model With Item Response Time ComponentsApplied Psychological Measurement, 2010
- Measurement of psychological disorders using cognitive diagnosis models.Psychological Methods, 2006
- A Lognormal Model for Response Times on Test ItemsJournal of Educational and Behavioral Statistics, 2006
- An Application of Item Response Time: The Effort‐Moderated IRT ModelJournal of Educational Measurement, 2006
- Test Construction for Cognitive DiagnosisApplied Psychological Measurement, 2005
- Response Time Effort: A New Measure of Examinee Motivation in Computer-Based TestsApplied Measurement in Education, 2005
- Bayesian Measures of Model Complexity and FitJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Rasch Models in Latent Classes: An Integration of Two Approaches to Item AnalysisApplied Psychological Measurement, 1990
- RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORYJournal of Educational Measurement, 1983