NeuralCD: A General Framework for Cognitive Diagnosis
Top Cited Papers
- 23 August 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 35 (8) , 8312-8327
Abstract
Recent decades have witnessed a rapid growth of intelligent educational systems as well as an increasing demand for computer-aided educational technologies. One of the fundamental issues in intelligent education is cognitive diagnosis, which aims to discover the proficiency level of students on specific knowledge concepts. Existing approaches usually mine linear interactions of student exercising process by manually designed function (e.g., logistic function). However, the cognitive interactions between students and exercises is a complex process, and excessive simplifications would lead to under fitting and thus get inaccurate diagnostic results. Besides, the manually designed interaction functions are relatively inflexible and limits their extensibility. This consequently causes lack of consideration about useful non-numerical information in the cognitive process besides response logs. In this paper, we propose a general Neural Cognitive Diagnosis (NeuralCD) framework as well as several implemented models (a basic implementation NeuralCDM and three extensions), where we project students and exercises to factor vectors and incorporates neural networks to learn the complex exercising interactions. To ensure the interpretability of diagnostic results, which is essential for cognitive diagnosis, we apply an monotonicity assumption to our NeuralCD framework. Moreover, NeuralCD is a general framework and has good extensibility. We show the generality of NeuralCD through proving how it can cover some traditional models. Then, we demonstrate the extensibility of NeuralCD, which benefits future developments. On one hand, we demonstrate content-based extensions where we provide examples of exploring the rich contents of exercise texts (CNCD-Q and CNCD-F). On the other hand, we demonstrate a knowledge-association based extension to show that NeuralCD is flexible for structural adjustments so as to solve specific problems. For instance, we improve the diagnostic results on uncovered knowledge concepts of a student by extending NeuralCD with the knowledge associations consideration (KaNCD). Extensive experimental results on real-world datasets show the effectiveness of NeuralCD framework with both accuracy and interpretability.Keywords
Funding Information
- National Natural Science Foundation of China (61922073, U20A20229, 62106244)
- Fundamental Research Funds for the Central Universities (WK2150110021)
- Iflytek joint research program
This publication has 52 references indexed in Scilit:
- Data-Driven Learning of Q-MatrixApplied Psychological Measurement, 2012
- The Value of Item Response Theory in Clinical Assessment: A ReviewAssessment, 2010
- Recommender system for predicting student performanceProcedia Computer Science, 2010
- DINA Model and Parameter Estimation: A DidacticJournal of Educational and Behavioral Statistics, 2009
- Measurement of psychological disorders using cognitive diagnosis models.Psychological Methods, 2006
- 31A Review of Cognitively Diagnostic Assessment and a Summary of Psychometric Models2006
- The Attribute Hierarchy Method for Cognitive Assessment: A Variation on Tatsuoka's Rule‐Space ApproachJournal of Educational Measurement, 2004
- The use of the area under the ROC curve in the evaluation of machine learning algorithmsPattern Recognition, 1997
- The Multidimensional Random Coefficients Multinomial Logit ModelApplied Psychological Measurement, 1997
- Multilayer feedforward networks are universal approximatorsNeural Networks, 1989