Predictive, scalable and interpretable knowledge tracing on structured domains
Preprint
Abstract
Intelligent tutoring systems optimize the selection and timing of learning materials to enhance understanding and long-term retention. This requires estimates of both the learner's progress (''knowledge tracing''; KT), and the prerequisite structure of the learning domain (''knowledge mapping''). While recent deep learning models achieve high KT accuracy, they do so at the expense of the interpretability of psychologically-inspired models. In this work, we present a solution to this trade-off. PSI-KT is a hierarchical generative approach that explicitly models how both individual cognitive traits and the prerequisite structure of knowledge influence learning dynamics, thus achieving interpretability by design. Moreover, by using scalable Bayesian inference, PSI-KT targets the real-world need for efficient personalization even with a growing body of learners and learning histories. Evaluated on three datasets from online learning platforms, PSI-KT achieves superior multi-step predictive accuracy and scalable inference in continual-learning settings, all while providing interpretable representations of learner-specific traits and the prerequisite structure of knowledge that causally supports learning. In sum, predictive, scalable and interpretable knowledge tracing with solid knowledge mapping lays a key foundation for effective personalized learning to make education accessible to a broad, global audience.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Scientific Inference with Interpretable Machine Learning: Analyzing Models to Learn About Real-World PhenomenaMinds and Machines, 2024
- Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive RepresentationsProceedings of the AAAI Conference on Artificial Intelligence, 2023
- Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challenge2021
- Equipoise and ethics in educational researchTheory and Research in Education, 2021
- A Network Neuroscience of Human Learning: Potential to Inform Quantitative Theories of Brain and BehaviorTrends in Cognitive Sciences, 2017
- Dynamic Bayesian Networks for Student ModelingIEEE Transactions on Learning Technologies, 2017
- Local Patterns to Global Architectures: Influences of Network Topology on Human LearningTrends in Cognitive Sciences, 2016
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- The form of the forgetting curve and the fate of memoriesJournal of Mathematical Psychology, 2011
- Concept Mapping to Encourage Meaningful Student LearningAdult Learning, 2005