Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions
Preprint
Abstract
In Computer Science (CS) education, understanding factors contributing to students' programming difficulties is crucial for effective learning support. By identifying specific issues students face, educators can provide targeted assistance to help them overcome obstacles and improve learning outcomes. While identifying sources of struggle, such as misconceptions, in real-time can be challenging in current educational practices, analyzing logical errors in students' code can offer valuable insights. This paper presents a scalable framework for automatically detecting logical errors in students' programming solutions. Our framework is based on an explainable Abstract Syntax Tree (AST) embedding model, the Subtree-based Attention Neural Network (SANN), that identifies the structural components of programs containing logical errors. We conducted a series of experiments to evaluate its effectiveness, and the results suggest that our framework can accurately capture students' logical errors and, more importantly, provide us with deeper insights into their learning processes, offering a valuable tool for enhancing programming education.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Attentive Q-matrix learning for knowledge tracingApplied Intelligence, 2026
- Supporting skill integration in an intelligent tutoring system for code tracingJournal of Computer Assisted Learning, 2022
- Adaptive Immediate Feedback for Block-Based Programming: Design and EvaluationIEEE Transactions on Learning Technologies, 2022
- HELP-DKT: an interpretable cognitive model of how students learn programming based on deep knowledge tracingScientific Reports, 2022
- Software Analytics to Support Students in Object-Oriented Programming Tasks: An Empirical StudyIEEE Access, 2020
- Improving Engagement in Program Construction Examples for Learning Python ProgrammingInternational Journal of Artificial Intelligence in Education, 2020
- Blending a class video blog to optimize student learning outcomes in higher educationThe Internet and Higher Education, 2016
- A Review on Predicting Student's Performance Using Data Mining TechniquesProcedia Computer Science, 2015
- Debugging: finding, fixing and flailing, a multi-institutional study of novice debuggersComputer Science Education, 2008
- Knowledge tracing: Modeling the acquisition of procedural knowledgeUser Modeling and User-Adapted Interaction, 1995