Feedback Systems on Computer Programming Courses: A Systematic Literature Review
Open Access
- 16 February 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 30654-30674
Abstract
Feedback is critical throughout the education process. Relevant and timely feedback is difficult to provide in classes with a large number of students, such as computer programming courses. This problem is common in scenarios such as first-year undergraduate education or massive open online courses, where the students have little chance to receive detailed feedback, usually reducing it to a right or wrong answer or to a general discussion about the most common mistakes in the course. Automatically generated feedback can help instructors and learners by personalizing content via just-in-time interventions. Following PRISMA guidelines, this paper used a systematic approach to review the literature about automatically generated feedback for computer programming education. Findings from the study provide a diverse set of approaches for providing feedback, from static ones based on unit tests to dynamic systems using machine learning and Large Language Models. Findings also indicate how different approaches delivered such feedback, including how such systems’ effectiveness was tested (if available), the type of feedback given, and the computational method they implemented. The most common approach was static analysis, with bugs of misconceptions being the most common type of feedback (38%). While not all the reviewed studies tested for educational outcomes, those that did mostly used surveys (>90%) and grades. Such surveys primarily measured participants’ perceptions and motivation. AI-based feedback decision methods are increasingly used, taking advantage of Large Language Models, which enable instructors to provide dynamic feedback. These latest developments will be in permanent improvement as they are personalized, more comprehensive, and provide several types of feedback.Keywords
Funding Information
- U.S. National Science Foundation (2434429)
- U.S. National Science Foundation (2315683)
- Fulbright U.S. Student Program, which is sponsored by U.S. Department of State and the Fulbright Colombia Commission
This publication has 45 references indexed in Scilit:
- Partnering with AI: A Pedagogical Feedback System for LLM Integration Into Programming Education2025
- Enhancing Programming Education with ChatGPT: A Case Study on Student Perceptions and Interactions in a Python Course2024
- Automated Grading in Coding Exercises Using Large Language Models2024
- Digitalization of Multistep Chemistry Exercises with Automated Formative FeedbackJournal of Science Education and Technology, 2023
- An analysis of learners’ programming skills through data miningEducation and Information Technologies, 2022
- Enhancing problem‐solving skills of novice programmers in an introductory programming courseComputer Applications in Engineering Education, 2021
- Customizing Feedback for Introductory Programming Courses Using Semantic Clusters2021
- Synthesis of Social Media Messages and Tweets as Feedback Medium in Introductory Programming2019
- A Data-Driven Method for Helping Teachers Improve Feedback in Computer Programming Automated Tutors2018
- Exploring feedback and student characteristics relevant for personalizing feedback strategiesComputers & Education, 2014