Evaluating CodeClusters for Effectively Providing Feedback on Code Submissions
Authors:
Open Access
- 8 October 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 50, 1-9
Abstract
Full research paper—Most introductory programming courses rely on the use of automated assessment for grading programming assignments. While such systems save teachers’ time by eliminating manual grading, the submissions may not be reviewed by the teachers at all, losing valuable insight into how students solve the assignments. In this paper, we introduce CodeClusters which provides teachers’ a quick overview of general patterns in code submissions. The main features of the system are full-text search and N-gram -based similarity detection model that can cluster and subset the code by various aspects such as AST similarity or software also has It has also an interface for streamlining the writing of feedback to multiple submissions at once. CodeClusters has been primarily designed to be used jointly with automated assessment systems where automated tests would assess the functionality of the code, and CodeClusters would be used for gaining a higher-level view of programming patterns and for writing feedback to students. CodeClusters was evaluated in a think-aloud study with university lecturers responsible for programming courses at two research-first universities. The lecturers were pleased by the possibility of providing better feedback to students quickly, saw it could improve the quality of their courses over solely automated assessment, and expressed interest in using CodeClusters in their own courses.Keywords
This publication has 36 references indexed in Scilit:
- OverCodeACM Transactions on Computer-Human Interaction, 2015
- Towards Providing Feedback to Students in Absence of Formalized Domain Models2013
- Test My Code: An Automatic Assessment Service for the Extreme Apprenticeship Method2013
- A first step towards algorithm plagiarism detection2012
- Data clustering: 50 years beyond K-meansPattern Recognition Letters, 2010
- RubyricACM SIGCSE Bulletin, 2009
- Automatic test-based assessment of programmingJournal on Educational Resources in Computing, 2005
- A Survey of Automated Assessment Approaches for Programming AssignmentsComputer Science Education, 2005
- How shall we assess this?ACM SIGCSE Bulletin, 2003
- Fully automatic assessment of programming exercisesACM SIGCSE Bulletin, 2001