CFlow: Supporting Semantic Flow Analysis of Students' Code in Programming Problems at Scale
Open Access
- 9 July 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 188-199
Abstract
Introductory programming courses have been growing rapidly, now enrolling hundreds or thousands of students. In such large courses, it can be overwhelmingly difficult for instructors to understand class-wide problem-solving patterns or issues, which is crucial for improving instruction and addressing important pedagogical challenges. In this paper, we propose a technique and system, CFlow, for creating understandable and navigable representations of code at scale. CFlow is able to represent thousands of code samples in a visualization that resembles a single code sample. CFlow creates scalable code representations by (1) clustering individual statements with similar semantic purposes, (2) presenting clustered statements in a way that maintains semantic relationships between statements, (3) representing the correctness of different variations as a histogram, and (4) allowing users to navigate through solutions interactively using semantic filters. With a multi-level view design, users can navigate high-level patterns, and low-level implementations. This is in contrast to prior tools that either limit their focus on isolated statements (and thus discard the surrounding context of those statements) or cluster entire code samples (which can lead to large numbers of clusters---for example, if there are n code features and m implementations of each, there can be mn clusters). We evaluated the effectiveness of CFlow with a comparison study, found participants using CFlow spent only half the time identifying mistakes and recalled twice as many desired patterns from over 6,000 submissions.Keywords
Funding Information
- Division of Undergraduate Education (1915515)
This publication has 47 references indexed in Scilit:
- Assessing Generalizability of CodeBERT2021
- Applying CodeBERT for Automated Program Repair of Java Simple Bugs2021
- Identifying Top Java Errors for Novice Programmers2006
- Interactive Sankey diagrams2005
- The Effect of Concept Mapping to Enhance Text Comprehension and SummarizationThe Journal of Experimental Education, 2002
- A Conceptual Framework for Analyzing Students’ Knowledge of ProgrammingJournal of Research on Computing in Education, 1997
- Novice programmer errors: language constructs and plan compositionInternational Journal of Human-Computer Studies, 1994
- Mental models and computer programmingInternational Journal of Human-Computer Studies, 1994
- Using conceptual models to teach BASIC computer programming.Journal of Educational Psychology, 1988
- On optimal and data-based histogramsBiometrika, 1979