Using NLP to Quantify Program Decomposition in CS1
Authors:
Open Access
- 1 June 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 113-120
Abstract
Decomposition is a problem-solving technique that is essential to software development. Nonetheless, it is perceived as the most challenging programming skill for learners to master. Researchers have studied decomposition in introductory programming courses through guided experiments, case studies, and surveys. We believe that the rapid advancements in scientific fields such as machine learning and natural language processing (NLP) opened up opportunities for more scalable approaches. We study the relationship between problem-related entities and functional decomposition. We use an automated system to collect 78,500 code snapshots from two CS1 programming assignments of 250 students and then apply NLP techniques to quantify the learner's ability to break down a problem into a series of smaller, more straightforward tasks. We compare different behaviors and evaluate at scale the impact of decomposition on the time it takes to deliver the solution, its complexity, and the student's performance in the assignment and the course exams. Finally, we discuss the implications of our results for teaching and future research.Keywords
This publication has 24 references indexed in Scilit:
- Program Decomposition and Complexity in CS12015
- Improving performance of natural language processing part-of-speech tagging on clinical narratives through domain adaptationJournal of the American Medical Informatics Association, 2013
- Modeling how students learn to program2012
- On the cognitive process of human problem solvingCognitive Systems Research, 2010
- Pattern-oriented instruction and its influence on problem decomposition and solution construction2007
- Automatic Labeling of Semantic RolesComputational Linguistics, 2002
- Starting top-down, refining bottom-up, sharpening by zoom-inACM SIGCSE Bulletin, 2001
- Using a software engineering approach to CS1ACM SIGCSE Bulletin, 1991
- Programming Language/Problem-Solving Research: A Review of Relevant IssuesReview of Educational Research, 1990
- Cognitive strategies and looping constructsCommunications of the ACM, 1983