Correlating Students' Class Performance Based on GitHub Metrics: A Statistical Study
Open Access
- 29 June 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 526-532
Abstract
What skills does a student need to succeed in a programming class? Ostensibly, previous programming experience may affect a student's performance. Most past studies on this topic use self-reporting questionnaires to query students about their programming experience. This paper presents a novel, unified, and replicable way to measure previous programming experience using students' pre-class GitHub contributions. To our knowledge, we are the first to use GitHub contributions in this way. We conducted a comprehensive statistical study of students in an object-oriented design and development class from 2017 to 2022 (n = 751) to explore the relationships between GitHub contributions (commits, comments, pull requests, etc.) and students' performance on exams, projects, designs, etc. in the class. Several kinds of contributions were shown to have statistically significant correlations with performance in the class. A set of two-samplet -tests demonstrate statistical significance of the difference between the means of some contributions from the high-performing and low-performing groups.Keywords
This publication has 12 references indexed in Scilit:
- Learners’ Performance in a MOOC on ProgrammingEducation Sciences, 2021
- An Analysis of Iterative and Recursive Problem Performance2021
- How Prior Programming Experience Affects Students' Pair Programming Experiences and Outcomes2019
- User's guide to correlation coefficientsTurkish Journal of Emergency Medicine, 2018
- Quantifying the Benefits of Prior Programming Experience in an Introductory Computer Science Course2018
- No tests required2014
- Programming2005
- The effect of student attributes on success in programming2001
- Does it help to have some programming experience before beginning a computing degree program?ACM SIGCSE Bulletin, 2000
- Previous Experience and the Learning of Computer Programming: The Computer Helps Those Who Help ThemselvesJournal of Educational Computing Research, 1988