Code Interviews: Design and Evaluation of a More Authentic Assessment for Introductory Programming Assignments
Open Access
- 12 February 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 554-560
Abstract
Generative artificial intelligence poses new challenges around assessment, increasingly driving introductory programming educators to employ invigilated exams. But exams do not afford more authentic programming experiences that involve planning, implementing, and debugging programs with computer interaction. In this experience report, we describe code interviews: a more authentic assessment method for take-home programming assignments. Through action research, we experimented with the number and type of questions as well as whether interviews were conducted individually or with groups of students. To scale the program, we converted most of our weekly teaching assistant (TA) sections to conduct code interviews on 5 major weekly take-home programming assignments. By triangulating data from 5 sources, we identified 4 themes. Code interviews (1) pushed students to discuss their work, motivating more nuanced but sometimes repetitive insights; (2) enabled peer learning, reducing stress in some ways but increasing stress in other ways; (3) scaled with TA-led sections, replacing familiar practice with an unfamiliar assessment; (4) focused on student contributions, limiting opportunities for TAs to give guidance and feedback. We reflect on the design of code interviews for student experience, academic integrity, and teacher workload.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses2023
- From "Ban It Till We Understand It" to "Resistance is Futile": How University Programming Instructors Plan to Adapt as More Students Use AI Code Generation and Explanation Tools such as ChatGPT and GitHub Copilot2023
- The Challenges and Value of Undergraduate Oral Exams in the Physical Chemistry Classroom: A Useful Tool in the Assessment ToolboxJournal of Chemical Education, 2023
- Programming Is Hard - Or at Least It Used to Be2023
- A Study of the Effects of Oral Proficiency Exams in Introductory Programming Courses on Underrepresented Groups2022
- Oral exams for large-enrollment engineering courses to promote academic integrity and student engagement during remote instruction2021
- Oral Exams: A More Meaningful Assessment of Students’ UnderstandingJournal of Statistics and Data Science Education, 2021
- Oral Exams in Shift to Remote Learning2021
- An Assessment of Oral Exams in Introductory CS2019
- Assessing students' knowledgeACM SIGCSE Bulletin, 2005