ChatGPT in Programming Education: An Empirical Study on Its Impact on Student Performance, Creativity, and Teamwork
Open Access
- 23 December 2025
- journal article
- research article
- Published by MDPI AG in Education Sciences
- Vol. 16 (1) , 19
Abstract
This study employs a two-part research design to explore the impact of ChatGPT on programming education for engineering undergraduates. Study 1 involved 56 third-year students who completed a questionnaire examining the frequency and purposes of ChatGPT use in text-based programming. While no statistically significant association was found between ChatGPT usage frequency and final grades, high-achieving students tended to use the tool less frequently, whereas lower-performing students relied on it more for support. Study 2 employed a counterbalanced repeated-measures design with nine first-year students divided into two groups, who developed desktop applications with and without ChatGPT. Project assessments and focus-group interviews were used to examine the effects of ChatGPT on creativity, confidence, effectiveness, and teamwork in visual programming. The results indicate that ChatGPT use was associated with reduced task completion time and increased coding efficiency; however, it was also linked to decreased creativity, greater reliance on ready-made solutions, and diminished code readability and collaborative engagement. These results highlight the need for teaching strategies that balance AI integration in programming education. The study recommends incorporating tasks based on the Reverse Bloom’s Taxonomy and activities that allow students to work with and without ChatGPT to encourage critical reflection and responsible AI use.Keywords
This publication has 45 references indexed in Scilit:
- The effectiveness of ChatGPT in assisting high school students in programming learning: evidence from a quasi-experimental researchInteractive Learning Environments, 2025
- Investigating students’ programming behaviors, interaction qualities and perceptions through prompt-based learning in ChatGPTHumanities and Social Sciences Communications, 2024
- Does ChatGPT Help Novice Programmers Write Better Code? Results From Static Code AnalysisIEEE Access, 2024
- Potential cognitive risks of generative transformer-based AI chatbots on higher order executive functions.Neuropsychology, 2024
- The future of grading programming assignments in education: The role of ChatGPT in automating the assessment and feedback processThinking Skills and Creativity, 2024
- Students’ Experiences of Using ChatGPT in an Undergraduate Programming CourseIEEE Access, 2024
- Programming with ChatGPT: How far can we go?Machine Learning with Applications, 2024
- Transformative effects of ChatGPT on modern education: Emerging Era of AI ChatbotsInternet of Things and Cyber-Physical Systems, 2024
- Augmented intelligence in programming learning: Examining student views on the use of ChatGPT for programming learningComputers in Human Behavior: Artificial Humans, 2023
- ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scopeInternet of Things and Cyber-Physical Systems, 2023