An Empirical Study of Knowledge Transfer in AI Pair Programming
Authors:
- 16 November 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 166-177
Abstract
Knowledge transfer is fundamental to human collaboration and is therefore common in software engineering. Pair programming is a prominent instance. With the rise of AI coding assistants, developers now not only work with human partners but also, as some claim, with AI pair programmers. Although studies confirm knowledge transfer during human pair programming, its effectiveness with AI coding assistants remains uncertain.To analyze knowledge transfer in both human–human and human–AI settings, we conducted an empirical study where developer pairs solved a programming task without AI support, while a separate group of individual developers completed the same task using the AI coding assistant GitHub Copilot. We extended an existing knowledge transfer framework and employed a semi-automated evaluation pipeline to assess differences in knowledge transfer episodes across both settings. We found a similar frequency of successful knowledge transfer episodes and overlapping topical categories across both settings. Two of our key findings are that developers tend to accept GitHub Copilot’s suggestions with less scrutiny than those from human pair programming partners, but also that GitHub Copilot can subtly remind developers of important code details they might otherwise overlook.Keywords
This publication has 30 references indexed in Scilit:
- Insights from the Frontline: GenAI Utilization Among Software Engineering Students2025
- Does generative AI help in learning programming: Students’ perceptions, reported use and relation to performanceComputers in Human Behavior Reports, 2025
- Code suggestions and explanations in programming learning: Use of ChatGPT and performanceThe International Journal of Management Education, 2024
- Peer-to-peer Teaching in Higher Education: A Critical Literature ReviewMentoring & Tutoring: Partnership in Learning, 2016
- When Is It Better to Learn Together? Insights from Research on Collaborative LearningEducational Psychology Review, 2015
- Knowledge transfer in pair programming: An in-depth analysisInternational Journal of Human-Computer Studies, 2015
- Measuring and modeling programming experienceEmpirical Software Engineering, 2013
- The State of Cooperative Learning in Postsecondary and Professional SettingsEducational Psychology Review, 2007
- Embracing change with extreme programmingComputer, 1999
- Peer teaching in higher education: A reviewHigher Education, 1976