Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book
Top Cited Papers
Open Access
- 2 March 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 931-937
Abstract
Advances in natural language processing have resulted in large language models (LLMs) that can generate code and code explanations. In this paper, we report on our experiences generating multiple code explanation types using LLMs and integrating them into an interactive e-book on web software development. Three different types of explanations -- a line-by-line explanation, a list of important concepts, and a high-level summary of the code -- were created. Students could view explanations by clicking a button next to code snippets, which showed the explanation and asked about its utility. Our results show that all explanation types were viewed by students and that the majority of students perceived the code explanations as helpful to them. However, student engagement varied by code snippet complexity, explanation type, and code snippet length. Drawing on our experiences, we discuss future directions for integrating explanations generated by LLMs into CS classrooms.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- Comprehension First2017
- iSnap2017
- Learning by Taking Apart2016
- Tutorons: Generating context-relevant, on-demand explanations and demonstrations of online code2015
- Autonomously Generating Hints by Inferring Problem Solving Policies2015
- Online python tutor2013
- Wheel-Spinning: Students Who Fail to Master a Skill2013
- Pair programming in education: a literature reviewComputer Science Education, 2011
- Extending the Engagement TaxonomyACM Transactions on Computing Education, 2009
- PeerWise2008