Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools
Authors:
- James PratherJPJames Prather
- Juho LeinonenJLJuho Leinonen
- Natalie KieslerNKNatalie Kiesler
- Jamie Gorson BenarioJBJamie Gorson Benario
- Sam LauSLSam Lau
- Stephen MacNeilStephen MacNeil
- Narges NorouziNNNarges Norouzi
- Simone OpelSOSimone Opel
- Vee PettitVPVee Pettit
- Leo PorterLPLeo Porter
- Brent N. ReevesBRBrent N. Reeves
- Jaromir SavelkaJSJaromir Savelka
Top Cited Papers
Open Access
- 22 January 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 300-338
Abstract
Generative AI (GenAI) is advancing rapidly, and the literature in computing education is expanding almost as quickly. Initial responses to GenAI tools were mixed between panic and utopian optimism. Many were fast to point out the opportunities and challenges of GenAI. Researchers reported that these new tools are capable of solving most introductory programming tasks and are causing disruptions throughout the curriculum. These tools can write and explain code, enhance error messages, create resources for instructors, and even provide feedback and help for students like a traditional teaching assistant. In 2024, new research started to emerge on the effects of GenAI usage in the computing classroom. These new data involve the use of GenAI to support classroom instruction at scale and to teach students how to code with GenAI. In support of the former, a new class of tools is emerging that can provide personalized feedback to students on their programming assignments or teach both programming and prompting skills at the same time. With the literature expanding so rapidly, this report aims to summarize and explain what is happening on the ground in computing classrooms. We provide a systematic literature review; a survey of educators and industry professionals; and interviews with educators using GenAI in their courses, educators studying GenAI, and researchers who create GenAI tools to support computing education. The triangulation of these methods and data sources expands the understanding of GenAI usage and perceptions at this critical moment for our community.Keywords
All Related Versions
Funding Information
- Research Council of Finland (356114)
- National Science Foundation (2417374)
This publication has 134 references indexed in Scilit:
- A Picture Is Worth a Thousand Words: Exploring Diagram and Video-Based OOP Exercises to Counter LLM Over-Reliance2024
- Evaluating the Application of Large Language Models to Generate Feedback in Programming Education2024
- Students’ Experiences of Using ChatGPT in an Undergraduate Programming CourseIEEE Access, 2024
- Bridging the Gap in AI-Driven Workflows: The Case for Domain-Specific Generative Bots2023
- Generating Multiple Choice Questions for Computing Courses Using Large Language Models2023
- Exploring the Potential of Large Language Models to Generate Formative Programming Feedback2023
- Industry's Expectations of Graduate Dispositions2023
- Challenging the Confirmation Bias: Using ChatGPT as a Virtual Peer for Peer Instruction in Computer Programming Education2023
- Investigating the Use of AI-Generated Exercises for Beginner and Intermediate Programming Courses: A ChatGPT Case Study2023
- The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivationComputers and Education: Artificial Intelligence, 2023