From Specifications to Implementation in the Gen-AI Era: Lessons from a Project-Based Software Engineering Course
Open Access
- 30 June 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Software Engineering
- Vol. 3 (FSE) , 1424-1447
Abstract
By early 2025, AI code assistants had evolved into sophisticated collaborators capable of generating, explaining, reviewing, and modifying substantial portions of a software system. In February 2025, as we were delivering an upper-level undergraduate course on Software Engineering in our university, the term vibe coding emerged and quickly became popularized, referring to a practice in which developers describe a project or task in a prompt to an AI model that then generates code artifacts automatically. In this paper, we first report on the course setup and our analysis of students’ experience using AI assistants for developing open-ended software engineering projects in the Spring 2025 offering of the course. We then discuss our independent exploratory study that we conducted in Summer 2025, systematically investigating strategies for working with AI tools, specifically GitHub Copilot and Cursor, to implement a project of a real-world size and complexity, while also systematically evaluating the quality of the generated code. The goal of both studies is to better understand whether and how to teach Software Engineering in the AI era, i.e., which skills are essential for effective human–AI collaboration. Our results show that students utilized AI tools in all stages of project development, to generate and refine artifacts and to learn unfamiliar concepts. While Generative AI tools simplified repetitive development tasks and helped quickly ramp up when working with unfamiliar frameworks and programming languages, students had mixed levels of satisfaction with using the tools, both as chat interfaces and as IDE-embedded solutions. We found no correlation between the degree of students’ reliance on AI and their grades, hypothesizing that other factors, such as groups’ knowledge and commitment, play a larger role in producing high-quality results. Our exploratory study shows that tools were still far from replacing software engineers or rendering software engineering education unnecessary. In fact, we observe that, in the new AI-empowered reality, skills such as requirements engineering, design, testing, and code review are becoming more relevant (and easier to teach) than ever. We conclude the paper with a set of suggestions for future offerings of this and similar Software Engineering courses, and for using AI in Software Engineering more broadly.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada (CRC)
This publication has 39 references indexed in Scilit:
- A Taxonomy of Inefficiencies in LLM-Generated Python Code2025
- Automated Code Review in Practice2025
- Insights from the Frontline: GenAI Utilization Among Software Engineering Students2025
- Towards Understanding the Characteristics of Code Generation Errors Made by Large Language Models2025
- Study on the use of ChatGPT for generating code for web-based augmented reality applicationsMeasurement: Sensors, 2025
- Assessing the Performance of AI-Generated Code: A Case Study on GitHub Copilot2024
- LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuning2023
- Is GitHub’s Copilot as bad as humans at introducing vulnerabilities in code?Empirical Software Engineering, 2023
- GitHub Copilot AI pair programmer: Asset or Liability?Journal of Systems and Software, 2023
- Large Language Models and Simple, Stupid Bugs2023