Learning to Code with Context: A Study-Based Approach
Preprint
Abstract
The rapid emergence of generative AI tools is transforming the way software is developed. Consequently, software engineering education must adapt to ensure that students not only learn traditional development methods but also understand how to meaningfully and responsibly use these new technologies. In particular, project-based courses offer an effective environment to explore and evaluate the integration of AI assistance into real-world development practices. This paper presents our approach and a user study conducted within a university programming project in which students collaboratively developed computer games. The study investigates how participants used generative AI tools throughout different phases of the software development process, identifies the types of tasks where such tools were most effective, and analyzes the challenges students encountered. Building on these insights, we further examine a repository-aware, locally deployed large language model (LLM) assistant designed to provide project-contextualized support. The system employs Retrieval-Augmented Generation (RAG) to ground responses in relevant documentation and source code, enabling qualitative analysis of model behavior, parameter sensitivity, and common failure modes. The findings deepen our understanding of context-aware AI support in educational software projects and inform future integration of AI-based assistance into software engineering curricula.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Designing Reusable LLM-Enhanced Assignments: A Quality-Oriented Framework for Software Engineering Education2025
- Automatic Program Assessment, Grading and Code Generation: Possible AI-Support in a Software Development Course2025
- Perceived Impact of AI-Based Tooling on Software Development Code QualitySN Computer Science, 2025
- Generative AI: Redefining the Future of Software EngineeringIEEE Software, 2024
- Revolutionizing learning − A journey into educational games with immersive and AI technologiesEntertainment Computing, 2024
- Artificial Intelligence in Software Engineering: Perspectives and Challenges2023
- On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot2023
- The Potential of Artificial Intelligence as a Method of Software Developer's Productivity Improvement2022
- Automatic Grading of Computer Programs: A Machine Learning Approach2013
- A Survey of Automated Assessment Approaches for Programming AssignmentsComputer Science Education, 2005