Bridging LMS and generative AI: dynamic course content integration (DCCI) for enhancing student satisfaction and engagement via the ask ME assistant
Open Access
- 12 July 2025
- journal article
- research article
- Published by Springer Nature in Journal of Computers in Education
- Vol. 13 (2) , 585-622
Abstract
Integration of Large Language Models (LLMs) with Learning Management Systems (LMSs) can enhance task automation and accessibility in education. However, hallucination where LLMs generate inaccurate or misleading information remains a challenge. This study introduces the Dynamic Course Content Integration (DCCI) mechanism, which dynamically retrieves course content from Canvas LMS and structures it within an LLM’s context window via prompt engineering, enabling the LLM-powered assistant, Ask ME, to deliver context-aware, curriculum-aligned responses while mitigating hallucinations. A mixed-methods pilot study grounded in Self-Determination Theory (autonomy, competence) and the Technology Acceptance Model (perceived usefulness, ease of use) evaluated DCCI’s effectiveness with 120 first-year programming students at Eötvös Loránd University. The course focused on foundational programming patterns in C#, including writing program specifications. We analyzed 14,746 logged interactions and a post-course survey completed by 101 students. User satisfaction was measured via a 5-point Likert scale (turn-level ratings), while the survey assessed usability, engagement, and ethical concerns. Results indicated high satisfaction (mean 4.65/5) and strong recognition of Ask ME’s ability to provide timely, contextually relevant answers to administrative and course-related queries. 78.06% agreed that Ask ME’s Canvas integration reduced platform switching, improving usability, engagement, comprehension, and topic exploration. Many students reported reduced hesitation to ask questions and increased motivation for self-directed learning, though concerns about over-reliance on AI and reduced student–teacher interaction emerged. This study demonstrates that DCCI enhances LLM reliability, student satisfaction, and engagement in AI-driven educational automation, while highlighting the importance of balancing AI efficiency with pedagogical integrity and human–AI collaboration.Keywords
All Related Versions
Funding Information
- Eötvös Loránd Tudományegyetem
This publication has 98 references indexed in Scilit:
- Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language modelsArtificial Intelligence Review, 2024
- The rapid rise of generative AI and its implications for academic integrity: Students’ perceptions and use of chatbots for assistance with assessmentsComputers and Education: Artificial Intelligence, 2024
- Special considerations for the use of AI tools by PEERs as a learning and communication aidJournal of Cellular Physiology, 2024
- Artificial Intelligence in Education: Implications for Policymakers, Researchers, and PractitionersTechnology, Knowledge and Learning, 2024
- The impact of a chatbot working as an assistant in a course for supporting student learning and engagementComputer Applications in Engineering Education, 2024
- AI literacy and its implications for prompt engineering strategiesComputers and Education: Artificial Intelligence, 2024
- Academic Surgery in the Era of Large Language ModelsJAMA Surgery, 2024
- Formative Feedback on Student-Authored Summaries in Intelligent Textbooks Using Large Language ModelsInternational Journal of Artificial Intelligence in Education, 2024
- Artificial intelligence (AI) learning tools in K-12 education: A scoping reviewJournal of Computers in Education, 2024
- Using LLMs to bring evidence-based feedback into the classroom: AI-generated feedback increases secondary students’ text revision, motivation, and positive emotionsComputers and Education: Artificial Intelligence, 2023