Lightweight Prompt Engineering for Cognitive Alignment in Educational AI: A OneClickQuiz Case Study
Preprint
Abstract
The rapid integration of Artificial Intelligence (AI) into educational technology promises to revolutionize content creation and assessment. However, the quality and pedagogical alignment of AI-generated content remain critical challenges. This paper investigates the impact of lightweight prompt engineering strategies on the cognitive alignment of AI-generated questions within OneClickQuiz, a Moodle plugin leveraging generative AI. We evaluate three prompt variants-a detailed baseline, a simpler version, and a persona-based approach-across Knowledge, Application, and Analysis levels of Bloom's Taxonomy. Utilizing an automated classification model (from prior work) and human review, our findings demonstrate that explicit, detailed prompts are crucial for precise cognitive alignment. While simpler and persona-based prompts yield clear and relevant questions, they frequently misalign with intended Bloom's levels, generating outputs that are either too complex or deviate from the desired cognitive objective. This study underscores the importance of strategic prompt engineering in fostering pedagogically sound AI-driven educational solutions and advises on optimizing AI for quality content generation in learning analytics and smart learning environments.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Analyzing Feedback Mechanisms in Ai-Generated Mcqs: Insights Into Readability, Lexical Properties, and Levels of Challenge2025
- Enhancing AI-Driven Education: Integrating Cognitive Frameworks, Linguistic Feedback Analysis, and Ethical Considerations for Improved Content Generation2025
- Cognitive Depth Enhancement in AI-Driven Educational Tools via SOLO Taxonomy2025
- Generative AI Prompt Engineering for Educators: Practical StrategiesJournal of Special Education Technology, 2024
- Optimizing Didactic Sequences with Artificial Intelligence: Integrating Bloom’s Taxonomy and Emotion in the Selection of Educational Technologies2024
- A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education2024
- Comparative Quality Analysis of GPT-Based Multiple Choice Question Generation2023
- Bloom’s Learning Outcomes’ Automatic Classification Using LSTM and Pretrained Word EmbeddingsIEEE Access, 2021
- Automated generation of programming language quizzes2015
- A Predictive Model to Evaluate Students’ Cognitive Engagement in Online LearningProcedia - Social and Behavioral Sciences, 2014