AFAbdolali Faraji

Abdolali Faraji

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Abdolali Faraji has a total of 5 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Designing Teacher-Centered Interfaces to Elicit Pedagogical Context for LLM-Based Content Generation

    by Abdolali Faraji, Mohammadreza Tavakoli, Mohammad Moein, Mohammadreza Molavi, Gábor Kismihók

    Large Language Models (LLMs) can help teachers generate and adapt educational materials, but most interactions still rely on free-form prompting, making instructional intent difficult to express and reuse. In this paper, we study how teacher-facing interfaces can elicit pedagogically meaningful contextual information and reduce ad hoc prompt engineering. We first conducted a requirement analysis with $$N=100$$ N = 100 teachers across 17 contextual fields. We measured importance and introduced fill deficit to identify “friction points” (i.e., information teachers consider important but are less likely to provide). Based on this analysis, we implemented a context-rich interface with targeted supports for important and friction-point fields. In a separate user study with a different sample of $$N=100$$ N = 100 teachers, the interface achieved high usability (SUS mean $$=80.33$$ = 80.33 ), low perceived workload, and increased willingness to provide contextual information, particularly for friction-point fields. For further validation, we conducted a comparative pilot with $$N=10$$ N = 10 experienced teachers; participants reported a greater tendency to use content generated with our context-rich interface (72.2%) than content generated with a baseline GPT interface (37.0%).

  • Open Access

    Personalized curricula through human-AI collaboration: Open learning platform development and validation from two experiments on knowledge acquisition

    by Abdolali Faraji, Mohammadreza Tavakoli, Mohammadreza Molavi, Stefan T. Mol, Gábor Kismihók

  • Cross-Dataset Bloom Question Classification: Supervised Models and Prompted LLMs

    by Abdolali Faraji, Mohammadreza Molavi, Zohreh Rasoulkhani, Mohammadreza Tavakoli, Gábor Kismihók

  • Open Access

    Embedding-Based Rankings of Educational Resources based on Learning Outcome Alignment: Benchmarking, Expert Validation, and Learner Performance

    by Mohammadreza Molavi Hajiagha, Mohammad Moein, Mohammadreza Tavakoli, Abdolali Faraji, Gábor Kismihók, Stefan T. Mol

    As the online learning landscape evolves, the need for personalization is increasingly evident. Although educational resources are burgeoning, educators face challenges selecting materials that both align with intended learning outcomes and address diverse learner needs. Large Language Models (LLMs) are attracting growing interest for their potential to create learning resources that better support personalization, but verifying coverage of intended outcomes still requires human alignment review, which is costly and limits scalability. We propose a framework that supports the cost-effective automation of evaluating alignment between educational resources and intended learning outcomes. Using human-generated materials, we benchmarked LLM-based text-embedding models and found that the most accurate model (Voyage) achieved 79% accuracy in detecting alignment. We then applied the optimal model to LLM-generated resources and, via expert evaluation, confirmed that it reliably assessed correspondence to intended outcomes (83% accuracy). Finally, in a three-group experiment with 360 learners, higher alignment scores were positively related to greater learning performance, χ2(2, N = 360) = 15.39, p <.001. These findings show that embedding-based alignment scores can facilitate scalable personalization by confirming alignment with learning outcomes, which allows teachers to focus on tailoring content to diverse learner needs.

  • Open Access

    Embedding-Based Rankings of Educational Resources based on Learning Outcome Alignment: Benchmarking, Expert Validation, and Learner Performance

    by Mohammadreza Molavi, Mohammad Moein, Mohammadreza Tavakoli, Abdolali Faraji, Stefan T. Mol, Gábor Kismihók

    As the online learning landscape evolves, the need for personalization is increasingly evident. Although educational resources are burgeoning, educators face challenges selecting materials that both align with intended learning outcomes and address diverse learner needs. Large Language Models (LLMs) are attracting growing interest for their potential to create learning resources that better support personalization, but verifying coverage of intended outcomes still requires human alignment review, which is costly and limits scalability. We propose a framework that supports the cost-effective automation of evaluating alignment between educational resources and intended learning outcomes. Using human-generated materials, we benchmarked LLM-based text-embedding models and found that the most accurate model (Voyage) achieved 79% accuracy in detecting alignment. We then applied the optimal model to LLM-generated resources and, via expert evaluation, confirmed that it reliably assessed correspondence to intended outcomes (83% accuracy). Finally, in a three-group experiment with 360 learners, higher alignment scores were positively related to greater learning performance, chi-squared(2, N = 360) = 15.39, p < 0.001. These findings show that embedding-based alignment scores can facilitate scalable personalization by confirming alignment with learning outcomes, which allows teachers to focus on tailoring content to diverse learner needs.

  • LLM-Driven Personalized Answer Generation and Evaluation

    by Mohammadreza Molavi, Mohammadreza Tavakoli, Abdolali Faraji, Gábor Kismihók


  • Designing Effective LLM-Assisted Interfaces for Curriculum Development

    by Abdolali Faraji, Mohammadreza Tavakoli, Mohammad Moein, Mohammadreza Molavi, Gábor Kismihók


  • Open Access

    Designing Effective LLM-Assisted Interfaces for Curriculum Development

    by Abdolali Faraji, Mohammadreza Tavakoli, Mohammad Moein, Mohammadreza Molavi, Gábor Kismihók

    Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and usability issues, which increase workload. Additionally, inaccuracies in LLM outputs can raise issues around output quality and ethical concerns in educational content delivery. Addressing these issues requires careful oversight, best achieved through cooperation between human and AI approaches. This paper introduces two novel User Interface (UI) designs, UI Predefined and UI Open, both grounded in Direct Manipulation (DM) principles to address these challenges. By reducing the reliance on intricate prompt engineering, these UIs improve usability, streamline interaction, and lower workload, providing a more effective pathway for educators to engage with LLMs. In a controlled user study with 20 participants, the proposed UIs were evaluated against the standard ChatGPT interface in terms of usability and cognitive load. Results showed that UI Predefined significantly outperformed both ChatGPT and UI Open, demonstrating superior usability and reduced task load, while UI Open offered more flexibility at the cost of a steeper learning curve. These findings underscore the importance of user-centered design in adopting AI-driven tools and lay the foundation for more intuitive and efficient educator-LLM interactions in online learning environments.

  • Open Access

    LLM-Driven Personalized Answer Generation and Evaluation

    by Mohammadreza Molavi, Mohammadreza Tavakoli, Mohammad Moein, Abdolali Faraji, Gábor Kismihók

    Online learning has experienced rapid growth due to its flexibility and accessibility. Personalization, adapted to the needs of individual learners, is crucial for enhancing the learning experience, particularly in online settings. A key aspect of personalization is providing learners with answers customized to their specific questions. This paper therefore explores the potential of Large Language Models (LLMs) to generate personalized answers to learners' questions, thereby enhancing engagement and reducing the workload on educators. To evaluate the effectiveness of LLMs in this context, we conducted a comprehensive study using the StackExchange platform in two distinct areas: language learning and programming. We developed a framework and a dataset for validating automatically generated personalized answers. Subsequently, we generated personalized answers using different strategies, including 0-shot, 1-shot, and few-shot scenarios. The generated answers were evaluated using three methods: 1. BERTScore, 2. LLM evaluation, and 3. human evaluation. Our findings indicated that providing LLMs with examples of desired answers (from the learner or similar learners) can significantly enhance the LLMs' ability to tailor responses to individual learners' needs.