Abdolali Faraji
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Abdolali Faraji has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Gábor Kismihók
Leibniz Information Centre for Science and Technology (TIB)
9 shared publications - Mohammadreza Tavakoli
Leibniz Information Centre for Science and Technology (TIB)
9 shared publications - Mohammad Moein
Leibniz Information Centre for Science and Technology (TIB)
5 shared publications - Stefan Thomas Mol
Amsterdam Business School, University of Amsterdam, NL
3 shared publications - Zohreh Rasoulkhani
University of Genoa
1 shared publication
Latest Publications
- Open Access
- 7 October 2026
- Published by Springer Nature
- p. 180-194
Designing Teacher-Centered Interfaces to Elicit Pedagogical Context for LLM-Based Content Generation
Large Language Models (LLMs) can help teachers generate and adapt educational materials, but most interactions still rely on free-form prompting, making instructional intent difficult to express and reuse. In this paper, we study how teacher-facing interfaces can elicit pedagogically meaningful contextual information and reduce ad hoc prompt engineering. We first conducted a requirement analysis with $$N=100$$ teachers across 17 contextual fields. We measured importance and introduced fill deficit to identify “friction points” (i.e., information teachers consider important but are less likely to provide). Based on this analysis, we implemented a context-rich interface with targeted supports for important and friction-point fields. In a separate user study with a different sample of $$N=100$$ teachers, the interface achieved high usability (SUS mean $$=80.33$$ ), low perceived workload, and increased willingness to provide contextual information, particularly for friction-point fields. For further validation, we conducted a comparative pilot with $$N=10$$ experienced teachers; participants reported a greater tendency to use content generated with our context-rich interface (72.2%) than content generated with a baseline GPT interface (37.0%).- 7 October 2026
- Published by Springer Nature
- p. 180-194
Open AccessDesigning Teacher-Centered Interfaces to Elicit Pedagogical Context for LLM-Based Content Generation
Large Language Models (LLMs) can help teachers generate and adapt educational materials, but most interactions still rely on free-form prompting, making instructional intent difficult to express and reuse. In this paper, we study how teacher-facing interfaces can elicit pedagogically meaningful contextual information and reduce ad hoc prompt engineering. We first conducted a requirement analysis with $$N=100$$ teachers across 17 contextual fields. We measured importance and introduced fill deficit to identify “friction points” (i.e., information teachers consider important but are less likely to provide). Based on this analysis, we implemented a context-rich interface with targeted supports for important and friction-point fields. In a separate user study with a different sample of $$N=100$$ teachers, the interface achieved high usability (SUS mean $$=80.33$$ ), low perceived workload, and increased willingness to provide contextual information, particularly for friction-point fields. For further validation, we conducted a comparative pilot with $$N=10$$ experienced teachers; participants reported a greater tendency to use content generated with our context-rich interface (72.2%) than content generated with a baseline GPT interface (37.0%). - 28 June 2026
- Published by Springer Nature
- p. 198-207
Cross-Dataset Bloom Question Classification: Supervised Models and Prompted LLMs
- 28 June 2026
- Published by Springer Nature
- p. 198-207
Cross-Dataset Bloom Question Classification: Supervised Models and Prompted LLMs
- Open Access
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 829-836
Embedding-Based Rankings of Educational Resources based on Learning Outcome Alignment: Benchmarking, Expert Validation, and Learner Performance
As the online learning landscape evolves, the need for personalization is increasingly evident. Although educational resources are burgeoning, educators face challenges selecting materials that both align with intended learning outcomes and address diverse learner needs. Large Language Models (LLMs) are attracting growing interest for their potential to create learning resources that better support personalization, but verifying coverage of intended outcomes still requires human alignment review, which is costly and limits scalability. We propose a framework that supports the cost-effective automation of evaluating alignment between educational resources and intended learning outcomes. Using human-generated materials, we benchmarked LLM-based text-embedding models and found that the most accurate model (Voyage) achieved 79% accuracy in detecting alignment. We then applied the optimal model to LLM-generated resources and, via expert evaluation, confirmed that it reliably assessed correspondence to intended outcomes (83% accuracy). Finally, in a three-group experiment with 360 learners, higher alignment scores were positively related to greater learning performance, χ2(2, N = 360) = 15.39, p <.001. These findings show that embedding-based alignment scores can facilitate scalable personalization by confirming alignment with learning outcomes, which allows teachers to focus on tailoring content to diverse learner needs.
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 829-836
Open AccessEmbedding-Based Rankings of Educational Resources based on Learning Outcome Alignment: Benchmarking, Expert Validation, and Learner Performance
As the online learning landscape evolves, the need for personalization is increasingly evident. Although educational resources are burgeoning, educators face challenges selecting materials that both align with intended learning outcomes and address diverse learner needs. Large Language Models (LLMs) are attracting growing interest for their potential to create learning resources that better support personalization, but verifying coverage of intended outcomes still requires human alignment review, which is costly and limits scalability. We propose a framework that supports the cost-effective automation of evaluating alignment between educational resources and intended learning outcomes. Using human-generated materials, we benchmarked LLM-based text-embedding models and found that the most accurate model (Voyage) achieved 79% accuracy in detecting alignment. We then applied the optimal model to LLM-generated resources and, via expert evaluation, confirmed that it reliably assessed correspondence to intended outcomes (83% accuracy). Finally, in a three-group experiment with 360 learners, higher alignment scores were positively related to greater learning performance, χ2(2, N = 360) = 15.39, p <.001. These findings show that embedding-based alignment scores can facilitate scalable personalization by confirming alignment with learning outcomes, which allows teachers to focus on tailoring content to diverse learner needs.
- Open Access
Embedding-Based Rankings of Educational Resources based on Learning Outcome Alignment: Benchmarking, Expert Validation, and Learner Performance
As the online learning landscape evolves, the need for personalization is increasingly evident. Although educational resources are burgeoning, educators face challenges selecting materials that both align with intended learning outcomes and address diverse learner needs. Large Language Models (LLMs) are attracting growing interest for their potential to create learning resources that better support personalization, but verifying coverage of intended outcomes still requires human alignment review, which is costly and limits scalability. We propose a framework that supports the cost-effective automation of evaluating alignment between educational resources and intended learning outcomes. Using human-generated materials, we benchmarked LLM-based text-embedding models and found that the most accurate model (Voyage) achieved 79% accuracy in detecting alignment. We then applied the optimal model to LLM-generated resources and, via expert evaluation, confirmed that it reliably assessed correspondence to intended outcomes (83% accuracy). Finally, in a three-group experiment with 360 learners, higher alignment scores were positively related to greater learning performance, chi-squared(2, N = 360) = 15.39, p < 0.001. These findings show that embedding-based alignment scores can facilitate scalable personalization by confirming alignment with learning outcomes, which allows teachers to focus on tailoring content to diverse learner needs.
Open AccessEmbedding-Based Rankings of Educational Resources based on Learning Outcome Alignment: Benchmarking, Expert Validation, and Learner Performance
As the online learning landscape evolves, the need for personalization is increasingly evident. Although educational resources are burgeoning, educators face challenges selecting materials that both align with intended learning outcomes and address diverse learner needs. Large Language Models (LLMs) are attracting growing interest for their potential to create learning resources that better support personalization, but verifying coverage of intended outcomes still requires human alignment review, which is costly and limits scalability. We propose a framework that supports the cost-effective automation of evaluating alignment between educational resources and intended learning outcomes. Using human-generated materials, we benchmarked LLM-based text-embedding models and found that the most accurate model (Voyage) achieved 79% accuracy in detecting alignment. We then applied the optimal model to LLM-generated resources and, via expert evaluation, confirmed that it reliably assessed correspondence to intended outcomes (83% accuracy). Finally, in a three-group experiment with 360 learners, higher alignment scores were positively related to greater learning performance, chi-squared(2, N = 360) = 15.39, p < 0.001. These findings show that embedding-based alignment scores can facilitate scalable personalization by confirming alignment with learning outcomes, which allows teachers to focus on tailoring content to diverse learner needs.
- 21 July 2025
- Published by Springer Nature
- p. 187-194
LLM-Driven Personalized Answer Generation and Evaluation
- 21 July 2025
- Published by Springer Nature
- p. 187-194
LLM-Driven Personalized Answer Generation and Evaluation
- 15 July 2025
- Published by Springer Nature
- p. 438-451
Designing Effective LLM-Assisted Interfaces for Curriculum Development
- 15 July 2025
- Published by Springer Nature
- p. 438-451
Designing Effective LLM-Assisted Interfaces for Curriculum Development
- Open Access
Designing Effective LLM-Assisted Interfaces for Curriculum Development
Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and usability issues, which increase workload. Additionally, inaccuracies in LLM outputs can raise issues around output quality and ethical concerns in educational content delivery. Addressing these issues requires careful oversight, best achieved through cooperation between human and AI approaches. This paper introduces two novel User Interface (UI) designs, UI Predefined and UI Open, both grounded in Direct Manipulation (DM) principles to address these challenges. By reducing the reliance on intricate prompt engineering, these UIs improve usability, streamline interaction, and lower workload, providing a more effective pathway for educators to engage with LLMs. In a controlled user study with 20 participants, the proposed UIs were evaluated against the standard ChatGPT interface in terms of usability and cognitive load. Results showed that UI Predefined significantly outperformed both ChatGPT and UI Open, demonstrating superior usability and reduced task load, while UI Open offered more flexibility at the cost of a steeper learning curve. These findings underscore the importance of user-centered design in adopting AI-driven tools and lay the foundation for more intuitive and efficient educator-LLM interactions in online learning environments.
Open AccessDesigning Effective LLM-Assisted Interfaces for Curriculum Development
Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and usability issues, which increase workload. Additionally, inaccuracies in LLM outputs can raise issues around output quality and ethical concerns in educational content delivery. Addressing these issues requires careful oversight, best achieved through cooperation between human and AI approaches. This paper introduces two novel User Interface (UI) designs, UI Predefined and UI Open, both grounded in Direct Manipulation (DM) principles to address these challenges. By reducing the reliance on intricate prompt engineering, these UIs improve usability, streamline interaction, and lower workload, providing a more effective pathway for educators to engage with LLMs. In a controlled user study with 20 participants, the proposed UIs were evaluated against the standard ChatGPT interface in terms of usability and cognitive load. Results showed that UI Predefined significantly outperformed both ChatGPT and UI Open, demonstrating superior usability and reduced task load, while UI Open offered more flexibility at the cost of a steeper learning curve. These findings underscore the importance of user-centered design in adopting AI-driven tools and lay the foundation for more intuitive and efficient educator-LLM interactions in online learning environments.
- Open Access
LLM-Driven Personalized Answer Generation and Evaluation
Online learning has experienced rapid growth due to its flexibility and accessibility. Personalization, adapted to the needs of individual learners, is crucial for enhancing the learning experience, particularly in online settings. A key aspect of personalization is providing learners with answers customized to their specific questions. This paper therefore explores the potential of Large Language Models (LLMs) to generate personalized answers to learners' questions, thereby enhancing engagement and reducing the workload on educators. To evaluate the effectiveness of LLMs in this context, we conducted a comprehensive study using the StackExchange platform in two distinct areas: language learning and programming. We developed a framework and a dataset for validating automatically generated personalized answers. Subsequently, we generated personalized answers using different strategies, including 0-shot, 1-shot, and few-shot scenarios. The generated answers were evaluated using three methods: 1. BERTScore, 2. LLM evaluation, and 3. human evaluation. Our findings indicated that providing LLMs with examples of desired answers (from the learner or similar learners) can significantly enhance the LLMs' ability to tailor responses to individual learners' needs.
Open AccessLLM-Driven Personalized Answer Generation and Evaluation
Online learning has experienced rapid growth due to its flexibility and accessibility. Personalization, adapted to the needs of individual learners, is crucial for enhancing the learning experience, particularly in online settings. A key aspect of personalization is providing learners with answers customized to their specific questions. This paper therefore explores the potential of Large Language Models (LLMs) to generate personalized answers to learners' questions, thereby enhancing engagement and reducing the workload on educators. To evaluate the effectiveness of LLMs in this context, we conducted a comprehensive study using the StackExchange platform in two distinct areas: language learning and programming. We developed a framework and a dataset for validating automatically generated personalized answers. Subsequently, we generated personalized answers using different strategies, including 0-shot, 1-shot, and few-shot scenarios. The generated answers were evaluated using three methods: 1. BERTScore, 2. LLM evaluation, and 3. human evaluation. Our findings indicated that providing LLMs with examples of desired answers (from the learner or similar learners) can significantly enhance the LLMs' ability to tailor responses to individual learners' needs.