Alejandro Ortega-Arranz
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Alejandro Ortega-Arranz has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Alejandra Martínez-Monés
Universidad de Valladolid, Valladolid, Spain
8 shared publications - Paraskevi Topali
NOLAI | National Education Lab AI, Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
8 shared publications - Juan Ignacio Asensio Pérez
Universidad de Valladolid
6 shared publications - Miguel L. Bote-Lorenzo
Universidad de Valladolid
6 shared publications - Erkan Er
Department of Computer Education and Instructional Technology, Middle East Technical University
4 shared publications - Yannis Dimitriadis
Universidad de Valladolid
4 shared publications
Latest Publications
- 6 October 2026
- Published by Springer Nature
- p. 327-332
A Contextualised Educational Chatbot Integrating GenAI Analytics Within Learning Management Systems
- 6 October 2026
- Published by Springer Nature
- p. 327-332
A Contextualised Educational Chatbot Integrating GenAI Analytics Within Learning Management Systems
- Open Access
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 779-785
GenAI Analytics and Pedagogical Configurations: Featuring New Generative AI Systems in Education
The appearance of general purpose Large Language Models (LLMs) and their derived chatbots (e.g., ChatGPT, Gemini) has revolutionized how students learn in high school and university settings. While these chatbots provide potential benefits to students (e.g., 24/7 tutor), they hinder the teachers’ autonomy, who are blinded to the questions made by the students and hand-tied to the answers provided by these models. However, such autonomy could be increased with the integration of GenAI Analytics tracking the students’ interactions with the chatbots (e.g., which are the most frequently asked topics), and with the configuration and contextualization of such models. This study aims at understanding which GenAI Analytics and Pedagogical Configurations are more useful for university teachers through a GenAI system developed by the authors. The evaluation involved 16 university teachers from 5 different institutions. Results show that analytics such as the number of prompts or the categorization of their contents are of great interest for teachers. Furthermore, while some pedagogical configurations were positively rated by most participants (e.g., not providing the direct solution, customized add-ons), some others were not (e.g., forced hallucinations, minimum answer length). By better understanding these two features of GenAI systems (i.e., GenAI Analytics and Pedagogical Configurations for chatbot behaviors), we expect teachers will increase their autonomy and trust in GenAI-based systems, thus enhancing the adoption of these technologies in their regular practice.
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 779-785
Open AccessGenAI Analytics and Pedagogical Configurations: Featuring New Generative AI Systems in Education
The appearance of general purpose Large Language Models (LLMs) and their derived chatbots (e.g., ChatGPT, Gemini) has revolutionized how students learn in high school and university settings. While these chatbots provide potential benefits to students (e.g., 24/7 tutor), they hinder the teachers’ autonomy, who are blinded to the questions made by the students and hand-tied to the answers provided by these models. However, such autonomy could be increased with the integration of GenAI Analytics tracking the students’ interactions with the chatbots (e.g., which are the most frequently asked topics), and with the configuration and contextualization of such models. This study aims at understanding which GenAI Analytics and Pedagogical Configurations are more useful for university teachers through a GenAI system developed by the authors. The evaluation involved 16 university teachers from 5 different institutions. Results show that analytics such as the number of prompts or the categorization of their contents are of great interest for teachers. Furthermore, while some pedagogical configurations were positively rated by most participants (e.g., not providing the direct solution, customized add-ons), some others were not (e.g., forced hallucinations, minimum answer length). By better understanding these two features of GenAI systems (i.e., GenAI Analytics and Pedagogical Configurations for chatbot behaviors), we expect teachers will increase their autonomy and trust in GenAI-based systems, thus enhancing the adoption of these technologies in their regular practice.
- Open Access
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 895-902
Configuring and Monitoring Students' Interactions with Generative AI Tools: Supporting Teacher Autonomy
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 895-902
Open AccessConfiguring and Monitoring Students' Interactions with Generative AI Tools: Supporting Teacher Autonomy
- Open Access
- 2 February 2025
- Published by Wiley in Computer Applications in Engineering Education
- Vol. 33 (2)
Studying the Effectiveness of Games as an Extracurricular Activity in a Higher Education Programming Course
Higher Education programming courses usually present high levels of student failure and drop‐out rates. Given this context, the use of educational video games is proposed as a strategy to increase the students' motivation and engagement, thus helping diminish such rates. However, there is a lack of empirical studies examining such effects, especially when they are proposed outside the formal curriculum (i.e., extracurricular) and when the students are enrolled in different Higher Education bachelors. This paper presents a cross‐sectional study following a between‐subjects design with 315 students (168 assigned to the experimental condition, 147 to the control condition) enrolled in one of the following bachelors: B.S. in Computer Science (where programming is a core subject), and B.S. in Statistics (where it is not). The study spanned two consecutive academic years. The outcomes were evaluated through a pre‐/post‐test schema and comparison of final course results to measure the effect on learning (objective assessment) and a survey to get the students' perceptions (subjective assessment). In addition, the level of participation was analyzed and compared between bachelors, considering the optional nature of the activity. Results show statistically significant differences in learning outcomes between the students in the experimental condition and those in the control group, without clear differences between Bachelors (the results are positive for both). In the subjective assessment and participation, the results are also positive, but, in this case, statistically significant differences between bachelors have been observed. These positive outcomes suggest its potential applicability to other Higher Education and Engineering courses.
- 2 February 2025
- Published by Wiley in Computer Applications in Engineering Education
- Vol. 33 (2)
Open AccessStudying the Effectiveness of Games as an Extracurricular Activity in a Higher Education Programming Course
Higher Education programming courses usually present high levels of student failure and drop‐out rates. Given this context, the use of educational video games is proposed as a strategy to increase the students' motivation and engagement, thus helping diminish such rates. However, there is a lack of empirical studies examining such effects, especially when they are proposed outside the formal curriculum (i.e., extracurricular) and when the students are enrolled in different Higher Education bachelors. This paper presents a cross‐sectional study following a between‐subjects design with 315 students (168 assigned to the experimental condition, 147 to the control condition) enrolled in one of the following bachelors: B.S. in Computer Science (where programming is a core subject), and B.S. in Statistics (where it is not). The study spanned two consecutive academic years. The outcomes were evaluated through a pre‐/post‐test schema and comparison of final course results to measure the effect on learning (objective assessment) and a survey to get the students' perceptions (subjective assessment). In addition, the level of participation was analyzed and compared between bachelors, considering the optional nature of the activity. Results show statistically significant differences in learning outcomes between the students in the experimental condition and those in the control group, without clear differences between Bachelors (the results are positive for both). In the subjective assessment and participation, the results are also positive, but, in this case, statistically significant differences between bachelors have been observed. These positive outcomes suggest its potential applicability to other Higher Education and Engineering courses.
- Open Access
- 15 June 2024
- Published by Elsevier in Computers & Education
- Vol. 219
Collaborative activities in hybrid learning environments: Exploring teacher orchestration load and students’ perceptions
- 15 June 2024
- Published by Elsevier in Computers & Education
- Vol. 219
Open AccessCollaborative activities in hybrid learning environments: Exploring teacher orchestration load and students’ perceptions
- Top Cited PapersOpen Access
- 24 April 2024
- Published by Taylor & Francis in Behaviour & Information Technology
- Vol. 44 (5) , 1071-1098
Designing human-centered learning analytics and artificial intelligence in education solutions: a systematic literature review
- 24 April 2024
- Published by Taylor & Francis in Behaviour & Information Technology
- Vol. 44 (5) , 1071-1098
Top Cited PapersOpen AccessDesigning human-centered learning analytics and artificial intelligence in education solutions: a systematic literature review
- Open Access
- 15 September 2023
- Published by Springer Nature in Technology, Knowledge and Learning
- Vol. 29 (4) , 2201-2202
Correction: Video Analytics in Digital Learning Environments: Exploring Student Behaviour Across Different Learning Contexts
- 15 September 2023
- Published by Springer Nature in Technology, Knowledge and Learning
- Vol. 29 (4) , 2201-2202
Open AccessCorrection: Video Analytics in Digital Learning Environments: Exploring Student Behaviour Across Different Learning Contexts
- Open Access
- 18 August 2023
- Published by Springer Nature in Technology, Knowledge and Learning
- Vol. 29 (4) , 1877-1905
Video Analytics in Digital Learning Environments: Exploring Student Behaviour Across Different Learning Contexts
The use of videos in teaching has gained impetus in recent years, especially after the increased attention towards remote learning. Understanding students’ video-related behaviour through learning (and video) analytics can offer instructors significant potential to intervene and enhance course designs. Previous studies explored students’ video engagement to reveal learning patterns and identify at-risk students. However, the focus has been mostly placed on single contexts, and therefore, limited insights have been offered about the differences and commonalities between different learning settings. To that end, the current paper explored student video engagement in three disparate contexts. Following a case study research approach, we uncovered the commonalities and differences of video engagement in the context of SPOC, MOOC, and an undergraduate university course. The findings offer a deeper and more comprehensive understanding of students’ video-related engagement and shed light into several key aspects related to video analytics that should be considered during the design of video-based learning (e.g., learning objectives in relation to video type or context). Additionally, the three cases indicated the important role of the content type, the length, and the aim of the video on students’ engagement. Further implications of the work are also discussed in the paper.
- 18 August 2023
- Published by Springer Nature in Technology, Knowledge and Learning
- Vol. 29 (4) , 1877-1905
Open AccessVideo Analytics in Digital Learning Environments: Exploring Student Behaviour Across Different Learning Contexts
The use of videos in teaching has gained impetus in recent years, especially after the increased attention towards remote learning. Understanding students’ video-related behaviour through learning (and video) analytics can offer instructors significant potential to intervene and enhance course designs. Previous studies explored students’ video engagement to reveal learning patterns and identify at-risk students. However, the focus has been mostly placed on single contexts, and therefore, limited insights have been offered about the differences and commonalities between different learning settings. To that end, the current paper explored student video engagement in three disparate contexts. Following a case study research approach, we uncovered the commonalities and differences of video engagement in the context of SPOC, MOOC, and an undergraduate university course. The findings offer a deeper and more comprehensive understanding of students’ video-related engagement and shed light into several key aspects related to video analytics that should be considered during the design of video-based learning (e.g., learning objectives in relation to video type or context). Additionally, the three cases indicated the important role of the content type, the length, and the aim of the video on students’ engagement. Further implications of the work are also discussed in the paper.
- Open Access
- 12 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 131965-131979
GamiTool: Supporting Instructors in the Gamification of MOOCs
Reward-based gamification strategies are proposed as a promising technique to increase student engagement in Massive Open Online Courses (MOOCs), following its success in other small-scale educational settings. However, these strategies imply a number of orchestration tasks ( e.g ., design, management) that are usually carried out by instructors, and which may hinder their use and adoption. Furthermore, some MOOC distinctive features ( e.g ., scale, 24/7 availability, etc.) have considerable implications on how these gamification strategies are orchestrated, resulting in an unmanageable instructors’ workload in cases of manual operation. Therefore, an eventual adoption of gamification in MOOCs calls for automatic systems capable of decreasing the additional workload of instructors. The limitations identified in the current solutions ( e.g ., non-usable graphical interfaces, inflexible gamification designs) led us to propose and develop a new gamification system named GamiTool . An evaluation with 19 MOOC instructors and gamification designers showed the high design expressiveness, usability and potential for adoption of GamiTool. Hence, GamiTool can be used by instructors to improve students’ engagement, and also, by researchers to keep understanding the effects of gamification in MOOC settings.
- 12 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 131965-131979
Open AccessGamiTool: Supporting Instructors in the Gamification of MOOCs
Reward-based gamification strategies are proposed as a promising technique to increase student engagement in Massive Open Online Courses (MOOCs), following its success in other small-scale educational settings. However, these strategies imply a number of orchestration tasks ( e.g ., design, management) that are usually carried out by instructors, and which may hinder their use and adoption. Furthermore, some MOOC distinctive features ( e.g ., scale, 24/7 availability, etc.) have considerable implications on how these gamification strategies are orchestrated, resulting in an unmanageable instructors’ workload in cases of manual operation. Therefore, an eventual adoption of gamification in MOOCs calls for automatic systems capable of decreasing the additional workload of instructors. The limitations identified in the current solutions ( e.g ., non-usable graphical interfaces, inflexible gamification designs) led us to propose and develop a new gamification system named GamiTool . An evaluation with 19 MOOC instructors and gamification designers showed the high design expressiveness, usability and potential for adoption of GamiTool. Hence, GamiTool can be used by instructors to improve students’ engagement, and also, by researchers to keep understanding the effects of gamification in MOOC settings.
- 23 October 2022
- Published by Springer Nature
- p. 295-303
Scenario for Analysing Student Interactions and Orchestration Load in Collaborative and Hybrid Learning Environments
- 23 October 2022
- Published by Springer Nature
- p. 295-303
Scenario for Analysing Student Interactions and Orchestration Load in Collaborative and Hybrid Learning Environments