Bahar Radmehr
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Bahar Radmehr has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Tanja Käser
EPFL
5 shared publications - Adish Singla
Max Planck Institute for Software Systems
3 shared publications - Ekaterina Shved
EPFL
2 shared publications - Fatma Betül Güreş
ETH Zurich, Zurich, Switzerland and EPFL, Lausanne, Switzerland
2 shared publications - Ethan Prihar
École Polytechnique Fédérale de Lausanne, Lausanne, Vaud, Switzerland
1 shared publication - Fatma Betül1 shared publication
Latest Publications
- 21 July 2025
- Published by Springer Nature
- p. 94-102
ClickSight: Interpreting Student Clickstreams to Reveal Insights on Learning Strategies via LLMs
- 21 July 2025
- Published by Springer Nature
- p. 94-102
ClickSight: Interpreting Student Clickstreams to Reveal Insights on Learning Strategies via LLMs
- 20 July 2025
- Published by Springer Nature
- p. 422-429
How Instructional Sequence and Personalized Support Impact Diagnostic Strategy Learning
- 20 July 2025
- Published by Springer Nature
- p. 422-429
How Instructional Sequence and Personalized Support Impact Diagnostic Strategy Learning
- Open Access
ClickSight: Interpreting Student Clickstreams to Reveal Insights on Learning Strategies via LLMs
Clickstream data from digital learning environments offer valuable insights into students' learning behaviors, but are challenging to interpret due to their high dimensionality and granularity. Prior approaches have relied mainly on handcrafted features, expert labeling, clustering, or supervised models, therefore often lacking generalizability and scalability. In this work, we introduce ClickSight, an in-context Large Language Model (LLM)-based pipeline that interprets student clickstreams to reveal their learning strategies. ClickSight takes raw clickstreams and a list of learning strategies as input and generates textual interpretations of students' behaviors during interaction. We evaluate four different prompting strategies and investigate the impact of self-refinement on interpretation quality. Our evaluation spans two open-ended learning environments and uses a rubric-based domain-expert evaluation. Results show that while LLMs can reasonably interpret learning strategies from clickstreams, interpretation quality varies by prompting strategy, and self-refinement offers limited improvement. ClickSight demonstrates the potential of LLMs to generate theory-driven insights from educational interaction data.
Open AccessClickSight: Interpreting Student Clickstreams to Reveal Insights on Learning Strategies via LLMs
Clickstream data from digital learning environments offer valuable insights into students' learning behaviors, but are challenging to interpret due to their high dimensionality and granularity. Prior approaches have relied mainly on handcrafted features, expert labeling, clustering, or supervised models, therefore often lacking generalizability and scalability. In this work, we introduce ClickSight, an in-context Large Language Model (LLM)-based pipeline that interprets student clickstreams to reveal their learning strategies. ClickSight takes raw clickstreams and a list of learning strategies as input and generates textual interpretations of students' behaviors during interaction. We evaluate four different prompting strategies and investigate the impact of self-refinement on interpretation quality. Our evaluation spans two open-ended learning environments and uses a rubric-based domain-expert evaluation. Results show that while LLMs can reasonably interpret learning strategies from clickstreams, interpretation quality varies by prompting strategy, and self-refinement offers limited improvement. ClickSight demonstrates the potential of LLMs to generate theory-driven insights from educational interaction data.
- 2 July 2024
- Published by Springer Nature
- p. 356-363
An Interpretable Approach to Identify Performance Indicators Within Unstructured Learning Environments
- 2 July 2024
- Published by Springer Nature
- p. 356-363
An Interpretable Approach to Identify Performance Indicators Within Unstructured Learning Environments
- Open Access
Towards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMs
There has been a growing interest in developing learner models to enhance learning and teaching experiences in educational environments. However, existing works have primarily focused on structured environments relying on meticulously crafted representations of tasks, thereby limiting the agent's ability to generalize skills across tasks. In this paper, we aim to enhance the generalization capabilities of agents in open-ended text-based learning environments by integrating Reinforcement Learning (RL) with Large Language Models (LLMs). We investigate three types of agents: (i) RL-based agents that utilize natural language for state and action representations to find the best interaction strategy, (ii) LLM-based agents that leverage the model's general knowledge and reasoning through prompting, and (iii) hybrid LLM-assisted RL agents that combine these two strategies to improve agents' performance and generalization. To support the development and evaluation of these agents, we introduce PharmaSimText, a novel benchmark derived from the PharmaSim virtual pharmacy environment designed for practicing diagnostic conversations. Our results show that RL-based agents excel in task completion but lack in asking quality diagnostic questions. In contrast, LLM-based agents perform better in asking diagnostic questions but fall short of completing the task. Finally, hybrid LLM-assisted RL agents enable us to overcome these limitations, highlighting the potential of combining RL and LLMs to develop high-performing agents for open-ended learning environments.
Open AccessTowards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMs
There has been a growing interest in developing learner models to enhance learning and teaching experiences in educational environments. However, existing works have primarily focused on structured environments relying on meticulously crafted representations of tasks, thereby limiting the agent's ability to generalize skills across tasks. In this paper, we aim to enhance the generalization capabilities of agents in open-ended text-based learning environments by integrating Reinforcement Learning (RL) with Large Language Models (LLMs). We investigate three types of agents: (i) RL-based agents that utilize natural language for state and action representations to find the best interaction strategy, (ii) LLM-based agents that leverage the model's general knowledge and reasoning through prompting, and (iii) hybrid LLM-assisted RL agents that combine these two strategies to improve agents' performance and generalization. To support the development and evaluation of these agents, we introduce PharmaSimText, a novel benchmark derived from the PharmaSim virtual pharmacy environment designed for practicing diagnostic conversations. Our results show that RL-based agents excel in task completion but lack in asking quality diagnostic questions. In contrast, LLM-based agents perform better in asking diagnostic questions but fall short of completing the task. Finally, hybrid LLM-assisted RL agents enable us to overcome these limitations, highlighting the potential of combining RL and LLMs to develop high-performing agents for open-ended learning environments.