Ali Keramati
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ali Keramati has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Mohammad Reza Keramati
University of Tehran
4 shared publications - Fahimeh Ansarizadeh
Islamic Azad University
2 shared publications - Bahar Shahrokhian
Arizona State University, Tempe, Arizona, USA
1 shared publication - Conrad Borchers
Vanderbilt University
1 shared publication - Elham Tajik
University of Albany, Albany, New York, USA
1 shared publication - Mohammad Hossein Arefian
Imam Khomeini International University
1 shared publication
Latest Publications
- Top Cited PapersOpen Access
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 933-939
Disagreement as Data: Reasoning Trace Analytics in Multi-Agent Systems
Learning analytics researchers often analyze qualitative student data such as coded annotations or interview transcripts to understand learning processes. With the rise of generative AI, fully automated and human–AI workflows have emerged as promising methods for analysis. However, methodological standards to guide such workflows remain limited. In this study, we propose that reasoning traces generated by large language model (LLM) agents, especially within multi-agent systems, constitute a novel and rich form of process data to enhance interpretive practices in qualitative coding. We apply cosine similarity to LLM reasoning traces to systematically detect, quantify, and interpret disagreements among agents, reframing disagreement as a meaningful analytic signal. Analyzing nearly 10,000 instances of agent pairs coding human tutoring dialog segments, we show that LLM agents’ semantic reasoning similarity robustly differentiates consensus from disagreement and correlates with human coding reliability. Qualitative analysis guided by this metric reveals nuanced instructional sub-functions within codes and opportunities for conceptual codebook refinement. By integrating quantitative similarity metrics with qualitative review, our method bears potential to improve and accelerate the process of establishing inter-rater reliability during coding by surfacing interpretive ambiguity, especially when LLMs collaborate with humans. We discuss how reasoning-trace disagreements represent a valuable new class of analytic signals advancing methodological rigor and interpretive depth in educational research.
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 933-939
Top Cited PapersOpen AccessDisagreement as Data: Reasoning Trace Analytics in Multi-Agent Systems
Learning analytics researchers often analyze qualitative student data such as coded annotations or interview transcripts to understand learning processes. With the rise of generative AI, fully automated and human–AI workflows have emerged as promising methods for analysis. However, methodological standards to guide such workflows remain limited. In this study, we propose that reasoning traces generated by large language model (LLM) agents, especially within multi-agent systems, constitute a novel and rich form of process data to enhance interpretive practices in qualitative coding. We apply cosine similarity to LLM reasoning traces to systematically detect, quantify, and interpret disagreements among agents, reframing disagreement as a meaningful analytic signal. Analyzing nearly 10,000 instances of agent pairs coding human tutoring dialog segments, we show that LLM agents’ semantic reasoning similarity robustly differentiates consensus from disagreement and correlates with human coding reliability. Qualitative analysis guided by this metric reveals nuanced instructional sub-functions within codes and opportunities for conceptual codebook refinement. By integrating quantitative similarity metrics with qualitative review, our method bears potential to improve and accelerate the process of establishing inter-rater reliability during coding by surfacing interpretive ambiguity, especially when LLMs collaborate with humans. We discuss how reasoning-trace disagreements represent a valuable new class of analytic signals advancing methodological rigor and interpretive depth in educational research.
- 1 April 2026
- Published by Springer Nature
- p. 283-298
Fostering Essential 21st-Century Skills Through Cooperative Learning
- 1 April 2026
- Published by Springer Nature
- p. 283-298
Fostering Essential 21st-Century Skills Through Cooperative Learning
- 31 July 2025
- Published by Taylor & Francis in Reflective Practice
- Vol. 27 (2) , 177-190
Developing future leaders: practicing reflective leadership skills in Iranian primary schools within a cooperative learning environment
- 31 July 2025
- Published by Taylor & Francis in Reflective Practice
- Vol. 27 (2) , 177-190
Developing future leaders: practicing reflective leadership skills in Iranian primary schools within a cooperative learning environment
- 7 October 2024
- Published by Taylor & Francis in International Journal of Early Years Education
- Vol. 33 (1) , 120-137
Challenges and solutions of implementing cooperative learning in classroom environments: lived experiences of primary school teachers in Iran
- 7 October 2024
- Published by Taylor & Francis in International Journal of Early Years Education
- Vol. 33 (1) , 120-137
Challenges and solutions of implementing cooperative learning in classroom environments: lived experiences of primary school teachers in Iran
- 25 January 2024
- Published by Taylor & Francis in Reflective Practice
- Vol. 25 (2) , 117-131
Students’ reflection on the effect of collaborative learning on the learning environment and academic achievement in online reflective platforms
- 25 January 2024
- Published by Taylor & Francis in Reflective Practice
- Vol. 25 (2) , 117-131
Students’ reflection on the effect of collaborative learning on the learning environment and academic achievement in online reflective platforms