Peyman Toreini
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Peyman Toreini has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Alexander Maedche
Human-Centered Systems Lab (h-lab), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
11 shared publications - Moritz Langner
Karlsruhe Institute of Technology (KIT)
7 shared publications Alexander Maedche
Karlsruhe Institute of Technology (KIT)
2 shared publicationsMoritz Langner
Karlsruhe Institute of Technology (KIT)
2 shared publications- Shi Liu
Human-Centered Systems Lab (h-lab), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
2 shared publications - Anke Greif-Winzrieth
Karlsruhe Institute of Technology (KIT)
1 shared publication
Latest Publications
- Open Access
- 4 November 2025
- Published by Springer Nature in Technology, Knowledge and Learning
- p. 1-35
Mixed Reality Learning Systems with Head-Mounted Displays in Higher Education: A Systematic Review
The advent of mixed reality (MR) technology has sparked emerging adoption of MR learning systems in higher education. In this systematic literature review, we examine the state of the art of MR systems in this field. We highlight the diverse applications and benefits of MR technology, including design features and specific fields of higher education addressed in existing studies. Despite its potential, our review also identifies research gaps, particularly regarding effective evaluation methods for learning outcomes. We identify the needs to provide advanced learning support and to better integrate established learning theories to guide more effective system design. Furthermore, we discover that leveraging biosignals to design biosignal-adaptive MR learning systems providing personalized learning support is currently underutilized. Through this systematic review, we aim to offer design implications for the application of MR in higher education, identify potential research gaps, and provide insights for future work in this rapidly evolving field.
- 4 November 2025
- Published by Springer Nature in Technology, Knowledge and Learning
- p. 1-35
Open AccessMixed Reality Learning Systems with Head-Mounted Displays in Higher Education: A Systematic Review
The advent of mixed reality (MR) technology has sparked emerging adoption of MR learning systems in higher education. In this systematic literature review, we examine the state of the art of MR systems in this field. We highlight the diverse applications and benefits of MR technology, including design features and specific fields of higher education addressed in existing studies. Despite its potential, our review also identifies research gaps, particularly regarding effective evaluation methods for learning outcomes. We identify the needs to provide advanced learning support and to better integrate established learning theories to guide more effective system design. Furthermore, we discover that leveraging biosignals to design biosignal-adaptive MR learning systems providing personalized learning support is currently underutilized. Through this systematic review, we aim to offer design implications for the application of MR in higher education, identify potential research gaps, and provide insights for future work in this rapidly evolving field.
- Open Access
- 1 April 2025
- Published by MDPI AG in Journal of Eye Movement Research
- Vol. 18 (2) , 8
Eye-Based Recognition of User Traits and States—A Systematic State-of-the-Art Review
Eye-tracking technology provides high-resolution information about a user’s visual behavior and interests. Combined with advances in machine learning, it has become possible to recognize user traits and states using eye-tracking data. Despite increasing research interest, a comprehensive systematic review of eye-based recognition approaches has been lacking. This study aimed to fill this gap by systematically reviewing and synthesizing the existing literature on the machine-learning-based recognition of user traits and states using eye-tracking data following PRISMA 2020 guidelines. The inclusion criteria focused on studies that applied eye-tracking data to recognize user traits and states with machine learning or deep learning approaches. Searches were performed in the ACM Digital Library and IEEE Xplore and the found studies were assessed for the risk of bias using standard methodological criteria. The data synthesis included a conceptual framework that covered the task, context, technology and data processing, and recognition targets. A total of 90 studies were included that encompassed a variety of tasks (e.g., visual, driving, learning) and contexts (e.g., computer screen, simulator, wild). The recognition targets included cognitive and affective states (e.g., emotions, cognitive workload) and user traits (e.g., personality, working memory). A set of various machine learning techniques, such as Support Vector Machines (SVMs), Random Forests, and deep learning models were applied to recognize user states and traits. This review identified state-of-the-art approaches and gaps, which highlighted the need for building up best practices, larger-scale datasets, and diversifying tasks and contexts. Future research should focus on improving the ecological validity, multi-modal approaches for robust user modeling, and developing gaze-adaptive systems.
- 1 April 2025
- Published by MDPI AG in Journal of Eye Movement Research
- Vol. 18 (2) , 8
Open AccessEye-Based Recognition of User Traits and States—A Systematic State-of-the-Art Review
Eye-tracking technology provides high-resolution information about a user’s visual behavior and interests. Combined with advances in machine learning, it has become possible to recognize user traits and states using eye-tracking data. Despite increasing research interest, a comprehensive systematic review of eye-based recognition approaches has been lacking. This study aimed to fill this gap by systematically reviewing and synthesizing the existing literature on the machine-learning-based recognition of user traits and states using eye-tracking data following PRISMA 2020 guidelines. The inclusion criteria focused on studies that applied eye-tracking data to recognize user traits and states with machine learning or deep learning approaches. Searches were performed in the ACM Digital Library and IEEE Xplore and the found studies were assessed for the risk of bias using standard methodological criteria. The data synthesis included a conceptual framework that covered the task, context, technology and data processing, and recognition targets. A total of 90 studies were included that encompassed a variety of tasks (e.g., visual, driving, learning) and contexts (e.g., computer screen, simulator, wild). The recognition targets included cognitive and affective states (e.g., emotions, cognitive workload) and user traits (e.g., personality, working memory). A set of various machine learning techniques, such as Support Vector Machines (SVMs), Random Forests, and deep learning models were applied to recognize user states and traits. This review identified state-of-the-art approaches and gaps, which highlighted the need for building up best practices, larger-scale datasets, and diversifying tasks and contexts. Future research should focus on improving the ecological validity, multi-modal approaches for robust user modeling, and developing gaze-adaptive systems.
- 14 March 2025
- Published by Springer Nature
- p. 293-303
Eye-Tracking Technology for Cognition-Adaptive LLM-Based Assistants at the Workplace
- 14 March 2025
- Published by Springer Nature
- p. 293-303
Eye-Tracking Technology for Cognition-Adaptive LLM-Based Assistants at the Workplace
- Open Access
- 25 March 2024
- Published by Walter de Gruyter GmbH in i-com
- Vol. 23 (1) , 109-129
Cognitive state detection with eye tracking in the field: an experience sampling study and its lessons learned
In the future, cognitive activity will be tracked in the same way how physical activity is tracked today. Eye-tracking technology is a promising off-body technology that provides access to relevant data for cognitive activity tracking. For building cognitive state models, continuous and longitudinal collection of eye-tracking and self-reported cognitive state label data is critical. In a field study with 11 students, we use experience sampling and our data collection system esmLoop to collect both cognitive state labels and eye-tracking data. We report descriptive results of the field study and develop supervised machine learning models for the detection of two eye-based cognitive states: cognitive load and flow. In addition, we articulate the lessons learned encountered during data collection and cognitive state model development to address the challenges of building generalizable and robust user models in the future. With this study, we contribute knowledge to bring eye-based cognitive state detection closer to real-world applications.
- 25 March 2024
- Published by Walter de Gruyter GmbH in i-com
- Vol. 23 (1) , 109-129
Open AccessCognitive state detection with eye tracking in the field: an experience sampling study and its lessons learned
In the future, cognitive activity will be tracked in the same way how physical activity is tracked today. Eye-tracking technology is a promising off-body technology that provides access to relevant data for cognitive activity tracking. For building cognitive state models, continuous and longitudinal collection of eye-tracking and self-reported cognitive state label data is critical. In a field study with 11 students, we use experience sampling and our data collection system esmLoop to collect both cognitive state labels and eye-tracking data. We report descriptive results of the field study and develop supervised machine learning models for the detection of two eye-based cognitive states: cognitive load and flow. In addition, we articulate the lessons learned encountered during data collection and cognitive state model development to address the challenges of building generalizable and robust user models in the future. With this study, we contribute knowledge to bring eye-based cognitive state detection closer to real-world applications.
- Open Access
- 8 December 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 13 (4) , 1-47
Does this Explanation Help? Designing Local Model-agnostic Explanation Representations and an Experimental Evaluation Using Eye-tracking Technology
In Explainable Artificial Intelligence (XAI) research, various local model-agnostic methods have been proposed to explain individual predictions to users in order to increase the transparency of the underlying Artificial Intelligence (AI) systems. However, the user perspective has received less attention in XAI research, leading to a (1) lack of involvement of users in the design process of local model-agnostic explanations representations and (2) a limited understanding of how users visually attend them. Against this backdrop, we refined representations of local explanations from four well-established model-agnostic XAI methods in an iterative design process with users. Moreover, we evaluated the refined explanation representations in a laboratory experiment using eye-tracking technology as well as self-reports and interviews. Our results show that users do not necessarily prefer simple explanations and that their individual characteristics, such as gender and previous experience with AI systems, strongly influence their preferences. In addition, users find that some explanations are only useful in certain scenarios making the selection of an appropriate explanation highly dependent on context. With our work, we contribute to ongoing research to improve transparency in AI.
- 8 December 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 13 (4) , 1-47
Open AccessDoes this Explanation Help? Designing Local Model-agnostic Explanation Representations and an Experimental Evaluation Using Eye-tracking Technology
In Explainable Artificial Intelligence (XAI) research, various local model-agnostic methods have been proposed to explain individual predictions to users in order to increase the transparency of the underlying Artificial Intelligence (AI) systems. However, the user perspective has received less attention in XAI research, leading to a (1) lack of involvement of users in the design process of local model-agnostic explanations representations and (2) a limited understanding of how users visually attend them. Against this backdrop, we refined representations of local explanations from four well-established model-agnostic XAI methods in an iterative design process with users. Moreover, we evaluated the refined explanation representations in a laboratory experiment using eye-tracking technology as well as self-reports and interviews. Our results show that users do not necessarily prefer simple explanations and that their individual characteristics, such as gender and previous experience with AI systems, strongly influence their preferences. In addition, users find that some explanations are only useful in certain scenarios making the selection of an appropriate explanation highly dependent on context. With our work, we contribute to ongoing research to improve transparency in AI.
- Open Access
- 3 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 349-353
An Immersive Learning Factory for AI & Data Literacy: An Exploratory Study in the Wild
- 3 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 349-353
Open AccessAn Immersive Learning Factory for AI & Data Literacy: An Exploratory Study in the Wild
- Open Access
- 30 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Leveraging Eye Tracking Technology for a Situation-Aware Writing Assistant
- 30 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessLeveraging Eye Tracking Technology for a Situation-Aware Writing Assistant
- Open Access
- 1 April 2023
- Published by MDPI AG in Journal of Eye Movement Research
- Vol. 16 (2)
The state of the art of diagnostic multiparty eye tracking in synchronous computer-mediated collaboration
In recent years, innovative multiparty eye tracking setups have been introduced to synchronously capture eye movements of multiple individuals engaged in computer-mediated collaboration. Despite its great potential for studying cognitive processes within groups, the method was primarily used as an interactive tool to enable and evaluate shared gaze visualizations in remote interaction. We conducted a systematic literature review to provide a comprehensive overview of what to consider when using multiparty eye tracking as a diagnostic method in experiments and how to process the collected data to compute and analyze group-level metrics. By synthesizing our findings in an integrative conceptual framework, we identified fundamental requirements for a meaningful implementation. In addition, we derived several implications for future research, as multiparty eye tracking was mainly used to study the correlation between joint attention and task performance in dyadic interaction. We found multidimensional recurrence quantification analysis, a novel method to quantify group-level dynamics in physiological data, to be a promising procedure for addressing some of the highlighted research gaps. In particular, the computation method enables scholars to investigate more complex cognitive processes within larger groups, as it scales up to multiple data streams.
- 1 April 2023
- Published by MDPI AG in Journal of Eye Movement Research
- Vol. 16 (2)
Open AccessThe state of the art of diagnostic multiparty eye tracking in synchronous computer-mediated collaboration
In recent years, innovative multiparty eye tracking setups have been introduced to synchronously capture eye movements of multiple individuals engaged in computer-mediated collaboration. Despite its great potential for studying cognitive processes within groups, the method was primarily used as an interactive tool to enable and evaluate shared gaze visualizations in remote interaction. We conducted a systematic literature review to provide a comprehensive overview of what to consider when using multiparty eye tracking as a diagnostic method in experiments and how to process the collected data to compute and analyze group-level metrics. By synthesizing our findings in an integrative conceptual framework, we identified fundamental requirements for a meaningful implementation. In addition, we derived several implications for future research, as multiparty eye tracking was mainly used to study the correlation between joint attention and task performance in dyadic interaction. We found multidimensional recurrence quantification analysis, a novel method to quantify group-level dynamics in physiological data, to be a promising procedure for addressing some of the highlighted research gaps. In particular, the computation method enables scholars to investigate more complex cognitive processes within larger groups, as it scales up to multiple data streams.
- 3 December 2022
- Published by Springer Nature
- p. 89-96
Recognizing Polychronic-Monochronic Tendency of Individuals Using Eye Tracking and Machine Learning
- 3 December 2022
- Published by Springer Nature
- p. 89-96
Recognizing Polychronic-Monochronic Tendency of Individuals Using Eye Tracking and Machine Learning
- 3 December 2022
- Published by Springer Nature
- p. 123-131
The View of Participants on the Potential of Conducting NeuroIS Studies in the Wild
- 3 December 2022
- Published by Springer Nature
- p. 123-131
The View of Participants on the Potential of Conducting NeuroIS Studies in the Wild