Understanding Collaborative Learning of Molecular Structures in AR With Eye Tracking
- 21 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 44 (6) , 39-51
Abstract
We present an approach for on-site instruction of multiple students accompanied by gaze-based monitoring to observe patterns of visual attention during task solving. We focus on collaborative processes in augmented reality (AR) that play an essential role in on-site and remote teaching alike. From a teaching perspective, it is important in such scenarios to communicate content and tasks effectively, observe whether students understand the task, and help appropriately. In our setting, students work with head-mounted displays with eye-tracking support to collaborate in a co-located space. The supervisor can observe the scene and the students and interact with them in a hybrid setup using both AR and a desktop PC. Attention monitoring and guidance are facilitated via a bidirectional mapping between 2D structural formulas and 3D molecules. We showcase our approach with an interactive teaching scenario in which chemistry students learn aspects of stereochemistry by interacting with virtual 3D models of molecular structures. An interview with supervisors and students showed that our approach has much potential in classroom applications for (1) engaging students in collaborative task solving and (2) assisting teachers in monitoring and supporting the learning processes of their students.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (EXC 2075 – 390740016, EXC 2120/1 – 390831618, 449742818, 251654672 – TRR 161)
This publication has 19 references indexed in Scilit:
- chARpack: The Chemistry Augmented Reality PackageJournal of Chemical Information and Modeling, 2024
- Evaluating Situated Visualization in AR with Eye Tracking2022
- The Value of Immersive VisualizationIEEE Computer Graphics and Applications, 2021
- Exploring Chemistry with Wireless, PC-Less Portable Virtual Reality LaboratoriesJournal of Chemical Education, 2020
- UCSF ChimeraX: Structure visualization for researchers, educators, and developersProtein Science, 2020
- Augmented reality in STEM education: a systematic reviewInteractive Learning Environments, 2020
- Digitising Teaching and Learning – Additional Perspectives for Chemistry EducationIsrael Journal of Chemistry, 2018
- Eye-tracking technology in medical education: A systematic reviewMedical Teacher, 2017
- Visualization of Eye Tracking Data: A Taxonomy and SurveyComputer Graphics Forum, 2017
- Learning Using Augmented Reality Technology: Multiple Means of Interaction for Teaching Children the Theory of Colours2005