Integrating Eye-Tracking to Augmented Reality System for Surgical Training
- 29 September 2020
- journal article
- research article
- Published by Springer Nature in Journal of Medical Systems
- Vol. 44 (11) , 1-7
Abstract
Augmented Reality has been utilized for surgical training. During the implementation, displaying instructional information at the right moment is critical for skill acquisition. We built a new surgical training platform combining augmented reality system (HoloLens, Microsoft) with an eye-tracker (Pupil labs, Germany). Our goal is to detect the moments of performance difficulty using the integrated eye-tracker so that the system could display instructions at the precise moment when the user is seeking instructional information during a surgical skill practice in simulation. In the paper, we describe the system design, system calibration and data transferring between these devices.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2016-06462)
- Teaching & Learning Enhancement Fund (Pro00064834)
This publication has 23 references indexed in Scilit:
- Systematic review on the effectiveness of augmented reality applications in medical trainingSurgical Endoscopy, 2016
- A Novel Eye-Gaze-Controlled Wheelchair System for Navigating Unknown Environments: Case Study With a Person With ALSIEEE Access, 2016
- Augmented reality assisted surgery: a urologic training toolAsian Journal of Andrology, 2016
- Cooperative Robotic Gamma Imaging: Enhancing US-guided Needle Biopsy2015
- Pupil responses to continuous aiming movementsInternational Journal of Human-Computer Studies, 2015
- Detection of Changes in Surgical DifficultySurgical Innovation, 2015
- Pupil2014
- Pupil dilations during target-pointing respect Fitts' law2014
- Context-aware Augmented Reality in laparoscopic surgeryComputerized Medical Imaging and Graphics, 2013
- Knowledge-Based Situation Interpretation for Context-Aware Augmented Reality in Dental Implant Surgery2010