An augmented reality approach to surgical telementoring
Authors:
- 1 October 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 1062922X,p. 2341-2346
Abstract
Optimal surgery and trauma treatment integrates different surgical skills frequently unavailable in rural/field hospitals. Telementoring can provide the missing expertise, but current systems require the trainee to focus on a nearby telestrator, fail to illustrate coming surgical steps, and give the mentor an incomplete picture of the ongoing surgery. A new telementoring system is presented that utilizes augmented reality to enhance the sense of co-presence. The system allows a mentor to add annotations to be displayed for a mentee during surgery. The annotations are displayed on a tablet held between the mentee and the surgical site as a heads-up display. As it moves, the system uses computer vision algorithms to track and align the annotations with the surgical region. Tracking is achieved through feature matching. To assess its performance, comparisons are made between SURF and SIFT detector, brute force and FLANN matchers, and hessian blob thresholds. The results show that the combination of a FLANN matcher and a SURF detector with a 1500 hessian threshold can optimize this system across scenarios of tablet movement and occlusion.Keywords
This publication has 22 references indexed in Scilit:
- Surgeons blinded by enhanced navigation: the effect of augmented reality on attentionSurgical Endoscopy, 2012
- Clinical and Educational Benefits of Surgical Telementoring2012
- Three-dimensional imaging navigation during a lung segmentectomy using an iPadEuropean Journal of Cardio-Thoracic Surgery, 2012
- Neurosurgical apps for iPhone, iPod Touch, iPad and AndroidSurgical Neurology International, 2010
- Quantifying distraction and interruption in urological surgeryQuality and Safety in Health Care, 2007
- Technology Insight: telementoring and telesurgery in urologyNature Reviews Endocrinology, 2006
- Vein ImagingDermatologic Surgery, 2006
- Building a Better Bridge: Testing e-training to improve e-mentoring programmes in higher educationMentoring & Tutoring: Partnership in Learning, 2003
- Robotic surgery, telerobotic surgery, telepresence, and telementoringSurgical Endoscopy, 2002
- Recent advances in augmented realityIEEE Computer Graphics and Applications, 2001