Exploratory Application of Augmented Reality/Mixed Reality Devices for Acute Care Procedure Training
Open Access
- 18 January 2018
- journal article
- research article
- Published by Western Journal of Emergency Medicine in Western Journal of Emergency Medicine
- Vol. 19 (1) , 158-164
Abstract
Introduction: Augmented reality (AR), mixed reality (MR), and virtual reality devices are enabling technologies that may facilitate effective communication in healthcare between those with information and knowledge (clinician/specialist; expert; educator) and those seeking understanding and insight (patient/family; non-expert; learner). Investigators initiated an exploratory program to enable the study of AR/MR use-cases in acute care clinical and instructional settings.Methods: Academic clinician educators, computer scientists, and diagnostic imaging specialists conducted a proof-of-concept project to 1) implement a core holoimaging pipeline infrastructure and open-access repository at the study institution, and 2) use novel AR/MR techniques on off-the-shelf devices with holoimages generated by the infrastructure to demonstrate their potential role in the instructive communication of complex medical information.Results: The study team successfully developed a medical holoimaging infrastructure methodology to identify, retrieve, and manipulate real patients’ de-identified computed tomography and magnetic resonance imagesets for rendering, packaging, transfer, and display of modular holoimages onto AR/MR headset devices and connected displays. Holoimages containing key segmentations of cervical and thoracic anatomic structures and pathology were overlaid and registered onto physical task trainers for simulation-based “blind insertion” invasive procedural training. During the session, learners experienced and used task-relevant anatomic holoimages for central venous catheter and tube thoracostomy insertion training with enhanced visual cues and haptic feedback. Direct instructor access into the learner’s AR/MR headset view of the task trainer was achieved for visual-axis interactive instructional guidance.Conclusion: Investigators implemented a core holoimaging pipeline infrastructure and modular open-access repository to generate and enable access to modular holoimages during exploratory pilot stage applications for invasive procedure training that featured innovative AR/MR techniques on off-the-shelf headset devices.Keywords
This publication has 29 references indexed in Scilit:
- Use of Point-of-Care Ultrasound in Connecticut Emergency DepartmentsThe Journal of Emergency Medicine, 2015
- Mixed Reality Ventriculostomy SimulationOperative Neurosurgery, 2014
- Telemedicine supported by Augmented Reality: an interactive guide for untrained people in performing an ECG testBioMedical Engineering OnLine, 2014
- Emerging Technology in Surgical Education: Combining Real-Time Augmented Reality and Wearable Computing DevicesOrthopedics, 2014
- Multi-Modal Intra-Operative Navigation During Distal Locking of Intramedullary NailsIEEE Transactions on Medical Imaging, 2014
- Evaluation of a simplified augmented reality device for ultrasound-guided vascular access in a vascular phantomJournal of Clinical Anesthesia, 2014
- Inattentional Blindness Increased with Augmented Reality Surgical NavigationAmerican Journal of Rhinology & Allergy, 2014
- An augmented reality framework for optimization of computer assisted navigation in endovascular surgery2014
- Ghostman: Augmented Reality Application for Telerehabilitation and Remote Instruction of a Novel Motor SkillBioMed Research International, 2014
- Using Augmented Reality as a Clinical Support Tool to Assist Combat Medics in the Treatment of Tension PneumothoracesMilitary Medicine, 2013