CAL-Tutor: A HoloLens 2 Application for Training in Obstetric Sonography and User Motion Data Recording
Open Access
- 29 December 2022
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 9 (1) , 6
Abstract
Obstetric ultrasound (US) training teaches the relationship between foetal anatomy and the viewed US slice to enable navigation to standardised anatomical planes (head, abdomen and femur) where diagnostic measurements are taken. This process is difficult to learn, and results in considerable inter-operator variability. We propose the CAL-Tutor system for US training based on a US scanner and phantom, where a model of both the baby and the US slice are displayed to the trainee in its physical location using the HoloLens 2. The intention is that AR guidance will shorten the learning curve for US trainees and improve spatial awareness. In addition to the AR guidance, we also record many data streams to assess user motion and the learning process. The HoloLens 2 provides eye gaze, head and hand position, ARToolkit and NDI Aurora tracking gives the US probe positions and an external camera records the overall scene. These data can provide a rich source for further analysis, such as distinguishing expert from novice motion. We have demonstrated the system in a sample of engineers. Feedback suggests that the system helps novice users navigate the US probe to the standard plane. The data capture is successful and initial data visualisations show that meaningful information about user behaviour can be captured. Initial feedback is encouraging and shows improved user assessment where AR guidance is provided.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (203145Z/16/z, EP/P027938/1, EP/R004080/1, EP/P012841/1, GA 863146)
- Royal Academy of Engineering Chair in Emerging Technologies (203145Z/16/z, EP/P027938/1, EP/R004080/1, EP/P012841/1, GA 863146)
This publication has 18 references indexed in Scilit:
- Image-guided laser ablation in the treatment of recurrence of renal tumours: technique and preliminary resultsEuropean Radiology Experimental, 2020
- Perceptual Limits of Optical See-Through Visors for Augmented Reality Guidance of Manual TasksIEEE Transactions on Biomedical Engineering, 2019
- ARssist: augmented reality on a head‐mounted display for the first assistant in robotic surgeryHealthcare Technology Letters, 2018
- Augmented Reality and Ultrasound Education: Initial ExperienceJournal of Cardiothoracic and Vascular Anesthesia, 2018
- Ultrasound Standard Plane Detection Using a Composite Neural Network FrameworkIEEE Transactions on Cybernetics, 2017
- Transfer from point-of-care Ultrasonography training to diagnostic performance on patients—a randomized controlled trialThe American Journal of Surgery, 2016
- Usability of virtual‐reality simulation training in obstetric ultrasonography: a prospective cohort studyUltrasound in Obstetrics & Gynecology, 2013
- Quality control of fetal ultrasound images: Detection of abdomen anatomical landmarks using AdaBoost2011
- Advanced training methods using an Augmented Reality ultrasound simulator2009
- Technologies for augmented reality systems1996