Qualitative and Quantitative Assessment of Invasive Surgery Skill Based on a Custom Training Simulator
- 14 June 2023
- journal article
- research article
- Published by SAGE Publications in Journal of Endovascular Therapy
- Vol. 32 (3) , 860-868
Abstract
Purpose: Qualitative and quantitative assessment of interventional performance is a vital component in the evaluation of endovascular surgery skill training. We established a custom simulator with qualitative and quantitative metrics for endovascular performance training. Methods: The simulator included an in vitro silicone phantom, mock circulation loop, visual module, force-sensing module, and custom software for image and force data postprocessing. Two tasks to deliver the guidewire to the target location of the carotid artery were conducted by the expert (n=4), novice (n=6), and test (n=4) groups. Seven features with significant differences extracted from the expert and novice groups were applied for qualitative assessment using the support vector machine (SVM) and quantitative assessment using the Mahalanobis distance (MD). Results: Significant differences were observed in kinematic and force data between experts and novices during the intervention procedure. The median value of finished time for task 1 was 26.88 seconds for experts and 63.36 seconds for novices. The maximum speed for experts and novices was 32.79 and 7.43 cm/s, respectively. Moreover, the classified results depicted that the accuracy of qualitative assessment for task 1 and task 2 was 96.67% and 90%, respectively. As for the quantitative data, the residents had higher scores than individuals majored in biomedical engineering at 2 tasks (70.06±5.30 vs 41.81±6.58 for task 1, p=0.001). Conclusions: The proposed endovascular intervention skill training simulator provides qualitative and quantitative metrics on intervention performance skills and may be a useful tool in future interventional surgical training. Clinical Impact: This simulator comprised an in-vitro silicone phantom, mock circulation loop, visual module, force-sensing module, and custom software for image and force data post-processing. Seven interventional performance features were used for qualitative assessment using the support vector machine and quantitative assessment using the Mahalanobis Distance. From the observations, we conclude that this endovascular intervention skill training simulator provides qualitative and quantitative metrics on intervention performance and may be a useful tool in future surgical training.Keywords
Funding Information
- National Natural Science Foundation of China (81970404)
- Scientific Research Translational Foundation of Wenzhou Safety (Emergency) Institute of Tianjin University (N/A)
- Natural Science Foundation of Beijing Municipality (L192010)
- Natural Science Foundation of Beijing Municipality (Z210012)
- National Key Research and Development Program of China (2018AAA0102600)
This publication has 32 references indexed in Scilit:
- A Pilot Study of Video-motion Analysis in Endovascular Surgery: Development of Real-time Discriminatory Skill MetricsEuropean Journal of Vascular and Endovascular Surgery, 2013
- Objective Skill Evaluation for Laparoscopic Training Based on Motion AnalysisIEEE Transactions on Biomedical Engineering, 2013
- Review of methods for objective surgical skill evaluationSurgical Endoscopy, 2010
- Endovascular skills training and assessmentJournal of Vascular Surgery, 2007
- Simulator assessment of innate endovascular aptitude versus empirically correct performanceJournal of Vascular Surgery, 2006
- Surgical SimulationAnnals of Surgery, 2005
- The "Cost" of Operative Training for Surgical ResidentsArchives of Surgery, 2004
- An Animal Model of Abdominal Aortic Aneurysm Created with Peritoneal Patch: Technique and Initial ResultsCardioVascular and Interventional Radiology, 2003
- Estimating the Support of a High-Dimensional DistributionNeural Computation, 2001
- A human cadaveric circulation modelJournal of Vascular Surgery, 2001