Do Metrics Matter? Time Versus Motion Tracking for Performance Assessment of Proficiency-Based Laparoscopic Skills Training
- 1 January 2009
- journal article
- empirical investigations
- Published by Wolters Kluwer Health in Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
- Vol. 4 (2) , 104-108
Abstract
Introduction: The purpose of this study was to compare the added value of motion metrics in determining training completion during a proficiency-based simulator curriculum compared with traditional metrics (time). Methods: Novices (n = 16) practiced on a basic laparoscopic task of a hybrid simulator until expert-derived proficiency levels for time, path length, and smoothness were achieved on two consecutive attempts. The order by which proficiency in each metric was achieved was recorded and correlated to baseline characteristics. Motion metrics were considered valuable if their incorporation led to extension of training duration. Results: Compared with baseline participant performance improved at training completion according to all metrics (time 67 ± 17 to 20 ± 6 seconds; P < 0.001, pathlength 5326 ± 1444 to 2339 ± 545 cm; P < 0.001, and smoothness from 529 ± 185 to 133 ± 59; P < 0.001). Pathlength was the easiest metric to reach the proficiency level and time the most difficult. Four (33%) participants benefited from the motion metrics as their training was prolonged by an average of 50% compared with using time alone. Baseline characteristics did not correlate to the order of achievement of these metrics. Conclusions: Time may be superior to motion tracking metrics for performance assessment during proficiency-based simulator training. Nevertheless, in this study one third of trainees benefited from motion analysis metrics by having their training duration extended. Further study is needed to establish the value of motion metrics during simulator training and their impact on operating room performance improvement.Keywords
This publication has 21 references indexed in Scilit:
- The Formula for a Successful Laparoscopic Skills CurriculumArchives of Surgery, 2009
- Proficiency-Based Laparoscopic Simulator Training Leads to Improved Operating Room Skill That Is Resistant to DecaySurgical Innovation, 2008
- The New ACS/APDS Skills Curriculum: Moving the Learning Curve Out of the Operating RoomJournal of Gastrointestinal Surgery, 2008
- Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS)Surgical Endoscopy, 2007
- Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomiesThe American Journal of Surgery, 2007
- Redefining simulator proficiency using automaticity theoryThe American Journal of Surgery, 2007
- Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning CenterSurgical Endoscopy, 2006
- Construct validation of a novel hybrid surgical simulatorSurgical Endoscopy, 2006
- Construct Validity Testing of a Laparoscopic Surgical SimulatorJournal of the American College of Surgeons, 2006
- Laparoscopic training on bench models: better and more cost effective than operating room experience?1Journal of the American College of Surgeons, 2000