Comparative assessment of three standardized robotic surgery training methods
Authors:
- 7 March 2013
- journal article
- research article
- Published by Wiley in BJU International
- Vol. 112 (6) , 864-871
Abstract
Objectives: To evaluate three standardized robotic surgery training methods, inanimate, virtual reality and in vivo , for their construct validity. To explore the concept of cross‐method validity, where the relative performance of each method is compared. Materials and Methods: Robotic surgical skills were prospectively assessed in 49 participating surgeons who were classified as follows: ‘novice/trainee’: urology residents, previous experience n = 38) and ‘experts’: faculty surgeons, previous experience ≥30 cases ( n = 11). Three standardized, validated training methods were used: (i) structured inanimate tasks; (ii) virtual reality exercises on the da V inci S kills S imulator (Intuitive Surgical, Sunnyvale, CA , USA ); and (iii) a standardized robotic surgical task in a live porcine model with performance graded by the G lobal E valuative A ssessment of R obotic S kills ( GEARS ) tool. A K ruskal– W allis test was used to evaluate performance differences between novices and experts (construct validity). Spearman's correlation coefficient (ρ) was used to measure the association of performance across inanimate, simulation and in vivo methods (cross‐method validity). Results: Novice and expert surgeons had previously performed a median (range) of 0 (0–20) and 300 (30–2000) robotic cases, respectively ( P < 0.001). Construct validity: experts consistently outperformed residents with all three methods ( P < 0.001). Cross‐method validity: overall performance of inanimate tasks significantly correlated with virtual reality robotic performance (ρ = −0.7, P < 0.001) and in vivo robotic performance based on GEARS (ρ = −0.8, P < 0.0001). Virtual reality performance and in vivo tissue performance were also found to be strongly correlated (ρ = 0.6, P < 0.001). Conclusions: We propose the novel concept of cross‐method validity, which may provide a method of evaluating the relative value of various forms of skills education and assessment. We externally confirmed the construct validity of each featured training tool.Keywords
This publication has 20 references indexed in Scilit:
- Comprehensive proficiency-based inanimate training for robotic surgery: reliability, feasibility, and educational benefitSurgical Endoscopy, 2012
- Best Practices for Robotic Surgery Training and CredentialingJournal of Urology, 2011
- Content validation of a novel robotic surgical simulatorBJU International, 2010
- Face Validation of a Novel Robotic Surgical SimulatorUrology, 2010
- 1336 DEVELOPMENT AND VALIDATION OF INANIMATE TASKS FOR ROBOTIC SURGICAL SKILLS ASSESSMENT AND TRAININGJournal of Urology, 2010
- Survey of senior resident training in urologic laparoscopy, robotics and endourology surgery in CanadaCanadian Urological Association Journal, 2010
- Fundamentals of Laparoscopic Surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trialThe American Journal of Surgery, 2010
- Face, Content, and Construct Validity of dV-Trainer, a Novel Virtual Reality Simulator for Robotic SurgeryUrology, 2009
- Validation of a Novel Virtual Reality Robotic SimulatorJournal of Endourology, 2009
- Survey of Residency Training in Laparoscopic and Robotic SurgeryJournal of Urology, 2006