A systematic review of performance assessment tools for laparoscopic cholecystectomy
- 20 June 2015
- journal article
- review article
- Published by Springer Nature in Surgical Endoscopy
- Vol. 30 (3) , 832-844
Abstract
Multiple tools are available to assess clinical performance of laparoscopic cholecystectomy (LC), but there are no guidelines on how best to implement and interpret them in educational settings. The purpose of this systematic review was to identify and critically appraise LC assessment tools and their measurement properties, in order to make recommendations for their implementation in surgical training. A systematic search (1989–2013) was conducted in MEDLINE, Embase, Scopus, Cochrane, and grey literature sources. Evidence for validity (content, response process, internal structure, relations to other variables, and consequences) and the conditions in which the evidence was obtained were evaluated. A total of 54 articles were included for qualitative synthesis. Fifteen technical skills and two non-technical skills assessment tools were identified. The 17 tools were used for either: recorded procedures (nine tools, 60 %), direct observation (five tools, 30 %), or both (three tools, 18 %). Fourteen (82 %) tools reported inter-rater reliability and one reported a Generalizability Theory coefficient. Nine (53 %) had evidence for validity based on clinical experience and 11 (65 %) compared scores to other assessments. Consequences of scores, educational impact, applications to residency training, and how raters were trained were not clearly reported. No studies mentioned cost. The most commonly reported validity evidence was inter-rater reliability and relationships to other known variables. Consequences of assessments and rater training were not clearly reported. These data and the evidence for validity should be taken into consideration when deciding how to select and implement a tool to assess performance of LC, and especially how to interpret the results.Keywords
This publication has 61 references indexed in Scilit:
- Warm-up in a Virtual Reality Environment Improves Performance in the Operating RoomAnnals of Surgery, 2010
- Laparoscopic Simulators : Are They Useful!Medical Journal Armed Forces India, 2009
- An Evaluation of the Feasibility, Validity, and Reliability of Laparoscopic Skills Assessment in the Operating RoomAnnals of Surgery, 2007
- Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomiesThe American Journal of Surgery, 2007
- The influence of non-technical performance on technical outcome in laparoscopic cholecystectomySurgical Endoscopy, 2007
- Competence Assessment of Laparoscopic Operative and Cognitive Skills: Objective Structured Clinical Examination (OSCE) or Observational Clinical Human Reliability Assessment (OCHRA)World Journal of Surgery, 2006
- Self-appraisal hierarchical task analysis of laparoscopic surgery performed by expert surgeonsSurgical Endoscopy, 2006
- Randomized clinical trial of virtual reality simulation for laparoscopic skills trainingBritish Journal of Surgery, 2004
- Virtual Reality Training Improves Operating Room PerformanceAnnals of Surgery, 2002
- Errors enacted during endoscopic surgery—a human reliability analysisApplied Ergonomics, 1998