Ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) for trabeculectomy
Open Access
- 18 August 2019
- journal article
- research article
- Published by BMJ in BMJ Open Ophthalmology
- Vol. 4 (1) , e000313
Abstract
Background/aims To develop, test and determine whether a surgical-competency assessment tool for simulated glaucoma surgery is valid. Methods The trabeculectomy ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) was assessed for face and content validity with a large international group of expert eye surgeons. Cohorts of novice and competent surgeons were invited to perform anonymised simulation trabeculectomy surgery, which was marked using the Sim-OSSCAR in a masked fashion by a panel of four expert surgeons. Construct validity was assessed using a Wilcoxon rank-sum test. Krippendorff’s alpha was calculated for interobserver reliability. Results For the Sim-OSSCAR for trabeculectomy, 58 of 67 surgeons (86.6%) either agreed or strongly agreed that the Sim-OSSCAR is an appropriate way to assess trainees’ surgical skill. Face validity was rated as 4.04 (out of 5.00). Fifty-seven of 71 surgeons (80.3%) either agreed or strongly agreed that the Sim-OSSCAR contents represented the surgical technique of surgical trabeculectomy. Content validity was rated as 4.00. Wilcoxon rank-sum test showed that competent surgeons perform better than novices (p=0.02). Interobserver reliability was rated >0.60 (Krippendorff’s alpha) in 19 of 20 steps of the Sim-OSSCAR. Conclusion The Sim-OSSCAR for trabeculectomy, a newly developed and validated assessment tool for simulation glaucoma surgery, has validity and reliability. It has the potential to play a useful role in ophthalmic surgical education.Keywords
Funding Information
- British Council for Prevention of Blindness
- Wellcome Trust (207472/Z/17/Z)
- Queen Elisabeth Diamond Jubilee Trust
- Christoffel Blinden Mission
- Ulverscroft Foundation
This publication has 17 references indexed in Scilit:
- Resident surgical training in glaucomaCurrent Opinion in Ophthalmology, 2016
- Update on Simulation-Based Surgical Training and Assessment in OphthalmologyOphthalmology, 2015
- Visual Field Improvement in the Collaborative Initial Glaucoma Treatment StudyAmerican Journal of Ophthalmology, 2014
- A survey of the role of virtual surgery simulators in ophthalmic graduate medical educationGraefe's Archive for Clinical and Experimental Ophthalmology, 2010
- A Unified Approach to Validation, Reliability, and Education Study Design for Surgical Technical Skills TrainingArchives of Surgery, 2010
- Practice, Rehearsal, and PerformanceJAMA, 2009
- Five-year Follow-up Optic Disc Findings of the Collaborative Initial Glaucoma Treatment StudyAmerican Journal of Ophthalmology, 2009
- Johns Hopkins University School of MedicineAcademic Medicine, 2004
- Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and trainingSurgical Endoscopy, 2003
- Early trabeculectomy versus conventional management in primary open angle glaucoma.British Journal of Ophthalmology, 1988