Validation of the Objective Structured Assessment of Technical Skill in Brasil
Open Access
- 1 March 2020
- journal article
- research article
- Published by FapUNIFESP (SciELO) in Revista da Associação Médica Brasileira
- Vol. 66 (3) , 328-333
Abstract
SUMMARY BACKGROUND The aim of this study was to perform a cross-cultural adaptation of the Objective Structured Assessment of Technical Skill (OSATS) tool into Brazilian Portuguese and to determine its reproducibility and validity in Brasil. METHODS A Brazilian Portuguese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing, and then its validation. For the construct and the concurrent validities, twelve participants were divided into a group of six experts and six novices, who had to perform tasks on a simulation model using human placentas. Each participant was filmed, and two blinded raters would then evaluate their performance using the traditional subjective method and then the Brazilian Portuguese version of OSATS. RESULTS The Brazilian Portuguese version of OSATS had the face, content, construct, and concurrent validities achieved. The average experts’ score and standard deviations were 34 and 0.894, respectively, for Judge 1 and 34.33 and 0.816 for Judge 2. In the case of novices, it was 13.33 and 2.388 for Judge 1 and 13.33 and 3.204 for Judge 2. The concordance between the judges was evident, with the Correlation Coefficient (Pearson) of 0.9944 with CI 95% between 0.9797 and 0.9985, with p < 10-10, evidencing the excellent reproducibility of the instrument. CONCLUSION This preliminary study suggests that the Brazilian Portuguese version of OSATS can reliably and validly assess surgical skills in Brasil.Keywords
This publication has 22 references indexed in Scilit:
- Construction and validation of a surgical skills assessment tool for general surgery residency programRevista do Colégio Brasileiro de Cirurgiões, 2015
- Evaluation of surgical training in the era of simulationWorld Journal of Gastrointestinal Endoscopy, 2014
- An Operative Performance Rating System for Urology ResidentsJournal of Urology, 2012
- The cross-cultural equivalence of participation instruments: a systematic reviewDisability and Rehabilitation, 2012
- Objective evaluation of the performance of surgical trainees on a porcine model of open colectomyBritish Journal of Surgery, 2010
- Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residentsSurgery, 2005
- Testing technical skill via an innovative “bench station” examinationThe American Journal of Surgery, 1997
- Objective structured assessment of technical skill (OSATS) for surgical residentsBritish Journal of Surgery, 1997
- Validation of an objective structured assessment of technical skill for surgical residentsAcademic Medicine, 1996
- Cross-cultural adaptation of health-related quality of life measures: Literature review and proposed guidelinesJournal of Clinical Epidemiology, 1993