System for Evaluation of Teaching Qualities (SETQ) Smart for use in Brazil: resident’s version
Open Access
- 1 January 2024
- journal article
- research article
- Published by FapUNIFESP (SciELO) in Revista Brasileira de Educação Médica
- Vol. 48 (3) , e076
Abstract
Introduction: It is commonly recognized that the enhancement of students’ learning potential is directly related to preceptors’ qualities. In this sense, the assessment of teachers’ practice becomes an essential element in ensuring the quality in the training of new specialists. However, in the context of medical education in Brazil, there are currently few studies on the evaluation of preceptors and a shortage of instruments for this purpose. One of the currently available instruments is the System for Evaluation of Teaching Qualities (SETQ) Smart. Objective: To conduct a cross-cultural adaptation and content validity of SETQ for use in Brazil. Methods: This instrument comprises two versions and, in this study, the version for residents was adapted for preceptor assessment. The cultural adaptation followed five steps: two initial English to Brazilian Portuguese translations; two synthesis translations; two back-translations; an expert committee assessment of conceptual analysis, semantic, idiomatic and cultural equivalences; and a pre-test. In addition, a panel of expert judges conducted the content validation. Results: Forty resident physicians, with a median age of 30 (IQR = 6.25), participated in the pre-test. Eighty percent of the participants rated the components that make up the SETQ Smart as clear and culturally appropriate, except for the title statement. The expert panel of judges comprised ten residents, 70% female. The agreement rates ranged from 80 to 100% regarding clarity, cultural adequacy, item representativeness within their respective domains and each item permanence in the instrument assessments. Conclusion: This study culturally adapted one of the two versions of the SETQ Smart for use in Brazil and provided preliminary evidence sources of validity of the versions through content validation.Keywords
This publication has 33 references indexed in Scilit:
- What are students' needs and preferences for academic feedback in higher education? A systematic reviewNurse Education Today, 2020
- COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi studyQuality of Life Research, 2018
- Reliable and Valid Tools for Measuring Surgeons' Teaching Performance: Residents' vs. Self EvaluationJournal of Surgical Education, 2012
- Assessing the Quality of Clinical TeachersJournal of General Internal Medicine, 2010
- The development and validation of a framework for teaching competencies in higher educationHigher Education, 2004
- Validating an instrument for clinical supervision using an expert panelInternational Journal of Nursing Studies, 2003
- Audit and feedback: effects on professional practice and health care outcomes2003
- CanMEDS 2000: Extract from the CanMEDS 2000 Project Societal Needs Working Group ReportMedical Teacher, 2000
- Factorial validation of an educational framework using residentsʼ evaluations of clinician-educatorsAcademic Medicine, 1999
- Factorial validation of a widely disseminated educational framework for evaluating clinical teachersAcademic Medicine, 1998