Learner and Teacher Entrustability Concordance in Endocrine Surgery Entrustable Professional Activities
Authors:
- 8 October 2025
- journal article
- Published by Wiley in World Journal of Surgery
- Vol. 49 (11) , 3136-3141
Abstract
Introduction: The American Association of Endocrine Surgeons (AAES) drafted Entrustable Professional Activities (EPAs) for Endocrine Surgery (ES) to assess general surgery residents and ES fellows in core topics. Here, we examine learner and teacher concordance of entrustability ratings. Methods: Fourteen EPAs were defined (10 “core”–6 with pre‐, intra‐, and post‐operative phases, four single‐phase–and four elective EPAs). Ten institutions collected three‐item micro‐assessments (MAs) of learner EPA performance using a web‐based platform, where entrustment was assessed on observable behaviors using a five‐point scale. Learner provided self‐assessment ratings, while teachers separately assigned ratings for the same activities. Spearman rank correlation tests were applied to compare learner‐teacher ratings for EPAs. Results: MAs ( n = 698) were submitted between 7/2022‐9/2023. Programs submitted between 3 and 468 MAs. Among 3‐phase core EPAs, the intraoperative phase was most assessed ( n = 496), followed by pre‐ and post‐operative phases ( n = 108 and 55, respectively). Thirty‐nine single‐phase EPAs were submitted. Learner self‐assessment and teacher ratings were equivalent for 32% of pre‐operative EPAs, 53% of intra‐operative EPAs, 29% of post‐operative EPAs, and 64% of single phase of care EPAs. Spearman rank correlation between teacher and learner ratings for all phases of care combined was 0.66. Correlation was highest for the intra‐operative phase (0.73), followed by single‐phase (0.65), pre‐operative phase (0.27), and post‐operative phase (0.20). Rating concordance did not differ when high and low scores were examined independently. Learners were more prone to underestimate performance than to overestimate it when ratings were discordant. Conclusions: Learners' self‐assessment and teacher ratings of endocrine surgery EPAs are strongly concordant with operative technical skills. However, learners often underestimate their performance of pre‐ and post‐operative care compared to faculty ratings when using EPAs.Keywords
Funding Information
- American Association of Endocrine Surgeons
This publication has 25 references indexed in Scilit:
- Introduction to Entrustable Professional Activities for Pediatric SurgeryJournal of Pediatric Surgery, 2024
- Assessing general surgery residents outside of the operating room: Our experience with entrustable professional activities in the pre-operative and post-operative settingsThe American Journal of Surgery, 2024
- Surgical Competency Assessment Using Entrustable Professional ActivitiesJAMA Surgery, 2024
- Entrustable Professional Activities in SurgeryJAMA Surgery, 2024
- Validity Evidence for ENTRUST as an Assessment of Surgical Decision-Making for the Inguinal Hernia Entrustable Professional Activity (EPA)Journal of Surgical Education, 2022
- American Board of Surgery Entrustable Professional Activities (EPAs): Assessing Graduating Residents’ Perception of Preoperative EntrustmentJournal of Surgical Education, 2021
- Entrustable Professional Activities in General Surgery: Trends in Resident Self-AssessmentJournal of Surgical Education, 2020
- Self-Assessment of Surgical Skills: A Systematic ReviewJournal of Surgical Education, 2020
- Association of intraoperative entrustment with clinical competency amongst general surgery residentsThe American Journal of Surgery, 2020
- Self vs expert assessment of technical and non-technical skills in high fidelity simulationThe American Journal of Surgery, 2011