Competencies “Plus”: The Nature of Written Comments on Internal Medicine Residentsʼ Evaluation Forms
Authors:
- Shiphra GinsburgSGShiphra Ginsburg
- Wayne GoldWGWayne Gold
- Rodrigo B. CavalcantiRCRodrigo B. Cavalcanti
- Bochra KurabiBKBochra Kurabi
- Heather McDonald-BlumerHMHeather McDonald-Blumer
Open Access
- 1 October 2011
- journal article
- research article
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 86 (10) , S30-S34
Abstract
Comments on residents' in-training evaluation reports (ITERs) may be more useful than scores in identifying trainees in difficulty. However, little is known about the nature of comments written by internal medicine faculty on residents' ITERs. Comments on 1,770 ITERs (from 180 residents in postgraduate years 1–3) were analyzed using constructivist grounded theory beginning with an existing framework. Ninety-three percent of ITERs contained comments, which were frequently easy to map onto traditional competencies, such as knowledge base (n = 1,075 comments) to the CanMEDs Medical Expert role. Many comments, however, could be linked to several overlapping competencies. Also common were comments completely unrelated to competencies, for instance, the resident's impact on staff (813), or personality issues (450). Residents' “trajectory” was a major theme (performance in relation to expected norms [494], improvement seen [286], or future predictions [286]). Faculty's assessments of residents are underpinned by factors related and unrelated to traditional competencies. Future evaluations should attempt to capture these holistic, integrated impressions.Keywords
This publication has 10 references indexed in Scilit:
- Good questions, good answers: construct alignment improves the performance of workplace‐based assessment scalesMedical Education, 2011
- Criteria for good assessment: Consensus statement and recommendations from the Ottawa 2010 ConferenceMedical Teacher, 2011
- Using Qualitative Data From a Program Director's Evaluation Form as an Outcome Measurement for Medical SchoolMilitary Medicine, 2010
- Toward Authentic Clinical Evaluation: Pitfalls in the Pursuit of CompetencyAcademic Medicine, 2010
- A multi‐method analysis of free‐text comments from the UK General Medical Council Colleague QuestionnairesMedical Education, 2009
- Measurement of the General Competencies of the Accreditation Council for Graduate Medical Education: A Systematic ReviewAcademic Medicine, 2009
- The State of Evaluation in Internal Medicine ResidencyJournal of General Internal Medicine, 2008
- The nature of qualitative comments in evaluating professionalismMedical Education, 2005
- Global Descriptive Evaluations Are More Responsive than Global Numeric Ratings in Detecting Studentsʼ Progress during the Inpatient Portion of an Internal Medicine ClerkshipAcademic Medicine, 2001
- Do final grades reflect written qualitative evaluations of student performance?Teaching and Learning in Medicine, 1993