A case for feedback and monitoring assessment in competency‐based medical education
- 18 December 2019
- journal article
- research article
- Published by Wiley in Journal of Evaluation in Clinical Practice
- Vol. 26 (4) , 1105-1113
Abstract
Purpose Within competency‐based medical education, self‐regulated learning (SRL) requires residents to leverage self‐assessment and faculty feedback. We sought to investigate the potential for competency‐based assessments to foster SRL by quantifying the relationship between faculty feedback and entrustment ratings as well as the congruence between faculty assessment and resident self‐assessment. Materials and methods We collected comments in (a) an emergency medicine objective structured clinical examination group (objective structured clinical examinations [OSCE] and emergency medicine OSCE group [EMOG]) and (b) a first‐year resident multidisciplinary resuscitation “Nightmares” course assessment group (NCAG) and OSCE group (NOG). We assessed comments across five domains including Initial Assessment (IA), Diagnostic Action (DA), Therapeutic Action (TA), Communication (COM), and entrustment. Analyses included structured qualitative coding and (non)parametric and descriptive analyses. Results In the EMOG, faculty's positive comments in the entrustment domain corresponded to lower entrustment score Mean Ranks (MRs) for IA (17.6). In the NCAG, faculty's positive IA comments were negatively correlated with entrustment scores (ρ = −.27, P = .04). Across programs, faculty and residents made similar domain‐specific comments 13% of the time. Conclusions Minimal and inconsistent associations were found between narrative and numerical feedback. Performance monitoring accuracy and feedback should be included in assessment validation.Keywords
Funding Information
- Southeastern Ontario Academic Medical Organization Innovation Fund
- The Kingston Resuscitation Institute
- The University of Saskatchewan College of Medicine
This publication has 52 references indexed in Scilit:
- Reflection as a component of formative assessment appears to be instrumental in promoting the use of feedback; an observational studyMedical Teacher, 2013
- Effective feedback for maintenance of competence: from data delivery to trusting dialoguesCanadian Medical Association Journal, 2013
- Perspective: Viewing “Strugglers” Through a Different Lens: How a Self-Regulated Learning Perspective Can Help Medical Educators With Assessment and RemediationAcademic Medicine, 2011
- Competency-based medical education: implications for undergraduate programsMedical Teacher, 2010
- Formative assessment and self‐regulated learning: a model and seven principles of good feedback practiceStudies in Higher Education, 2006
- How can self‐regulated learning be supported in mathematical E‐learning environments?Journal of Computer Assisted Learning, 2006
- Self-regulated learning: Bridging the gap between metacognitive and metamotivation theoriesEducational Psychologist, 1995
- Feedback and Self-Regulated Learning: A Theoretical SynthesisReview of Educational Research, 1995
- Self-Regulated Learning and Academic Achievement: An OverviewEducational Psychologist, 1990
- The validity of licensure examinations.American Psychologist, 1982