Three methods of multi-source feedback compared: A plea for narrative comments and coworkers’ perspectives
Authors:
- K. OvereemKOK. Overeem
- M.J.M.H. LombartsMLM.J.M.H. Lombarts
- O.A. ArahOAO.A. Arah
- N.S. KlazingaNKN.S. Klazinga
- R.P.T.M. GrolRGR.P.T.M. Grol
- H.C. WollersheimHWH.C. Wollersheim
- 1 January 2010
- journal article
- research article
- Published by Taylor & Francis in Medical Teacher
- Vol. 32 (2) , 141-147
Abstract
Background: Doctor performance assessments based on multi-source feedback (MSF) are increasingly central in professional self-regulation. Research has shown that simple MSF is often unproductive. It has been suggested that MSF should be delivered by a facilitator and combined with a portfolio. Aims: To compare three methods of MSF for consultants in the Netherlands and evaluate the feasibility, topics addressed and perceived impact upon clinical practice. Method: In 2007, 38 facilitators and 109 consultants participated in the study. The performance assessment system was composed of (i) one of the three MSF methods, namely, Violato's Physician Achievement Review (PAR), the method developed by Ramsey et al. for the American Board of Internal Medicine (ABIM), or the Dutch Appraisal and Assessment Instrument (AAI), (ii) portfolio, (iii) assessment interview with a facilitator and (iv) personal development plan. The evaluation consisted of a postal survey for facilitators and consultants. Generalized estimating equations were used to assess the association between MSF method used and perceived impact. Results: It takes on average 8 hours to conduct one assessment. The CanMEDS roles ‘collaborator’, ‘communicator’ and ‘manager’ were discussed in, respectively, 79, 74 and 71% of the assessment interviews. The ‘health advocate role’ was the subject of conversation in 35% of the interviews. Consultants are more satisfied with feedback that contains narrative comments. The perceived impact of MSF that includes coworkers’ perspectives significantly exceeds the perceived impact of methods not including this perspective. Conclusions: Performance assessments based on MSF combined with a portfolio and a facilitator-led interview seem to be feasible in hospital settings. The perceived impact of MSF increases when it contains coworkers’ perspectives.Keywords
This publication has 19 references indexed in Scilit:
- What do doctors really think about the relevance and impact of GP appraisal 3 years on? A survey of Scottish GPsBritish Journal of General Practice, 2008
- Doctor performance assessment in daily practise: does it help doctors or not? A systematic reviewMedical Education, 2007
- Workplace-based assessment as an educational tool: AMEE Guide No. 31Medical Teacher, 2007
- A best evidence systematic review of interprofessional education: BEME Guide no. 9Medical Teacher, 2007
- Physicians' assessment and competence: USA and UKThe Lancet, 2006
- A review of evaluation outcomes of web‐based continuing medical educationMedical Education, 2005
- EditorialCompetency-based assessment: making it a realityMedical Teacher, 2003
- The Value of Patient and Peer Ratings in RecertificationAcademic Medicine, 2002
- Changing physiciansʼ practicesAcademic Medicine, 1999
- The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.Psychological Bulletin, 1996