Self-Other Agreement in Multisource Feedback: The Influence of Doctor and Rater Group Characteristics
Authors:
- Martin J. RobertsMRMartin J. Roberts
- John L. CampbellJCJohn L. Campbell
- Suzanne H. RichardsSRSuzanne H. Richards
- Christine WrightCWChristine Wright
- 1 January 2013
- journal article
- research article
- Published by Wolters Kluwer Health in Journal of Continuing Education in the Health Professions
- Vol. 33 (1) , 14-23
Abstract
Gs have received little attention. We aimed to identify the characteristics of doctors and their rater groups that affect self-other agreement in MSF ratings. Methods: We invited 2454 doctors to obtain patient and colleague feedback using the UK General Medical Council's MSF questionnaires and to self-assess on core items from both patient (PQ) and colleague (CQ) questionnaires. Correlations and differences between doctor, patient and colleague mean feedback scores were examined. Regression analyses identified the characteristics of doctors and their rater groups that influenced self-other score agreement. Results: 1065 (43%) doctors returned at least one questionnaire, of whom 773 (73%) provided self and patient PQ scores and 1026 (96%) provided self and colleague CQ scores. Most doctors rated themselves less favourably than they were rated by either their patients or their colleagues. This tendency to underrate performance in comparison to external feedback was influenced by the doctor's place of training, clinical specialty, ethnicity and the profile of his/her patient and colleague rater samples but, in contrast to studies undertaken in nonmedical settings, was unaffected by age or gender. Discussion: Self-other agreement in MSF ratings is influenced by characteristics of both raters and ratees. Managers, appraisers, and others responsible for interpreting and reviewing feedback results with the doctor need to be aware of these influences....Keywords
This publication has 38 references indexed in Scilit:
- Perceptions, attitudes, and beliefs of staff anaesthetists related to multi-source feedback used for their performance appraisalBritish Journal of Anaesthesia, 2011
- Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processesAdvances in Health Sciences Education, 2011
- How Do Physicians Assess Their Family Physician Colleagues' Performance? Creating a Rubric to Inform Assessment and FeedbackJournal of Continuing Education in the Health Professions, 2011
- 360-Degree Physician Performance AssessmentWorld Health & Population, 2010
- State of the science in health professional education: effective feedbackMedical Education, 2009
- “I'll never play professional football” and other fallacies of self-assessmentJournal of Continuing Education in the Health Professions, 2008
- Accuracy of Physician Self-assessment Compared With Observed Measures of CompetenceJAMA, 2006
- Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7Medical Teacher, 2006
- Self-Assessment in the Health Professions: A Reformulation and Research AgendaAcademic Medicine, 2005
- A review of the validity and accuracy of self-assessments in health professions trainingAcademic Medicine, 1991