Reliability of peer and self‐assessment scores compared with trainers' scores following third molar surgery
Authors:
- 13 August 2007
- journal article
- research article
- Published by Wiley in Medical Education
- Vol. 41 (9) , 866-872
Abstract
Context It is sometimes claimed that self‐assessment is inaccurate and that clinicians over‐rate their performance. There is a need to find out why this should be. Is poor self‐assessment caused by some clinicians' inability to accurately judge performance? Or does over‐scoring result from a desire to convey a more favourable impression? Peer assessment is widely advocated and is said to be of benefit to both assessor and assessee. Methods In this study, we wanted to see if postgraduates were able to peer‐assess and if this form of assessment was more reliable than self‐assessment when compared with assessment by a trainer. We used checklist and global rating scales to evaluate surgical skills in removing a mandibular third molar tooth. Results There was no statistically significant difference between peer‐assessed and trainer‐assessed scores. We found that, on average, peer assessment (especially global rating scales) reflected trainer scores more accurately than self‐assessment of surgical skills. Self‐assessment scores were significantly higher on average than those given in peer assessment. Discussion Although peers and trainee surgeons came from the same group, the surgeons were more likely to over‐score when measuring their own performances. The greatest variability (and over‐scoring) between assessor and trainee surgeon appeared to occur in those with lower mean scores. Formative peer assessment may be a useful and less stressful mechanism for encouraging reflection.Keywords
This publication has 16 references indexed in Scilit:
- Self-Assessment in the Health Professions: A Reformulation and Research AgendaAcademic Medicine, 2005
- The influence of self-deception and impression management upon self-assessment in oral surgeryBritish Dental Journal, 2005
- Trainees' perspectives on the assessment and self‐assessment of surgical skillsAssessment & Evaluation in Higher Education, 2005
- Review of instruments for peer assessment of physiciansBMJ, 2004
- Clinical skills in junior medical officers: a comparison of self‐reported confidence and observed competenceMedical Education, 2004
- Objective assessment of technical skills in surgeryBMJ, 2003
- Evaluating web-based learning modules during an MSc programme in dental public health: a case studyBritish Dental Journal, 2002
- Assessment of surgeon competency to remove mandibular third molar teethInternational Journal of Oral and Maxillofacial Surgery, 2002
- Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments.Journal of Personality and Social Psychology, 1999
- Objective structured assessment of technical skill (OSATS) for surgical residentsBritish Journal of Surgery, 1997