Can physician examiners overcome their first impression when examinee performance changes?
Authors:
- 20 March 2018
- journal article
- research article
- Published by Springer Nature in Advances in Health Sciences Education
- Vol. 23 (4) , 721-732
Abstract
There is an increasing focus on factors that influence the variability of rater-based judgments. First impressions are one such factor. First impressions are judgments about people that are made quickly and are based on little information. Under some circumstances, these judgments can be predictive of subsequent decisions. A concern for both examinees and test administrators is whether the relationship remains stable when the performance of the examinee changes. That is, once a first impression is formed, to what degree will an examiner be willing to modify it? The purpose of this study is to determine the degree that first impressions influence final ratings when the performance of examinees changes within the context of an objective structured clinical examination (OSCE). Physician examiners (n = 29) viewed seven videos of examinees (i.e., actors) performing a physical exam on a single OSCE station. They rated the examinees’ clinical abilities on a six-point global rating scale after 60 s (first impression or FIGR). They then observed the examinee for the remainder of the station and provided a final global rating (GRS). For three of the videos, the examinees’ performance remained consistent throughout the videos. For two videos, examinee performance changed from initially strong to weak and for two videos, performance changed from initially weak to strong. The mean FIGR rating for the Consistent condition (M = 4.80) and the Strong to Weak condition (M = 4.87) were higher compared to their respective GRS ratings (M = 3.93, M = 2.73) with a greater decline for the Strong to Weak condition. The mean FIGR rating for the Weak to Strong condition was lower (3.60) than the corresponding mean GRS (4.81). This pattern of findings suggests that raters were willing to change their judgments based on examinee performance. Future work should explore the impact of making a first impression judgment explicit versus implicit and the role of context on the relationship between a first impression and a subsequent judgment.Keywords
Funding Information
- Medical Council of Canada (MCC-1/1314)
- Department of Medicine, University of Ottawa
This publication has 24 references indexed in Scilit:
- Rater cognition: review and integration of research findingsMedical Education, 2016
- Seeing the ‘black box’ differently: assessor cognition from three research perspectivesMedical Education, 2014
- Workplace-based assessment: raters’ performance theories and constructsAdvances in Health Sciences Education, 2012
- Rater-Based Assessments as Social Judgments: Rethinking the Etiology of Rater ErrorsAcademic Medicine, 2011
- Good questions, good answers: construct alignment improves the performance of workplace‐based assessment scalesMedical Education, 2011
- Workplace-based assessment: effects of rater expertiseAdvances in Health Sciences Education, 2010
- A thin slice perspective on the accuracy of first impressionsJournal of Research in Personality, 2007
- Toward a histology of social behavior: Judgmental accuracy from thin slices of the behavioral stream2000
- The effect of early performance on examinersʼ marking patterns during an oral examinationAcademic Medicine, 1996
- Attention Allocation and Impression FormationPersonality and Social Psychology Bulletin, 1991