“Could You Work in My Team?”: Exploring How Professional Clinical Role Expectations Influence Decision-Making of Assessors During Exit-Level Medical School OSCEs
Open Access
- 6 May 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Medicine
- Vol. 9, 844899
Abstract
Decision-making in clinical assessment, such as exit-level medical school Objective Structured Clinical Examinations (OSCEs), is complex. This study utilized an empirical phenomenological qualitative approach with thematic analysis to explore OSCE assessors' perceptions of the concept of a “prototypical intern” expressed during focus group discussions. Topics discussed included the concept of a prototypical intern, qualities to be assessed, and approaches to clinical assessment decision-making. The thematic analysis was then applied to a theoretical framework (Cultural Historical Activity Theory—CHAT) that explored the complexity of making assessment decisions amidst potentially contradicting pressures from academic and clinical perspectives. Ten Australasian medical schools were involved with 15 experienced and five less experienced assessors participating. Thematic analysis of the data revealed four major themes in relation to how the prototypical intern concept influences clinical assessors' judgements: (a) Suitability of marking rubric based on assessor characteristics and expectations; (b) Competence as final year student vs. performance as a prototypical intern; (c) Safety, trustworthiness and reliability as constructs requiring assessment and (d) Contradictions in decision making process due to assessor differences. These themes mapped well within the interaction between two proposed activity systems in the CHAT model: academic and clinical. More clinically engaged and more experienced assessors tend to fall back on a heuristic, mental construct of a “prototypical intern,” to calibrate judgements, particularly, in difficult situations. Further research is needed to explore whether consensus on desirable intern qualities and their inclusion into OSCE marksheets decreases the cognitive load and increases the validity of assessor decision making.Keywords
This publication has 53 references indexed in Scilit:
- Exploring the role of first impressions in rater-based assessmentsAdvances in Health Sciences Education, 2013
- Workplace-based assessment: raters’ performance theories and constructsAdvances in Health Sciences Education, 2012
- Heuristic Decision MakingAnnual Review of Psychology, 2011
- Students’ perceptions of patient safety during the transition from undergraduate to postgraduate training: an activity theory analysisAdvances in Health Sciences Education, 2010
- Workplace-based assessment: effects of rater expertiseAdvances in Health Sciences Education, 2010
- Naturalistic Decision MakingHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2008
- Undesired variance due to examiner stringency/leniency effect in communication skill scores assessed in OSCEsAdvances in Health Sciences Education, 2007
- Using thematic analysis in psychologyQualitative Research in Psychology, 2006
- Activity theory as a framework for analyzing and redesigning workErgonomics, 2000
- Confirmation Bias: A Ubiquitous Phenomenon in Many GuisesReview of General Psychology, 1998