Objectivity in subjectivity: do students’ self and peer assessments correlate with examiners’ subjective and objective assessment in clinical skills? A prospective study
Authors:
Open Access
Abstract
Objectives The qualitative subjective assessment has been exercised either by self-reflection (self-assessment (SA)) or by an observer (peer assessment (PA)) and is considered to play an important role in students’ development. The objectivity of PA and SA by students as well as those by faculty examiners has remained debated. This matters most when it comes to a high-stakes examination. We explored the degree of objectivity in PA, SA, as well as the global rating by examiners being Examiners’ Subjective Assessment (ESA) compared with Objective Structured Clinical Examinations (OSCE). Design Prospective cohort study. Setting Undergraduate medical students at Alfaisal University, Riyadh. Participants All second-year medical students (n=164) of genders, taking a course to learn clinical history taking and general physical examination. Main outcome measures A Likert scale questionnaire was distributed among the participants during selected clinical skills sessions. Each student was evaluated randomly by peers (PA) as well as by himself/herself (SA). Two OSCEs were conducted where students were assessed by an examiner objectively as well as subjectively (ESA) for a global rating of confidence and well-preparedness. OSCE-1 had fewer topics and stations, whereas OSCE-2 was terminal and full scale. Results OSCE-1 (B=0.10) and ESA (B=8.16) predicted OSCE-2 scores. ‘No nervousness’ in PA (r=0.185, p=0.018) and ‘confidence’ in SA (r=0.207, p=0.008) correlated with ‘confidence’ in ESA. In ‘well-preparedness’, SA correlated with ESA (r=0.234, p=0.003). Conclusions OSCE-1 and ESA predicted students’ performance in the OSCE-2, a high-stakes evaluation, indicating practical ‘objectivity’ in ESA, whereas SA and PA had minimal predictive role. Certain components of SA and PA correlated with ESA, suggesting partial objectivity given the limited objectiveness of ESA. Such difference in ‘qualitative’ objectivity probably reflects experience. Thus, subjective assessment can be used with some degree of objectivity for continuous assessment.Keywords
This publication has 23 references indexed in Scilit:
- A Comparison of Students’ Self-Assessments With Faculty Evaluations of Their Communication SkillsAmerican Journal of Pharmaceutical Education, 2013
- Reliability and validity of student peer assessment in medical education: A systematic reviewMedical Teacher, 2011
- Self-assessment or self deception? A lack of association between nursing students’ self-assessment and performanceJournal of Advanced Nursing, 2011
- Low Correlation between Subjective and Objective Measures of Knowledge on Surgery ClerkshipsJournal of the American College of Surgeons, 2010
- Relationships between student characteristics and self‐, peer and tutor evaluations of oral presentationsAssessment & Evaluation in Higher Education, 2008
- An analysis of peer, self, and tutor assessment in problem-based learning tutorialsMedical Teacher, 2007
- Self-Grading In Large General Education Classes: A Case StudyCollege Teaching, 2004
- Self-Efficacy Beliefs in Academic SettingsReview of Educational Research, 1996
- Self-assessment programs and their implications for health professions trainingAcademic Medicine, 1992
- A review of the validity and accuracy of self-assessments in health professions trainingAcademic Medicine, 1991