A comparative analysis of student, educator, and simulated parent ratings of video-recorded medical student consultations in pediatrics
Open Access
- 17 February 2024
- journal article
- research article
- Published by Springer Nature in Advances in Simulation
- Vol. 9 (1) , 1-11
Abstract
Background: Simulation-based education (SBE) affords learners opportunities to develop communication skills, including those related to pediatrics. Feedback is an integral part of SBE, and while much research into feedback from multiple sources exists, the findings are mixed. The aim of this comparative study was to replicate some of this work in a novel area, pediatric medical education, to better understand how multisource feedback (self, educator, and simulated parent) may inform learning and curriculum design. Methods: During their pediatric rotation, medical students participated in a consultation with a simulated parent, engaged in video-assisted self-reflection, and received feedback from both an educator and the simulated parent through an e-learning platform. The Pediatric Consultation Skills Assessment Tool (PCAT) was used for self-assessment and educator feedback, and the Consultation and Relational Empathy (CARE) measure was used for simulated parent feedback. Results: Our results showed that high-performing students underrated their performance, and low-performing students overrated their performance. Feedback from multiple sources helps to identify both areas of weakness in student performance and areas of weakness in student self-appraisal. Overall, general areas of weakness identified for the learners related to making contingency plans and providing easy-to-understand explanations for simulated parents. Some simulated parent feedback did not align with educator and student ratings, highlighting the value of including the simulated parent perspective. Our findings question whether a third party can reliably judge the simulated parent’s level of understanding. Conclusion: Multisource feedback allows students to develop layered insights into their performance and supports self-appraisal. Aggregating feedback through an e-learning platform allows educators to gain greater insights into the strengths and weakness of students and design a more tailored teaching plan to support student needs.Keywords
Funding Information
- RCSI University of Medicine and Health Sciences
This publication has 26 references indexed in Scilit:
- Accuracy of Physician Self-assessment Compared With Observed Measures of CompetenceJAMA, 2006
- Not knowing that they do not know: self‐assessment accuracy of third‐year medical studentsMedical Education, 2006
- Self-Assessment in the Health Professions: A Reformulation and Research AgendaAcademic Medicine, 2005
- The Kappa Statistic in Reliability Studies: Use, Interpretation, and Sample Size RequirementsPhysical Therapy, 2005
- The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measureFamily Practice, 2004
- Improving the Interviewing and Self-Assessment Skills of Medical Students: Is it Time to Readopt Videotaping as an Educational Tool?Academic Pediatrics, 2004
- Difficulties in Recognizing Oneʼs Own IncompetenceAcademic Medicine, 2001
- Who should assess medical students' communication skills: their academic teachers or their patients?Medical Education, 1998
- Video recording feedback: a feasible and effective approach to teaching history‐taking and physical examination skills in undergraduate paediatric medicineMedical Education, 1998
- Televised paediatric consultations: a student evaluation of a multipurpose learning strategyMedical Education, 1990