MD Student Perceptions of ChatGPT for Reflective Writing Feedback in Undergraduate Medical Education
Open Access
- 23 July 2025
- journal article
- research article
- Published by MDPI AG in International Medical Education
- Vol. 4 (3) , 27
Abstract
At the Michael G. DeGroote School of Medicine, a significant component of the MD curriculum involves written narrative reflections on topics related to professional identity in medicine, with written feedback provided by their in-person longitudinal facilitators (LFs). However, it remains to be understood how generative artificial intelligence chatbots, such as ChatGPT (GPT-4), augment the feedback process and how MD students perceive feedback provided by ChatGPT versus the feedback provided by their LFs. In this study, 15 MD students provided their written narrative reflections along with the feedback they received from their LFs. Their reflections were input into ChatGPT (GPT-4) to generate instantaneous personalized feedback. MD students rated both modalities of feedback using a Likert-scale survey, in addition to providing open-ended textual responses. Quantitative analysis involved mean comparisons and t-tests, while qualitative responses were coded for themes and representational quotations. The results showed that while the LF-provided feedback was rated slightly higher in six out of eight survey items, these differences were not statistically significant. In contrast, ChatGPT scored significantly higher in helping to identify strengths and areas for improvement, as well as in providing actionable steps for improvement. Criticisms of ChatGPT included a discernible “AI tone” and paraphrasing or misuse of quotations from the reflections. In addition, MD students valued LF feedback for being more personal and reflective of the real, in-person relationships formed with LFs. Overall, findings suggest that although skepticism regarding ChatGPT’s feedback exists amongst MD students, it represents a viable avenue for deepening reflective practice and easing some of the burden on LFs.Keywords
This publication has 20 references indexed in Scilit:
- Developing residents’ feedback literacy in emergency medicine: Lessons from design‐based researchAEM Education and Training, 2023
- Using AI-generated suggestions from ChatGPT to optimize clinical decision supportJournal of the American Medical Informatics Association, 2023
- Assessment and feedback methods in competency-based medical educationAnnals of Allergy, Asthma & Immunology, 2022
- Recognizing Reflection: Computer-Assisted Analysis of First Year Medical Students’ Reflective WritingMedical Science Educator, 2020
- A Best Evidence in Medical Education systematic review to determine the most effective teaching methods that develop reflection in medical students: BEME Guide No. 51Medical Teacher, 2019
- The reflective zombie: Problematizing the conceptual framework of reflection in medical educationPerspectives on Medical Education, 2018
- Professional Identity FormationAcademic Medicine, 2015
- Assessing the quality of reflection in student journals: a review of the researchTeaching in Higher Education, 2011
- Reflecting on Reflections: Enhancement of Medical Education Curriculum With Structured Field Notes and Guided FeedbackAcademic Medicine, 2009
- The use of reflection in medical education: AMEE Guide No. 44Medical Teacher, 2009