Exploring Radiology Postgraduate Students' Engagement with Large Language Models for Educational Purposes: A Study of Knowledge, Attitudes, and Practices
Open Access
- 19 July 2024
- journal article
- research article
- Published by Georg Thieme Verlag KG in Indian Journal of Radiology and Imaging
- Vol. 35 (01) , 035-042
Abstract
Background The integration of large language models (LLMs) into medical education has received increasing attention as a potential tool to enhance learning experiences. However, there remains a need to explore radiology postgraduate students' engagement with LLMs and their perceptions of their utility in medical education. Hence, we conducted this study to investigate radiology postgraduate students' knowledge, attitudes, and practices regarding LLMs in medical education. Materials and Methods A cross-sectional quantitative survey was conducted online on Google Forms. Participants from all over India were recruited via social media platforms and snowball sampling techniques. A previously validated questionnaire was used to assess knowledge, attitude, and practices regarding LLMs. Descriptive statistical analysis was employed to summarize participants' responses. Results A total of 252 (139 [55.16%] males and 113 [44.84%] females) radiology postgraduate students with a mean age of 28.33 ± 3.32 years participated in the study. The majority of the participants (47.62%) were familiar with LLMs with their potential incorporation with traditional teaching–learning tools (71.82%). They are open to including LLMs as a learning tool (71.03%) and think that it would provide comprehensive medical information (62.7%). Residents take the help of LLMs when they do not get the desired information from books (46.43%) or Internet search engines (59.13%). The overall score of knowledge (3.52 ± 0.58), attitude (3.75 ± 0.51), and practice (3.15 ± 0.57) were statistically significantly different (analysis of variance [ANOVA], p < 0.0001), with the highest score in attitude and lowest in practice. However, no significant differences were found in the scores for knowledge (p = 0.64), attitude (p = 0.99), and practice (p = 0.25) depending on the year of training. Conclusion Radiology postgraduate students are familiar with LLM and recognize the potential benefits of LLMs in postgraduate radiology education. Although they have a positive attitude toward the use of LLMs, they are concerned about its limitations and use it only in limited situations for educational purposes.Keywords
This publication has 24 references indexed in Scilit:
- Response Generated by Large Language Models Depends on the Structure of the PromptIndian Journal of Radiology and Imaging, 2024
- Clinical Radiology: Past, Present, and Future—Whither are We Going?Indian Journal of Radiology and Imaging, 2024
- Assessing radiologists’ and radiographers’ perceptions on artificial intelligence integration: opportunities and challengesBritish Journal of Radiology, 2024
- AI in medical education: medical student perception, curriculum recommendations and design suggestionsBMC Medical Education, 2023
- The Role of Large Language Models in Medical Education: Applications and ImplicationsJMIR Medical Education, 2023
- A Context-based Chatbot Surpasses Radiologists and Generic ChatGPT in Following the ACR Appropriateness GuidelinesRadiology, 2023
- Feasibility of Differential Diagnosis Based on Imaging Patterns Using a Large Language ModelRadiology, 2023
- Evaluating GPT as an Adjunct for Radiologic Decision Making: GPT-4 Versus GPT-3.5 in a Breast Imaging PilotJournal of the American College of Radiology, 2023
- Performance of ChatGPT on a Radiology Board-style Examination: Insights into Current Strengths and LimitationsRadiology, 2023
- Large Language Models in Medical Education: Opportunities, Challenges, and Future DirectionsJMIR Medical Education, 2023