Exploring the potential of artificial intelligence to enhance the writing of english academic papers by non-native english-speaking medical students - the educational application of ChatGPT
Top Cited Papers
Open Access
- 9 July 2024
- journal article
- research article
- Published by Springer Nature in BMC Medical Education
- Vol. 24 (1) , 1-8
Abstract
Background: Academic paper writing holds significant importance in the education of medical students, and poses a clear challenge for those whose first language is not English. This study aims to investigate the effectiveness of employing large language models, particularly ChatGPT, in improving the English academic writing skills of these students. Methods: A cohort of 25 third-year medical students from China was recruited. The study consisted of two stages. Firstly, the students were asked to write a mini paper. Secondly, the students were asked to revise the mini paper using ChatGPT within two weeks. The evaluation of the mini papers focused on three key dimensions, including structure, logic, and language. The evaluation method incorporated both manual scoring and AI scoring utilizing the ChatGPT-3.5 and ChatGPT-4 models. Additionally, we employed a questionnaire to gather feedback on students’ experience in using ChatGPT. Results: After implementing ChatGPT for writing assistance, there was a notable increase in manual scoring by 4.23 points. Similarly, AI scoring based on the ChatGPT-3.5 model showed an increase of 4.82 points, while the ChatGPT-4 model showed an increase of 3.84 points. These results highlight the potential of large language models in supporting academic writing. Statistical analysis revealed no significant difference between manual scoring and ChatGPT-4 scoring, indicating the potential of ChatGPT-4 to assist teachers in the grading process. Feedback from the questionnaire indicated a generally positive response from students, with 92% acknowledging an improvement in the quality of their writing, 84% noting advancements in their language skills, and 76% recognizing the contribution of ChatGPT in supporting academic research. Conclusion: The study highlighted the efficacy of large language models like ChatGPT in augmenting the English academic writing proficiency of non-native speakers in medical education. Furthermore, it illustrated the potential of these models to make a contribution to the educational evaluation process, particularly in environments where English is not the primary language.Keywords
Funding Information
- Fundamental Research Funds for the Central Universities (2023SCU12057)
- National Natural Science Foundation of China (32070671)
This publication has 34 references indexed in Scilit:
- RARPKB: A knowledge-guide decision support platform for personalized robot-assisted surgery in prostate cancerEuropean Urology, 2024
- ChatGPT in education: global reactions to AI innovationsScientific Reports, 2023
- Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5Journal of Academic Ophthalmology, 2023
- Large language models encode clinical knowledgeNature, 2023
- Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial IntelligenceJournal of Science Education and Technology, 2023
- Can ChatGPT pass the life support exams without entering the American heart association course?Resuscitation, 2023
- An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challengesBenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2022
- BioGPT: generative pre-trained transformer for biomedical text generation and miningBriefings in Bioinformatics, 2022
- Considering the possibilities and pitfalls of Generative Pre-trained Transformer 3 (GPT-3) in healthcare deliverynpj Digital Medicine, 2021
- Ethnic and Gender Differences in First-Year College Students’ Goal Orientation, Self-Efficacy, and Extrinsic and Intrinsic MotivationThe Journal of Educational Research, 2014