Is ChatGPT Ready to Write Scientific Case Reports Independently? A Comparative Evaluation Between Human and Artificial Intelligence
Open Access
- 23 May 2023
- journal article
- research article
- Published by Springer Nature in Cureus
- Vol. 15 (5) , e39386
Abstract
The use of artificial intelligence (AI) in scientific publishing has gained increased attention, and one AI tool that has been the subject of much discussion is ChatGPT. It is a large language model (LLM) built on the OpenAI platform that aims to emulate human-like writing and continually improves through user interactions. In this paper, ChatGPT's performance was assessed in medical publishing by comparing it to a case report written by oral and maxillofacial radiologists. ChatGPT was tasked with writing a case report based on a drafted report written by the authors in five different prompts. The findings of this study highlight issues related to the accuracy, completeness, and readability of the generated text. These results have significant implications for the future use of AI in scientific publishing and suggest that in the current iteration of ChatGPT, scientific information must be revised by an expert.Keywords
This publication has 9 references indexed in Scilit:
- Medical Literature Writing With ChatGPT: A Rare Case of Choriocarcinoma Syndrome With Hemorrhagic Brain Metastases Due to Burned Out Metastatic Mixed Testicular CancerCureus, 2023
- ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid ConcernsHealthcare, 2023
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- ChatGPT and the rise of generative AI: Threat to academic integrity?Journal of Responsible Technology, 2023
- Artificial Hallucinations in ChatGPT: Implications in Scientific WritingCureus, 2023
- Use of ChatGPT in Academic Publishing: A Rare Case of Seronegative Systemic Lupus Erythematosus in a Patient With HIV InfectionCureus, 2023
- The great Transformer: Examining the role of large language models in the political economy of AIBig Data & Society, 2021
- Introduction to Machine Learning, Neural Networks, and Deep Learning2020
- The Importance of Writing and Publishing Case Reports During Medical TrainingCureus, 2017