ChatGPT in Healthcare: A Taxonomy and Systematic Review
Authors:
Preprint
Abstract
The recent release of ChatGPT, a chat bot research project / product of natural language processing (NLP) by OpenAI, stirs up a sensation among both the general public and medical professionals, amassing a phenomenally large user base in a short time. This is a typical example of the ‘productization’ of cutting-edge technologies, which allows the general public without a technical background to gain firsthand experience in artificial intelligence (AI), similar to the AI hype created by AlphaGo (DeepMind Technologies, UK) and self-driving cars (Google, Tesla, etc.). However, it is crucial, especially for healthcare researchers, to remain prudent amidst the hype. This work provides a systematic review of existing publications on the use of ChatGPT in healthcare, elucidating the ‘status quo’ of ChatGPT in medical applications, for general readers, healthcare professionals as well as NLP scientists. The large biomedical literature database PubMed is used to retrieve published works on this topic using the keyword ‘ChatGPT’. An inclusion criterion and a taxonomy are further proposed to filter the search results and categorize the selected publications, respectively. It is found through the review that the current release of ChatGPT has achieved only moderate or ‘passing’ performance in a variety of tests, and is unreliable for actual clinical deployment, since it is not intended for clinical applications by design. We conclude that specialized NLP models trained on (bio)medical datasets still represent the right direction to pursue for critical clinical applications.Keywords
All Related Versions
- Published version: Computer Methods and Programs in Biomedicine, 245, 108013.
This publication has 80 references indexed in Scilit:
- Acute Pulmonary Edema After Hyperbaric Oxygen Treatment: A Case Report Written With ChatGPT AssistanceCureus, 2023
- Recurrent Strokes in a Patient With Metastatic Lung CancerCureus, 2023
- Pacemaker Malfunction in a Patient With Congestive Heart Failure and HypertensionCureus, 2023
- Analysis of large-language model versus human performance for genetics questionsmedRxiv, 2023
- AI bot ChatGPT writes smart essays — should professors worry?Nature, 2022
- BioGPT: generative pre-trained transformer for biomedical text generation and miningBriefings in Bioinformatics, 2022
- Natural Language Processing2020
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding2018
- Long Short-Term Memory2012
- Medicine and the ComputerNew England Journal of Medicine, 1970