Comparing Diagnostic Accuracy of Radiologists versus GPT-4V and Gemini Pro Vision Using Image Inputs from Diagnosis Please Cases
Authors:
- Pae Sun SuhPSPae Sun Suh
- Woo Hyun ShimWSWoo Hyun Shim
- Chong Hyun SuhChong Hyun Suh
- Hwon HeoHHHwon Heo
- Chae Ri ParkCPChae Ri Park
- Hye Joung EomHEHye Joung Eom
- Kye Jin ParkKPKye Jin Park
- Jooae ChoeJCJooae Choe
- Pyeong Hwa KimPKPyeong Hwa Kim
- Hyo Jung ParkHyo Jung Park
- Yura AhnYAYura Ahn
- Ho Young ParkHPHo Young Park
Top Cited Papers
- 1 July 2024
- journal article
- research article
- Published by Radiological Society of North America (RSNA) in Radiology
- Vol. 312 (1) , e240273
Abstract
Using direct radiologic image inputs, two large language models, GPT-4V and Gemini Pro Vision, improved in diagnostic accuracy with increasing temperature settings; although GPT-4V slightly underperformed compared with radiologists, it nonetheless demonstrated promising potential as a supportive tool in diagnostic decision-making.Keywords
Funding Information
- National Research Foundation of Korea (NRF-2022R1I1A1A01072397)
This publication has 11 references indexed in Scilit:
- Capabilities of GPT-4 in ophthalmology: an analysis of model entropy and progress towards human-level medical question answeringBritish Journal of Ophthalmology, 2023
- Potential of ChatGPT and GPT-4 for Data Mining of Free-Text CT Reports on Lung CancerRadiology, 2023
- A Context-based Chatbot Surpasses Radiologists and Generic ChatGPT in Following the ACR Appropriateness GuidelinesRadiology, 2023
- Diagnostic Performance of ChatGPT from Patient History and Imaging Findings on the Diagnosis Please QuizzesRadiology, 2023
- Feasibility of Differential Diagnosis Based on Imaging Patterns Using a Large Language ModelRadiology, 2023
- How AI Responds to Common Lung Cancer Questions: ChatGPT versus Google BardRadiology, 2023
- Performance of ChatGPT on a Radiology Board-style Examination: Insights into Current Strengths and LimitationsRadiology, 2023
- Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language modelsPLOS Digital Health, 2023
- How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge AssessmentJMIR Medical Education, 2023
- Case 233: BlastomycosisRadiology, 2016