ChatGPT performance in answering medical residency questions in nephrology: a pilot study in Brazil
Authors:
- Helvécio Neves Feitosa FilhoHFHelvécio Neves Feitosa Filho
- João Filipe Cavalcante Uchoa FurtadoJFJoão Filipe Cavalcante Uchoa Furtado
- Eduardo Correia EulálioEEEduardo Correia Eulálio
- Pedro Vianna Caldas RibeiroPRPedro Vianna Caldas Ribeiro
- Lucas Macêdo Aurélio PaivaLPLucas Macêdo Aurélio Paiva
- Matheus Maia Gonçalves Bringel CorreiaMCMatheus Maia Gonçalves Bringel Correia
- Geraldo Bezerra da Silva JúniorGJGeraldo Bezerra da Silva Júnior
Open Access
- 1 December 2025
- journal article
- research article
- Published by FapUNIFESP (SciELO) in Brazilian Journal of Nephrology
- Vol. 47 (4) , e20240254
Abstract
Objective: This study evaluated the performance of ChatGPT 4 and 3.5 versions in answering nephrology questions from medical residency exams in Brazil.Keywords
This publication has 26 references indexed in Scilit:
- Performance of ChatGPT on Nephrology Test QuestionsClinical Journal of the American Society of Nephrology, 2023
- Bibliographic Research with ChatGPT may be Misleading: The Problem of HallucinationJournal of Pediatric Surgery, 2023
- GPT-4 Artificial Intelligence Model Outperforms ChatGPT, Medical Students, and Neurosurgery Residents on Neurosurgery Written Board-Like QuestionsWorld Neurosurgery, 2023
- Assessing the Accuracy of ChatGPT on Core Questions in Glomerular DiseaseKidney International Reports, 2023
- ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerationsFrontiers in Artificial Intelligence, 2023
- ChatGPT Is Equivalent to First-Year Plastic Surgery Residents: Evaluation of ChatGPT on the Plastic Surgery In-Service ExaminationAesthetic Surgery Journal, 2023
- Overview of Early ChatGPT’s Presence in Medical Literature: Insights From a Hybrid Literature Review by ChatGPT and Human ExpertsCureus, 2023
- ChatGPT, an Opportunity to Understand More About Language ModelsMedical Reference Services Quarterly, 2023
- ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid ConcernsHealthcare, 2023
- Artificial Hallucinations in ChatGPT: Implications in Scientific WritingCureus, 2023