Medical education with large language models in ophthalmology: custom instructions and enhanced retrieval capabilities
Open Access
- 7 May 2024
- journal article
- review article
- Published by BMJ in British Journal of Ophthalmology
- Vol. 108 (10) , 1354-1361
Abstract
Foundation models are the next generation of artificial intelligence that has the potential to provide novel use cases for healthcare. Large language models (LLMs), a type of foundation model, are capable of language comprehension and the ability to generate human-like text. Researchers and developers have been tuning LLMs to optimise their performance in specific tasks, such as medical challenge problems. Until recently, tuning required technical programming expertise, but the release of custom generative pre-trained transformers (GPTs) by OpenAI has allowed users to tune their own GPTs with natural language. This has the potential to democratise access to high-quality bespoke LLMs globally. In this review, we provide an overview of LLMs, how they are tuned and how custom GPTs work. We provide three use cases of custom GPTs in ophthalmology to demonstrate the versatility and effectiveness of these tools. First, we present ‘EyeTeacher’, an educational aid that generates questions from clinical guidelines to facilitate learning. Second, we built ‘EyeAssistant’, a clinical support tool that is tuned with clinical guidelines to respond to various physician queries. Lastly, we design ‘The GPT for GA’, which offers clinicians a comprehensive summary of emerging management strategies for geographic atrophy by analysing peer-reviewed documents. The review underscores the significance of custom instructions and information retrieval in tuning GPTs for specific tasks in ophthalmology. We also discuss the evaluation of LLM responses and address critical aspects such as privacy and accountability in their clinical application. Finally, we discuss their potential in ophthalmic education and clinical practice.Keywords
Funding Information
- the Fonds de recherche du Québec - Santé (NA)
- Moorfields Eye Charity (GR001474)
- Research England (MR/T019050/1)
This publication has 37 references indexed in Scilit:
- Complement inhibitors for the treatment of geographic atrophyThe Lancet, 2023
- Pegcetacoplan for the treatment of geographic atrophy secondary to age-related macular degeneration (OAKS and DERBY): two multicentre, randomised, double-masked, sham-controlled, phase 3 trialsThe Lancet, 2023
- Generative Artificial Intelligence Through ChatGPT and Other Large Language Models in OphthalmologyOphthalmology Science, 2023
- Efficacy and safety of avacincaptad pegol in patients with geographic atrophy (GATHER2): 12-month results from a randomised, double-masked, phase 3 trialThe Lancet, 2023
- Performance of an Upgraded Artificial Intelligence Chatbot for Ophthalmic Knowledge AssessmentJAMA Ophthalmology, 2023
- Evaluating large language models for use in healthcare: A framework for translational value assessmentInformatics in Medicine Unlocked, 2023
- Comparative analysis of large language models in the Royal College of Ophthalmologists fellowship examsEye, 2023
- AI-Generated Medical Advice—GPT and BeyondJAMA, 2023
- Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicineEBioMedicine, 2023
- Does Active Learning Work? A Review of the ResearchJournal of Engineering Education, 2004