The use of large language models to enhance cancer clinical trial educational materials
Authors:
- Mingye GaoMGMingye Gao
- Aman VarshneyAVAman Varshney
- Shan ChenSCShan Chen
- Vikram GoddlaVGVikram Goddla
- Jack GallifantJGJack Gallifant
- Patrick DoylePDPatrick Doyle
- Claire NovackCNClaire Novack
- Maeve Dillon-MartinMDMaeve Dillon-Martin
- Teresia PerkinsTPTeresia Perkins
- Xinrong CorreiaXCXinrong Correia
- Erik DuhaimeEDErik Duhaime
- Howard IsensteinHIHoward Isenstein
Preprint
Abstract
Cancer clinical trials often face challenges in recruitment and engagement due to a lack of participant-facing informational and educational resources. This study investigated the potential of Large Language Models (LLMs), specifically GPT4, in generating patient-friendly educational content from clinical trial informed consent forms. Using data from ClinicalTrials.gov, we employed zero-shot learning for creating trial summaries and one-shot learning for developing multiple-choice questions, evaluating their effectiveness through patient surveys and crowdsourced annotation. Results showed that GPT4-generated summaries were both readable and comprehensive, and may improve patients' understanding and interest in clinical trials. The multiple-choice questions demonstrated high accuracy and agreement with crowdsourced annotators. For both resource types, hallucinations were identified that require ongoing human oversight. The findings demonstrate the potential of LLMs "out-of-the-box" to support the generation of clinical trial education materials with minimal trial-specific engineering, but implementation with a human-in-the-loop is still needed to avoid misinformation risks.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- Perspectives on Artificial Intelligence–Generated Responses to Patient MessagesJAMA Network Open, 2024
- AI-Generated Clinical Summaries Require More Than AccuracyJAMA, 2024
- ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reportsEuropean Radiology, 2023
- Large Language Model−Based Chatbot vs Surgeon-Generated Informed Consent Documentation for Common ProceduresJAMA Network Open, 2023
- Use of Artificial Intelligence Chatbots for Cancer Treatment InformationJAMA Oncology, 2023
- Diversity in Clinical Trial Enrollment and Reporting—Where We Are and the Road AheadJAMA Cardiology, 2023
- Growth in eligibility criteria content and failure to accrue among National Cancer Institute (NCI)‐affiliated clinical trialsCancer Medicine, 2022
- Barriers for cancer clinical trial enrollment: A qualitative study of the perspectives of healthcare providersContemporary Clinical Trials Communications, 2022
- Audio-visual presentation of information for informed consent for participation in clinical trialsCochrane Database of Systematic Reviews, 2014
- Consent in clinical trials: What do patients know?Contemporary Clinical Trials, 2010