Aman Varshney
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Aman Varshney has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Brian W. Anthony
Massachusetts Institute of Technology, Cambridge, USA
1 shared publication - Claire Novack
Department of Radiation Oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute , Boston, MA 02115
1 shared publication - Danielle S. Bitterman
Mass General Brigham, Boston, USA
1 shared publication David Kozono
Department of Radiation Oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute , Boston, MA 02115
1 shared publication- Dmitriy Dligach
Department of Computer Science, Loyola University Chicago, Chicago, IL, United States
1 shared publication - Elad Sharon
Dana Farber Cancer Institute, Boston, Massachusetts, United States
1 shared publication
Latest Publications
- Open Access
- 8 February 2025
- Published by Oxford University Press (OUP) in JNCI Cancer Spectrum
- Vol. 9 (2)
The use of large language models to enhance cancer clinical trial educational materials
Background: Adequate patient awareness and understanding of cancer clinical trials is essential for trial recruitment, informed decision making, and protocol adherence. Although large language models (LLMs) have shown promise for patient education, their role in enhancing patient awareness of clinical trials remains unexplored. This study explored the performance and risks of LLMs in generating trial-specific educational content for potential participants. Methods: Generative Pretrained Transformer 4 (GPT4) was prompted to generate short clinical trial summaries and multiple-choice question-answer pairs from informed consent forms from ClinicalTrials.gov. Zero-shot learning was used for summaries, using a direct summarization, sequential extraction, and summarization approach. One-shot learning was used for question-answer pairs development. We evaluated performance through patient surveys of summary effectiveness and crowdsourced annotation of question-answer pair accuracy, using held-out cancer trial informed consent forms not used in prompt development. Results: For summaries, both prompting approaches achieved comparable results for readability and core content. Patients found summaries to be understandable and to improve clinical trial comprehension and interest in learning more about trials. The generated multiple-choice questions achieved high accuracy and agreement with crowdsourced annotators. For both summaries and multiple-choice questions, GPT4 was most likely to include inaccurate information when prompted to provide information that was not adequately described in the informed consent forms. Conclusions: LLMs such as GPT4 show promise in generating patient-friendly educational content for clinical trials with minimal trial-specific engineering. The findings serve as a proof of concept for the role of LLMs in improving patient education and engagement in clinical trials, as well as the need for ongoing human oversight.
- 8 February 2025
- Published by Oxford University Press (OUP) in JNCI Cancer Spectrum
- Vol. 9 (2)
Open AccessThe use of large language models to enhance cancer clinical trial educational materials
Background: Adequate patient awareness and understanding of cancer clinical trials is essential for trial recruitment, informed decision making, and protocol adherence. Although large language models (LLMs) have shown promise for patient education, their role in enhancing patient awareness of clinical trials remains unexplored. This study explored the performance and risks of LLMs in generating trial-specific educational content for potential participants. Methods: Generative Pretrained Transformer 4 (GPT4) was prompted to generate short clinical trial summaries and multiple-choice question-answer pairs from informed consent forms from ClinicalTrials.gov. Zero-shot learning was used for summaries, using a direct summarization, sequential extraction, and summarization approach. One-shot learning was used for question-answer pairs development. We evaluated performance through patient surveys of summary effectiveness and crowdsourced annotation of question-answer pair accuracy, using held-out cancer trial informed consent forms not used in prompt development. Results: For summaries, both prompting approaches achieved comparable results for readability and core content. Patients found summaries to be understandable and to improve clinical trial comprehension and interest in learning more about trials. The generated multiple-choice questions achieved high accuracy and agreement with crowdsourced annotators. For both summaries and multiple-choice questions, GPT4 was most likely to include inaccurate information when prompted to provide information that was not adequately described in the informed consent forms. Conclusions: LLMs such as GPT4 show promise in generating patient-friendly educational content for clinical trials with minimal trial-specific engineering. The findings serve as a proof of concept for the role of LLMs in improving patient education and engagement in clinical trials, as well as the need for ongoing human oversight.