Accelerating Drug Repurposing with AI: The Role of Large Language Models in Hypothesis Validation
Preprint
Abstract
Drug repurposing accelerates drug discovery by identifying new therapeutic uses for existing drugs, but validating computational predictions remains a challenge. Large Language Models (LLMs) offer a potential solution by analyzing biomedical literature to assess drug-disease associations. This study evaluates four LLMs (GPT-4o, Claude-3, Gemini-2, and DeepSeek) using ten prompt strategies to validate repurposing hypotheses. The best-performing prompts and models were tested on 30 pathway-based cases and 10 benchmark cases. Results show that structured prompts enhance LLM accuracy, with GPT-4o and DeepSeek emerging as the most reliable models. Benchmark cases achieved significantly higher accuracy, precision, and F1-score (p < 0.001), while recall remained consistent across datasets. These findings highlight LLMs’ potential in drug repurposing validation while emphasizing the need for structured prompts and human oversight.Keywords
Funding Information
- The work is a result of the project Data-driven drug repositioning applying graph neural networks (3DR-GNN) that is being developed under grant PID2021-122659OB-I00 from the Spanish Ministry of Science and Innovation.
This publication has 16 references indexed in Scilit:
- The path forward for large language models in medicine is opennpj Digital Medicine, 2024
- Large language models in medical and healthcare fields: applications, advances, and challengesArtificial Intelligence Review, 2024
- Systematic analysis of ChatGPT, Google search and Llama 2 for clinical decision support tasksNature Communications, 2024
- Identifying patterns to uncover the importance of biological pathways on known drug repurposing scenariosBMC Genomics, 2024
- Few-shot learning for medical text: A review of advances, trends, and opportunitiesJournal of Biomedical Informatics, 2023
- Large language models in medicineNature Medicine, 2023
- Evaluating large language models for use in healthcare: A framework for translational value assessmentInformatics in Medicine Unlocked, 2023
- Drug repurposing: progress, challenges and recommendationsNature Reviews Drug Discovery, 2018
- Risk factors for the development of paclitaxel‐induced neuropathy in breast cancer patientsJournal of the Peripheral Nervous System, 2018
- gene2drug: a computational tool for pathway-based rational drug repositioningBioinformatics, 2017