ESCARGOT: an AI agent leveraging large language models, dynamic graph of thoughts, and biomedical knowledge graphs for enhanced reasoning
Authors:
Open Access
- 22 January 2025
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 41 (2)
Abstract
Motivation: LLMs like GPT-4, despite their advancements, often produce hallucinations and struggle with integrating external knowledge effectively. While Retrieval-Augmented Generation (RAG) attempts to address this by incorporating external information, it faces significant challenges such as context length limitations and imprecise vector similarity search. ESCARGOT aims to overcome these issues by combining LLMs with a dynamic Graph of Thoughts and biomedical knowledge graphs, improving output reliability, and reducing hallucinations. Result: ESCARGOT significantly outperforms industry-standard RAG methods, particularly in open-ended questions that demand high precision. ESCARGOT also offers greater transparency in its reasoning process, allowing for the vetting of both code and knowledge requests, in contrast to the black-box nature of LLM-only or RAG-based approaches. Availability and implementation: ESCARGOT is available as a pip package and on GitHub at: https://github.com/EpistasisLab/ESCARGOT.Keywords
Funding Information
- Center for AI Research and Education at Cedars-Sinai Medical Center
- National Institutes of Health USA (U01 AG066833, R01 LM014572, R01 LM010098)
This publication has 5 references indexed in Scilit:
- KRAGEN: a knowledge graph-enhanced RAG framework for biomedical problem solving using large language modelsBioinformatics, 2024
- The Alzheimer’s Knowledge Base: A Knowledge Graph for Alzheimer Disease ResearchJournal of Medical Internet Research, 2024
- Graph of Thoughts: Solving Elaborate Problems with Large Language ModelsProceedings of the AAAI Conference on Artificial Intelligence, 2024
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- Natural Language Interfaces to DataFoundations and Trends® in Databases, 2022