Graph Neural Prompting with Large Language Models
Top Cited Papers
Open Access
- 24 March 2024
- journal article
- research article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 38 (17) , 19080-19088
Abstract
Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded knowledge. While existing work has explored utilizing knowledge graphs (KGs) to enhance language modeling via joint training and customized model architectures, applying this to LLMs is problematic owing to their large number of parameters and high computational cost. Therefore, how to enhance pre-trained LLMs using grounded knowledge, e.g., retrieval-augmented generation, remains an open question. In this work, we propose Graph Neural Prompting (GNP), a novel plug-and-play method to assist pre-trained LLMs in learning beneficial knowledge from KGs. GNP encompasses various designs, including a standard graph neural network encoder, a cross-modality pooling module, a domain projector, and a self-supervised link prediction objective. Extensive experiments on multiple datasets demonstrate the superiority of GNP on both commonsense and biomedical reasoning tasks across different LLM sizes and settings. Code is available at https://github.com/meettyj/GNP.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- LLMRec: Large Language Models with Graph Augmentation for Recommendation2024
- Unifying Large Language Models and Knowledge Graphs: A RoadmapIEEE Transactions on Knowledge and Data Engineering, 2024
- A Reusable Model-agnostic Framework for Faithfully Explainable Recommendation and System ScrutabilityACM Transactions on Information Systems, 2023
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing Surveys, 2023
- A Survey on Knowledge Graphs: Representation, Acquisition, and ApplicationsIEEE Transactions on Neural Networks and Learning Systems, 2021
- Improving Natural Language Inference Using External Knowledge in the Science Questions DomainProceedings of the AAAI Conference on Artificial Intelligence, 2019
- An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competitionBMC Bioinformatics, 2015
- The Unified Medical Language System (UMLS): integrating biomedical terminologyNucleic Acids Research, 2004
- A Learning Algorithm for Continually Running Fully Recurrent Neural NetworksNeural Computation, 1989