ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphs
Authors:
- 4 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 515-520
Abstract
ChatGPT, as a recently launched large language model (LLM), has shown superior performance in various natural language processing (NLP) tasks. However, two major limitations hinder its potential applications: 1) the inflexibility of finetuning on downstream tasks, and 2) the lack of interpretability in the decision-making process. To tackle these limitations, we propose a novel framework that leverages the power of ChatGPT for specific tasks, such as text classification, while improving its interpretability. The proposed framework conducts a knowledge graph extraction task to extract refined and structural knowledge from the raw data using ChatGPT. The rich knowledge is then converted into a graph, which is further used to train an interpretable linear classifier to make predictions. To evaluate the effectiveness of our proposed method, we conduct experiments on four benchmark datasets. The results demonstrate that our method can significantly improve the prediction performance compared to directly utilizing ChatGPT for text classification tasks. Furthermore, our method provides a more transparent decision-making process compared with previous text classification methods. The code is available at https://github.com/sycny/ChatGraph.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A SurveyACM Computing Surveys, 2023
- Putting ChatGPT’s Medical Advice to the (Turing) Test: Survey StudyJMIR Medical Education, 2023
- Is ChatGPT a General-Purpose Natural Language Processing Task Solver?2023
- Towards Making the Most of ChatGPT for Machine Translation2023
- Data-centric AI: Perspectives and Challenges2023
- Data Augmentation for Graph Neural NetworksProceedings of the AAAI Conference on Artificial Intelligence, 2021
- A Survey on Knowledge Graphs: Representation, Acquisition, and ApplicationsIEEE Transactions on Neural Networks and Learning Systems, 2021
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension2020
- Graph Convolutional Networks for Text ClassificationProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks2015