KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction
Authors:
Top Cited Papers
Open Access
- 25 April 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2778-2788
Abstract
Recently, prompt-tuning has achieved promising results for specific few-shot classification tasks. The core idea of prompt-tuning is to insert text pieces (i.e., templates) into the input and transform a classification task into a masked language modeling problem. However, for relation extraction, determining an appropriate prompt template requires domain expertise, and it is cumbersome and time-consuming to obtain a suitable label word. Furthermore, there exists abundant semantic and prior knowledge among the relation labels that cannot be ignored. To this end, we focus on incorporating knowledge among relation labels into prompt-tuning for relation extraction and propose a Knowledge-aware Prompt-tuning approach with synergistic optimization (KnowPrompt). Specifically, we inject latent knowledge contained in relation labels into prompt construction with learnable virtual type words and answer words. Then, we synergistically optimize their representation with structured constraints. Extensive experimental results on five datasets with standard and low-resource settings demonstrate the effectiveness of our approach. Our code and datasets are available in GitHub1 for reproducibility.Keywords
All Related Versions
Funding Information
- NSFC (91846204, U19B2027)
- National Key R&D Program of China (SQ2018YFC000004)
This publication has 44 references indexed in Scilit:
- Hybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation ClassificationProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Attention Guided Graph Convolutional Networks for Relation Extraction2019
- Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks2019
- Graph Convolution over Pruned Dependency Trees Improves Relation Extraction2018
- Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction2018
- FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation2018
- Position-aware Attention and Supervised Data Improve Slot Filling2017
- Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification2016
- Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks2015
- Learning information extraction patterns from examples1996