EntailE: Introducing Textual Entailment in Commonsense Knowledge Graph Completion
Preprint
Abstract
Commonsense knowledge graph completion is a new challenge for commonsense knowledge graph construction and application. In contrast to factual knowledge graphs such as Freebase and YAGO, commonsense knowledge graphs (CSKGs; e.g., ConceptNet) utilize free-form text to represent named entities, short phrases, and events as their nodes. Such a loose structure results in large and sparse CSKGs, which makes the semantic understanding of these nodes more critical for learning rich commonsense knowledge graph embedding. While current methods leverage semantic similarities to increase the graph density, the semantic plausibility of the nodes and their relations are under-explored. Previous works adopt conceptual abstraction to improve the consistency of modeling (event) plausibility, but they are not scalable enough and still suffer from data sparsity. In this paper, we propose to adopt textual entailment to find implicit entailment relations between CSKG nodes, to effectively densify the subgraph connecting nodes within the same conceptual class, which indicates a similar level of plausibility. Each node in CSKG finds its top entailed nodes using a finetuned transformer over natural language inference (NLI) tasks, which sufficiently capture textual entailment signals. The entailment relation between these nodes are further utilized to: 1) build new connections between source triplets and entailed nodes to densify the sparse CSKGs; 2) enrich the generalization ability of node representations by comparing the node embeddings with a contrastive loss. Experiments on two standard CSKGs demonstrate that our proposed framework EntailE can improve the performance of CSKG completion tasks under both transductive and inductive settings.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representation2022
- ComFact: A Benchmark for Linking Contextual Commonsense Knowledge2022
- Inductive Learning on Commonsense Knowledge Graph Completion2021
- Thinking Like a Skeptic: Defeasible Inference in Natural Language2020
- Commonsense reasoning and commonsense knowledge in artificial intelligenceCommunications of the ACM, 2015
- Freebase2008
- DBpedia: A Nucleus for a Web of Open Data2007
- Event structure in perception and conception.Psychological Bulletin, 2001
- WordNetCommunications of the ACM, 1995
- A preferential, pattern-seeking, Semantics for natural language inferenceArtificial Intelligence, 1975