KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graph
Preprint
Abstract
Entity synonyms discovery is crucial for entity-leveraging applications. However, existing studies suffer from several critical issues: (1) the input mentions may be out-of-vocabulary (OOV) and may come from a different semantic space of the entities; (2) the connection between mentions and entities may be hidden and cannot be established by surface matching; and (3) some entities rarely appear due to the long-tail effect. To tackle these challenges, we facilitate knowledge graphs and propose a novel entity synonyms discovery framework, named \emph{KGSynNet}. Specifically, we pre-train subword embeddings for mentions and entities using a large-scale domain-specific corpus while learning the knowledge embeddings of entities via a joint TransC-TransE model. More importantly, to obtain a comprehensive representation of entities, we employ a specifically designed \emph{fusion gate} to adaptively absorb the entities' knowledge information into their semantic features. We conduct extensive experiments to demonstrate the effectiveness of our \emph{KGSynNet} in leveraging the knowledge graph. The experimental results show that the \emph{KGSynNet} improves the state-of-the-art methods by 14.7\% in terms of hits@3 in the offline evaluation and outperforms the BERT model by 8.3\% in the positive feedback rate of an online A/B test on the entity linking module of a question answering system.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Biomedical Entity Representations with Synonym Marginalization2020
- Learning unsupervised contextual representations for medical synonym discoveryJAMIA Open, 2019
- Mining Entity Synonyms with Efficient Neural Set GenerationProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Improving Natural Language Inference Using External Knowledge in the Science Questions DomainProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Enriching Word Vectors with Subword InformationTransactions of the Association for Computational Linguistics, 2017
- A method for named entity normalization in biomedical articles: application to diseases and plantsBMC Bioinformatics, 2017
- CNN-based ranking for biomedical entity normalizationBMC Bioinformatics, 2017
- GRIAS: An Entity-Relation Graph Based Framework for Discovering Entity Aliases2013
- DNorm: disease name normalization with pairwise learning to rankBioinformatics, 2013
- DBpedia - A crystallization point for the Web of DataJournal of Web Semantics, 2009