Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 15663-15676
Abstract
Taolin Zhang, Ruyao Xu, Chengyu Wang, Zhongjie Duan, Cen Chen, Minghui Qiu, Dawei Cheng, Xiaofeng He, Weining Qian. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training for X-ray Diagnosis2023
- HORNET2021
- Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingACM Transactions on Computing for Healthcare, 2021
- KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language RepresentationTransactions of the Association for Computational Linguistics, 2021
- CokeBERT: Contextual knowledge selection and embedding towards enhanced pre-trained language modelsAI Open, 2021
- SG-Net: Syntax Guided Transformer for Language RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformatics, 2019
- CN-DBpedia: A Never-Ending Chinese Knowledge Extraction System2017
- On Statistical Characteristics of Real-Life Knowledge GraphsLecture Notes in Computer Science, 2016
- Dimensionality Reduction by Learning an Invariant Mapping2006