Rethinking the Value of Gazetteer in Chinese Named Entity Recognition
Preprint
Abstract
Gazetteer is widely used in Chinese named entity recognition (NER) to enhance span boundary detection and type classification. However, to further understand the generalizability and effectiveness of gazetteers, the NLP community still lacks a systematic analysis of the gazetteer-enhanced NER model. In this paper, we first re-examine the effectiveness several common practices of the gazetteer-enhanced NER models and carry out a series of detailed analysis to evaluate the relationship between the model performance and the gazetteer characteristics, which can guide us to build a more suitable gazetteer. The findings of this paper are as follows: (1) the gazetteer improves most of the situations that the traditional NER model datasets are difficult to learn. (2) the performance of model greatly benefits from the high-quality pre-trained lexeme embeddings. (3) a good gazetteer should cover more entities that can be matched in both the training set and testing set.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Chinese Named Entity Recognition Augmented with Lexicon MemoryJournal of Computer Science and Technology, 2023
- DeepGCNs: Making GCNs Go as Deep as CNNsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- Weakly Supervised Sequence Tagging from Noisy RulesProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Rethinking Generalization of Neural Models: A Named Entity Recognition Case StudyProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources2020
- Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning2020
- FLAT: Chinese NER Using Flat-Lattice Transformer2020
- Soft Gazetteers for Low-Resource Named Entity Recognition2020
- Simplify the Usage of Lexicon in Chinese NER2020
- Chinese Word Segmentation and Named Entity Recognition: A Pragmatic ApproachComputational Linguistics, 2005