Character-based Joint Word Segmentation and Part-of-Speech Tagging for Tibetan Based on Deep Learning
Open Access
- 30 September 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 21 (5) , 1-15
Abstract
Tibetan word segmentation and POS tagging are the primary tasks of Tibetan natural language processing. Most of existing methods of Tibetan word segmentation and POS tagging are based on rules and statistics, which need manual construction of features. In addition, the joint mode has shown stronger capabilities for word segmentation and POS tagging and have received great interests. In this paper, we propose Bi-LSTM+IDCNN+CRF structures, a simple yet effective end-to-end neural network model, for joint Tibetan word segmentation and POS tagging. We conduct step-by-step and joint experiments on the Tibetan datasets. The results demonstrate that the performance of the Bi-LSTM+IDCNN+CRF model is the best regardless of the step-by-step or joint mode. We obtain state-of-the-art performance in the joint tagging mode. The F1 score of the word segmentation task reached 92.31%, and the F1 score of the POS tagging task reached 81.26%.Keywords
Funding Information
- National Key R&D Program of China (2020YFC0832500)
- Ministry of Education - China Mobile Research Foundation (MCM20170206)
- Fundamental Research Funds for the Central Universities (lzujbky-2019-kb51 and lzujbky-2018-k12)
- National Natural Science Foundation of China (61402210)
- Major National Project of High Resolution Earth Observation System (30-Y20A34-9010-15/17)
- State Grid Corporation of China Science and Technology Project (SGGSKY00WYJS2000062)
- Program for New Century Excellent Talents in University (NCET-12-0250)
- Strategic Priority Research Program of the Chinese Academy of Sciences (XDA03030100)
- Google Research Awards and Google Faculty Award, Science and Technology Plan of Qinghai Province (2020-GX-164)
This publication has 13 references indexed in Scilit:
- Bi-directional LSTM Recurrent Neural Network for Chinese Word Segmentation2016
- Transition-Based Neural Word Segmentation2016
- End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF2016
- A Transition-based Model for Joint Segmentation, POS-tagging and Normalization2015
- Tibetan Word Segmentation Based on Word-Position Tagging2013
- Long Short-Term Memory2012
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005
- Chinese word segmentation as LMR tagging2003
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998