Prompt-based for Low-Resource Tibetan Text Classification
Author:
Open Access
- 24 August 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 22 (8) , 1-13
Abstract
Text classification is a critical and foundational task in Tibetan natural language processing, it plays a crucial role in various applications, such as sentiment analysis and information extraction. However, the limited availability of annotated data poses a significant challenge to Tibetan natural language processing. This paper proposes a prompt learning-based method for low-resource Tibetan text classification to overcome this challenge. This method utilizes pre-trained language models to learn text representation and generation capabilities on a large-scale unsupervised Tibetan corpus, enabling few-shot Tibetan text classification. Experimental results demonstrate that the proposed method significantly improves the performance of Tibetan text classification in low-resource scenarios. This work provides a new research idea and method for low-resource language processing, such as Tibetan natural language processing. Hopefully, it will inspire subsequent work on low-resource language processing.Keywords
Funding Information
- National Social Science Foundation of China (22BTQ010)
- National Natural Science Foundation of China (62076233)
- Innovation Project major research of Chinese Academy of Social Sciences (2022MZSQN001)
This publication has 19 references indexed in Scilit:
- A review on the attention mechanism of deep learningNeurocomputing, 2021
- Pre-trained models for natural language processing: A surveyScience China Technological Sciences, 2020
- Generalizing from a Few ExamplesACM Computing Surveys, 2020
- Research on Tibetan Text Classification Method Based on Neural Network2019
- Graph Convolutional Networks for Text ClassificationProceedings of the AAAI Conference on Artificial Intelligence, 2019
- End-to-End Neural Text Classification for Tibetan2017
- Deep Pyramid Convolutional Neural Networks for Text Categorization2017
- Word2VecNatural Language Engineering, 2016
- Tibetan Text Classification Based on the Feature of Position Weight2013
- Plant recolonization in the Himalaya from the southeastern Qinghai-Tibetan Plateau: Geographical isolation contributed to high population differentiationMolecular Phylogenetics and Evolution, 2010