Enhancement of Named Entity Recognition in Low-Resource Languages with Data Augmentation and BERT Models: A Case Study on Urdu
Open Access
Abstract
Identifying and categorizing proper nouns in text, known as named entity recognition (NER), is crucial for various natural language processing tasks. However, developing effective NER techniques for low-resource languages like Urdu poses challenges due to limited training data, particularly in the nastaliq script. To address this, our study introduces a novel data augmentation method, “contextual word embeddings augmentation” (CWEA), for Urdu, aiming to enrich existing datasets. The extended dataset, comprising 160,132 tokens and 114,912 labeled entities, significantly enhances the coverage of named entities compared to previous datasets. We evaluated several transformer models on this augmented dataset, including BERT-multilingual, RoBERTa-Urdu-small, BERT-base-cased, and BERT-large-cased. Notably, the BERT-multilingual model outperformed others, achieving the highest macro F1 score of 0.982%. This surpassed the macro f1 scores of the RoBERTa-Urdu-small (0.884%), BERT-large-cased (0.916%), and BERT-base-cased (0.908%) models. Additionally, our neural network model achieved a micro F1 score of 96%, while the RNN model achieved 97% and the BiLSTM model achieved a macro F1 score of 96% on augmented data. Our findings underscore the efficacy of data augmentation techniques in enhancing NER performance for low-resource languages like Urdu.Keywords
Funding Information
- the Mexican Government (A1-S-47854, 20241816, 20,241,819, 20,240,951)
- The Secretaría de Investigación y Posgrado of the Instituto Politécnico Nacional, Mexico (A1-S-47854, 20241816, 20,241,819, 20,240,951)
- The Microsoft Latin America PhD Award (A1-S-47854, 20241816, 20,241,819, 20,240,951)
This publication has 27 references indexed in Scilit:
- Urdu Named Entity Recognition System Using Deep Learning ApproachesThe Computer Journal, 2022
- The impact of using different annotation schemes on named entity recognitionEgyptian Informatics Journal, 2021
- A survey on sentiment analysis in Urdu: A resource-poor languageEgyptian Informatics Journal, 2021
- Deep Learning-based Sentiment Analysis of Facebook Data: The Case of Turkish UsersThe Computer Journal, 2021
- A Korean named entity recognition method using Bi-LSTM-CRF and masked self-attentionComputer Speech & Language, 2021
- Named-Entity Recognition for Indonesian Language using Bidirectional LSTM-CNNsProcedia Computer Science, 2018
- Urdu language processing: a surveyArtificial Intelligence Review, 2016
- NERA: Named Entity Recognition for ArabicJournal of the American Society for Information Science and Technology, 2009
- A survey of named entity recognition and classification2007
- A system for supporting cross-lingual information retrievalInformation Processing & Management, 2000