Urdu Named Entity Recognition System Using Deep Learning Approaches
Authors:
- 23 April 2022
- journal article
- research article
- Published by Oxford University Press (OUP) in The Computer Journal
- Vol. 66 (8) , 1856-1869
Abstract
Named entity recognition (NER) is a fundamental part of other natural language processing tasks such as information retrieval, question answering systems and machine translation. Progress and success have already been achieved in research on the English NER systems. However, the Urdu NER system is still in its infancy due to the complexity and morphological richness of the Urdu language. Existing Urdu NER systems are highly dependent on manual feature engineering and word embedding to capture similarity. Their performance lags if the words are previously unknown or infrequent. The feature-based models suffer from complicated feature engineering and are often highly reliant on external resources. To overcome these limitations in this study, we present several deep neural approaches that automatically learn features from the data and eliminate manual feature engineering. Our extension involved convolutional neural network to extract character-level features and combine them with word embedding to handle out-of-vocabulary words. The study also presents a tweets dataset in Urdu, annotated manually for five named entity classes. The effectiveness of the deep learning approaches is demonstrated on four benchmarks datasets. The proposed method demonstrates notable progress upon current state-of-the-art NER approaches in Urdu. The results show an improvement of 6.26% in the F1 score.Keywords
Funding Information
- National Natural Science Foundation of China (61972455)
- Peiyang Young Scholars in Tianjin University (2019XRX-0032)
This publication has 21 references indexed in Scilit:
- Improving LSTM CRFs using character-based compositions for Korean named entity recognitionComputer Speech & Language, 2019
- Bidirectional Recurrent Neural Network Approach for Arabic Named Entity RecognitionFuture Internet, 2018
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Character-based Bidirectional LSTM-CRF with words and characters for Japanese Named Entity Recognition2017
- Named Entity Recognition with Bidirectional LSTM-CNNsTransactions of the Association for Computational Linguistics, 2016
- Urdu language processing: a surveyArtificial Intelligence Review, 2016
- Morphologically rich Urdu grammar parsing using Earley algorithmNatural Language Engineering, 2015
- Challenges of Urdu Named Entity Recognition: A Scarce Resourced LanguageqResearch Journal of Applied Sciences, Engineering and Technology, 2014
- Named entity recognition with multiple segment representationsInformation Processing & Management, 2013
- An Information-Extraction System for Urdu---A Resource-Poor LanguageACM Transactions on Asian Language Information Processing, 2010