Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus
Open Access
- 29 April 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 21 (5) , 1-11
Abstract
Machine translation has been a major motivation of development in natural language processing. Despite the burgeoning achievements in creating more efficient machine translation systems, thanks to deep learning methods, parallel corpora have remained indispensable for progress in the field. In an attempt to create parallel corpora for the Kurdish language, in this article, we describe our approach in retrieving potentially alignable news articles from multi-language websites and manually align them across dialects and languages based on lexical similarity and transliteration of scripts. We present a corpus containing 12,327 translation pairs in the two major dialects of Kurdish, Sorani and Kurmanji. We also provide 1,797 and 650 translation pairs in English-Kurmanji and English-Sorani. The corpus is publicly available under the CC BY-NC-SA 4.0 license. 1Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Findings of the WMT 2019 Shared Task on Parallel Corpus Filtering for Low-Resource Conditions2019
- Parallel Corpus Filtering Based on Fuzzy String Matching2019
- Findings of the WMT 2018 Shared Task on Parallel Corpus Filtering2018
- BLARK for multi-dialect languages: towards the Kurdish BLARKLanguage Resources and Evaluation, 2017
- Kurdish Interdialect Machine Translation2017
- On the linguistic history of KurdishKurdish Studies, 2014
- Building a Test Collection for Sorani Kurdish2013
- Toward Computational Processing of Less Resourced Languages: Primarily Experiments for Moroccan Amazigh Language2012
- The Web as a Parallel CorpusComputational Linguistics, 2003
- Kurdish linguistics: a brief overviewSTUF - Language Typology and Universals, 2002