Zakarya Erraji
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zakarya Erraji has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Abdessalam Bahafid
SI2M Labs, INSEA
4 shared publications - Imade Benelallam
SI2M Lab, INSEA, Rabat, Morocco
4 shared publications - Naira Abdou Mohamed
SI2M Lab, INSEA, Rabat, Morocco
3 shared publications - Anass Allak
SI2M Labs, INSEA
2 shared publications - Kamel Gaanoun
SI2M Labs, INSEA
2 shared publications - Abdou Mohamed Naira
INSEA Rabat Morocco
1 shared publication
Latest Publications
- 18 April 2025
- Published by Springer Nature
- p. 146-158
Machine Learning and NLP-Based Approach for Constraint Acquisition Problems
- 18 April 2025
- Published by Springer Nature
- p. 146-158
Machine Learning and NLP-Based Approach for Constraint Acquisition Problems
- 6 November 2024
- Published by Springer Nature in International Journal of Data Science and Analytics
- Vol. 20 (4) , 3513-3528
Multilingual speech recognition initiative for African languages
- 6 November 2024
- Published by Springer Nature in International Journal of Data Science and Analytics
- Vol. 20 (4) , 3513-3528
Multilingual speech recognition initiative for African languages
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 140-149
Datasets Creation and Empirical Evaluations of Cross-Lingual Learning on Extremely Low-Resource Languages: A Focus on Comorian Dialects
Abdou Mohamed Naira, Abdessalam Bahafid, Zakarya Erraji, Imade Benelallam. Proceedings of the 18th Linguistic Annotation Workshop (LAW-XVIII). 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 140-149
Open AccessDatasets Creation and Empirical Evaluations of Cross-Lingual Learning on Extremely Low-Resource Languages: A Focus on Comorian Dialects
Abdou Mohamed Naira, Abdessalam Bahafid, Zakarya Erraji, Imade Benelallam. Proceedings of the 18th Linguistic Annotation Workshop (LAW-XVIII). 2024.
- Open Access
- 28 December 2023
- Published by Springer Nature in Research Square
BantuLM: Enhancing Cross-Lingual Learning in the Bantu Language Family
This paper outlines methods for improving Bantu languages through the application of Natural Language Processing techniques. We trained a Large Language Model known as Bidirectional Encoder Representations from Transformers for the understanding of 18 Bantu languages. More precisely, we pre-trained the model using an unsupervised corpus obtained using pseudo-labeling. This pre-training task aims to comprehend the latent structures of these languages owing to an attention mechanism that enables a deeper understanding of the context. We then conducted various experiments on five downstream tasks: Language Identification, Sentiment Analysis, News Classification, Named Entity Recognition and Text Summarization. Finally, we proposed to test the effectiveness of using multilingualism in a few closely related languages instead of leveraging a vast amount of data and multiple languages that are not necessarily related. In fact, we conducted experiments on unseen languages belonging to the Bantu family and we found that the model demonstrates better ability understanding them due to their similarities to the languages used for pre-training.
- 28 December 2023
- Published by Springer Nature in Research Square
Open AccessBantuLM: Enhancing Cross-Lingual Learning in the Bantu Language Family
This paper outlines methods for improving Bantu languages through the application of Natural Language Processing techniques. We trained a Large Language Model known as Bidirectional Encoder Representations from Transformers for the understanding of 18 Bantu languages. More precisely, we pre-trained the model using an unsupervised corpus obtained using pseudo-labeling. This pre-training task aims to comprehend the latent structures of these languages owing to an attention mechanism that enables a deeper understanding of the context. We then conducted various experiments on five downstream tasks: Language Identification, Sentiment Analysis, News Classification, Named Entity Recognition and Text Summarization. Finally, we proposed to test the effectiveness of using multilingualism in a few closely related languages instead of leveraging a vast amount of data and multiple languages that are not necessarily related. In fact, we conducted experiments on unseen languages belonging to the Bantu family and we found that the model demonstrates better ability understanding them due to their similarities to the languages used for pre-training.