A Hybrid Ensemble Approach for Greek Text Classification Based on Multilingual Models
Open Access
- 14 October 2024
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 8 (10) , 137
Abstract
The present study explores the field of text classification in the Greek language. A novel ensemble classification scheme based on generated embeddings from Greek text made by the multilingual capabilities of the E5 model is presented. Our approach incorporates partial transfer learning by using pre-trained models to extract embeddings, enabling the evaluation of classical classifiers on Greek data. Additionally, we enhance the predictive capability while maintaining the costs low by employing a soft voting combination scheme that exploits the strengths of XGBoost, K-nearest neighbors, and logistic regression. This method significantly improves all classification metrics, demonstrating the superiority of ensemble techniques in handling the complexity of Greek textual data. Our study contributes to the field of natural language processing by proposing an effective ensemble framework for the categorization of Greek texts, leveraging the advantages of both traditional and modern machine learning techniques. This framework has the potential to be applied to other less-resourced languages, thereby broadening the impact of our research beyond Greek language processing.Keywords
This publication has 32 references indexed in Scilit:
- A Survey of Text Representation and Embedding Techniques in NLPIEEE Access, 2023
- A Survey on Text Classification: From Traditional to Deep LearningACM Transactions on Intelligent Systems and Technology, 2022
- k-Nearest Neighbour Classifiers - A TutorialACM Computing Surveys, 2021
- Building and evaluating resources for sentiment analysis in the Greek languageLanguage Resources and Evaluation, 2018
- XGBoost2016
- Extremely randomized treesMachine Learning, 2006
- Random ForestsMachine Learning, 2001
- Support-vector networksMachine Learning, 1995
- Ridge Estimators in Logistic RegressionJournal of the Royal Statistical Society Series C: Applied Statistics, 1992
- The Regression Analysis of Binary SequencesJournal of the Royal Statistical Society Series B: Statistical Methodology, 1958