Imb-LLMClass: A Large Language Model-Based Framework for Imbalanced Text Classification
Open Access
- 25 August 2026
- journal article
- Published by SDU Journal of Natural and Applied Sciences in SDÜ Fen Bilimleri Enstitüsü Dergisi
- Vol. 30 (2) , 466-480
Abstract
Class imbalance constitutes a significant challenge in text classification tasks, particularly due to the insufficient representation of minority-class instances. Traditional machine learning methods trained on imbalanced datasets tend to exhibit a bias toward majority classes, thereby limiting their ability to accurately classify minority-class samples. To address this issue, this study proposes a classification framework, termed Imb-LLMClass, to investigate the effectiveness of large language model-based classification approaches for imbalanced text data. Experimental results demonstrate that the proposed Imb-LLMClass framework achieved the highest performance among the compared methods when evaluated based on the average of three experimental runs, attaining a Macro F1-Score of 0.878 and a Balanced Accuracy of 0.870 across three datasets. Furthermore, the increase in the average minority-class recall to 0.834 indicates that the proposed approach not only improves overall classification performance but also enhances the learning of underrepresented classes. These findings indicate that, in imbalanced text classification tasks, evaluating large language models solely based on overall performance metrics may be insufficient and that their ability to effectively represent minority classes should also be taken into consideration.Keywords
This publication has 18 references indexed in Scilit:
- Improving text classification on small-sized, imbalanced datasets with selective few-random-shot augmentationApplied Intelligence, 2026
- LLM-based data augmentation for text classification on imbalanced datasets: A case study on fake news detectionEgyptian Informatics Journal, 2026
- Addressing class imbalance in text classification with LLMs: A prompt-based GPT-2 approachJournal of Information Science, 2025
- A comprehensive evaluation of oversampling techniques for enhancing text classification performanceScientific Reports, 2025
- Semantics-based oversampling for imbalanced named entity recognition datasets using Word2Vec embeddingsIntelligent Data Analysis: An International Journal, 2025
- A review of intelligent data analysis: Machine learning approaches for addressing class imbalance in healthcare - challenges and perspectivesIntelligent Data Analysis: An International Journal, 2025
- ANALYZING THE IMPACT OF RESAMPLING METHOD FOR IMBALANCED DATA TEXT IN INDONESIAN SCIENTIFIC ARTICLES CATEGORIZATIONBACA: JURNAL DOKUMENTASI DAN INFORMASI, 2020
- The balancing trick: Optimized sampling of imbalanced datasets—A brief survey of the recent State of the ArtEngineering Reports, 2020
- The Balanced Accuracy and Its Posterior Distribution2010
- SMOTE: Synthetic Minority Over-sampling TechniqueJournal of Artificial Intelligence Research, 2002