Classification Performance of Stacking Ensemble with Meta-Model of Categorical Principal Component Logistic Regression on Food Insecurity Data
Open Access
- 28 November 2024
- journal article
- Published by Universitas Negeri Semarang in Scientific Journal of Informatics
- Vol. 11 (4) , 1085-1098
Abstract
Purpose: Stacking is one type of ensemble whose base-models use different algorithms. The classification results from its base-models are categorical and tend to be associated with each other. They then become input for the stacking meta-model. However, there are no currently definite rules for determining the classifier that becomes the meta-model in stacking. On the other hand, recent research has found that CATPCA-LR can work well on categorical predictor variables associated with each other. Therefore, this study focuses on the classification performance of the stacking algorithm with the CATPCA-LR meta-model. Methods: The study compared the classification performance stacking with CATPCA-LR meta-model to stacking with other meta-models (random forest, gradient boost, and logistic regression) and its base-models (random forest, gradient boost, extreme gradient boost, extra trees, light gradient boost). This research used food insecurity data from March 2022. Result: The stacking algorithm with the CATPCA-LR meta-model performs better insecurity data regarding sensitivity, balanced accuracy, F1-Score, and G-Means values. This model offers a sensitivity of 46.28%, a balanced accuracy of 59.82%, an F1-Score of 37.82%, and a G-Means of 58.26%. Meanwhile, regarding specificity values, the light gradient boost (LGB) algorithm gives the highest value compared to other algorithms. This model provides a specificity value of 88.40%. Generally, the stacking with the CATPCA-LR meta-model algorithm provides the best performance compared with other algorithms on food insecurity data. Novelty: This research has explored a stacking classification performance with CATPCA-LR as meta-model.Keywords
This publication has 37 references indexed in Scilit:
- A review of ensemble learning and data augmentation models for class imbalanced problems: Combination, implementation and evaluationExpert Systems with Applications, 2023
- Application of supervised machine learning algorithms for classification and prediction of type-2 diabetes disease status in Afar regional state, Northeastern Ethiopia 2021Scientific Reports, 2023
- General Performance Score for classification problemsApplied Intelligence, 2022
- A meta-learning classification model for supporting decisions on energy efficiency investmentsEnergy and Buildings, 2022
- Relevant information undersampling to support imbalanced data classificationNeurocomputing, 2021
- Improved prediction of slope stability using a hybrid stacking ensemble method based on finite element analysis and field dataJournal of Rock Mechanics and Geotechnical Engineering, 2021
- Stacked generalization: an introduction to super learningEuropean Journal of Epidemiology, 2018
- Categorical Principal Component Logistic Regression: A Case Study for Housing Loan ApprovalProcedia - Social and Behavioral Sciences, 2014
- Nonlinear principal components analysis: Introduction and application.Psychological Methods, 2007
- Extremely randomized treesMachine Learning, 2006