Lightweight Ensemble Models for Static Malware Detection: AddressingDeep Learning Trade-Offs with the Kaggle PE Dataset
Open Access
- 28 July 2025
- journal article
- Published by CV Cendekia Publisher in IJACI : International Journal of Advanced Computing and Informatics
- Vol. 2 (1) , 21-33
Abstract
Static malware detection plays a crucial role in cybersecurity by enabling the identification of malicious files without the need to execute them. This study explores the effectiveness of lightweight ensemble models as an efficient and interpretable alternative to deep learning approaches. Using the Kaggle PE Malware Dataset, eight classifiers including Random Forest, Extra Trees, Gradient Boosting, LightGBM, XGBoost, CatBoost, HistGradientBoosting, and Multilayer Perceptron were evaluated, with a one-dimensional Convolutional Neural Network serving as a performance benchmark. To address class imbalance, three oversampling methods were applied separately, namely Synthetic Minority Oversampling Technique, Adaptive Synthetic Sampling, and SMOTE combined with Edited Nearest Neighbors. The dataset was normalized, and SelectKBest was used to select the 20 most informative features. All models were tuned using the Optuna framework to ensure optimal performance. Experimental results showed that the Voting Classifier achieved perfect accuracy, precision, recall, and F1-score on the validation set when trained with SMOTE and the full feature set and retained nearly identical results using only the top 20 features. While the CNN baseline required more computational resources, it did not outperform the optimized ensemble models. Furthermore, SHAP analysis provided insights into feature importance and improved interpretability. These findings confirm that lightweight ensemble classifiers are a practical and effective solution for static malware detection, offering high accuracy, fast inference, and greater transparency, which makes them suitable for deployment in environments with limited computing capacity.Keywords
This publication has 18 references indexed in Scilit:
- Efficient Malware Detection with Optimized Learning on High-Dimensional Features2025
- Machine Learning for Detecting Malware in PE Files2023
- MALWARE DETECTION BASED ON OPCODE FREQUENCYProblems of Information Technology, 2023
- Malware Detection Using LightGBM With a Custom Logistic Loss FunctionIEEE Access, 2022
- Generating the Blood Exposome Database Using a Comprehensive Text Mining and Database Fusion ApproachEnvironmental Health Perspectives, 2019
- LightGBM: an Effective Decision Tree Gradient Boosting Method to Predict Customer Loyalty in the Finance Industry2019
- XGBoost2016
- A Hybrid Data Mining Approach for Intrusion Detection on Imbalanced NSL-KDD DatasetInternational Journal of Advanced Computer Science and Applications, 2016
- Ensemble based systems in decision makingIEEE Circuits and Systems Magazine, 2006
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001