Comparative Analysis of Ensemble Machine Learning Models for Risk-Oriented Monitoring of Military Procurement
Open Access
- 28 February 2026
- journal article
- research article
- Published by MDPI AG in Journal of Risk and Financial Management
- Vol. 19 (3) , 170
Abstract
This study examines the application of ensemble machine learning methods for identifying and flagging potentially risky transactions in military public procurement in Ukraine, a sector characterized by elevated financial and security sensitivity and limited capacity for comprehensive ex post control. Using an integrated dataset of procurement procedures conducted between 2021 and 2025, enriched with 56 financial, economic, and behavioral indicators of suppliers, the study develops and compares standard logistic and LASSO-penalized regression as econometric benchmarks, Random Forest, XGBoost, XGBoost with SMOTE balancing, and CatBoost classification models. The target variable is defined on the basis of officially detected violations identified through state monitoring. Model performance is evaluated using standard binary classification metrics, with particular emphasis on recall. Model uncertainty and predictive robustness are addressed through partial dependence analysis, temporal stability assessment, and out-of-sample residual diagnostics. The results indicate that the CatBoost model demonstrates the most balanced performance across evaluation measures. Feature importance analysis identifies expected contract value, procurement method, CPV code, and suppliers’ financial capacity as significant determinants of procurement-related risk. The findings provide empirical evidence on the usefulness of risk-oriented machine learning tools in supporting earlier detection and monitoring of irregularities in military procurement.Keywords
This publication has 18 references indexed in Scilit:
- Artificial intelligence (AI) and machine learning (ML) in procurement and purchasing decision-support (DS): a taxonomic literature review and research opportunitiesArtificial Intelligence Review, 2025
- Assessing the value of artificial intelligence (AI) in governmental public procurementJournal of Public Procurement, 2025
- Methodology for automatic extraction of red flags in public procurement2023
- CatBoost for big data: an interdisciplinary reviewJournal of Big Data, 2020
- Corruption risk analysis using semi-supervised naïve Bayes classifiersInternational Journal of Reasoning-based Intelligent Systems, 2013
- Learning from Imbalanced DataIEEE Transactions on Knowledge and Data Engineering, 2009
- The Elements of Statistical Learning2009
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Random ForestsMachine Learning, 2001
- A preprocessing scheme for high-cardinality categorical attributes in classification and prediction problemsACM SIGKDD Explorations Newsletter, 2001