Comparative Evaluation of Statistical, Machine Learning, Deep Learning, and Bayesian Optimization Models for Predicting Crude Oil Production in Pakistan
Authors:
- Ghulam ZahraGZGhulam Zahra
- Hafiza Mamona NazirHNHafiza Mamona Nazir
- Syed Haroon AliSASyed Haroon Ali
- Yasir BashirYasir Bashir
- Noureen ShoukatNSNoureen Shoukat
Preprint
- 1 September 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Energy planning, policymaking, and economic stability depend on accurate crude oil production (COP) forecasts, especially in developing nations like Pakistan. Traditional linear forecasting methods are ineffective for COP time series due to nonlinearity, structural breakdowns, and regime-dependent dynamics. This research compares statistical, machine learning (ML), deep learning (DL), and Bayesian optimization (BO) models for COP forecasting. The article uses Pakistani monthly COP data from July 2005 to March 2024. Through the investigation of statistical models like ARIMA, SETAR, and State Space, a comprehensive forecasting framework has been created. Machine learning models including Random Forest (RF), XGBoost, and Extreme Learning Machine (ELM) were added, along with deep learning architectures like LSTM and Gated Recurrent Unit. RMSE, MAE, and MAPE were used to evaluate model performance for in-sample and out-of-sample forecasting. Deep learning models exceed most traditional and machine learning COP forecasters. N-HiTS had the lowest out-of-sample RMSE at 0.0459, followed by XGBoost at 0.0517 and SETAR at 0.0574. This research presents a consistent comparison methodology for COP prediction across statistics, machine learning, deep learning, and Bayesian optimization-enhanced models in energy forecasting. It offers advice on choosing feasible forecasting methods for nonlinear and data-constrained energy applications.Keywords
This publication has 18 references indexed in Scilit:
- A novel time-delay multivariable grey model and its application in predicting oil productionEngineering Applications of Artificial Intelligence, 2024
- Classical and machine learning modeling of crude oil production in Nigeria: Identification of an eminent model for applicationEnergy Reports, 2021
- A time series analysis of oil production, rig count and crude oil price: Evidence from six U.S. oil producing regionsEnergy, 2016
- Taking the Human Out of the Loop: A Review of Bayesian OptimizationProceedings of the IEEE, 2015
- Trade and energy consumption in the Middle EastEnergy Economics, 2011
- Extreme learning machines: a surveyInternational Journal of Machine Learning and Cybernetics, 2011
- Extreme learning machine: Theory and applicationsNeurocomputing, 2006
- Another look at measures of forecast accuracyInternational Journal of Forecasting, 2006
- Random ForestsMachine Learning, 2001
- Non-linear Time Series1990