A comparison between machine and deep learning models on high stationarity data
Open Access
- 21 August 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-11
Abstract
Advances in sensor, computing, and communication technologies are enabling big data analytics by providing time series data. However, conventional models struggle to identify sequence features and forecast accuracy. This paper investigates time series features and shows that some machine learning algorithms can outperform deep learning models. In particular, the problem analyzed concerned predicting the number of vehicles passing through an Italian tollbooth in 2021. The dataset, composed of 8766 rows and 6 columns relating to additional tollbooths, proved to have high stationarity and was treated through machine learning methods such as support vector machine, random forest, and eXtreme gradient boosting (XGBoost), as well as deep learning through recurrent neural networks with long short-term memory (RNN-LSTM) cells. From the comparison of these models, the prediction through the XGBoost algorithm outperforms competing algorithms, particularly in terms of MAE and MSE. The result highlights how a shallower algorithm than a neural network is, in this case, able to obtain a better adaptation to the time series instead of a much deeper model that tends to develop a smoother prediction.Keywords
This publication has 54 references indexed in Scilit:
- Predictive modeling of physical and mechanical properties of pervious concrete using XGBoostNeural Computing and Applications, 2024
- XGBoost based residual life prediction in the presence of human error in maintenanceNeural Computing and Applications, 2022
- Linear support vector regression with linear constraintsMachine Learning, 2021
- Research on orthopedic auxiliary classification and prediction model based on XGBoost algorithmNeural Computing and Applications, 2019
- A new combined method for future energy forecasting in electrical networksInternational Transactions on Electrical Energy Systems, 2018
- Forecasting nonlinear time series with a hybrid methodologyApplied Mathematics Letters, 2009
- Predicting time series with support vector machines1997
- The Nature of Statistical Learning Theory1995
- Testing the null hypothesis of stationarity against the alternative of a unit rootJournal of Econometrics, 1992
- A logical calculus of the ideas immanent in nervous activityBulletin of Mathematical Biology, 1943