Impact of Hyperparameter Tuning on Machine Learning Models in Stock Price Forecasting
Open Access
- 8 December 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 163815-163830
Abstract
Stock price forecasting has been reported as a challenging task in the scientific and financial communities due to stock prices’ nonlinear and dynamic nature. Machine learning models exhibit capabilities that allow them to handle nonlinear data and be candidate tools for stock price forecasting. In this study, an empirical evaluation of eight conventional machine learning models’ is conducted to forecast the stock price of eleven companies belonging to the Saudi Stock Exchange. Moreover, the optimal configuration of hyperparameters in each machine learning model is identified. Forecasting performance is evaluated by two well-known error metrics: Root Mean Square Error (RMSE) and Mean Absolute Percentage Error (MAPE). Wilcoxson effect size is utilized to determine the impact of hyperparameter tuning by comparing tuned and un-tuned machine learning models’ forecasting performance. Empirical results indicate there are varying impacts of hyperparameter tuning of machine learning models in forecasting stock price. After tuning the hyperparameters, Support Vector Regression outperforms other forecasting models with a significant statistical difference. In contrast, Kernel Ridge Regression shows noteworthy forecasting performance without hyperparameter tuning with respect to other un-tuned forecasting models. However, Decision Tree and K-Nearest Neighbour are the poor-performing models which demonstrate inadequate forecasting performance even after hyperparameter tuning.Keywords
Funding Information
- King Fahd University of Petroleum and Minerals (KFUPM), Saudi Arabia
This publication has 51 references indexed in Scilit:
- Alpha Values as a Function of Sample Size, Effect Size, and Power: Accuracy over InferencePsychological Reports, 2013
- Making and Evaluating Point ForecastsJournal of the American Statistical Association, 2011
- A Comparison of Time Series Forecasting using Support Vector Machine and Artificial Neural Network ModelJournal of Applied Sciences, 2010
- A survey of cross-validation procedures for model selectionStatistics Surveys, 2010
- Technical analysis and the London stock exchange: testing the MACD and RSI rules using the FT30Applied Economics Letters, 2008
- A hybrid ARIMA and support vector machines model in stock price forecastingOmega, 2005
- Standard deviations and standard errorsBMJ, 2005
- An overview of statistical learning theoryIEEE Transactions on Neural Networks, 1999
- Multiple significance tests: the Bonferroni methodBMJ, 1995
- The TAME project: towards improvement-oriented software environmentsIEEE Transactions on Software Engineering, 1988