A Hybrid Deep Reinforcement Learning Approach for Algorithmic Trading in Commodity Futures Markets
Open Access
- 1 January 2025
- journal article
- Published by Wiley in Applied Computational Intelligence and Soft Computing
- Vol. 2025 (1)
Abstract
The financial markets have been affected extensively in recent years, due to algorithmic trading, predominantly concerning commodity futures. This research provides a novel hybrid approach combining classical machine learning algorithms (random forest) with modern deep reinforcement learning algorithms (deep Q‐network, proximal policy optimization, and soft actor–critic) for algorithmic trading in the commodity futures market. In contrast to prior investigations which mostly focus on equities, we applied this hybrid model to precious metals (gold) futures using a novel dataset of gold prices augmented with geopolitical risk indices, resulting in outstanding performance on financial risk metrics. The evaluation done suggests that the soft actor–critic agent modeled outshines conventional approaches (buy‐and‐hold and sell‐and‐hold) along with deep Q‐network and proximal policy optimization, in relation to cumulative profit, Sharpe ratio, maximum drawdown, and annualized volatility. Our results enhance the algorithmic trading methodology growth by supporting problem reduction commonly associated with classical trading techniques or approaches. This study provides significant value for traders and financial institutions intending to implement artificial intelligence in their cognitive trading strategies.Keywords
This publication has 29 references indexed in Scilit:
- A deep Q-learning based algorithmic trading system for commodity futures marketsExpert Systems with Applications, 2023
- A new crude oil futures forecasting method based on fusing quadratic forecasting with residual forecastingDigital Signal Processing, 2022
- Multi-type data fusion framework based on deep reinforcement learning for algorithmic tradingApplied Intelligence, 2022
- Gold volatility prediction using a CNN-LSTM approachExpert Systems with Applications, 2020
- Adaptive stock trading strategies with deep reinforcement learning methodsInformation Sciences, 2020
- Long-term prediction of the metals’ prices using non-Gaussian time-inhomogeneous stochastic processPhysica A: Statistical Mechanics and its Applications, 2020
- Combining wavelet decomposition with machine learning to forecast gold returnsInternational Journal of Forecasting, 2019
- Improving financial trading decisions using deep Q-learning: Predicting the number of shares, action strategies, and transfer learningExpert Systems with Applications, 2019
- Reinforcement learning applied to Forex tradingApplied Soft Computing, 2018
- A novel method based on numerical fitting for oil price trend forecastingApplied Energy, 2018