Beating the Stock Market with a Deep Reinforcement Learning Day Trading System
Authors:
- 1 July 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
In this study we investigate the potential of using Deep Reinforcement Learning (DRL) to day trade stocks, taking into account the constraints imposed by the stock market, such as liquidity, latency, slippage and transaction costs. More specifically, we use a Deep Deterministic Policy Gradient (DDPG) algorithm to solve a series of asset allocation problems in order to define the percentage of capital that must be invested in each asset at each period, executing exclusively day trade operations. DDPG is a model-free, off-policy actor-critic method that can learn policies in high-dimensional and continuous action and state spaces, like the ones normally found in financial market environments. The proposed day trading system was tested in B3 - Brazil Stock Exchange, an important and understudied market, especially considering the application of DRL techniques to alpha generation. A series of experiments were performed from the beginning of 2017 until the end of 2019 and compared with ten benchmarks, including Ibovespa, the most important Brazilian market index, and the stock portfolios suggested by the main Brazilian banks and brokers during these years. The results were evaluated considering return and risk metrics and showed that the proposed method outperformed the benchmarks by a huge margin. The best results obtained by the algorithm had a cumulative percentage return of 311% in three years, with an annual average maximum drawdown around 19%.Keywords
This publication has 20 references indexed in Scilit:
- An evolutionary trend reversion model for stock trading rule discoveryKnowledge-Based Systems, 2015
- Deep learning in neural networks: An overviewNeural Networks, 2015
- Intelligent trading of seasonal effects: A decision support algorithm based on reinforcement learningDecision Support Systems, 2014
- Forecasting S&P 500 index using artificial neural networks and design of experimentsJournal of Industrial Engineering International, 2013
- Testing Different Reinforcement Learning Configurations for Financial Trading: Introduction and ApplicationsProcedia Economics and Finance, 2012
- Neuro-dynamic trading methodsEuropean Journal of Operational Research, 2006
- Adaptive stock trading with dynamic asset allocation using reinforcement learningInformation Sciences, 2006
- An automated FX trading system using adaptive reinforcement learningExpert Systems with Applications, 2006
- Learning to trade via direct reinforcementIEEE Transactions on Neural Networks, 2001
- Foundations of Technical Analysis: Computational Algorithms, Statistical Inference, and Empirical ImplementationThe Journal of Finance, 2000