Deep Reinforcement Learning for Trading
Authors:
Preprint
Abstract
We adopt Deep Reinforcement Learning algorithms to design trading strategies for continuous futures contracts. Both discrete and continuous action spaces are considered and volatility scaling is incorporated to create reward functions which scale trade positions based on market volatility. We test our algorithms on the 50 most liquid futures contracts from 2011 to 2019, and investigate how performance varies across different asset classes including commodities, equity indices, fixed income and FX markets. We compare our algorithms against classical time series momentum strategies, and show that our method outperforms such baseline models, delivering positive profits despite heavy transaction costs. The experiments show that the proposed algorithms can follow large market trends without changing positions and can also scale down, or hold, through consolidation periods.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Enhancing Time-Series Momentum Strategies Using Deep Neural NetworksThe Journal of Financial Data Science, 2019
- Universal features of price formation in financial markets: perspectives from deep learningQuantitative Finance, 2019
- DeepLOB: Deep Convolutional Neural Networks for Limit Order BooksIEEE Transactions on Signal Processing, 2019
- Deep learning with long short-term memory networks for financial market predictionsEuropean Journal of Operational Research, 2018
- A deep learning framework for financial time series using stacked autoencoders and long-short term memoryPLOS ONE, 2017
- Deep Direct Reinforcement Learning for Financial Signal Representation and TradingIEEE Transactions on Neural Networks and Learning Systems, 2016
- Testing Different Reinforcement Learning Configurations for Financial Trading: Introduction and ApplicationsProcedia Economics and Finance, 2012
- Stock trading with cycles: A financial application of ANFIS and reinforcement learningExpert Systems with Applications, 2011
- Learning to trade via direct reinforcementIEEE Transactions on Neural Networks, 2001
- Performance functions and reinforcement learning for trading systems and portfoliosJournal of Forecasting, 1998