A Novel Deep Reinforcement Learning Based Automated Stock Trading System Using Cascaded LSTM Networks
Preprint
Abstract
More and more stock trading strategies are constructed using deep reinforcement learning (DRL) algorithms, but DRL methods originally widely used in the gaming community are not directly adaptable to financial data with low signal-to-noise ratios and unevenness, and thus suffer from performance shortcomings. In this paper, to capture the hidden information, we propose a DRL based stock trading system using cascaded LSTM, which first uses LSTM to extract the time-series features from stock daily data, and then the features extracted are fed to the agent for training, while the strategy functions in reinforcement learning also use another LSTM for training. Experiments in DJI in the US market and SSE50 in the Chinese stock market show that our model outperforms previous baseline models in terms of cumulative returns and Sharp ratio, and this advantage is more significant in the Chinese stock market, a merging market. It indicates that our proposed method is a promising way to build a automated stock trading system.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- A graph-based CNN-LSTM stock price prediction algorithm with leading indicatorsMultimedia Systems, 2021
- Multi-DQN: An ensemble of Deep Q-learning agents for stock market forecastingExpert Systems with Applications, 2021
- A graph‐based convolutional neural network stock price prediction with leading indicatorsSoftware: Practice and Experience, 2020
- Improving financial trading decisions using deep Q-learning: Predicting the number of shares, action strategies, and transfer learningExpert Systems with Applications, 2019
- Deep learning with long short-term memory networks for financial market predictionsEuropean Journal of Operational Research, 2018
- An intelligent hybrid trading system for discovering trading rules for the futures market using rough sets and genetic algorithmsApplied Soft Computing, 2017
- Online Portfolio Selection Strategy Based on Combining Experts’ AdviceComputational Economics, 2016
- Human-level control through deep reinforcement learningNature, 2015
- Stock market prediction of S&P 500 via combination of improved BCO approach and BP neural networkExpert Systems with Applications, 2009
- A decision support system for the stock market through integration of fuzzy neural networks and fuzzy delphiApplied Artificial Intelligence, 1998