Deep Reinforcement Learning Model for Stock Portfolio Management Based on Data Fusion
Open Access
- 17 March 2024
- journal article
- research article
- Published by Springer Nature in Neural Processing Letters
- Vol. 56 (2) , 1-24
Abstract
Deep reinforcement learning (DRL) can be used to extract deep features that can be incorporated into reinforcement learning systems to enable improved decision-making; DRL can therefore also be used for managing stock portfolios. Traditional methods cannot fully exploit the advantages of DRL because they are generally based on real-time stock quotes, which do not have sufficient features for making comprehensive decisions. In this study, in addition to stock quotes, we introduced stock financial indices as additional stock features. Moreover, we used Markowitz mean-variance theory for determining stock correlation. A three-agent deep reinforcement learning model called Collaborative Multi-agent reinforcement learning-based stock Portfolio management System (CMPS) was designed and trained based on fused data. In CMPS, each agent was implemented with a deep Q-network to obtain the features of time-series stock data, and a self-attention network was used to combine the output of each agent. We added a risk-free asset strategy to CMPS to prevent risks and referred to this model as CMPS-Risk Free (CMPS-RF). We conducted experiments under different market conditions using the stock data of China Shanghai Stock Exchange 50 and compared our model with the state-of-the-art models. The results showed that CMPS could obtain better profits than the compared benchmark models, and CMPS-RF was able to accurately recognize the market risk and achieved the best Sharpe and Calmar ratios. The study findings are expected to aid in the development of an efficient investment-trading strategy.Keywords
This publication has 38 references indexed in Scilit:
- A novel recurrent neural network based online portfolio analysis for high frequency tradingExpert Systems with Applications, 2023
- A hybrid approach to cardinality constraint portfolio selection problem based on nonlinear neural network and genetic algorithmExpert Systems with Applications, 2021
- Multi-agent reinforcement learning approach for hedging portfolio problemSoft Computing, 2021
- Quantum beetle antennae search: a novel technique for the constrained portfolio optimization problemScience China Information Sciences, 2021
- Modelling Stock Markets by Multi-agent Reinforcement LearningComputational Economics, 2020
- Intelligent trading of seasonal effects: A decision support algorithm based on reinforcement learningDecision Support Systems, 2014
- Regime-switching recurrent reinforcement learning for investment decision makingComputational Management Science, 2011
- Threshold Recurrent Reinforcement Learning Model for Automated TradingLecture Notes in Computer Science, 2010
- Making Financial Trading by Recurrent Reinforcement LearningLecture Notes in Computer Science, 2007
- Q-learningMachine Learning, 1992