Reinforcement Learning in Multi-Asset Trading: Integrating Temporal-Frequency Features and Novel Risk-Adaptability Indices
Open Access
- 14 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 195016-195030
Abstract
Financial markets present a significant challenge for traditional trading models, which often fail to capture the complex, non-stationary nature of asset price movements. This study introduces a novel reinforcement learning (RL) framework designed to overcome these limitations by integrating signal processing with advanced AI. We enhance the state representation for RL agents by extracting temporal-frequency features from market data using the Short-Time Fourier Transform (STFT). We then conduct a rigorous comparative analysis of three leading RL algorithms—Deep Q-Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Proximal Policy Optimization (PPO)—across the diverse markets of gold, oil, and Bitcoin. To provide a more sophisticated evaluation of performance, we propose two novel metrics: the Robust Trading Strategy Score (RTSS), which balances profitability with downside risk, and the Market Adaptability Index (MAI), which measures an agent's ability to adapt its strategy to changing market dynamics. Our empirical results, validated by comprehensive statistical testing (MANOVA, Tukey’s HSD Test, and Kruskal-Wallis Test), demonstrate that the PPO agent consistently and significantly outperforms its counterparts in both profitability and risk-adjusted returns. This work provides a robust framework for developing next-generation, AI-driven trading systems and offers new tools for the rigorous evaluation of their performance.Keywords
This publication has 39 references indexed in Scilit:
- A survey on multi-agent reinforcement learning and its applicationJournal of Automation and Intelligence, 2024
- Deep deterministic policy gradient algorithm: A systematic reviewHeliyon, 2024
- Cryptocurrency Exchange SimulationComputational Economics, 2024
- A multi-agent reinforcement learning framework for optimizing financial trading strategies based on TimesNetExpert Systems with Applications, 2023
- Financial performance evaluation by multi-criteria decision-making techniquesHeliyon, 2022
- A shrinkage approach for Sharpe ratio optimal portfolios with estimation risksJournal of Banking & Finance, 2021
- Regime switching model estimation: spectral clustering hidden Markov modelAnnals of Operations Research, 2019
- Real‐Time Risk2017
- Balancing market exploration and market exploitation in product innovation: A contingency perspectiveInternational Journal of Research in Marketing, 2015
- How Markets Slowly Digest Changes in Supply and Demand2009