ITO-ADAM OPTIMIZER FOR TRAINING LSTM NETWORKS: APPLICATION TO STOCK PRICE FORECASTING
Open Access
- 18 September 2025
- journal article
- Published by Academic Publications in International Journal of Applied Mathematics
- Vol. 38 (2s) , 433-445
Abstract
This study introduces ItoAdam, an enhanced optimizer that incorporates Itô’s lemma and Brownian noise into Adam to improve convergence in complex, non-convex settings. By perturbing gradient updates with stochastic noise, ItoAdam enables better exploration of the loss surface and avoids poor local minima. We apply ItoAdam to train Long Short-Term Memory (LSTM) networks for stock price forecasting across 13 major companies sourced from Yahoo Finance. Experiments show that ItoAdam-LSTM consistently outperforms Adam-LSTM across RMSE, MAE, and R², with sensitivity analysis indicating that optimal performance occurs when noise standard deviation lies between 2.1 × 10⁻⁴ and 2.9 × 10⁻⁴. Overall, results demonstrate the effectiveness of combining Itô-driven stochastic optimization, evolutionary hyperparameter tuning, and recurrent architectures for reliable financial time series forecasting in noisy and nonstationary environments.Keywords
This publication has 4 references indexed in Scilit:
- Time-series forecasting with deep learning: a surveyPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2021
- Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500European Journal of Operational Research, 2017
- Multilevel Monte Carlo Path SimulationOperations Research, 2008
- An Algorithmic Introduction to Numerical Simulation of Stochastic Differential EquationsSIAM Review, 2001