Is Deep-Learning and Natural Language Processing Transcending the Financial Forecasting? Investigation Through Lens of News Analytic Process
Open Access
- 22 July 2021
- journal article
- research article
- Published by Springer Nature in Computational Economics
- Vol. 60 (1) , 147-171
Abstract
This study tries to unravel the stock market prediction puzzle using the textual analytic with the help of natural language processing (NLP) techniques and Deep-learning recurrent model called long short term memory (LSTM). Instead of using count-based traditional sentiment index methods, the study uses its own sum and relevance based sentiment index mechanism. Hourly price data has been used in this research as daily data is too late and minutes data is too early for getting the exclusive effect of sentiments. Normally, hourly data is extremely costly and difficult to manage and analyze. Hourly data has been rarely used in similar kinds of researches. To built sentiment index, text analytic information has been parsed and analyzed, textual information that is relevant to selected stocks has been collected, aggregated, categorized, and refined with NLP and eventually converted scientifically into hourly sentiment index. News analytic sources include mainstream media, print media, social media, news feeds, blogs, investors’ advisory portals, experts’ opinions, brokers updates, web-based information, company’ internal news and public announcements regarding policies and reforms. The results of the study indicate that sentiments significantly influence the direction of stocks, on average after 3–4 h. Top ten companies from High-tech, financial, medical, automobile sectors are selected, and six LSTM models, three for using text-analytic and other without analytic are used. Every model includes 1, 3, and 6 h steps back. For all sectors, a 6-hour steps based model outperforms the other models due to LSTM specialty of keeping long term memory. Collective accuracy of textual analytic models is way higher relative to non-textual analytic models.Keywords
Funding Information
- Universität Osnabrück
This publication has 48 references indexed in Scilit:
- The application of artificial intelligence in auditing: Looking back to the futureExpert Systems with Applications, 2012
- Natural language processing: an introductionJournal of the American Medical Informatics Association, 2011
- Adapting centroid classifier for document categorizationExpert Systems with Applications, 2011
- Surveying stock market forecasting techniques – Part II: Soft computing methodsExpert Systems with Applications, 2009
- Maps of Bounded Rationality: Psychology for Behavioral EconomicsAmerican Economic Review, 2003
- Forecasting with artificial neural networks:International Journal of Forecasting, 1998
- A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural NetworksReview of Economics and Statistics, 1997
- Designing a neural network for forecasting financial and economic time seriesNeurocomputing, 1996
- A Comparison of Discriminant Analysis versus Artificial Neural NetworksJournal of the Operational Research Society, 1993
- Three models for the description of languageIEEE Transactions on Information Theory, 1956