Development of deep learning framework for complex pattern recognition in big data
Authors:
- Gulzhan MuratovaGMGulzhan Muratova
- Ainur JumagaliyevaAJAinur Jumagaliyeva
- Venera RystygulovaVRVenera Rystygulova
- Elmira AbdykerimovaEAElmira Abdykerimova
- Asset TurkmenbayevATAsset Turkmenbayev
- Bulat SerimbetovBSBulat Serimbetov
- Zauresh YersultanovaZYZauresh Yersultanova
- Gulzada OmarkulovaGOGulzada Omarkulova
Open Access
- 30 December 2025
- journal article
- Published by Private Company Technology Center in Eastern-European Journal of Enterprise Technologies
- Vol. 6 (9 (138)) , 54-66
Abstract
The object of this study is the process and analysis of intelligent recognition and classification of spatiotemporal patterns in large arrays of streaming data. The problem to be solved is the absence of a deep learning framework that can guarantee adaptability to rapidly changing concepts, efficient computation for continuous data streams, and the transparency of the prediction process when working with heterogeneous and dynamically changing sources of big data used to support decision making. The developed programing framework applies convolutional neural network- long short – term memory networks with an attention-gating mechanism that enables detection of spatiotemporal dependencies and exhibits model interpretation of decisions. Extensive evaluation of the implemented system using multivariate flow-based data demonstrated the performance capabilities of the system with a classification accuracy of 0.98, F1 score of 0.97, area under the receiver operating characteristic curve of 0.99 and Harmonic Score of 0.90. The interpretation of the results is summarized by the interaction of multilevel feature extraction followed by an optimization process through Kullback-Leibler divergence that ensures reliable online drift detection and automatic models re-training. Additional contributions of the systematic use of the framework included interpretable decisions using Shapley Additive explanations and gradient-weighted class activation mapping visualizations. It has a strong evidence of sustained reliable model performance in non-stationarity data conditions and streaming data. The outcome of this study embodies significant practical implications toward the creation of real-time decision-support systems in domains. Finally, the structured framework can also be utilized for future investigations into the development of highly scalable, explainable, and trust-worthy artificial intelligence architectures.Keywords
This publication has 17 references indexed in Scilit:
- Big Data and Artificial Intelligence in the Banking Industry2025
- Unleashing Environmental Intelligence Through AI, Image Processing, and Big Data: Paving the Path to a Sustainable Future2025
- The latest innovative avenues for the utilization of artificial Intelligence and big data analytics in water resource managementResults in Engineering, 2023
- Adventures in data analysis: a systematic review of Deep Learning techniques for pattern recognition in cyber-physical-social systemsMultimedia Tools and Applications, 2023
- Deep learning: Applications, architectures, models, tools, and frameworks: A comprehensive surveyCAAI Transactions on Intelligence Technology, 2023
- Using Machine Learning and Data Mining to Evaluate Modern Financial Management Techniques2022
- A systematic review on machine learning approaches for cardiovascular disease prediction using medical big dataMedical Engineering & Physics, 2022
- Big data, artificial intelligence and machine learning: A transformative symbiosis in favour of financial technologyEuropean Financial Management, 2022
- Application of machine learning, deep learning and optimization algorithms in geoengineering and geoscience: Comprehensive review and future challengeGondwana Research, 2022
- An overview of deep learning in big data, image, and signal processing in the modern digital age2021