Deep Neural Architecture Combining Frequency and Attention Mechanisms for Cloud CPU Usage Prediction
Authors:
Top Cited Papers
- 12 September 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 215-220
Abstract
This study addresses the key problem of CPU utilization prediction in cloud computing environments and proposes a time series modeling method based on an improved FedFormer. The research first analyzes the complexity of cloud workloads under high concurrency and dynamic fluctuations, and points out the limitations of traditional methods in handling nonlinear, non-stationary, and noisy data with insufficient accuracy and weak robustness. To address this issue, the proposed approach introduces an improved structure that integrates frequency-domain modeling with attention mechanisms. Global periodic patterns are extracted through the fast Fourier transform, while multi-head self-attention captures both local and long-range dependencies, enabling efficient modeling of CPU utilization sequences. A unified feature embedding and prediction framework is constructed, where raw time series data are transformed into high-dimensional representations at the input layer, and nonlinear mappings generate predictions in the output stage, optimized by the mean squared error loss function. In experimental design, the study conducts multidimensional validation, including hyperparameter sensitivity, environment sensitivity, and data sensitivity. The results show that the method maintains stable predictive performance in complex cloud computing scenarios and achieves higher accuracy and robustness than multiple baseline models. The findings enrich the methodological system of deep time series modeling in cloud computing and provide solid technical support for resource scheduling, load balancing, and performance optimization.Keywords
This publication has 16 references indexed in Scilit:
- Deep Skin Lesion Segmentation with Transformer-CNN Fusion: Toward Intelligent Skin Cancer Analysis2025
- A Reinforcement Learning-Driven Task Scheduling Algorithm for Multi-Tenant Distributed Systems2025
- Federated Graph Neural Networks for Heterogeneous Graphs with Data Privacy and Structural Consistency2025
- Behavioral Anomaly Detection in Distributed Systems via Federated Contrastive Learning2025
- Selective Knowledge Injection via Adapter Modules in Large-Scale Language Models2025
- Unsupervised Computer Vision for Aerospace Systems2025
- An effective deep learning architecture leveraging BIRCH clustering for resource usage prediction of heterogeneous machines in cloud data centerCluster Computing, 2024
- An Integrated Deep Learning Prediction Approach for Efficient Modelling of Host Load Patterns in Cloud ComputingJournal of Grid Computing, 2022
- An efficient forecasting approach for resource utilization in cloud data center using CNN-LSTM modelNeural Computing and Applications, 2021
- Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud DatacentersProcedia Computer Science, 2018