A Machine Learning Framework for Predicting Failures in Cloud Data Centers -A case of Google Cluster -Azure Clouds and Alibaba Clouds
Preprint
- 12 September 2023
- preprint
- Published by Springer Nature in Research Square
Abstract
The large scale and dynamic nature of cloud has added extra complexity when it comes to fault detection and management. Availability directly depends upon how fast the cloud infrastructure can detect any faults and take necessary steps to troubleshoot the problem. It is critical for service providers to provide stable service or else it may cause losses for clients. It is important to detect a failure in its embryonic stages to employ preventive measures to avoid a disastrous failure before it occurs. Researchers have focused on pure-bred failure characterization and analysis machine learning models to enhance cloud failure prediction accuracy for large cloud data centers but limited research has been done with ensemble models. In this paper we develop an enhanced cloud failure prediction model based on Adaboost ensemble Machine Learning algorithms that predicts hardware and software failures using Google Cluster 2019, Azure Clouds and Alibaba clouds datasets. Our model employs ensemble classification using Logistic Regression, Random Forest Classifier and Decision Tree Classifier. Results indicate our approach recorded a marginal improvement in accuracy prediction compared with results from previous researchers in the area. Decision Tree yielded best average model performance results recording 91.7% Precision, 88.8% Recall, 89.7% F1 Score, 94.0% Accuracy and 89.0% AUC.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Ensemble Learning2021
- Failure mode and effects analysis of RC members based on machine-learning-based SHapley Additive exPlanations (SHAP) approachEngineering Structures, 2020
- Failure Analysis Modelling in an Infrastructure as a Service (Iaas) EnvironmentElectronic Notes in Theoretical Computer Science, 2018
- Performance prediction model for cloud service selection from smart dataFuture Generation Computer Systems, 2018
- Reliability and high availability in cloud computing environments: a reference roadmapHuman-centric Computing and Information Sciences, 2018
- Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud DatacentersProcedia Computer Science, 2018
- Predicting Application Failure in Cloud: A Machine Learning Approach2017