Enhancing Cloud Service Failure Prediction Via Temporal Relationship Distillation
Authors:
- 13 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1061-1067
Abstract
Deep learning-based task failure prediction methods have achieved significant performance gains in ensuring high service reliability and availability at the core cloud by predicting task failure probability. With the increasing complexity of the deep-learning-based task failure prediction models, the number of service requests, and software and hardware failures, the ability to quickly detect and predict failures becomes essential for minimizing downtime and optimizing resource allocation. However, fast and lightweight deep learning-based task failure prediction models perform poorly in predicting failure occurrence probability compared to highly parameterized deep learning models. These failed tasks demand large amounts of resources, time, and cost to be recovered. Predicting task failure probabilities quickly before their occurrence with high accuracy may increase reliability and reduce wastage. Inspired by the aforementioned issue, we propose a knowledge distillation-based learning approach that empowers lightweight architectures to achieve improved performances during inference. The proposed approach leverages the representational capacity of the high-parameterized best-performing deep learning-based task failure prediction models considered by a teacher to the lightweight student. To extract the temporal pattern, we focus on a Bidirectional Long Short Term Memory (Bi-LSTM) based distillation approach where the teacher is the large and heavy architecture that transfers the predictive distribution as the regularization term to the tiny Bi-LSTM student network by analyzing past system message logs and identifying the relationship between the data and the failures. The proposed method achieves a state-of-the-art complexity-vs-accuracy trade-off in task failure prediction at the core cloud. Extensive experiments and ablation study depicts the superiority of our technique on large-scale standard benchmark dataset.Keywords
This publication has 10 references indexed in Scilit:
- Cloud failure prediction based on traditional machine learning and deep learningJournal of Cloud Computing, 2022
- Meta-heuristic Approaches for Effective Scheduling in Infrastructure as a Service Cloud: A Systematic ReviewJournal of Network and Systems Management, 2021
- DeepLog2017
- Predicting Application Failure in Cloud: A Machine Learning Approach2017
- Filling the Knowledge GapsThe Consultant Pharmacist, 2015
- Software-as-a-service (SaaS): perspectives and challengesScience China Information Sciences, 2014
- Failure prediction based on log files using Random Indexing and Support Vector MachinesJournal of Systems and Software, 2013
- Failure Prediction of Data Centers Using Time Series and Fault Tree Analysis2012
- An Approach to Forecasting QoS Attributes of Web Services Based on ARIMA and GARCH Models2012
- Predicting Disk Failures with HMM- and HSMM-Based Approaches2010