A tail-tolerant cloud storage scheduling based on precise periodicity detection
Open Access
- 23 May 2022
- journal article
- research article
- Published by Springer Nature in CCF Transactions on High Performance Computing
- Vol. 4 (3) , 321-338
Abstract
Cloud storage is a fundamental component of the cloud computing system, which significantly affects the overall performance and quality of service of the cloud. Cloud storage servers face the challenge of imbalanced workloads. According to our observations on the time series generated by cloud storage, we found that the imbalance workloads will dramatically increase the tail latency of data access in the multi-tenant scenario. The intuitive solution is to periodicity detect the imbalance storage nodes and re-balance the loads. However, there are four challenges to accurately detect load of storage in the cloud with multiple tenants since the load may change frequently in cloud. This paper proposes PrecisePeriod, a precise periodicity detection algorithm customized for multi-tenant cloud storage. It removes outliers through data preprocessing, employs the discrete wavelet transform to remove high-frequency noise while keeping frequency domain information, computes the candidate periodicity queue using the autocorrelation function, and determines precise period through periodicity verification. Then, we design a cloud storage load balancing scheduling strategy based on PrecisePeriod, and the evaluation shows that the PrecisePeriod scheduling significantly reduces tail latency while only bringing $$1-2\%$$ overhead.
Keywords
Funding Information
- the national key Research and Development Program of China (2019YFB1804502)
- NSFC (61872392)
- NSFC (61832020)
- the Major Program of Guangdong Basic and Applied Research (2019B030302002)
- the Program for Guangdong Introducing Innovative and Entrepreneurial Teams under Grant (2016ZT06D211)
- Guangdong Natural Science Foundation (2018B030312002)
This publication has 30 references indexed in Scilit:
- DRAW: A New Data-gRouping-AWare Data Placement Scheme for Data Intensive Applications with Interest Locality2014
- A Framework for Periodic Outlier Pattern Detection in Time-Series SequencesIEEE Transactions on Cybernetics, 2014
- Forecasting monthly and quarterly time series using STL decompositionInternational Journal of Forecasting, 2011
- CoHadoopProceedings of the VLDB Endowment, 2011
- A New Approach for Testing PeriodicityCommunications in Statistics - Theory and Methods, 2011
- A static data placement strategy towards perfect load-balancing for distributed storage clusters2008
- On Periodicity Detection and Structural Periodic Similarity2005
- File assignment in parallel I/O systems with minimal variance of service timeIEEE Transactions on Computers, 2000
- Different Discrete Wavelet Transforms Applied to Denoising Analytical DataJournal of Chemical Information and Computer Sciences, 1998
- A LIMITING PROPERTY OF SAMPLE AUTOCOVARIANCES OF PERIODICALLY CORRELATED PROCESSES WITH APPLICATION TO PERIOD DETERMINATIONJournal of Time Series Analysis, 1988