MasterPlan: A Reinforcement Learning Based Scheduler for Archive Storage
Open Access
- 20 March 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 22 (1) , 1-25
Abstract
With the sheer volume of data in today’s world, archive storage systems play a significant role in persisting the cold data. Due to stringent cost concerns, one popular design is to organize disks into groups and periodically switch them to be powered on for serving user requests. Scheduling thus becomes critical for both CapEx and performance. Unfortunately, field results indicate that existing schedulers can be often suboptimal. Our further analysis suggests that the main reason is the mismatch between the ever-changing workloads and the fixed set of coarsely-configured parameters in current heuristic-based schedulers. In this article, we propose MasterPlan , a reinforcement learning (RL) based scheduler for archive storage systems. By identifying the unique characteristics of archive storage service, we design a state space and reward function for the RL agent. MasterPlan includes a continuous action encoding approach to guarantee efficient exploration, and a meta adaptation module to extract features of workload series. Experiments show that MasterPlan can achieve 1.25× throughput, 2.16× 99 th latency and 1.47× power draw improvement compared to existing solutions.Keywords
Funding Information
- Natural Science Foundation of China (62072306, 623B2072)
This publication has 14 references indexed in Scilit:
- Project Silica: Towards Sustainable Cloud Archival Storage in Glass2023
- A unified congestion control framework for diverse application preferences and network conditions2021
- Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network2019
- A general reinforcement learning algorithm that masters chess, shogi, and Go through self-playScience, 2018
- Deep Reinforcement Learning That MattersProceedings of the AAAI Conference on Artificial Intelligence, 2018
- Actor-critic reinforcement learning for tracking control in robotics2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Large-scale cluster management at Google with Borg2015
- Conflict-Oriented Windowed Hierarchical Cooperative A*2014
- Curriculum learning2009