An Analytical Model-based Capacity Planning Approach for Building CSD-based Storage Systems
Open Access
- 11 September 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 23 (6) , 1-25
Abstract
The data movement in large-scale computing facilities (from compute nodes to data nodes) is categorized as one of the major contributors to high cost and energy utilization. To tackle it, in-storage processing (ISP) within storage devices, such as Solid-State Drives (SSDs), has been explored actively. The introduction of computational storage drives (CSDs) enabled ISP within the same form factor as regular SSDs and made it easy to replace SSDs within traditional compute nodes. With CSDs, host systems can offload various operations such as search, filter, and count. However, commercialized CSDs have different hardware resources and performance characteristics. Thus, it requires careful consideration of hardware, performance, and workload characteristics for building a CSD-based storage system within a compute node. Therefore, storage architects are hesitant to build a storage system based on CSDs as there are no tools to determine the benefits of CSD-based compute nodes to meet the performance requirements compared to traditional nodes based on SSDs. In this work, we proposed an analytical model-based storage capacity planner called CsdPlan for system architects to build performance-effective CSD-based compute nodes. Our model takes into account the performance characteristics of the host system, targeted workloads, and hardware and performance characteristics of CSDs to be deployed and provides optimal configuration based on the number of CSDs for a compute node. Furthermore, CsdPlan estimates and reduces the total cost of ownership (TCO) for building a CSD-based compute node. To evaluate the efficacy of CsdPlan , we selected two commercially available CSDs and four representative big data analysis workloads.Keywords
All Related Versions
Funding Information
- Institute for Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea Government (2021-0-00136)
This publication has 21 references indexed in Scilit:
- An Analysis of System Balance and Architectural Trends Based on Top500 Supercomputers2021
- Computational storage: an efficient and scalable platform for big data and HPC applicationsJournal of Big Data, 2019
- Optimizing the cost of DBaaS object placement in hybrid storage systemsFuture Generation Computer Systems, 2019
- Summarizer2017
- SSD in-storage computing for list intersection2016
- BiscuitACM SIGARCH Computer Architecture News, 2016
- Near-Data Processing: Insights from a MICRO-46 WorkshopIEEE Micro, 2014
- HybridPlan: a capacity planning technique for projecting storage requirements in hybrid storage systemsThe Journal of Supercomputing, 2013
- Amdahl’s Law2011
- MapReduceCommunications of the ACM, 2008