An Analytical Model-based Capacity Planning Approach for Building CSD-based Storage Systems
Authors:
- Hongsu ByunHBHongsu Byun
- Safdar JamilSJSafdar Jamil
- Jungwook HanJHJungwook Han
- Sungyong ParkSungyong Park
- Myungcheol LeeMLMyungcheol Lee
- Changsoo KimCKChangsoo Kim
- Beongjun ChoiBCBeongjun Choi
- Youngjae KimYKYoungjae Kim
Preprint
Abstract
The data movement in large-scale computing facilities (from compute nodes to data nodes) is categorized as one of the major contributors to high cost and energy utilization. To tackle it, in-storage processing (ISP) within storage devices, such as Solid-State Drives (SSDs), has been explored actively. The introduction of computational storage drives (CSDs) enabled ISP within the same form factor as regular SSDs and made it easy to replace SSDs within traditional compute nodes. With CSDs, host systems can offload various operations such as search, filter, and count. However, commercialized CSDs have different hardware resources and performance characteristics. Thus, it requires careful consideration of hardware, performance, and workload characteristics for building a CSD-based storage system within a compute node. Therefore, storage architects are hesitant to build a storage system based on CSDs as there are no tools to determine the benefits of CSD-based compute nodes to meet the performance requirements compared to traditional nodes based on SSDs. In this work, we proposed an analytical model-based storage capacity planner called CSDPlan for system architects to build performance-effective CSD-based compute nodes. Our model takes into account the performance characteristics of the host system, targeted workloads, and hardware and performance characteristics of CSDs to be deployed and provides optimal configuration based on the number of CSDs for a compute node. Furthermore, CSDPlan estimates and reduces the total cost of ownership (TCO) for building a CSD-based compute node. To evaluate the efficacy of CSDPlan, we selected two commercially available CSDs and 4 representative big data analysis workloads.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Optimizing the cost of DBaaS object placement in hybrid storage systemsFuture Generation Computer Systems, 2019
- Catalina: In-Storage Processing Acceleration for Scalable Big Data Analytics2019
- SSD in-storage computing for list intersection2016
- BiscuitACM SIGARCH Computer Architecture News, 2016
- In-storage processing of database scans and joinsInformation Sciences, 2016
- Near-Data Processing: Insights from a MICRO-46 WorkshopIEEE Micro, 2014
- HybridPlan: a capacity planning technique for projecting storage requirements in hybrid storage systemsThe Journal of Supercomputing, 2013
- Enabling cost-effective data processing with smart SSD2013
- Amdahl’s Law2011
- MapReduceCommunications of the ACM, 2008