ECSSD: Hardware/Data Layout Co-Designed In-Storage-Computing Architecture for Extreme Classification
Open Access
- 17 June 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Abstract
With the rapid growth of classification scale in deep learning systems, the final classification layer becomes extreme classification with a memory footprint exceeding the main memory capacity of the CPU or GPU. The emerging in-storage-computing technique offers an opportunity on account of the fact that SSD has enough storage capacity for the parameters of extreme classification. However, the limited performance of naive in-storage-computing schemes is insufficient to support the heavy workload of extreme classification. To this end, we propose ECSSD, the first hardware/data layout co-designed in-storage-computing architecture for extreme classification, based on the approximate screening algorithm. We propose an alignment-free floating-point MAC circuit technique to improve the computational ability under the limited area budget of in-storage-computing schemes so that the computational ability can match SSD's high internal bandwidth. We present a heterogeneous data layout design for the 4/32-bit weight data in the approximate screening algorithm to avoid data transfer interference and further utilize the internal DRAM bandwidth of SSD. Moreover, we propose a learning-based adaptive interleaving framework to balance the access workload in each flash channel and improve channel-level bandwidth utilization. Putting them together, our ECSSD achieves 3.24--49.87x performance improvements compared with state-of-the-art baselines.Keywords
This publication has 31 references indexed in Scilit:
- Graph Convolutional Neural Networks for Web-Scale Recommender Systems2018
- Optimized CNN Based Image Recognition Through Target Region SelectionOptik, 2018
- Detection of rail surface defects based on CNN image recognition and classification2018
- Crash Consistency in Encrypted Non-volatile Main Memory Systems2018
- I/O Performance Improvement of Secure Big Data Analyses with Application Support on SSD Cache2018
- Parabel2018
- Deep Learning for Extreme Multi-label Text Classification2017
- SSD in-storage computing for list intersection2016
- Hidden factors and hidden topics2013
- Anatomy of a solid-state driveCommunications of the ACM, 2012