Ouroboros: Wafer-Scale SRAM CIM with Token-Grained Pipelining for Large Language Model Inference
Open Access
- 22 March 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1349-1365
Abstract
No abstract availableAll Related Versions
Funding Information
- National Natural Science Foundation of China (92473205)
- National Key Research and Development Program of China (2023YFB4404400)
- National Natural Science Foundation of China (62222411)
This publication has 30 references indexed in Scilit:
- DOJO: The Microarchitecture of Tesla’s Exa-Scale Computer2022
- Cerebras Architecture Deep Dive: First Look Inside the HW/SW Co-Design for Deep Learning : Cerebras Systems2022
- Benchmarking a New Paradigm: Experimental Analysis and Characterization of a Real Processing-in-Memory SystemIEEE Access, 2022
- SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning2021
- InFO_SoW (System-on-Wafer) for High Performance Computing2020
- A^3: Accelerating Attention Mechanisms in Neural Networks with Approximation2020
- Scaling equations for the accurate prediction of CMOS device performance from 180 nm to 7 nmIntegration, 2017
- ASAP7: A 7-nm finFET predictive process design kitMicroelectronics Journal, 2016
- Mixed Integer Programming: Analyzing 12 Years of Progress2013
- SUMMA: scalable universal matrix multiplication algorithmConcurrency: Practice and Experience, 1997