SPACX: Silicon Photonics-based Scalable Chiplet Accelerator for DNN Inference
Authors:
- 1 April 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 831-845
Abstract
In pursuit of higher inference accuracy, deep neural network (DNN) models have significantly increased in complexity and size. To overcome the consequent computational challenges, scalable chiplet-based accelerators have been proposed. However, data communication using metallic-based interconnects in these chiplet-based DNN accelerators is becoming a primary obstacle to performance, energy efficiency, and scalability. The photonic interconnects can provide adequate data communication support due to some superior properties like low latency, high bandwidth and energy efficiency, and ease of broadcast communication. In this paper, we propose SPACX: a Silicon Photonics-based Chiplet ACcelerator for DNN inference applications. Specifically, SPACX includes a photonic network design that enables seamless single-chiplet and cross-chiplet broadcast communications, and a tailored dataflow that promotes data broadcast and maximizes parallelism. Furthermore, we explore the broadcast granularities of the photonic network and implications on system performance and energy efficiency. A flexible bandwidth allocation scheme is also proposed to dynamically adjust communication bandwidths for different types of data. Simulation results using several DNN models show that SPACX can achieve 78% and 75% reduction in execution time and energy, respectively, as compared to other state-of-the-art chiplet-based DNN accelerators.Keywords
Funding Information
- National Science Foundation
This publication has 57 references indexed in Scilit:
- Active microring based tunable optical power splittersOptics Communications, 2016
- ShiDianNao2015
- Leveraging Silicon-Photonic NoC for Designing Scalable GPUs2015
- Origami2015
- Crosstalk limitations of microring-resonator based WDM demultiplexers on SOI2015
- Galaxy2014
- LumiNOC: A Power-Efficient, High-Performance, Photonic Network-on-ChipIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2014
- DianNaoACM SIGPLAN Notices, 2014
- Silicon microring resonatorsLaser & Photonics Reviews, 2011
- Photonic network-on-chip architectures using multilayer deposited silicon materials for high-performance chip multiprocessorsACM Journal on Emerging Technologies in Computing Systems, 2011