Breaking the Interaction Wall: A DLPU-Centric Deep Learning Computing System
- 14 December 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 71 (1) , 209-222
Abstract
Due to the broad successes of deep learning, many CPU-centric artificial intelligent computing systems employ specialized devices such as GPUs, FPGAs, and ASICs, which can be named as Deep Learning Processing Units (DLPUs), for processing computation-intensive deep learning tasks. The separation between the scalar control operations mapped on CPUs and the vector computation operations mapped on DLPUs causes the frequent and costly interactions between CPUs and DLPUs, leading to the Interaction Wall. Moreover, the increasing algorithm complexity and DLPU computation speed would further aggravate the interaction wall substantially.Keywords
Funding Information
- National Key Research and Development Program of China (2017YFA0700902)
- National Natural Science Foundation of China (61925208, U19B2019, U20A20227)
- Beijing Natural Science Foundation (JQ18013)
- Strategic Priority Research Program of Chinese Academy of Science (XDB32050200)
- Beijing Academy of Artificial Intelligence
- Beijing Nova Program of Science and Technology (Z191100001119093)
- CAS Project for Young Scientists in Basic Research (YSBR-029)
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
- XPLORE PRIZE
This publication has 37 references indexed in Scilit:
- Going Deeper with Embedded FPGA Platform for Convolutional Neural Network2016
- 4.1 14nm 6th-generation Core processor SoC with low power consumption and improved performance2016
- ShiDianNao2015
- Human-level control through deep reinforcement learningNature, 2015
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015
- DaDianNao: A Machine-Learning Supercomputer2014
- DianNaoACM SIGPLAN Notices, 2014
- Overview of the Architecture, Circuit Design, and Physical Implementation of a First-Generation Cell ProcessorIEEE Journal of Solid-State Circuits, 2005
- Tarantula: a vector extension to the alpha architecture2003
- Long Short-Term MemoryNeural Computation, 1997