Towards Memory-Efficient Allocation of CNNs on Processing-in-Memory Architecture
- 9 January 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 29 (6) , 1428-1441
Abstract
In contrast to conventional computing-centric applications, CNNs are known to be both computationally and memory intensive. The emerging Processing-in-Memory (PIM) alleviates the memory bottleneck by integrating both processing elements and memory into a 3D-stacked architecture. Although this architecture can offer near-data processing to reduce data movement, memory is still a limiting factor of the entire system. We observe that an unsolved key challenge is how to efficiently allocate convolutions to 3D-stacked PIM to combine the advantages of both neural and computational processing.Keywords
Funding Information
- National Natural Science Foundation of China (61502309)
- Natural Science Foundation of Guangdong Province (2016A030313045, 2017B030314073)
- Shenzhen Science and Technology Foundation (JCYJ20150529164656096, JCYJ20170302153955969)
- Natural Science Foundation of SZU (803/000026080154, 827-000073)
- State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences (CARCH201608)
This publication has 40 references indexed in Scilit:
- DeepBurning2016
- HRL: Efficient and flexible reconfigurable logic for near-data processing2016
- Practical Near-Data Processing for In-Memory Analytics Frameworks2015
- Data reorganization in memory using 3D-stacked DRAM2015
- Implementation-Aware Model Analysis2015
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015
- A Ultra-Low-Energy Convolution Engine for Fast Brain-Inspired Vision in Multicore Clusters2015
- Caffe2014
- DianNaoACM SIGPLAN Notices, 2014
- Memory-Aware Task Scheduling with Communication Overhead Minimization for Streaming Applications on Bus-Based Multiprocessor System-on-ChipsIEEE Transactions on Parallel and Distributed Systems, 2013