Analog CMOS-based resistive processing unit for deep neural network training
Authors:
- 1 August 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 422-425
Abstract
Recently we have shown that an architecture based on resistive processing unit (RPU) devices has potential to achieve significant acceleration in deep neural network (DNN) training compared to today's software-based DNN implementations running on CPU/GPU. However, currently available device candidates based on non-volatile memory technologies do not satisfy all the requirements to realize the RPU concept. Here, we propose an analog CMOS-based RPU design (CMOS RPU) which can store and process data locally and can be operated in a massively parallel manner. We analyze various properties of the CMOS RPU to evaluate the functionality and feasibility for acceleration of DNN training.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Neuromorphic computing using non-volatile memoryAdvances in Physics: X, 2016
- Model Accuracy and Runtime Tradeoff in Distributed Deep Learning: A Systematic Study2016
- Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices: Design ConsiderationsFrontiers in Neuroscience, 2016
- Deep learningNature, 2015
- Building high-level features using large scale unsupervised learning2013
- Learning representations by back-propagating errorsNature, 1986