Analog CMOS-based Resistive Processing Unit for Deep Neural Network Training
Authors:
Preprint
Abstract
Recently we have shown that an architecture based on resistive processing unit (RPU) devices has potential to achieve significant acceleration in deep neural network (DNN) training compared to today's software-based DNN implementations running on CPU/GPU. However, currently available device candidates based on non-volatile memory technologies do not satisfy all the requirements to realize the RPU concept. Here, we propose an analog CMOS-based RPU design (CMOS RPU) which can store and process data locally and can be operated in a massively parallel manner. We analyze various properties of the CMOS RPU to evaluate the functionality and feasibility for acceleration of DNN training.Keywords
All Related Versions
This publication has 4 references indexed in Scilit:
- Training Deep Convolutional Neural Networks with Resistive Cross-Point DevicesFrontiers in Neuroscience, 2017
- Neuromorphic computing using non-volatile memoryAdvances in Physics: X, 2016
- Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices: Design ConsiderationsFrontiers in Neuroscience, 2016
- Learning representations by back-propagating errorsNature, 1986