MemTorch: An Open-source Simulation Framework for Memristive Deep Learning Systems
Authors:
- Corey LammieCLCorey Lammie
- Wei XiangWXWei Xiang
- Bernabé Linares-BarrancoBLBernabé Linares-Barranco
- Mostafa Rahimi AzghadiMAMostafa Rahimi Azghadi
Preprint
Abstract
Memristive devices have shown great promise to facilitate the acceleration and improve the power efficiency of Deep Learning (DL) systems. Crossbar architectures constructed using memristive devices can be used to efficiently implement various in-memory computing operations, such as Multiply-Accumulate (MAC) and unrolled-convolutions, which are used extensively in Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs). Currently, there is a lack of a modernized, open source and general high-level simulation platform that can fully integrate any behavioral or experimental memristive device model and its putative non-idealities into crossbar architectures within DL systems. This paper presents such a framework, entitled MemTorch, which adopts a modernized software engineering methodology and integrates directly with the well-known PyTorch Machine Learning (ML) library. We fully detail the public release of MemTorch and its release management, and use it to perform novel simulations of memristive DL systems, which are trained and benchmarked using the CIFAR-10 dataset. Moreover, we present a case study, in which MemTorch is used to simulate a near-sensor in-memory computing system for seizure detection using Pt/Hf/Ti Resistive Random Access Memory (ReRAM) devices. Our open source MemTorch framework can be used and expanded upon by circuit and system designers to conveniently perform customized large-scale memristive DL simulations taking into account various unavoidable device non-idealities, as a preliminary step before circuit-level realization.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Challenges hindering memristive neuromorphic hardware from going mainstreamNature Communications, 2018
- Recent progress in analog memory-based accelerators for deep learningJournal of Physics D: Applied Physics, 2018
- Quantized conductance coincides with state instability and excess noise in tantalum oxide memristorsNature Communications, 2016
- Generalized boundary condition memristor modelInternational Journal of Circuit Theory and Applications, 2015
- Pattern classification by memristive crossbar circuits using ex situ and in situ trainingNature Communications, 2013
- Switching dynamics in titanium dioxide memristive devicesJournal of Applied Physics, 2009
- A systematic analysis of performance measures for classification tasksInformation Processing & Management, 2009
- The elusive memristor: properties of basic electrical circuitsEuropean Journal of Physics, 2009
- The missing memristor foundNature, 2008
- Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain statePhysical Review E, 2001