Variability-tolerant Convolutional Neural Network for Pattern Recognition applications based on OxRAM synapses
Authors:
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 01631918,p. 28.4.1-28.4.4
Abstract
Software implementations of artificial Convolutional Neural Networks (CNNs), taking inspiration from biology, are at the state-of-the-art for Pattern Recognition (PR) applications and they are successfully used in commercial products [1]. However, they require power-hungry CPU/GPU to perform convolution operations based on computationally expensive sums of multiplications. This hinders their integration in portable devices. Some full CMOS-based hardware implementations of CNN have been suggested, but they still require the computation of multiplications [2]. In this work, we present for the first time to our knowledge a spike-based hardware implementation of CNN using HfO2 based OxRAM devices as binary synapses. OxRAM devices are chosen for their low switching energy [3] and promising endurance performance [4]. We perform an experimental and theoretical study of the impact of programming conditions at both device and system levels. A complex visual pattern recognition application is demonstrated with a spike-based hierarchical CNN, inspired from the mammalian visual cortex organization. A high accuracy (pattern recognition rate >94%) is obtained for all the tested programming conditions, even if the variability associated to weaker programming conditions is larger.Keywords
This publication has 7 references indexed in Scilit:
- Mapping from Frame-Driven to Frame-Free Event-Driven Vision Systems by Low-Rate Rate Coding and Coincidence Processing--Application to Feedforward ConvNetsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Metal–Oxide RRAMProceedings of the IEEE, 2012
- On the Switching Parameter Variation of Metal-Oxide RRAM—Part I: Physical Modeling and Simulation MethodologyIEEE Transactions on Electron Devices, 2012
- An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision SensorsIEEE Journal of Solid-State Circuits, 2011
- Universal Reset Characteristics of Unipolar and Bipolar Metal-Oxide RRAMIEEE Transactions on Electron Devices, 2011
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Receptive fields and functional architecture of monkey striate cortexThe Journal of Physiology, 1968