Full hardware implementation of neuromorphic visual system based on multimodal optoelectronic resistive memory arrays for versatile image processing
Top Cited Papers
Open Access
- 20 December 2023
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 14 (1) , 1-11
Abstract
In-sensor and near-sensor computing are becoming the next-generation computing paradigm for high-density and low-power sensory processing. To fulfil a high-density and efficient neuromorphic visual system with fully hierarchical emulation of the retina and visual cortex, emerging multimodal neuromorphic devices for multi-stage processing and a fully hardware-implemented system with versatile image processing functions are still lacking and highly desirable. Here we demonstrate an emerging multimodal-multifunctional resistive random-access memory (RRAM) device array based on modified silk fibroin protein (MSFP), exhibiting both optoelectronic RRAM (ORRAM) mode featured by unique negative and positive photoconductance memory and electrical RRAM (ERRAM) mode featured by analogue resistive switching. A full hardware implementation of the artificial visual system with versatile image processing functions is realised for the first time, including ORRAM mode array for the in-sensor image pre-processing (contrast enhancement, background denoising, feature extraction) and ERRAM mode array for near-sensor high-level image recognition, which hugely improves the integration density, and simply the circuit design and the fabrication and integration complexity.Keywords
This publication has 36 references indexed in Scilit:
- Demonstration of Convolution Kernel Operation on Resistive Cross-Point ArrayIEEE Electron Device Letters, 2016
- Silk Fibroin for Flexible Electronic DevicesAdvanced Materials, 2015
- Retinal bipolar cells: elementary building blocks of visionNature Reviews Neuroscience, 2014
- Hydrogen bonding-assisted thermal conduction in β-sheet crystals of spider silk proteinNanoscale, 2014
- Microporous Carbon Nanoplates from Regenerated Silk Proteins for SupercapacitorsAdvanced Materials, 2013
- Dynamic Shifts of Limited Working Memory Resources in Human VisionScience, 2008
- The fundamental plan of the retinaNature Neuroscience, 2001
- Neuromorphic Vision SensorsScience, 2000
- The Silicon Retina1994
- The Silicon RetinaScientific American, 1991