Single neuromorphic memristor closely emulates multiple synaptic mechanisms for energy efficient neural networks
Authors:
Top Cited Papers
Open Access
- 13 August 2024
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1-13
Abstract
Biological neural networks do not only include long-term memory and weight multiplication capabilities, as commonly assumed in artificial neural networks, but also more complex functions such as short-term memory, short-term plasticity, and meta-plasticity - all collocated within each synapse. Here, we demonstrate memristive nano-devices based on SrTiO3 that inherently emulate all these synaptic functions. These memristors operate in a non-filamentary, low conductance regime, which enables stable and energy efficient operation. They can act as multi-functional hardware synapses in a class of bio-inspired deep neural networks (DNN) that make use of both long- and short-term synaptic dynamics and are capable of meta-learning or learning-to-learn. The resulting bio-inspired DNN is then trained to play the video game Atari Pong, a complex reinforcement learning task in a dynamic environment. Our analysis shows that the energy consumption of the DNN with multi-functional memristive synapses decreases by about two orders of magnitude as compared to a pure GPU implementation. Based on this finding, we infer that memristive devices with a better emulation of the synaptic functionalities do not only broaden the applicability of neuromorphic computing, but could also improve the performance and energy costs of certain artificial intelligence applications.Keywords
All Related Versions
This publication has 52 references indexed in Scilit:
- Trade‐Off Between Data Retention and Switching Speed in Resistive Switching ReRAM DevicesAdvanced Electronic Materials, 2020
- Emerging Memristive Artificial Synapses and Neurons for Energy‐Efficient Neuromorphic ComputingAdvanced Materials, 2020
- Filament‐Free Bulk Resistive Memory Enables Deterministic Analogue SwitchingAdvanced Materials, 2020
- Memristive Synapses and Neurons for Bioinspired ComputingAdvanced Electronic Materials, 2019
- Bienenstock, Cooper, and Munro Learning Rules Realized in Second‐Order Memristors with Tunable Forgetting RateAdvanced Functional Materials, 2019
- Mechanism of memristive switching in OxRAM2019
- Oxygen Exchange Processes between Oxide Memristive Devices and Water MoleculesAdvanced Materials, 2018
- Anomalous Resistance Hysteresis in Oxide ReRAM: Oxygen Evolution and Reincorporation Revealed by In Situ TEMAdvanced Materials, 2017
- Nanoscale Chemical and Valence Evolution at the Metal/Oxide Interface: A Case Study of Ti/SrTiO3Advanced Materials Interfaces, 2016
- Coexistence of Filamentary and Homogeneous Resistive Switching in Fe‐Doped SrTiO3 Thin‐Film Memristive DevicesAdvanced Materials, 2010