Hybrid synaptic structure for spiking neural network realization
Open Access
- 13 May 2024
- journal article
- research article
- Published by IOP Publishing in Superconductor Science and Technology
- Vol. 37 (6) , 065011
Abstract
Neural networks and neuromorphic computing represent fundamental paradigms as alternative approaches to Von-Neumann-based implementations, advancing in the applications of deep learning and machine vision. Nonetheless, conventional semiconductor circuits encounter challenges in achieving ultra-fast processing speed and low power consumption due to their dissipative properties. Conversely, single flux quantum circuits exhibit inherent spiking behavior, showcasing their characteristics as a promising candidate for spiking neural networks (SNNs). In this work, we present a compact hybrid synapse circuit to mimic the biological interconnect functionality, enabling the weighting operations for excitatory and inhibitory impulses. Additionally, the proposed structure facilitates input accumulation, which is performed before the activation function. In the experiments, our synaptic structure interfaces with a soma circuit fabricated using a commercial Nb process, underscoring its compatibility and supporting its potential for integration into efficient neural network architectures. The weight value on the synapse is configurable by utilizing cryo-CMOS circuits, providing adaptability to the inference networks. We’ve successfully designed, fabricated, and partially tested the JJ-Synapse within our cryocooler system, enabling high-speed inference implementation for SNNs.Keywords
Funding Information
- Türkiye Bilimsel ve Teknolojik Araştırma Kurumu (21E242)
This publication has 30 references indexed in Scilit:
- A superconducting synapse exhibiting spike-timing dependent plasticityApplied Physics Letters, 2023
- Superconducting Nanowire Spiking Element for Neural NetworksNano Letters, 2020
- Miniaturization of the Superconducting Memory Cell via a Three-Dimensional Nb Nano-superconducting Quantum Interference DeviceACS Nano, 2020
- Deep learning in spiking neural networksNeural Networks, 2019
- Direct-coupled micro-magnetometer with Y-Ba-Cu-O nano-slit SQUID fabricated with a focused helium ion beamApplied Physics Letters, 2018
- A Superconducting-Nanowire Three-Terminal Electrothermal DeviceNano Letters, 2014
- Memristor-based neural networksJournal of Physics D: Applied Physics, 2013
- Optimization of Single Flux Quantum Circuit Based Comparators Using PSOJournal of Superconductivity and Novel Magnetism, 2012
- Current status and future prospect of the Nb-based fabrication process for single flux quantum circuitsSuperconductor Science and Technology, 2006
- An artificial neural cell implemented with superconducting circuitsSuperconductor Science and Technology, 1991