Coupled Ferroelectric‐Photonic Memory in a Retinomorphic Hardware for In‐Sensor Computing
Authors:
Open Access
- 17 January 2024
- journal article
- research article
- Published by Wiley in Advanced Science
- Vol. 11 (12) , e2303447
Abstract
The development of all‐in‐one devices for artificial visual systems offers an attractive solution in terms of energy efficiency and real‐time processing speed. In recent years, the proliferation of smart sensors in the growth of Internet‐of‐Things (IoT) has led to the increasing importance of in‐sensor computing technology, which places computational power at the edge of the data‐flow architecture. In this study, a prototype visual sensor inspired by the human retina is proposed, which integrates ferroelectricity and photosensitivity in two‐dimensional (2D) α‐In2Se3 material. This device mimics the functions of photoreceptors and amacrine cells in the retina, performing optical reception and memory computation functions through the use of electrical switching polarization in the channel. The gate‐tunable linearity of excitatory and inhibitory functions in photon‐induced short‐term plasticity enables to encode and classify 12 000 images in the Mixed National Institute of Standards and Technology (MNIST) dataset with remarkable accuracy, achieving ≈94%. Additionally, in‐sensor convolution image processing through a network of phototransistors, with five convolutional kernels electrically pre‐programmed into the transistors is demonstrated. The convoluted photocurrent matrices undergo straightforward arithmetic calculations to produce edge and feature‐enhanced scenarios. The findings demonstrate the potential of ferroelectric α‐In2Se3 for highly compact and efficient retinomorphic hardware implementation, regardless of ambipolar transport in the channel.Keywords
Funding Information
- National Research Foundation Singapore (NRF‐CRP24‐2020‐0002)
- Science and Engineering Research Council (A2083c0061)
This publication has 32 references indexed in Scilit:
- Ultrafast machine vision with 2D material neural network image sensorsNature, 2020
- A ferroelectric semiconductor field-effect transistorNature Electronics, 2019
- Optoelectronic resistive random access memory for neuromorphic vision sensorsNature Nanotechnology, 2019
- Two‐Terminal Multibit Optical Memory via van der Waals HeterostructureAdvanced Materials, 2018
- Prediction of intrinsic two-dimensional ferroelectrics in In2Se3 and other III2-VI3 van der Waals materialsNature Communications, 2017
- Gate Controlled Photocurrent Generation Mechanisms in High-Gain In2Se3 PhototransistorsNano Letters, 2015
- Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking OutputProceedings of the IEEE, 2014
- Contributions of the 12 Neuron Classes in the Fly Lamina to Motion VisionNeuron, 2013
- Eye Smarter than Scientists Believed: Neural Computations in Circuits of the RetinaNeuron, 2010
- The metabolic cost of neural informationNature Neuroscience, 1998