Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
Top Cited Papers
Open Access
- 23 October 2023
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 14 (1) , 1-9
Abstract
Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardware implementation of a neuro-inspired vision system also requires the fulfilment of detecting and recognizing moving targets. Here, we demonstrated a neuro-inspired optical sensor based on two-dimensional NbS2/MoS2 hybrid films, which featured remarkable photo-induced conductance plasticity and low electrical energy consumption. A neuro-inspired optical sensor array with 10 × 10 NbS2/MoS2 phototransistors enabled highly integrated functions of sensing, memory, and contrast enhancement capabilities for static images, which benefits convolutional neural network (CNN) with a high image recognition accuracy. More importantly, in-sensor trajectory registration of moving light spots was experimentally implemented such that the post-processing could yield a high restoration accuracy. Our neuro-inspired optical sensor array could provide a fascinating platform for the implementation of high-performance artificial vision systems.Keywords
Funding Information
- National Natural Science Foundation of China (52102161)
- Shenzhen Science and Technology Innovation Commission (RCYX20221008092912045, RCBS20200714114911270)
This publication has 81 references indexed in Scilit:
- A 3.6 $\mu$s Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-SensorIEEE Journal of Solid-State Circuits, 2011
- Corticogeniculate feedback and visual processing in the primateThe Journal of Physiology, 2010
- Eye Smarter than Scientists Believed: Neural Computations in Circuits of the RetinaNeuron, 2010
- A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision SensorIEEE Journal of Solid-State Circuits, 2008
- Retinal Adaptation to Object MotionNeuron, 2007
- Selective Transmission of Single Photon Responses by Saturation at the Rod-to-Rod Bipolar SynapseNeuron, 2004
- Segregation of object and background motion in the retinaNature, 2003
- A biomorphic digital image sensorIEEE Journal of Solid-State Circuits, 2003
- Nonlinear Signal Transfer from Mouse Rods to Bipolar Cells and Implications for Visual SensitivityNeuron, 2002
- A single-chip optical sensor with analog memory for motion detectionIEEE Journal of Solid-State Circuits, 1995