Invited: Neuromorphic Vision Modalities in the NimbleAI 3D Chip
Authors:
- Xabier IturbeXIXabier Iturbe
- Bernabe Linares-BarrancoBernabe Linares-Barranco
- Sio-Hoi IengSISio-Hoi Ieng
- Arne ErdmannAEArne Erdmann
- Luca PeresLPLuca Peres
- Oliver RhodesOROliver Rhodes
- Rafael TorneroRTRafael Tornero
- Manolis SifalakisMSManolis Sifalakis
- Marcel van de BurgwalMBMarcel van de Burgwal
- Amirreza YousefzadehAYAmirreza Yousefzadeh
- Maha KooliMKMaha Kooli
- Riccardo AlidoriRARiccardo Alidori
Open Access
- 23 June 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Abstract
This paper provides an overview of the ongoing work to enable novel modalities of passive monocular neuromorphic vision in the NimbleAI sensing-processing architecture; namely, foveated and light-field event-driven vision with selective visual attention. The latter vision modality encodes 3D visual surroundings as sparse visual events in a 4D spatiotemporal domain, adding depth to current representation of visual information delivered by Dynamic Vision Sensors (DVS). The NimbleAI architecture implements hardware support for efficient execution of mainstream computer vision algorithms and AI models using these visual inputs. The architecture is designed to harness the latest advancements in 3D silicon integration, making it possible to squeeze sensing and spiking circuitry, memory, and processing engines into a miniature silicon volume.Keywords
Funding Information
- UKRI (10039070)
- EU Horizon Europe (101070679)
This publication has 3 references indexed in Scilit:
- HOTS: A Hierarchy of Event-Based Time-Surfaces for Pattern RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- A 128$\,\times$128 1.5% Contrast Sensitivity 0.9% FPN 3 µs Latency 4 mW Asynchronous Frame-Free Dynamic Vision Sensor Using Transimpedance PreamplifiersIEEE Journal of Solid-State Circuits, 2013
- A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision SensorIEEE Journal of Solid-State Circuits, 2008