A Spike-Based Neuromorphic Architecture of Stereo Vision
Open Access
- 13 November 2020
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neurorobotics
- Vol. 14
Abstract
The problem of finding stereo correspondences in binocular vision is solved effortlessly in nature and yet it is still a critical bottleneck for artificial machine vision systems. As temporal information is a crucial feature in this process, the advent of event-based vision sensors and dedicated event-based processors promises to offer an effective approach to solve the stereo matching problem. Indeed, event-based neuromorphic hardware provides an optimal substrate for fast, asynchronous computation, that can make explicit use of precise temporal coincidences. Although several biologically-inspired solutions have already been proposed, the performance benefits of combining event-based sensing with asynchronous and parallel computation are yet to be explored. Here we present a spike-based stereo-vision system that leverages the advantages of brain-inspired neuromorphic computing by interfacing two event-based vision sensors to an event-based mixed-signal analog/digital neuromorphic processor. We describe a prototype interface designed to enable the emulation of a stereo-vision system on neuromorphic hardware and we quantify the stereo matching performance with two datasets. Our results demonstrate a proof of concept for a low-latency, end-to-end event-based, neuromorphic architecture of stereo vision.Keywords
Funding Information
- Universität Zürich
This publication has 30 references indexed in Scilit:
- Computational neurobiology is a useful tool in translational neurology: the example of ataxiaFrontiers in Neuroscience, 2015
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- Neuromorphic Electronic Circuits for Building Autonomous Cognitive SystemsProceedings of the IEEE, 2014
- The SpiNNaker ProjectProceedings of the IEEE, 2014
- Review of stereo vision algorithms and their suitability for resource-limited systemsJournal of Real-Time Image Processing, 2013
- Distinguishing linear vs. non-linear integration in CA1 radial oblique dendrites: it’s about timeFrontiers in Computational Neuroscience, 2011
- A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision SensorIEEE Journal of Solid-State Circuits, 2008
- Adaptive Exponential Integrate-and-Fire Model as an Effective Description of Neuronal ActivityJournal of Neurophysiology, 2005
- A computational theory of human stereo visionProceedings of the Royal Society of London. B. Biological Sciences, 1979
- Cooperative Computation of Stereo DisparityScience, 1976