A spatiotemporal energy model based on spiking neurons for human motion perception
- 7 February 2024
- journal article
- research article
- Published by Springer Nature in Cognitive Neurodynamics
- Vol. 18 (4) , 2015-2029
Abstract
Inspired by the motion processing pathway, this paper proposes a bio-inspired feedforward spiking network model based on Hodgkin–Huxley neurons for human motion perception. The proposed network mimics the mechanisms of direction selectivity found in simple and complex cells of the primary visual cortex. Simple cells' receptive fields are modeled using Gabor energy filters, while complex cells' receptive fields are constructed by integrating the responses of simple cells in an energy model. To generate the motion map, the spiking output of the network integrates motion information encoded by the responses of complex cells with various preferred directions. Simulation results demonstrate that the spiking neuron-based network effectively replicates the directional selectivity operation of the visual cortex when presented with a sequence of time-varying images. We evaluate the proposed model against state-of-the-art spiking neuron-based motion detection models using publicly available datasets. The results highlight the model's capability to extract motion energy from diverse video sequences, akin to human visual motion perception models. Additionally, we showcase the application of the proposed model in motion segmentation tasks and compare its performance with state-of-the-art motion-based segmentation models using challenging video segmentation benchmarks. The results indicate competitive performance. The motion maps generated by the proposed model can be utilized for action recognition in input videos.Keywords
This publication has 46 references indexed in Scilit:
- Efficient Spiking Neural Network Model of Pattern Motion Selectivity in Visual CortexNeuroinformatics, 2014
- Segmentation of Moving Objects by Long Term Video AnalysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Action recognition via bio-inspired features: The richness of center–surround interactionComputer Vision and Image Understanding, 2012
- A CORF computational model of a simple cell that relies on LGN input outperforms the Gabor function modelBiological Cybernetics, 2012
- Object Segmentation by Long Term Analysis of Point Trajectories2010
- Optical flow using spatiotemporal filtersInternational Journal of Computer Vision, 1988
- Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filtersJournal of the Optical Society of America A, 1985
- Spatiotemporal energy models for the perception of motionJournal of the Optical Society of America A, 1985
- Phase Relationships Between Adjacent Simple Cells in the Visual CortexScience, 1981
- Mathematical description of the responses of simple cortical cells*Journal of the Optical Society of America, 1980