Predictive Coding with Spiking Neural Networks: a Survey
Preprint
Abstract
In this article, we review a class of neuro-mimetic computational models that we place under the label of spiking predictive coding. Specifically, we review the general framework of predictive processing in the context of neurons that emit discrete action potentials, i.e., spikes. Theoretically, we structure our survey around how prediction errors are represented, which results in an organization of historical neuromorphic generalizations that is centered around three broad classes of approaches: prediction errors in explicit groups of error neurons, in membrane potentials, and implicit prediction error encoding. Furthermore, we examine some applications of spiking predictive coding that utilize more energy-efficient, edge-computing hardware platforms. Finally, we highlight important future directions and challenges in this emerging line of inquiry in brain-inspired computing. Building on the prior results of work in computational cognitive neuroscience, machine intelligence, and neuromorphic engineering, we hope that this review of neuromorphic formulations and implementations of predictive coding will encourage and guide future research and development in this emerging research area.Keywords
All Related Versions
This publication has 90 references indexed in Scilit:
- Feed-Forward Optimization With Delayed Feedback for Neural Network Training2025
- Evaluating the extent to which homeostatic plasticity learns to compute prediction errors in unstructured neuronal networksJournal of Computational Neuroscience, 2022
- Feature selectivity can explain mismatch signals in mouse visual cortexCell Reports, 2021
- Computational Resource Demands of a Predictive Bayesian BrainComputational Brain & Behavior, 2019
- A review of predictive coding algorithmsBrain and Cognition, 2017
- A tutorial on the free-energy framework for modelling perception and learningJournal of Mathematical Psychology, 2017
- A predictive coding account of MMN reduction in schizophreniaBiological Psychology, 2016
- Optimal Prediction in the Retina and Natural Motion StatisticsJournal of Statistical Physics, 2016
- Sparse coding of sensory inputsCurrent Opinion in Neurobiology, 2004
- Sparse spike coding in an asynchronous feed-forward multi-layer neural network using matching pursuitNeurocomputing, 2004