Learning Scalable Temporal Representations in Spiking Neural Networks Without Labels
Preprint
Abstract
Spiking neural networks (SNNs) exhibit temporal, sparse, and event-driven dynamics that make them appealing for efficient inference. However, extending these models to self-supervised regimes remains challenging because the discontinuities introduced by spikes break the cross-view gradient correspondences required by contrastive and consistency-driven objectives. This work introduces a training paradigm that enables large SNN architectures to be optimized without labeled data. We formulate a dual-path neuron in which a spike-generating process is paired with a differentiable surrogate branch, allowing gradients to propagate across augmented inputs while preserving a fully spiking implementation at inference. In addition, we propose temporal alignment objectives that enforce representational coherence both across spike timesteps and between augmented views. Using convolutional and transformer-style SNN backbones, we demonstrate ImageNet-scale self-supervised pretraining and strong transfer to classification, detection, and segmentation benchmarks. Our best model, a fully self-supervised Spikformer-16-512, achieves 70.1% top-1 accuracy on ImageNet-1K, demonstrating that unlabeled learning in high-capacity SNNs is feasible at modern scaleKeywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Temporal Contrastive Learning for Spiking Neural Networks2024
- Self-Supervised Contrastive Learning In Spiking Neural Networks2024
- Training Spiking Neural Networks Using Lessons From Deep LearningProceedings of the IEEE, 2023
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks2021
- The Evolution of Submissive Strategies on the Clustered Scale-Free Networks2021
- Advancing Neuromorphic Computing With Loihi: A Survey of Results and OutlookProceedings of the IEEE, 2021
- Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural NetworksFrontiers in Neuroscience, 2018
- CIFAR10-DVS: An Event-Stream Dataset for Object ClassificationFrontiers in Neuroscience, 2017
- Networks of spiking neurons: The third generation of neural network modelsNeural Networks, 1997