Time Cell Inspired Temporal Codebook in Spiking Neural Networks for Enhanced Image Generation
- 20 February 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive and Developmental Systems
- Vol. PP (23798920) , 1-11
Abstract
Spiking Neural Networks (SNNs) have garnered significant attention due to their biological plausibility and energy efficiency. However, their generative modeling capabilities remain relatively underexplored, particularly in the context of handling temporal information. In this work, we propose a novel SNN-based Vector Quantized-Variational Autoencoder (VQ-VAE) framework that incorporates a temporal codebook inspired by hippocampal time cells. The temporal codebook enables the model to effectively encode and utilize temporal dependencies, facilitating the generation of high-resolution, temporally consistent images and event-based data. Extensive experiments conducted on diverse datasets, including CelebA-HQ, LSUN Bedroom, LSUN Church, CIFAR-10, and N-MNIST, demonstrate the superior performance of the proposed framework. Our method achieves state-of-the-art results in image quality and temporal consistency, outperforming existing SNN-based generative models. Furthermore, through destructive experiments, we validate the critical role of the temporal codebook in enhancing temporal correlation and improving generative performance. In addition to its superior image generation capabilities, our model exhibits significantly lower energy consumption compared to ANN-based counterparts, leveraging the inherent sparsity of SNNs. These findings highlight the potential of integrating temporal dynamics into the latent space of generative models, paving the way for advancements in neuromorphic computing and biologically inspired machine learning.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62406325)
This publication has 39 references indexed in Scilit:
- DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic ModelsMachine Intelligence Research, 2025
- Spiking generative adversarial network with attention scoring decodingNeural Networks, 2024
- BrainCog: A spiking neural network based, brain-inspired cognitive intelligence engine for brain-inspired AI and brain simulationPatterns, 2023
- Deep learning in spiking neural networksNeural Networks, 2019
- Supervised learning in spiking neural networks with noise-thresholdNeurocomputing, 2017
- Hippocampal “Time Cells”: Time versus Path IntegrationNeuron, 2013
- Gradual Changes in Hippocampal Activity Support Remembering the Order of EventsNeuron, 2007
- The contribution of sleep to hippocampus-dependent memory consolidationTrends in Cognitive Sciences, 2007
- A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic InputBiological Cybernetics, 2006
- Place units in the hippocampus of the freely moving ratExperimental Neurology, 1976