SNN-SC: A Spiking Semantic Communication Framework for Collaborative Intelligence
- 25 November 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (4) , 5883-5896
Abstract
Collaborative Intelligence (CI) has emerged as a promising framework for deploying Artificial Intelligence (AI) models on resource-constrained edge devices. In CI, the AI model is partitioned between the edge device and the cloud, with intermediate features transmitted from the edge sub-model to the cloud sub-model to complete the inference task. However, reducing feature transmission overhead while maintaining task performance remains a challenge, particularly in the case of noisy wireless channels. In this paper, we propose a Spiking Neural Network (SNN)-based Semantic Communication (SC) model, SNN-SC, which extracts compact semantic information from features and transmits it through digital binary channels. Compared to the Deep Neural Network (DNN)-based SC model, whose output is floating-point, the binary output of SNN makes SNN-SC directly applicable to digital binary channels without the need for extra quantization. Moreover, we introduce a novel spiking neuron called IHF to enhance the reconstruction capability of the SNN-SC decoder. Finally, we enhance the performance of SNN-SC by maximizing the entropy of semantic information. SNN-SC achieves a higher compression ratio and overcomes the ‘cliff effect’ compared to the traditional separate source and channel coding method. In addition, SNN-SC has lower computational complexity than the DNN-based SC model and maintains higher task performance under poor channel conditions.Keywords
All Related Versions
Funding Information
- National Key R&D Program of China (2021YFF0900500)
- National Natural Science Foundation of China (62441202, U22B2035)
This publication has 64 references indexed in Scilit:
- An adaptive threshold mechanism for accurate and efficient deep spiking convolutional neural networksNeurocomputing, 2022
- Deep learning in spiking neural networksNeural Networks, 2019
- Deep neural networks with weighted spikesNeurocomputing, 2018
- Deep Residual Learning for Image Recognition2016
- Auto-encoder based dimensionality reductionNeurocomputing, 2016
- Deep learningNature, 2015
- Elements of Information Theory2005
- The JPEG 2000 still image compression standardIEEE Signal Processing Magazine, 2001
- Networks of spiking neurons: The third generation of neural network modelsNeural Networks, 1997
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948