A Scalable Multi-Device Semantic Communication System for Multi - Task Execution
Authors:
- 4 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2227-2232
Abstract
Motivated by the success of deep learning, semantic communication has emerged as new paradigm shifts in 6G from the conventional data-oriented communications. However, the semantic communication systems suffer performance degradation at the receiver side or computation latency accumulation at the transmitter side, when serves multiple task execution. To address the issue, we develop a VisionTransformer based multi-device semantic communication system called MDSC to effectively perform multiple tasks. In particular, we introduce the shared semantic encoder to the transmitter to extract global semantic information, preventing for computation accumulation at the transmitter side. To cope with the fact that the semantic information for different task may differ from each other, we propose multiple-encoder-multiple-decoder channel codec architecture, improving the compression efficiency with task-specific codec. The compression efficiency leads to higher noise robustness and downstream task execution accuracy at the receiver side. In the experiments, we validate the proposed system with two tasks in NYUD-v2 and four tasks in PASCAL-Context, respectively. Compared with the state-of-the-art multi-task semantic communication system, MDSC achieves higher performance simultaneously for all tasks in both datasets.Keywords
Funding Information
- National Natural Science Foundation of China (62101336)
This publication has 17 references indexed in Scilit:
- WITT: A Wireless Image Transmission Transformer for Semantic Communications2023
- A Unified Multi-Task Semantic Communication System with Domain Adaptation2022
- Semantic Communication System Based on Semantic Slice Models PropagationIEEE Journal on Selected Areas in Communications, 2022
- Heterogeneous Semantic and Bit Communications: A Semi-NOMA SchemeIEEE Journal on Selected Areas in Communications, 2022
- Deep Learning-Enabled Semantic Communication Systems With Task-Unaware Transmitter and Dynamic DataIEEE Journal on Selected Areas in Communications, 2022
- Task-Oriented Multi-User Semantic CommunicationsIEEE Journal on Selected Areas in Communications, 2022
- Task-Oriented Multi-User Semantic Communications for VQAIEEE Wireless Communications Letters, 2021
- Deep Joint Source-Channel Coding for Multi-Task NetworkIEEE Signal Processing Letters, 2021
- The Role of Context for Object Detection and Semantic Segmentation in the Wild2014
- Indoor Segmentation and Support Inference from RGBD Images2012