Semantic-Aided Parallel Image Transmission Compatible With Practical System
- 12 May 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 24 (10) , 8476-8491
Abstract
In this paper, we propose a novel semantic-aided image communication framework for supporting the compatibility with practical separation-based coding architectures. Particularly, the deep learning (DL)-based joint source-channel coding (JSCC) is integrated into the classical separate source-channel coding (SSCC) to transmit the images via the combination of semantic stream and image stream from DL networks and SSCC respectively, which we name as parallel-stream transmission. The positive coding gain stems from the sophisticated design of the JSCC encoder, which leverages the residual information neglected by the SSCC to enhance the learnable image features. Furthermore, a conditional rate adaptation mechanism is introduced to adjust the transmission rate of semantic stream according to residual, rendering the framework more flexible and efficient to bandwidth allocation. We also design a dynamic stream aggregation strategy at the receiver, which provides the composite framework with more robustness to signal-to-noise ratio (SNR) fluctuations in wireless systems compared to a single conventional codec. Finally, the proposed framework is verified to surpass the performance of both traditional and DL-based competitors in a large range of scenarios and meanwhile, maintains lightweight in terms of the transmission and computational complexity of semantic stream, which exhibits the potential to be applied in real systems.Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2022YFB2902100)
- Fundamental Research Funds for the Central Universities
- Yangtze River Delta Science and Technology Innovation Community Joint Research (Basic Research) Project (BK20244006)
- Higher Education Discipline Innovation Project (BP0719010, STCSM 22DZ2229005)
- National Natural Science Foundation of China (62431015, 62293481)
This publication has 34 references indexed in Scilit:
- Time‐Varying Channel Estimation Based on Air‐Ground Channel Modelling and Modulated Learning NetworksChinese Journal of Electronics, 2022
- Deep Learning-Based Image Semantic Coding for Semantic Communications2021
- Semantic segmentation of outdoor panoramic imagesSignal, Image and Video Processing, 2021
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study2017
- Variational Inference: A Review for StatisticiansJournal of the American Statistical Association, 2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- ImageNet: A large-scale hierarchical image database2009
- Multiscale structural similarity for image quality assessment2004
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948