Transformer-Aided Wireless Image Transmission With Channel Feedback
Top Cited Papers
- 15 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 23 (9) , 11904-11919
Abstract
This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called JSCCformer-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single encoder to facilitate transmission over multiple blocks, refining the receiver’s estimation at each block. Specifically, the unified encoder of JSCCformer-f can leverage the semantic information from the source image, and acquire channel state information and the decoder’s current belief about the source image from the feedback signal to generate coded symbols at each block. Numerical experiments show that our JSCCformer-f scheme achieves state-of-the-art performance with robustness to noise in the feedback link. Additionally, JSCCformer-f can adapt to the channel condition directly through feedback without the need for separate channel estimation. We further extend the scope of the JSCCformer-f approach to include the broadcast channel, which enables the transmitter to generate broadcast codes in accordance with signal semantics and channel feedback from individual receivers.Keywords
All Related Versions
Funding Information
- UKRI for the projects AI-R (EP/X030806/1)
- SONATA (EPSRC-EP/W035960/1)
- SNS JU Project 6G-GOALS under the EU’s Horizon Program (101139232)
This publication has 45 references indexed in Scilit:
- On the Role of ViT and CNN in Semantic Communications: Analysis and Prototype ValidationIEEE Access, 2023
- Feedback is Good, Active Feedback is Better: Block Attention Active Feedback Codes2023
- Vision Transformer for Adaptive Image Transmission over MIMO Channels2023
- Task-Oriented Multi-User Semantic CommunicationsIEEE Journal on Selected Areas in Communications, 2022
- Nonlinear Transform Source-Channel Coding for Semantic CommunicationsIEEE Journal on Selected Areas in Communications, 2022
- Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck ApproachIEEE Journal on Selected Areas in Communications, 2021
- Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers2021
- Wireless Image Retrieval at the EdgeIEEE Journal on Selected Areas in Communications, 2020
- CNN-Based Analog CSI Feedback in FDD MIMO-OFDM Systems2020
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018