Learned Image Transmission Toward Machine-Type Semantic Communications
- 5 September 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Humans tend to focus on only a few regions of interest (ROI) rather than perceiving the entire scene. This insight is also useful for machine tasks. Built upon the properties of ROI, in this paper, we propose a learned image transmission framework toward machine tasks, which ensures both the image reconstruction quality and the task accuracy. The whole system is optimized under a tripartite RDA tradeoff across the channel bandwidth cost (rate, R), the signal reconstruction quality (distortion, D), and the machine task performance (accuracy, A). According to the image content complexity distribution and the specific task, we incorporate both the entropy model and the ROI map to guide the source-channel coding rate allocation. As a result, we obtain the system coding gain. During this process, we develop two types of real-time ROI generation methods, suitable for high and low bandwidth cost regions, respectively. Experimental results show that our approach vastly outperforms state-of-the-art engineered image transmission methods and emerging image transmission methods. Moreover, we conduct an extensive ablation study to demonstrate the importance of individual components in our method, by which we expect to facilitate future research on this novel approach for machine-type semantic communications.Keywords
Funding Information
- National Natural Science Foundation of China
This publication has 11 references indexed in Scilit:
- Towards End-to-End Image Compression and Analysis with TransformersProceedings of the AAAI Conference on Artificial Intelligence, 2022
- Nonlinear Transform Source-Channel Coding for Semantic CommunicationsIEEE Journal on Selected Areas in Communications, 2022
- Toward Wisdom-Evolutionary and Primitive-Concise 6G: A New Paradigm of Semantic Communication NetworksEngineering, 2022
- Deep Learning Enabled Semantic Communication SystemsIEEE Transactions on Signal Processing, 2021
- Developments in International Video Coding Standardization After AVC, With an Overview of Versatile Video Coding (VVC)Proceedings of the IEEE, 2021
- Deep Joint Source-Channel Coding for Wireless Image TransmissionIEEE Transactions on Cognitive Communications and Networking, 2019
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- Deep Residual Learning for Image Recognition2016
- Fast R-CNN2015
- ImageNet: A large-scale hierarchical image database2009