Large AI Model-Enabled Generative Semantic Communications for Image Transmission
Preprint
Abstract
The rapid development of generative artificial intelligence (AI) has introduced significant opportunities for enhancing the efficiency and accuracy of image transmission within semantic communication systems. Despite these advancements, existing methodologies often neglect the difference in importance of different regions of the image, potentially compromising the reconstruction quality of visually critical content. To address this issue, we introduce an innovative generative semantic communication system that refines semantic granularity by segmenting images into key and non-key regions. Key regions, which contain essential visual information, are processed using an image oriented semantic encoder, while non-key regions are efficiently compressed through an image-to-text modeling approach. Additionally, to mitigate the substantial storage and computational demands posed by large AI models, the proposed system employs a lightweight deployment strategy incorporating model quantization and low-rank adaptation fine-tuning techniques, significantly boosting resource utilization without sacrificing performance. Simulation results demonstrate that the proposed system outperforms traditional methods in terms of both semantic fidelity and visual quality, thereby affirming its effectiveness for image transmission tasks.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Generative Semantic Communication for Joint Image Transmission and Segmentation2025
- Adaptive Cross-Modal Super-Resolution Semantic Communication for Mobile AI-Generated Panoramic VideoIEEE Transactions on Cognitive Communications and Networking, 2025
- Generative AI for Semantic Communication: Architecture, Challenges, and OutlookIEEE Wireless Communications, 2025
- EdgeShard: Efficient LLM Inference via Collaborative Edge ComputingIEEE Internet of Things Journal, 2024
- Multimodal Semantic Communication for Generative Audio-Driven Video ConferencingIEEE Wireless Communications Letters, 2024
- Generative AI-Driven Semantic Communication Networks: Architecture, Technologies, and ApplicationsIEEE Transactions on Cognitive Communications and Networking, 2024
- A Unified Multi-Task Semantic Communication System for Multimodal DataIEEE Transactions on Communications, 2024
- Deep Joint Source-Channel Coding for Semantic CommunicationsIEEE Communications Magazine, 2023
- Toward Wisdom-Evolutionary and Primitive-Concise 6G: A New Paradigm of Semantic Communication NetworksEngineering, 2022
- Deep Learning Enabled Semantic Communication SystemsIEEE Transactions on Signal Processing, 2021