Multi-Task Semantic Communications via Large Models
Preprint
Abstract
Artificial intelligence (AI) promises to revolutionize the design, optimization and management of next-generation communication systems. In this article, we explore the integration of large AI models (LAMs) into semantic communications (SemCom) by leveraging their multi-modal data processing and generation capabilities. Although LAMs bring unprecedented abilities to extract semantics from raw data, this integration entails multifaceted challenges including high resource demands, model complexity, and the need for adaptability across diverse modalities and tasks. To overcome these challenges, we propose a LAM-based multi-task SemCom (MTSC) architecture, which includes an adaptive model compression strategy and a federated split fine-tuning approach to facilitate the efficient deployment of LAM-based semantic models in resource-limited networks. Furthermore, a retrieval-augmented generation scheme is implemented to synthesize the most recent local and global knowledge bases to enhance the accuracy of semantic extraction and content generation, thereby improving the inference performance. Finally, simulation results demonstrate the efficacy of the proposed LAM-based MTSC architecture, highlighting the performance enhancements across various downstream tasks under varying channel conditions.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Large Language Model Agents for Radio Map Generation and Wireless Network PlanningIEEE Networking Letters, 2025
- Large AI Model Empowered Multimodal Semantic CommunicationsIEEE Communications Magazine, 2024
- Generative AI-Driven Semantic Communication Networks: Architecture, Technologies, and ApplicationsIEEE Transactions on Cognitive Communications and Networking, 2024
- LaMoSC: Large Language Model-Driven Semantic Communication System for Visual TransmissionIEEE Transactions on Cognitive Communications and Networking, 2024
- A Unified Multi-Task Semantic Communication System for Multimodal DataIEEE Transactions on Communications, 2024
- Semantic Communications Based on Adaptive Generative Models and Information BottleneckIEEE Communications Magazine, 2023
- Deep Learning Enabled Semantic Communications With Speech Recognition and SynthesisIEEE Transactions on Wireless Communications, 2023
- Wireless Semantic Communications for Video ConferencingIEEE Journal on Selected Areas in Communications, 2022
- Semantic Communications for Future Internet: Fundamentals, Applications, and ChallengesIEEE Communications Surveys & Tutorials, 2022
- Deep Joint Source-Channel Coding for Wireless Image TransmissionIEEE Transactions on Cognitive Communications and Networking, 2019