Conditional Entropy-Constrained Multi-Stage Vector Quantization for Semantic Communication
- 15 December 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications Letters
- Vol. 15 (21622337) , 885-889
Abstract
This letter presents a conditional entropy-constrained multi-stage vector quantization (CEC-MSVQ) framework for semantic communication (SC). The proposed method integrates multi-stage VQ (MSVQ) for fine-grained rate control and entropy-constrained VQ (ECVQ) for improved rate–distortion efficiency. By modeling stage-wise quantization outputs as a Markovian sequence with conditional entropy modeling, CEC-MSVQ jointly trains semantic encoder–decoder networks and VQ codebooks while explicitly optimizing the rate–distortion objective. During inference, multi-rate transmission is supported by selectively activating VQ modules. Simulation results show that CEC-MSVQ achieves superior task performance over existing VQ-based SC, confirming the effectiveness of the proposed conditional entropy modeling.Keywords
Funding Information
- a Grant of Korean ARPA-H Project through the Korea Health Industry Development Institute
- Ministry of Health & Welfare, Republic of Korea (RS-2025-25454431)
- National Research Foundation of Korea
- Korean government (RS-2024-00453301)
This publication has 11 references indexed in Scilit:
- Deep Learning-Based CSI Feedback for Wi-Fi Systems With Temporal CorrelationIEEE Transactions on Communications, 2025
- Variable Bitrate Residual Vector Quantization for Audio Coding2025
- Entropy-Constrained VQ-VAE for Deep-Learning-Based CSI FeedbackIEEE Transactions on Vehicular Technology, 2025
- Vector Quantization for Deep-Learning-Based CSI Feedback in Massive MIMO SystemsIEEE Wireless Communications Letters, 2024
- Learning Variable-Rate CSI Compression with Multi-Stage Vector Quantization2024
- Variable Rate Allocation for Vector-Quantized Autoencoders2023
- Semantic Communications: Overview, Open Issues, and Future Research DirectionsIEEE Wireless Communications, 2022
- Multiple stage vector quantization for speech coding2005
- Entropy-constrained vector quantizationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- Product code vector quantizers for waveform and voice codingIEEE Transactions on Acoustics, Speech, and Signal Processing, 1984