LEARN Codes: Inventing Low-latency Codes via Recurrent Neural Networks
Preprint
Abstract
Designing channel codes under low-latency constraints is one of the most demanding requirements in 5G standards. However, a sharp characterization of the performance of traditional codes is available only in the large block-length limit. Guided by such asymptotic analysis, code designs require large block lengths as well as latency to achieve the desired error rate. Tail-biting convolutional codes and other recent state-of-the-art short block codes, while promising reduced latency, are neither robust to channel-mismatch nor adaptive to varying channel conditions. When the codes designed for one channel (e.g.,~Additive White Gaussian Noise (AWGN) channel) are used for another (e.g.,~non-AWGN channels), heuristics are necessary to achieve non-trivial performance. In this paper, we first propose an end-to-end learned neural code, obtained by jointly designing a Recurrent Neural Network (RNN) based encoder and decoder. This code outperforms canonical convolutional code under block settings. We then leverage this experience to propose a new class of codes under low-latency constraints, which we call Low-latency Efficient Adaptive Robust Neural (LEARN) codes. These codes outperform state-of-the-art low-latency codes and exhibit robustness and adaptivity properties. LEARN codes show the potential to design new versatile and universal codes for future communications via tools of modern deep learning coupled with communication engineering insights.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Short Block-Length Codes for Ultra-Reliable Low Latency CommunicationsIEEE Communications Magazine, 2018
- Deep Learning Methods for Improved Decoding of Linear CodesIEEE Journal of Selected Topics in Signal Processing, 2018
- Deep Learning Based Communication Over the AirIEEE Journal of Selected Topics in Signal Processing, 2017
- Scaling Deep Learning-Based Decoding of Polar Codes via Partitioning2017
- An Introduction to Deep Learning for the Physical LayerIEEE Transactions on Cognitive Communications and Networking, 2017
- Comparison of Convolutional and Block Codes for Low Structural DelayIEEE Transactions on Communications, 2015
- Modern Coding Theory2008
- Near Shannon limit error-correcting coding and decoding: Turbo-codes. 12002
- On the approximation capability of recurrent neural networksNeurocomputing, 2000
- A coding scheme for additive noise channels with feedback--I: No bandwidth constraintIEEE Transactions on Information Theory, 1966