Few-Shot Domain Adaptation For End-to-End Communication
Preprint
Abstract
The problem of end-to-end learning of a communication system using an autoencoder -- consisting of an encoder, channel, and decoder modeled using neural networks -- has recently been shown to be an effective approach. A challenge faced in the practical adoption of this learning approach is that under changing channel conditions (e.g. a wireless link), it requires frequent retraining of the autoencoder in order to maintain a low decoding error rate. Since retraining is both time consuming and requires a large number of samples, it becomes impractical when the channel distribution is changing quickly. We propose to address this problem using a fast and sample-efficient (few-shot) domain adaptation method that does not change the encoder and decoder networks. Different from conventional training-time unsupervised or semi-supervised domain adaptation, here we have a trained autoencoder from a source distribution that we want to adapt (at test time) to a target distribution using only a small labeled dataset, and no unlabeled data. We focus on a generative channel model based on the Gaussian mixture density network (MDN), and propose a regularized, parameter-efficient adaptation of the MDN using a set of affine transformations. The learned affine transformations are then used to design an optimal transformation at the decoder input to compensate for the distribution shift, and effectively present to the decoder inputs close to the source distribution. Experiments on many simulated distribution changes common to the wireless setting, and a real mmWave FPGA testbed demonstrate the effectiveness of our method at adaptation using very few target domain samples. The code for our work can be found at: https://github.com/jayaram-r/domain-adaptation-autoencoder.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Millimeter Wave Channel Modeling via Generative Neural Networks2020
- Meta-Transfer Learning for Few-Shot Learning2019
- Approximating the Void: Learning Stochastic Channel Models from Observation with Variational Generative Adversarial Networks2019
- Channel Agnostic End-to-End Learning Based Communication Systems with Conditional GAN2018
- End-to-End Learning of Communications Systems Without a Channel Model2018
- Maximum Classifier Discrepancy for Unsupervised Domain Adaptation2018
- Deep learning for wireless physical layer: Opportunities and challengesChina Communications, 2017
- Unified Deep Supervised Domain Adaptation and Generalization2017
- A theory of learning from different domainsMachine Learning, 2009
- Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models2007