Exploring Shifted Domain Problem within MNIST Dataset

Authors:

Abstract
Domain data can be shifted in any direction so it will be shared in different distributions to its original domain. This could be a problem since the model was trained with different distributions. It is found that adversarial domain adaptation using domain adversarial neural networks (DANN) can help to solve this problem on some scale. DANN can minimize the discrepancy between source and target data so the model can work well in both domains. The experiment is done by utilizing MNIST dataset that shifted into some conditions. In a condition when the shifting of distribution is too far, DANN is struggling to maintain the knowledge extracted from source data which leads to underperformance in the source and target domain. In contrast, when the shifting is closer, DANN can easily fit the model so it can perform well in both domains. It proves DANN is one of the good approaches to performing domain adaptation in small discrepancies.

This publication has 17 references indexed in Scilit: