Generalized Dual Discriminator GANs
Authors:
Preprint
Abstract
Dual discriminator generative adversarial networks (D2 GANs) were introduced to mitigate the problem of mode collapse in generative adversarial networks. In D2 GANs, two discriminators are employed alongside a generator: one discriminator rewards high scores for samples from the true data distribution, while the other favors samples from the generator. In this work, we first introduce dual discriminator $α$-GANs (D2 $α$-GANs), which combines the strengths of dual discriminators with the flexibility of a tunable loss function, $α$-loss. We further generalize this approach to arbitrary functions defined on positive reals, leading to a broader class of models we refer to as generalized dual discriminator generative adversarial networks. For each of these proposed models, we provide theoretical analysis and show that the associated min-max optimization reduces to the minimization of a linear combination of an $f$-divergence and a reverse $f$-divergence. This generalizes the known simplification for D2-GANs, where the objective reduces to a linear combination of the KL-divergence and the reverse KL-divergence. Finally, we perform experiments on 2D synthetic data and use multiple performance metrics to capture various advantages of our GANs.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Addressing GAN Training Instabilities via Tunable Classification LossesIEEE Journal on Selected Areas in Information Theory, 2024
- A Unifying Generator Loss Function for Generative Adversarial NetworksEntropy, 2024
- A Tunable Loss Function for Robust Classification: Calibration, Landscape, and GeneralizationIEEE Transactions on Information Theory, 2022
- Cumulant GANIEEE Transactions on Neural Networks and Learning Systems, 2022
- Tunable Measures for Information Leakage and Applications to Privacy-Utility TradeoffsIEEE Transactions on Information Theory, 2019
- On the empirical estimation of integral probability metricsElectronic Journal of Statistics, 2012
- Information-theoretical considerations on estimation problemsInformation and Control, 1971