Synthesizing Informative Training Samples with GAN
Preprint
Abstract
Remarkable progress has been achieved in synthesizing photo-realistic images with generative adversarial networks (GANs). Recently, GANs are utilized as the training sample generator when obtaining or storing real training data is expensive even infeasible. However, traditional GANs generated images are not as informative as the real training samples when being used to train deep neural networks. In this paper, we propose a novel method to synthesize Informative Training samples with GAN (IT-GAN). Specifically, we freeze a pre-trained GAN model and learn the informative latent vectors that correspond to informative training samples. The synthesized images are required to preserve information for training deep neural networks rather than visual reality or fidelity. Experiments verify that the deep neural networks can learn faster and achieve better performance when being trained with our IT-GAN generated images. We also show that our method is a promising solution to dataset condensation problem.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Dataset Condensation with Distribution Matching2023
- CAFE: Learning to Condense Dataset by Aligning Features2022
- Soft-Label Dataset Distillation and Text Dataset Distillation2021
- AttGAN: Facial Attribute Editing by Only Changing What You WantIEEE Transactions on Image Processing, 2019
- Generative adversarial networks for data augmentation in machine fault diagnosisComputers in Industry, 2019
- Self-Supervised Video Hashing With Hierarchical Binary Auto-EncoderIEEE Transactions on Image Processing, 2018
- Wide Residual Networks2016