Advancements in Data Augmentation and Transfer Learning: A Comprehensive Survey to Address Data Scarcity Challenges
Authors:
- 1 November 2024
- journal article
- Published by Bentham Science Publishers Ltd. in Recent Advances in Computer Science and Communications
- Vol. 17 (8) , 1-22
Abstract
Deep Learning (DL) models have demonstrated remarkable proficiency in image classification and recognition tasks, surpassing human capabilities. The observed enhancement in performance can be attributed to the utilization of extensive datasets. Nevertheless, DL models have huge data requirements. Widening the learning capability of such models from limited samples even today remains a challenge, given the intrinsic constraints of small datasets. The trifecta of challenges, encompassing limited labeled datasets, privacy, poor generalization performance, and the costliness of annotations, further compounds the difficulty in achieving robust model performance. Overcoming the challenge of expanding the learning capabilities of Deep Learning models with limited sample sizes remains a pressing concern even today. To address this critical issue, our study conducts a meticulous examination of established methodologies, such as Data Augmentation and Transfer Learning, which offer promising solutions to data scarcity dilemmas. Data Augmentation, a powerful technique, amplifies the size of small datasets through a diverse array of strategies. These encompass geometric transformations, kernel filter manipulations, neural style transfer amalgamation, random erasing, Generative Adversarial Networks, augmentations in feature space, and adversarial and meta- learning training paradigms. : Furthermore, Transfer Learning emerges as a crucial tool, leveraging pre-trained models to facilitate knowledge transfer between models or enabling the retraining of models on analogous datasets. Through our comprehensive investigation, we provide profound insights into how the synergistic application of these two techniques can significantly enhance the performance of classification tasks, effectively magnifying scarce datasets. This augmentation in data availability not only addresses the immediate challenges posed by limited datasets but also unlocks the full potential of working with Big Data in a new era of possibilities in DL applications.Keywords
This publication has 70 references indexed in Scilit:
- MR‐DCAE: Manifold regularization‐based deep convolutional autoencoder for unauthorized broadcasting identificationInternational Journal of Intelligent Systems, 2021
- Spectrum interference-based two-level data augmentation method in deep learning for automatic modulation classificationNeural Computing and Applications, 2020
- A deep transfer learning model with classical data augmentation and CGAN to detect COVID-19 from chest CT radiography digital imagesNeural Computing and Applications, 2020
- Diagnostic Assessment of Deep Learning Algorithms for Detection and Segmentation of Lesion in Mammographic Images2020
- Biomedical Data Augmentation Using Generative Adversarial Neural Networks2017
- Playing for Data: Ground Truth from Computer Games2016
- Do We Really Need to Collect Millions of Faces for Effective Face Recognition?2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Learning a Deep Convolutional Network for Image Super-Resolution2014
- Challenges in Representation Learning: A Report on Three Machine Learning Contests2013