An Overview of Deep Semi-Supervised Learning
Preprint
Abstract
Deep neural networks demonstrated their ability to provide remarkable performances on a wide range of supervised learning tasks (e.g., image classification) when trained on extensive collections of labeled data (e.g., ImageNet). However, creating such large datasets requires a considerable amount of resources, time, and effort. Such resources may not be available in many practical cases, limiting the adoption and the application of many deep learning methods. In a search for more data-efficient deep learning methods to overcome the need for large annotated datasets, there is a rising research interest in semi-supervised learning and its applications to deep neural networks to reduce the amount of labeled data required, by either developing novel methods or adopting existing semi-supervised learning frameworks for a deep learning setting. In this paper, we provide a comprehensive overview of deep semi-supervised learning, starting with an introduction to the field, followed by a summarization of the dominant semi-supervised approaches in deep learning.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Interpolation consistency training for semi-supervised learningNeural Networks, 2022
- Adversarial feature distribution alignment for semi-supervised learningComputer Vision and Image Understanding, 2021
- Consistency-Based Semi-supervised Active Learning: Towards Minimizing Labeling Cost2020
- A gentle introduction to deep learning for graphsNeural Networks, 2020
- Graph neural networks: A review of methods and applicationsAI Open, 2020
- Graph embedding techniques, applications, and performance: A surveyKnowledge-Based Systems, 2018
- Multi-view learning overview: Recent progress and new challengesInformation Fusion, 2017
- Active and semi-supervised learning for object detection with imperfect dataCognitive Systems Research, 2017
- Molecular graph convolutions: moving beyond fingerprintsJournal of Computer-Aided Molecular Design, 2016
- Robust automatic speech recognition with missing and unreliable acoustic dataSpeech Communication, 2001