ACPL: Anti-curriculum Pseudo-labelling for Semi-supervised Medical Image Classification
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 20665-20674
Abstract
Effective semi-supervised learning (SSL) in medical image analysis (MIA) must address two challenges: 1) work effectively on both multi-class (e.g., lesion classification) and multi-label (e.g., multiple-disease diagnosis) problems, and 2) handle imbalanced learning (because of the high variance in disease prevalence). One strategy to explore in SSL MIA is based on the pseudo labelling strategy, but it has a few shortcomings. Pseudo-labelling has in general lower accuracy than consistency learning, it is not specifically design for both multi-class and multi-label problems, and it can be challenged by imbalanced learning. In this paper, unlike traditional methods that select confident pseudo label by threshold, we propose a new SSL algorithm, called anti-curriculum pseudo-labelling (ACPL), which introduces novel techniques to select informative unlabelled samples, improving training balance and allowing the model to work for both multi-label and multi-class problems, and to estimate pseudo labels by an accurate ensemble of classifiers (improving pseudo label accuracy). We run extensive experiments to evaluate ACPL on two public medical image classification benchmarks: Chest X-Ray 14 for thorax disease multi-label classification and ISIC2018 for skin lesion multi-class classification. Our method outperforms previous SOTA SSL methods on both datasets 1 1 Supported by Australian Research Council through grants DP180103232 and FT190100525. 2 2 Code is available at https://github.com/FBLADL/ACPL.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- A Baseline for Multi-Label Image Classification Using an Ensemble of Deep Convolutional Neural Networks2019
- CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert ComparisonProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Retinal Image Synthesis and Semi-Supervised Learning for Glaucoma AssessmentIEEE Transactions on Medical Imaging, 2019
- The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesionsScientific Data, 2018
- Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised LearningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- Densely Connected Convolutional Networks2017
- ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases2017
- Curriculum learning2009
- Maximum Likelihood from Incomplete Data Via the EM AlgorithmJournal of the Royal Statistical Society Series B: Statistical Methodology, 1977