Big Self-Supervised Models Advance Medical Image Classification
Authors:
Top Cited Papers
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3458-3468
Abstract
Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the effectiveness of self-supervised learning as a pre-training strategy for medical image classification. We conduct experiments on two distinct tasks: dermatology condition classification from digital camera images and multi-label chest X-ray classification, and demonstrate that self-supervised learning on ImageNet, followed by additional self-supervised learning on unlabeled domain-specific medical images significantly improves the accuracy of medical image classifiers. We introduce a novel Multi-Instance Contrastive Learning (MICLe) method that uses multiple images of the underlying pathology per patient case, when available, to construct more informative positive pairs for self-supervised learning. Combining our contributions, we achieve an improvement of 6.7% in top-1 accuracy and an improvement of 1.1% in mean AUC on dermatology and chest X-ray classification respectively, outperforming strong supervised baselines pretrained on ImageNet. In addition, we show that big self-supervised models are robust to distribution shift and can learn efficiently with a small number of labeled medical images.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- A transfer learning method with deep residual network for pediatric pneumonia diagnosisComputer Methods and Programs in Biomedicine, 2020
- Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysisMedical Image Analysis, 2019
- Improving Cytoarchitectonic Segmentation of Human Brain Areas with Self-supervised Siamese Networks2018
- Unsupervised Feature Learning via Non-parametric Instance Discrimination2018
- Time-Contrastive Networks: Self-Supervised Learning from Video2018
- ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases2017
- Knowledge transfer for melanoma screening with deep learning2017
- Deep Residual Learning for Image Recognition2016
- Unsupervised Visual Representation Learning by Context Prediction2015
- Self-organizing neural network that discovers surfaces in random-dot stereogramsNature, 1992