CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
Authors:
Preprint
Abstract
Regional dropout strategies have been proposed to enhance the performance of convolutional neural network classifiers. They have proved to be effective for guiding the model to attend on less discriminative parts of objects (e.g. leg as opposed to head of a person), thereby letting the network generalize better and have better object localization capabilities. On the other hand, current methods for regional dropout remove informative pixels on training images by overlaying a patch of either black pixels or random noise. Such removal is not desirable because it leads to information loss and inefficiency during training. We therefore propose the CutMix augmentation strategy: patches are cut and pasted among training images where the ground truth labels are also mixed proportionally to the area of the patches. By making efficient use of training pixels and retaining the regularization effect of regional dropout, CutMix consistently outperforms the state-of-the-art augmentation strategies on CIFAR and ImageNet classification tasks, as well as on the ImageNet weakly-supervised localization task. Moreover, unlike previous augmentation methods, our CutMix-trained ImageNet classifier, when used as a pretrained model, results in consistent performance gains in Pascal detection and MS-COCO image captioning benchmarks. We also show that CutMix improves the model robustness against input corruptions and its out-of-distribution detection performances. Source code and pretrained models are available at https://github.com/clovaai/CutMix-PyTorch .Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Shakedrop Regularization for Deep Residual LearningIEEE Access, 2019
- MixUp as Locally Linear Out-of-Manifold RegularizationProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Deep Pyramidal Residual Networks2017
- Aggregated Residual Transformations for Deep Neural Networks2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep Networks with Stochastic Depth2016
- Deep Residual Learning for Image Recognition2016
- Going deeper with convolutions2015
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009