Improving Fine-Grained Visual Classification using Pairwise Confusion
Preprint
Abstract
Fine-Grained Visual Classification (FGVC) datasets contain small sample sizes, along with significant intra-class variation and inter-class similarity. While prior work has addressed intra-class variation using localization and segmentation techniques, the inter-class similarity may also affect feature learning and reduce classification performance. In this work, we address this problem using a novel optimization procedure for the end-to-end neural network training on FGVC tasks. This procedure, called Pairwise Confusion (PC) attempts to learn features with greater generalization, thereby preventing overfitting. This regularization during training is accomplished by intentionally introducing confusion in the activations. With PC regularization, we obtain state-of-the-art performance on six of the most widely-used FGVC datasets and demonstrate improved localization ability. PC is easy to implement, does not need excessive hyperparameter tuning during training, and does not add significant overhead during test timeKeywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Modeling Image Virality with Pairwise Spatial Transformer Networks2017
- Improved Bilinear Pooling with CNNs2017
- The Unreasonable Effectiveness of Noisy Data for Fine-Grained Recognition2016
- Weakly Supervised Fine-Grained Categorization With Part-Based Image RepresentationIEEE Transactions on Image Processing, 2016
- Energy statistics: A class of statistics based on distancesJournal of Statistical Planning and Inference, 2013