BIER — Boosting Independent Embeddings Robustly
Authors:
- Michael OpitzMOMichael Opitz
- Georg WaltnerGWGeorg Waltner
- Horst PosseggerHPHorst Possegger
- Horst BischofHBHorst Bischof
- 1 October 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5199-5208
Abstract
Learning similarity functions between image pairs with deep neural networks yields highly correlated activations of large embeddings. In this work, we show how to improve the robustness of embeddings by exploiting independence in ensembles. We divide the last embedding layer of a deep network into an embedding ensemble and formulate training this ensemble as an online gradient boosting problem. Each learner receives a reweighted training sample from the previous learners. This leverages large embedding sizes more effectively by significantly reducing correlation of the embedding and consequently increases retrieval accuracy of the embedding. Our method does not introduce any additional parameters and works with any differentiable loss function. We evaluate our metric learning method on image retrieval tasks and show that it improves over state-ofthe- art methods on the CUB-200-2011, Cars-196, Stanford Online Products, In-Shop Clothes Retrieval and VehicleID datasets by a significant margin.Keywords
This publication has 24 references indexed in Scilit:
- Learning descriptors for object recognition and 3D pose estimation2015
- Going deeper with convolutions2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Scalable Nearest Neighbor Algorithms for High Dimensional DataIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Quadruplet-Wise Image Similarity Learning2013
- 3D Object Representations for Fine-Grained Categorization2013
- A Robust and Efficient Doubly Regularized Metric Learning Approach2012
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Learning a Similarity Metric Discriminatively, with Application to Face Verification2005
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997