Attributable Visual Similarity Learning
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7522-7531
Abstract
This paper proposes an attributable visual similarity learning (AVSL) framework for a more accurate and ex-plainable similarity measure between images. Most existing similarity learning methods exacerbate the unexplain-ability by mapping each sample to a single point in the em-bedding space with a distance metric (e.g., Mahalanobis distance, Euclidean distance). Motivated by the human se-mantic similarity cognition, we propose a generalized simi-larity learning paradigm to represent the similarity between two images with a graph and then infer the overall simi-larity accordingly. Furthermore, we establish a bottom-up similarity construction and top-down similarity inference framework to infer the similarity based on semantic hier-archy consistency. We first identify unreliable higher-level similarity nodes and then correct them using the most co-herent adjacent lower-level similarity nodes, which simulta-neously preserve traces for similarity attribution. Extensive experiments on the CUB-200-2011, Cars196, and Stanford Online Products datasets demonstrate significant improve-ments over existing deep similarity learning methods and verify the interpretability of our framework. 1 1 Code: https://github.com/zbr17/AVSL.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62125603,U1813218)
This publication has 34 references indexed in Scilit:
- "Why Should I Trust You?"2016
- Deep Metric Learning via Lifted Structured Feature Embedding2016
- Human-level concept learning through probabilistic program inductionScience, 2015
- FaceNet: A unified embedding for face recognition and clustering2015
- Multi-manifold deep metric learning for image set classification2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Discriminative Deep Metric Learning for Face Verification in the Wild2014
- 3D Object Representations for Fine-Grained Categorization2013
- Face Description with Local Binary Patterns: Application to Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004