A Self-Supervised Descriptor for Image Copy Detection
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 14512-14522
Abstract
Image copy detection is an important task for content moderation. We introduce SSCD, a model that builds on a recent self-supervised contrastive training objective. We adapt this method to the copy detection task by changing the architecture and training objective, including a pooling operator from the instance matching literature, and adapting contrastive learning to augmentations that combine images. Our approach relies on an entropy regularization term, promoting consistent separation between descriptor vectors, and we demonstrate that this significantly improves copy detection accuracy. Our method produces a compact descriptor vector, suitable for real-world web scale applications. Statistical information from a background image distribution can be incorporated into the descriptor. On the recent DISC2021 benchmark, SSCD is shown to outperform both baseline copy detection models and self-supervised architectures designed for image classification by huge margins, in all settings. For example, SSCD out-performs SimCLR descriptors by 48% absolute. Code is available at https://github.com/facebookresearch/sscd-copy-detection.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Image Search with Selective Match Kernels: Aggregation Across Single and Multiple ImagesInternational Journal of Computer Vision, 2015
- INSTREACM Transactions on Multimedia Computing, Communications, and Applications, 2015
- Perceptual DFT Watermarking With Improved Detection and Robustness to Geometrical DistortionsIEEE Transactions on Information Forensics and Security, 2014
- To Aggregate or Not to aggregate: Selective Match Kernels for Image Search2013
- California-ND: An annotated dataset for near-duplicate detection in personal photo collections2013
- CASIA Image Tampering Detection Evaluation Database2013
- Negative Evidences and Co-occurences in Image Retrieval: The Benefit of PCA and Whitening2012
- Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval2007
- Scalable Recognition with a Vocabulary Tree2006