Neural Audio Fingerprint for High-Specific Audio Retrieval Based on Contrastive Learning
Authors:
- 6 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3025-3029
Abstract
Most of existing audio fingerprinting systems have limitations to be used for high-specific audio retrieval at scale. In this work, we generate a low-dimensional representation from a short unit segment of audio, and couple this fingerprint with a fast maximum inner-product search. To this end, we present a contrastive learning framework that derives from the segment-level search objective. Each update in training uses a batch consisting of a set of pseudo labels, randomly selected original samples, and their augmented replicas. These replicas can simulate the degrading effects on original audio signals by applying small time offsets and various types of distortions, such as background noise and room/microphone impulse responses. In the segment-level search task, where the conventional audio fingerprinting systems used to fail, our system using 10x smaller storage has shown promising results. Our code and dataset are available at https://mimbres.github.io/neural-audio-fp/.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Audio Set: An ontology and human-labeled dataset for audio events2017
- Audio Fingerprinting for Multi-Device Self-LocalizationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Simultaneous feature learning and hash coding with deep neural networks2015
- FaceNet: A unified embedding for face recognition and clustering2015
- Simplifying ConvNets for Fast Learning2012
- Audio fingerprinting to identify multiple videos of an event2010
- Waveprint: Efficient wavelet-based audio fingerprintingPattern Recognition, 2008
- Using Audio Fingerprinting for Duplicate Detection and Thumbnail Generation2006
- A Review of Audio FingerprintingJournal of Signal Processing Systems, 2005
- Musical genre classification of audio signalsIEEE Transactions on Speech and Audio Processing, 2002