Content-based Representations of audio using Siamese neural networks
Authors:
- Pranay ManochaPMPranay Manocha
- Rohan BadlaniRBRohan Badlani
- Anurag KumarAKAnurag Kumar
- Ankit ShahASAnkit Shah
- Benjamin ElizaldeBEBenjamin Elizalde
- Bhiksha RajBRBhiksha Raj
Preprint
Abstract
In this paper, we focus on the problem of content-based retrieval for audio, which aims to retrieve all semantically similar audio recordings for a given audio clip query. We propose a novel approach which encodes the audio into a vector representation using Siamese Neural Networks. The goal is to obtain an encoding similar for files belonging to the same audio class, thus allowing retrieval of semantically similar audio. We used two similarity measures, Cosine similarity and Euclidean distance, to show that our method is effective in retrieving files similar in audio content. Our results indicate that our neural network-based approach is able to retrieve files similar in content and semantics.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Joint Learning of Speaker and Phonetic Similarities with Siamese Networks2016
- Sketch-based image retrieval via Siamese convolutional neural network2016
- Learning Deep Structure-Preserving Image-Text Embeddings2016
- Siamese Recurrent Architectures for Learning Sentence SimilarityProceedings of the AAAI Conference on Artificial Intelligence, 2016
- Detection and Classification of Acoustic Scenes and EventsIEEE Transactions on Multimedia, 2015
- Content-Based Music Information Retrieval: Current Directions and Future ChallengesProceedings of the IEEE, 2008
- Content-based classification, search, and retrieval of audioIEEE MultiMedia, 1996